2024-04-22T07:12:29.686 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-22T07:12:29.686 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668168 --name leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/suites/iozone}} --verbose --owner scheduled_leonidus@teuthology -- /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668168/orig.config.yaml 2024-04-22T07:12:29.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-22T07:12:29.836 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668168 branch: wip-lusov-quiescer description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/suites/iozone}} email: null first_in_suite: false job_id: '7668168' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-quiescer ceph: cephfs: session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: 86f7587a5a09af35f0895e1a2d08527638fae697 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 86f7587a5a09af35f0895e1a2d08527638fae697 kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-quiescer sha1: 86f7587a5a09af35f0895e1a2d08527638fae697 owner: scheduled_leonidus@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 4362 sha1: 86f7587a5a09af35f0895e1a2d08527638fae697 sleep_before_teardown: 0 subset: 222/111111 suite: fs suite_branch: wip-lusov-quiescer suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 86f7587a5a09af35f0895e1a2d08527638fae697 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi040.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB5rKvGg7MW1fGzHX36ncn+v0vACzRssTv+vZv5MDgb2UXo7CKroeabdmmAYZbrsg3VJ33DcBRZ4ShgvJosgzM8= smithi062.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDYDkvdit+d7zM2oNGn+ltPuzX+t1N84Q3t9ZzL8j17qLHcKMRJmhP+VMLq6+15LBS9xmZicRTP5wVr4XWejcx0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - quiescer: null - workunit: clients: all: - suites/iozone.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-22_05:52:53 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-22T07:12:29.836 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa; will attempt to use it 2024-04-22T07:12:29.837 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa/tasks 2024-04-22T07:12:29.837 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-22T07:12:29.839 INFO:teuthology.task.internal:Checking packages... 2024-04-22T07:12:29.864 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '86f7587a5a09af35f0895e1a2d08527638fae697' 2024-04-22T07:12:29.864 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-22T07:12:29.865 INFO:teuthology.packaging:ref: None 2024-04-22T07:12:29.865 INFO:teuthology.packaging:tag: None 2024-04-22T07:12:29.865 INFO:teuthology.packaging:branch: wip-lusov-quiescer 2024-04-22T07:12:29.865 INFO:teuthology.packaging:sha1: 86f7587a5a09af35f0895e1a2d08527638fae697 2024-04-22T07:12:29.865 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-quiescer 2024-04-22T07:12:30.039 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3156.g86f7587a 2024-04-22T07:12:30.041 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-22T07:12:30.047 INFO:teuthology.task.internal:no buildpackages task found 2024-04-22T07:12:30.048 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-22T07:12:30.061 INFO:teuthology.task.internal:Saving configuration 2024-04-22T07:12:30.080 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-22T07:12:30.086 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-22T07:12:30.119 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668168', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-22 07:07:34.528839', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB5rKvGg7MW1fGzHX36ncn+v0vACzRssTv+vZv5MDgb2UXo7CKroeabdmmAYZbrsg3VJ33DcBRZ4ShgvJosgzM8='} 2024-04-22T07:12:30.151 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668168', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-22 07:07:34.530332', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDYDkvdit+d7zM2oNGn+ltPuzX+t1N84Q3t9ZzL8j17qLHcKMRJmhP+VMLq6+15LBS9xmZicRTP5wVr4XWejcx0='} 2024-04-22T07:12:30.151 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-22T07:12:30.158 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-22T07:12:30.158 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-22T07:12:30.158 INFO:teuthology.run_tasks:Running task console_log... 2024-04-22T07:12:30.263 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd1890ec0d0>, signals=[15]) 2024-04-22T07:12:30.263 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-22T07:12:30.270 INFO:teuthology.task.internal:Opening connections... 2024-04-22T07:12:30.270 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi040.front.sepia.ceph.com 2024-04-22T07:12:30.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-22T07:12:30.379 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2024-04-22T07:12:30.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-22T07:12:30.463 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-22T07:12:30.470 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2024-04-22T07:12:30.488 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2024-04-22T07:12:30.488 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2024-04-22T07:12:30.547 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2024-04-22T07:12:30.547 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9" 2024-04-22T07:12:30.547 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2024-04-22T07:12:30.547 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2024-04-22T07:12:30.547 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9" 2024-04-22T07:12:30.547 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9" 2024-04-22T07:12:30.547 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-22T07:12:30.547 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2024-04-22T07:12:30.547 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon" 2024-04-22T07:12:30.547 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-22T07:12:30.547 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2024-04-22T07:12:30.547 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-22T07:12:30.548 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-22T07:12:30.548 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-22T07:12:30.548 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2024-04-22T07:12:30.580 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2024-04-22T07:12:30.599 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2024-04-22T07:12:30.599 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2024-04-22T07:12:30.656 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2024-04-22T07:12:30.656 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="9" 2024-04-22T07:12:30.657 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2024-04-22T07:12:30.657 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2024-04-22T07:12:30.657 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="9" 2024-04-22T07:12:30.657 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el9" 2024-04-22T07:12:30.657 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-22T07:12:30.657 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2024-04-22T07:12:30.657 INFO:teuthology.orchestra.run.smithi062.stdout:LOGO="fedora-logo-icon" 2024-04-22T07:12:30.657 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-22T07:12:30.657 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2024-04-22T07:12:30.657 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-22T07:12:30.657 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-22T07:12:30.657 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-22T07:12:30.658 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2024-04-22T07:12:30.688 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-22T07:12:30.698 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-22T07:12:30.705 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-22T07:12:30.705 DEBUG:teuthology.orchestra.run.smithi040:> test '!' -e /home/ubuntu/cephtest 2024-04-22T07:12:30.707 DEBUG:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2024-04-22T07:12:30.724 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-22T07:12:30.731 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-22T07:12:30.731 DEBUG:teuthology.orchestra.run.smithi040:> test -z $(ls -A /var/lib/ceph) 2024-04-22T07:12:30.765 DEBUG:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2024-04-22T07:12:30.789 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-22T07:12:30.865 INFO:teuthology.run_tasks:Running task kernel... 2024-04-22T07:12:30.880 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-04-22T07:12:30.881 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-04-22T07:12:30.881 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-04-22T07:12:30.881 DEBUG:teuthology.orchestra.run.smithi040:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-22T07:12:30.898 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T07:12:30.899 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2024-04-22T07:12:30.956 INFO:teuthology.orchestra.run.smithi040.stdout:5.14.0-437.el9.x86_64 2024-04-22T07:12:30.957 INFO:teuthology.task.kernel:Running kernel on smithi040: 5.14.0-437.el9.x86_64 2024-04-22T07:12:30.957 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum install -y kernel 2024-04-22T07:12:34.190 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.0 MB 00:01 2024-04-22T07:12:56.339 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - AppStream 925 kB/s | 19 MB 00:21 2024-04-22T07:13:07.906 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - CRB 802 kB/s | 6.2 MB 00:07 2024-04-22T07:13:09.322 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 16 kB 00:00 2024-04-22T07:13:13.241 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 5.5 MB/s | 21 MB 00:03 2024-04-22T07:13:18.365 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-22T07:13:20.305 INFO:teuthology.orchestra.run.smithi040.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-22T07:13:20.305 INFO:teuthology.orchestra.run.smithi040.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-22T07:13:20.402 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-04-22T07:13:20.403 INFO:teuthology.orchestra.run.smithi040.stdout:Nothing to do. 2024-04-22T07:13:20.403 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-04-22T07:13:20.503 DEBUG:teuthology.orchestra.run.smithi040:> echo no | sudo yum reinstall kernel || true 2024-04-22T07:13:21.025 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:00:03 ago on Mon 22 Apr 2024 07:13:18 AM UTC. 2024-04-22T07:13:21.156 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-04-22T07:13:21.173 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-22T07:13:21.173 INFO:teuthology.orchestra.run.smithi040.stdout: Package Architecture Version Repository Size 2024-04-22T07:13:21.173 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-22T07:13:21.173 INFO:teuthology.orchestra.run.smithi040.stdout:Reinstalling: 2024-04-22T07:13:21.173 INFO:teuthology.orchestra.run.smithi040.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-22T07:13:21.174 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:13:21.174 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-04-22T07:13:21.174 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-22T07:13:21.174 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:13:21.174 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 255 k 2024-04-22T07:13:21.174 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 0 2024-04-22T07:13:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:Operation aborted. 2024-04-22T07:13:21.237 INFO:teuthology.orchestra.run.smithi040.stdout:Is this ok [y/N]: 2024-04-22T07:13:21.237 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum reinstall -y kernel || true 2024-04-22T07:13:21.754 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:00:03 ago on Mon 22 Apr 2024 07:13:18 AM UTC. 2024-04-22T07:13:21.874 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-04-22T07:13:21.875 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-22T07:13:21.875 INFO:teuthology.orchestra.run.smithi040.stdout: Package Architecture Version Repository Size 2024-04-22T07:13:21.875 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-22T07:13:21.875 INFO:teuthology.orchestra.run.smithi040.stdout:Reinstalling: 2024-04-22T07:13:21.875 INFO:teuthology.orchestra.run.smithi040.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-22T07:13:21.875 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:13:21.875 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-04-22T07:13:21.875 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-22T07:13:21.876 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:13:21.876 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 255 k 2024-04-22T07:13:21.876 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 0 2024-04-22T07:13:21.876 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-04-22T07:13:22.334 INFO:teuthology.orchestra.run.smithi040.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.4 MB/s | 255 kB 00:00 2024-04-22T07:13:22.335 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-04-22T07:13:22.335 INFO:teuthology.orchestra.run.smithi040.stdout:Total 555 kB/s | 255 kB 00:00 2024-04-22T07:13:22.350 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-04-22T07:13:22.555 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-04-22T07:13:22.555 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-04-22T07:13:22.560 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-04-22T07:13:22.561 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-04-22T07:13:22.698 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-04-22T07:13:22.785 INFO:teuthology.orchestra.run.smithi040.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-22T07:13:22.786 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-22T07:13:23.445 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-22T07:13:23.445 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-22T07:13:24.123 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-22T07:13:24.124 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:13:24.124 INFO:teuthology.orchestra.run.smithi040.stdout:Reinstalled: 2024-04-22T07:13:24.124 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-22T07:13:24.124 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:13:24.124 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-04-22T07:13:24.296 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q kernel | sort -rV | head -n 1 2024-04-22T07:13:24.344 INFO:teuthology.orchestra.run.smithi040.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-22T07:13:24.344 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-22T07:13:24.344 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-22T07:13:24.344 DEBUG:teuthology.parallel:result is None 2024-04-22T07:13:24.345 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-22T07:13:24.352 INFO:teuthology.task.internal:Creating test directory... 2024-04-22T07:13:24.353 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-22T07:13:24.355 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-22T07:13:24.374 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-22T07:13:24.392 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-22T07:13:24.398 INFO:teuthology.task.internal:Creating archive directory... 2024-04-22T07:13:24.398 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-22T07:13:24.411 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-22T07:13:24.443 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-22T07:13:24.449 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-22T07:13:24.450 DEBUG:teuthology.orchestra.run.smithi062:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-22T07:13:24.494 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T07:13:24.495 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-22T07:13:24.497 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-22T07:13:24.528 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-22T07:13:24.544 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-22T07:13:24.576 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-22T07:13:24.597 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-22T07:13:24.599 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-22T07:13:24.606 INFO:teuthology.task.internal:Configuring sudo... 2024-04-22T07:13:24.606 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-22T07:13:24.609 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-22T07:13:24.667 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-22T07:13:24.676 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-22T07:13:24.676 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-22T07:13:24.678 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-22T07:13:24.724 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-22T07:13:24.782 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-22T07:13:24.828 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-22T07:13:24.919 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-22T07:13:24.949 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:13:24.949 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-22T07:13:25.013 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-22T07:13:25.066 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-22T07:13:25.110 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-22T07:13:25.202 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-22T07:13:25.237 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-22T07:13:25.237 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-22T07:13:25.304 DEBUG:teuthology.orchestra.run.smithi040:> sudo service rsyslog restart 2024-04-22T07:13:25.306 DEBUG:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2024-04-22T07:13:25.341 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-22T07:13:25.386 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-22T07:13:25.780 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-22T07:13:25.787 INFO:teuthology.task.internal:Starting timer... 2024-04-22T07:13:25.787 INFO:teuthology.run_tasks:Running task pcp... 2024-04-22T07:13:25.798 INFO:teuthology.run_tasks:Running task selinux... 2024-04-22T07:13:25.807 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-22T07:13:25.808 DEBUG:teuthology.orchestra.run.smithi040:> sudo service auditd rotate 2024-04-22T07:13:25.885 INFO:teuthology.orchestra.run.smithi040.stdout:Rotating logs: 2024-04-22T07:13:25.887 DEBUG:teuthology.orchestra.run.smithi062:> sudo service auditd rotate 2024-04-22T07:13:25.950 INFO:teuthology.orchestra.run.smithi062.stdout:Rotating logs: 2024-04-22T07:13:25.952 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-22T07:13:25.952 DEBUG:teuthology.orchestra.run.smithi040:> /usr/sbin/getenforce 2024-04-22T07:13:25.984 INFO:teuthology.orchestra.run.smithi040.stdout:Permissive 2024-04-22T07:13:25.985 DEBUG:teuthology.orchestra.run.smithi062:> /usr/sbin/getenforce 2024-04-22T07:13:26.010 INFO:teuthology.orchestra.run.smithi062.stdout:Permissive 2024-04-22T07:13:26.010 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi040.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi062.front.sepia.ceph.com': 'permissive'} 2024-04-22T07:13:26.011 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-22T07:13:26.049 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T07:13:26.050 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-22T07:13:26.076 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T07:13:26.077 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-22T07:13:26.077 DEBUG:teuthology.orchestra.run.smithi040:> sudo /usr/sbin/setenforce permissive 2024-04-22T07:13:26.115 DEBUG:teuthology.orchestra.run.smithi062:> sudo /usr/sbin/setenforce permissive 2024-04-22T07:13:26.143 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-22T07:13:26.153 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-22T07:13:26.169 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-22T07:13:26.171 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi040.front.sepia.ceph.com,smithi062.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-22T07:17:17.067 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi040.front.sepia.ceph.com'), Remote(name='ubuntu@smithi062.front.sepia.ceph.com')] 2024-04-22T07:17:17.068 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-04-22T07:17:17.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-22T07:17:17.192 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-04-22T07:17:17.274 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-04-22T07:17:17.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-04-22T07:17:17.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-22T07:17:17.377 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-04-22T07:17:17.467 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-04-22T07:17:17.467 INFO:teuthology.run_tasks:Running task clock... 2024-04-22T07:17:17.477 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-22T07:17:17.477 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-22T07:17:17.478 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-22T07:17:17.480 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-22T07:17:17.480 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-22T07:17:17.509 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-22T07:17:17.524 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-22T07:17:17.539 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-22T07:17:17.549 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: ntpd: command not found 2024-04-22T07:17:17.554 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-22T07:17:17.561 INFO:teuthology.orchestra.run.smithi040.stdout:506 Cannot talk to daemon 2024-04-22T07:17:17.575 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-22T07:17:17.579 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: ntpd: command not found 2024-04-22T07:17:17.589 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-22T07:17:17.590 INFO:teuthology.orchestra.run.smithi062.stdout:506 Cannot talk to daemon 2024-04-22T07:17:17.604 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-22T07:17:17.618 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-22T07:17:17.646 INFO:teuthology.orchestra.run.smithi040.stderr:bash: line 1: ntpq: command not found 2024-04-22T07:17:17.650 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-22T07:17:17.650 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2024-04-22T07:17:17.650 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T07:17:17.650 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T07:17:17.650 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T07:17:17.650 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T07:17:17.682 INFO:teuthology.orchestra.run.smithi062.stderr:bash: line 1: ntpq: command not found 2024-04-22T07:17:17.686 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-22T07:17:17.686 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-04-22T07:17:17.686 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T07:17:17.686 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T07:17:17.687 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T07:17:17.687 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T07:17:17.687 INFO:teuthology.run_tasks:Running task install... 2024-04-22T07:17:17.696 DEBUG:teuthology.task.install:project ceph 2024-04-22T07:17:17.696 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697'}} 2024-04-22T07:17:17.696 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697'} 2024-04-22T07:17:17.696 INFO:teuthology.task.install:Using flavor: default 2024-04-22T07:17:17.702 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-22T07:17:17.702 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-22T07:17:17.702 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697', 'tag': None, 'wait_for_package': False} 2024-04-22T07:17:17.703 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=86f7587a5a09af35f0895e1a2d08527638fae697 2024-04-22T07:17:17.704 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697', 'tag': None, 'wait_for_package': False} 2024-04-22T07:17:17.705 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=86f7587a5a09af35f0895e1a2d08527638fae697 2024-04-22T07:17:17.931 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/86f7587a5a09af35f0895e1a2d08527638fae697/centos/9/flavors/default/ 2024-04-22T07:17:17.932 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3156.g86f7587a 2024-04-22T07:17:17.949 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/86f7587a5a09af35f0895e1a2d08527638fae697/centos/9/flavors/default/ 2024-04-22T07:17:17.949 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3156.g86f7587a 2024-04-22T07:17:18.076 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/86f7587a5a09af35f0895e1a2d08527638fae697/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/86f7587a5a09af35f0895e1a2d08527638fae697/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/86f7587a5a09af35f0895e1a2d08527638fae697/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-22T07:17:18.077 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-22T07:17:18.077 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-22T07:17:18.102 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-22T07:17:18.102 DEBUG:teuthology.orchestra.run.smithi062:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/86f7587a5a09af35f0895e1a2d08527638fae697/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-22T07:17:18.109 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/86f7587a5a09af35f0895e1a2d08527638fae697/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/86f7587a5a09af35f0895e1a2d08527638fae697/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/86f7587a5a09af35f0895e1a2d08527638fae697/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-22T07:17:18.109 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:17:18.109 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-22T07:17:18.136 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-22T07:17:18.136 DEBUG:teuthology.orchestra.run.smithi040:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/86f7587a5a09af35f0895e1a2d08527638fae697/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-22T07:17:18.168 DEBUG:teuthology.orchestra.run.smithi062:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-22T07:17:18.203 DEBUG:teuthology.orchestra.run.smithi040:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-22T07:17:18.243 DEBUG:teuthology.orchestra.run.smithi062:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-22T07:17:18.279 DEBUG:teuthology.orchestra.run.smithi040:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-22T07:17:18.307 INFO:teuthology.orchestra.run.smithi062.stdout:check_obsoletes = 1 2024-04-22T07:17:18.308 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum clean all 2024-04-22T07:17:18.344 INFO:teuthology.orchestra.run.smithi040.stdout:check_obsoletes = 1 2024-04-22T07:17:18.345 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum clean all 2024-04-22T07:17:18.542 INFO:teuthology.orchestra.run.smithi062.stdout:48 files removed 2024-04-22T07:17:18.570 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-22T07:17:18.580 INFO:teuthology.orchestra.run.smithi040.stdout:48 files removed 2024-04-22T07:17:18.607 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-22T07:17:19.214 INFO:teuthology.orchestra.run.smithi040.stdout:ceph packages for x86_64 253 kB/s | 83 kB 00:00 2024-04-22T07:17:19.305 INFO:teuthology.orchestra.run.smithi062.stdout:ceph packages for x86_64 181 kB/s | 83 kB 00:00 2024-04-22T07:17:19.581 INFO:teuthology.orchestra.run.smithi040.stdout:ceph noarch packages 36 kB/s | 12 kB 00:00 2024-04-22T07:17:19.731 INFO:teuthology.orchestra.run.smithi062.stdout:ceph noarch packages 31 kB/s | 12 kB 00:00 2024-04-22T07:17:19.999 INFO:teuthology.orchestra.run.smithi040.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2024-04-22T07:17:20.106 INFO:teuthology.orchestra.run.smithi062.stdout:ceph source packages 5.5 kB/s | 1.9 kB 00:00 2024-04-22T07:17:20.640 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.0 MB 00:00 2024-04-22T07:17:21.740 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.0 MB 00:01 2024-04-22T07:17:23.517 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - AppStream 29 MB/s | 19 MB 00:00 2024-04-22T07:17:27.884 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - CRB 9.0 MB/s | 6.2 MB 00:00 2024-04-22T07:17:29.368 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 16 kB 00:00 2024-04-22T07:17:30.522 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 20 MB/s | 21 MB 00:01 2024-04-22T07:17:35.661 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-04-22T07:17:37.888 INFO:teuthology.orchestra.run.smithi040.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-22T07:17:37.888 INFO:teuthology.orchestra.run.smithi040.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-22T07:17:37.900 INFO:teuthology.orchestra.run.smithi040.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-22T07:17:37.901 INFO:teuthology.orchestra.run.smithi040.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-22T07:17:37.902 INFO:teuthology.orchestra.run.smithi040.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-22T07:17:37.902 INFO:teuthology.orchestra.run.smithi040.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-22T07:17:37.904 INFO:teuthology.orchestra.run.smithi040.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-22T07:17:37.906 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-22T07:17:37.907 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-22T07:17:37.973 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-04-22T07:17:37.982 INFO:teuthology.orchestra.run.smithi040.stdout:======================================================================================= 2024-04-22T07:17:37.982 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2024-04-22T07:17:37.982 INFO:teuthology.orchestra.run.smithi040.stdout:======================================================================================= 2024-04-22T07:17:37.982 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-04-22T07:17:37.983 INFO:teuthology.orchestra.run.smithi040.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-22T07:17:37.983 INFO:teuthology.orchestra.run.smithi040.stdout: ceph x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 6.6 k 2024-04-22T07:17:37.983 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 5.4 M 2024-04-22T07:17:37.983 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 890 k 2024-04-22T07:17:37.983 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 145 k 2024-04-22T07:17:37.983 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 1.5 M 2024-04-22T07:17:37.983 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 142 k 2024-04-22T07:17:37.983 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 3.5 M 2024-04-22T07:17:37.983 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 7.4 M 2024-04-22T07:17:37.983 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 49 k 2024-04-22T07:17:37.983 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 11 M 2024-04-22T07:17:37.983 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 49 M 2024-04-22T07:17:37.983 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-volume noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 273 k 2024-04-22T07:17:37.984 INFO:teuthology.orchestra.run.smithi040.stdout: cephadm noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 763 k 2024-04-22T07:17:37.984 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 225 k 2024-04-22T07:17:37.984 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-shell x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 27 k 2024-04-22T07:17:37.984 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-top noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 18 k 2024-04-22T07:17:37.984 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-22T07:17:37.984 INFO:teuthology.orchestra.run.smithi040.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-22T07:17:37.984 INFO:teuthology.orchestra.run.smithi040.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-22T07:17:37.984 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 32 k 2024-04-22T07:17:37.984 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 747 k 2024-04-22T07:17:37.984 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 127 k 2024-04-22T07:17:37.984 INFO:teuthology.orchestra.run.smithi040.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-22T07:17:37.984 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-22T07:17:37.984 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-22T07:17:37.984 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-22T07:17:37.984 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-22T07:17:37.984 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-22T07:17:37.985 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 162 k 2024-04-22T07:17:37.985 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 320 k 2024-04-22T07:17:37.985 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 298 k 2024-04-22T07:17:37.985 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 100 k 2024-04-22T07:17:37.985 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 85 k 2024-04-22T07:17:37.985 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 3.1 M 2024-04-22T07:17:37.985 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 171 k 2024-04-22T07:17:37.985 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-22T07:17:37.985 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrading: 2024-04-22T07:17:37.985 INFO:teuthology.orchestra.run.smithi040.stdout: librados2 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 3.4 M 2024-04-22T07:17:37.985 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 3.1 M 2024-04-22T07:17:37.985 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-04-22T07:17:37.985 INFO:teuthology.orchestra.run.smithi040.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-22T07:17:37.986 INFO:teuthology.orchestra.run.smithi040.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-22T07:17:37.986 INFO:teuthology.orchestra.run.smithi040.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-22T07:17:37.986 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 21 M 2024-04-22T07:17:37.986 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 34 k 2024-04-22T07:17:37.986 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 2.4 M 2024-04-22T07:17:37.986 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 249 k 2024-04-22T07:17:37.986 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 4.7 M 2024-04-22T07:17:37.986 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 17 M 2024-04-22T07:17:37.986 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 16 k 2024-04-22T07:17:37.986 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 25 k 2024-04-22T07:17:37.986 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-22T07:17:37.986 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-22T07:17:37.986 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-22T07:17:37.987 INFO:teuthology.orchestra.run.smithi040.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-22T07:17:37.987 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-22T07:17:37.987 INFO:teuthology.orchestra.run.smithi040.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-22T07:17:37.987 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-22T07:17:37.987 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-22T07:17:37.987 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 164 k 2024-04-22T07:17:37.987 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-22T07:17:37.987 INFO:teuthology.orchestra.run.smithi040.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-22T07:17:37.987 INFO:teuthology.orchestra.run.smithi040.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-22T07:17:37.987 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-22T07:17:37.987 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-22T07:17:37.987 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 500 k 2024-04-22T07:17:37.987 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-22T07:17:37.987 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 5.4 M 2024-04-22T07:17:37.987 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-22T07:17:37.987 INFO:teuthology.orchestra.run.smithi040.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-22T07:17:37.988 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-22T07:17:37.988 INFO:teuthology.orchestra.run.smithi040.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-22T07:17:37.988 INFO:teuthology.orchestra.run.smithi040.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-22T07:17:37.988 INFO:teuthology.orchestra.run.smithi040.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-22T07:17:37.988 INFO:teuthology.orchestra.run.smithi040.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-22T07:17:37.988 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-22T07:17:37.988 INFO:teuthology.orchestra.run.smithi040.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-22T07:17:37.988 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-22T07:17:37.988 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-22T07:17:37.988 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-22T07:17:37.988 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-22T07:17:37.988 INFO:teuthology.orchestra.run.smithi040.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-22T07:17:37.989 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-22T07:17:37.989 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-22T07:17:37.989 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-22T07:17:37.989 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 45 k 2024-04-22T07:17:37.989 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 135 k 2024-04-22T07:17:37.989 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-22T07:17:37.989 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-22T07:17:37.989 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-22T07:17:37.989 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-22T07:17:37.989 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-22T07:17:37.989 INFO:teuthology.orchestra.run.smithi040.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-22T07:17:37.989 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-22T07:17:37.989 INFO:teuthology.orchestra.run.smithi040.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-22T07:17:37.989 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-22T07:17:37.989 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-22T07:17:37.990 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-22T07:17:37.990 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-22T07:17:37.990 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-22T07:17:37.990 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-22T07:17:37.990 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-22T07:17:37.990 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-22T07:17:37.990 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-22T07:17:37.990 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-22T07:17:37.990 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-22T07:17:37.990 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-22T07:17:37.990 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-22T07:17:37.990 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-22T07:17:37.991 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-22T07:17:37.991 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-22T07:17:37.991 INFO:teuthology.orchestra.run.smithi040.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-22T07:17:37.991 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-22T07:17:37.991 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-22T07:17:37.991 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-22T07:17:37.991 INFO:teuthology.orchestra.run.smithi040.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-22T07:17:37.991 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-22T07:17:37.991 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-22T07:17:37.991 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-22T07:17:37.991 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-22T07:17:37.991 INFO:teuthology.orchestra.run.smithi040.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-22T07:17:37.991 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-22T07:17:37.991 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-22T07:17:37.992 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-22T07:17:37.992 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-22T07:17:37.992 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-22T07:17:37.992 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-22T07:17:37.992 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-22T07:17:37.992 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-22T07:17:37.992 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-22T07:17:37.992 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-22T07:17:37.992 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-22T07:17:37.992 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-22T07:17:37.992 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-22T07:17:37.992 INFO:teuthology.orchestra.run.smithi040.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-22T07:17:37.992 INFO:teuthology.orchestra.run.smithi040.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-22T07:17:37.992 INFO:teuthology.orchestra.run.smithi040.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-22T07:17:37.992 INFO:teuthology.orchestra.run.smithi040.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-22T07:17:37.993 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-22T07:17:37.993 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-22T07:17:37.993 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-22T07:17:37.993 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-22T07:17:37.993 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-22T07:17:37.993 INFO:teuthology.orchestra.run.smithi040.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-22T07:17:37.993 INFO:teuthology.orchestra.run.smithi040.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-22T07:17:37.993 INFO:teuthology.orchestra.run.smithi040.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-22T07:17:37.993 INFO:teuthology.orchestra.run.smithi040.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-22T07:17:37.993 INFO:teuthology.orchestra.run.smithi040.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-22T07:17:37.993 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-22T07:17:37.993 INFO:teuthology.orchestra.run.smithi040.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-22T07:17:37.993 INFO:teuthology.orchestra.run.smithi040.stdout:Installing weak dependencies: 2024-04-22T07:17:37.993 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-22T07:17:37.994 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:17:37.994 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-04-22T07:17:37.994 INFO:teuthology.orchestra.run.smithi040.stdout:======================================================================================= 2024-04-22T07:17:37.994 INFO:teuthology.orchestra.run.smithi040.stdout:Install 148 Packages 2024-04-22T07:17:37.994 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrade 2 Packages 2024-04-22T07:17:37.994 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:17:37.994 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 218 M 2024-04-22T07:17:37.994 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-04-22T07:17:38.746 INFO:teuthology.orchestra.run.smithi040.stdout:(1/150): ceph-19.0.0-3156.g86f7587a.el9.x86_64. 27 kB/s | 6.6 kB 00:00 2024-04-22T07:17:39.146 INFO:teuthology.orchestra.run.smithi040.stdout:(2/150): ceph-fuse-19.0.0-3156.g86f7587a.el9.x8 2.2 MB/s | 890 kB 00:00 2024-04-22T07:17:39.263 INFO:teuthology.orchestra.run.smithi040.stdout:(3/150): ceph-base-19.0.0-3156.g86f7587a.el9.x8 7.1 MB/s | 5.4 MB 00:00 2024-04-22T07:17:39.289 INFO:teuthology.orchestra.run.smithi040.stdout:(4/150): ceph-immutable-object-cache-19.0.0-315 1.0 MB/s | 145 kB 00:00 2024-04-22T07:17:39.464 INFO:teuthology.orchestra.run.smithi040.stdout:(5/150): ceph-mds-19.0.0-3156.g86f7587a.el9.x86 12 MB/s | 2.4 MB 00:00 2024-04-22T07:17:39.656 INFO:teuthology.orchestra.run.smithi040.stdout:(6/150): ceph-mgr-19.0.0-3156.g86f7587a.el9.x86 4.1 MB/s | 1.5 MB 00:00 2024-04-22T07:17:39.790 INFO:teuthology.orchestra.run.smithi040.stdout:(7/150): ceph-mon-19.0.0-3156.g86f7587a.el9.x86 14 MB/s | 4.7 MB 00:00 2024-04-22T07:17:40.573 INFO:teuthology.orchestra.run.smithi040.stdout:(8/150): ceph-radosgw-19.0.0-3156.g86f7587a.el9 14 MB/s | 11 MB 00:00 2024-04-22T07:17:40.640 INFO:teuthology.orchestra.run.smithi040.stdout:(9/150): ceph-selinux-19.0.0-3156.g86f7587a.el9 379 kB/s | 25 kB 00:00 2024-04-22T07:17:41.915 INFO:teuthology.orchestra.run.smithi040.stdout:(10/150): ceph-common-19.0.0-3156.g86f7587a.el9 6.2 MB/s | 21 MB 00:03 2024-04-22T07:17:42.174 INFO:teuthology.orchestra.run.smithi040.stdout:(11/150): ceph-osd-19.0.0-3156.g86f7587a.el9.x8 6.7 MB/s | 17 MB 00:02 2024-04-22T07:17:42.199 INFO:teuthology.orchestra.run.smithi040.stdout:(12/150): cephfs-mirror-19.0.0-3156.g86f7587a.e 793 kB/s | 225 kB 00:00 2024-04-22T07:17:42.232 INFO:teuthology.orchestra.run.smithi040.stdout:(13/150): cephfs-shell-19.0.0-3156.g86f7587a.el 463 kB/s | 27 kB 00:00 2024-04-22T07:17:42.258 INFO:teuthology.orchestra.run.smithi040.stdout:(14/150): libcephfs-devel-19.0.0-3156.g86f7587a 540 kB/s | 32 kB 00:00 2024-04-22T07:17:42.400 INFO:teuthology.orchestra.run.smithi040.stdout:(15/150): libcephfs2-19.0.0-3156.g86f7587a.el9. 4.4 MB/s | 747 kB 00:00 2024-04-22T07:17:42.425 INFO:teuthology.orchestra.run.smithi040.stdout:(16/150): libcephsqlite-19.0.0-3156.g86f7587a.e 980 kB/s | 164 kB 00:00 2024-04-22T07:17:42.483 INFO:teuthology.orchestra.run.smithi040.stdout:(17/150): librados-devel-19.0.0-3156.g86f7587a. 1.5 MB/s | 127 kB 00:00 2024-04-22T07:17:42.876 INFO:teuthology.orchestra.run.smithi040.stdout:(18/150): libradosstriper1-19.0.0-3156.g86f7587 1.1 MB/s | 500 kB 00:00 2024-04-22T07:17:42.992 INFO:teuthology.orchestra.run.smithi040.stdout:(19/150): python3-ceph-argparse-19.0.0-3156.g86 387 kB/s | 45 kB 00:00 2024-04-22T07:17:43.109 INFO:teuthology.orchestra.run.smithi040.stdout:(20/150): python3-ceph-common-19.0.0-3156.g86f7 1.1 MB/s | 135 kB 00:00 2024-04-22T07:17:43.260 INFO:teuthology.orchestra.run.smithi040.stdout:(21/150): librgw2-19.0.0-3156.g86f7587a.el9.x86 6.9 MB/s | 5.4 MB 00:00 2024-04-22T07:17:43.293 INFO:teuthology.orchestra.run.smithi040.stdout:(22/150): python3-cephfs-19.0.0-3156.g86f7587a. 881 kB/s | 162 kB 00:00 2024-04-22T07:17:43.352 INFO:teuthology.orchestra.run.smithi040.stdout:(23/150): python3-rados-19.0.0-3156.g86f7587a.e 3.4 MB/s | 320 kB 00:00 2024-04-22T07:17:43.435 INFO:teuthology.orchestra.run.smithi040.stdout:(24/150): python3-rgw-19.0.0-3156.g86f7587a.el9 1.2 MB/s | 100 kB 00:00 2024-04-22T07:17:43.461 INFO:teuthology.orchestra.run.smithi040.stdout:(25/150): python3-rbd-19.0.0-3156.g86f7587a.el9 1.7 MB/s | 298 kB 00:00 2024-04-22T07:17:43.519 INFO:teuthology.orchestra.run.smithi040.stdout:(26/150): rbd-fuse-19.0.0-3156.g86f7587a.el9.x8 1.0 MB/s | 85 kB 00:00 2024-04-22T07:17:43.611 INFO:teuthology.orchestra.run.smithi040.stdout:(27/150): rbd-nbd-19.0.0-3156.g86f7587a.el9.x86 1.8 MB/s | 171 kB 00:00 2024-04-22T07:17:43.656 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - AppStream 888 kB/s | 19 MB 00:21 2024-04-22T07:17:44.045 INFO:teuthology.orchestra.run.smithi040.stdout:(28/150): ceph-test-19.0.0-3156.g86f7587a.el9.x 14 MB/s | 49 MB 00:03 2024-04-22T07:17:44.070 INFO:teuthology.orchestra.run.smithi040.stdout:(29/150): ceph-grafana-dashboards-19.0.0-3156.g 75 kB/s | 34 kB 00:00 2024-04-22T07:17:44.096 INFO:teuthology.orchestra.run.smithi040.stdout:(30/150): ceph-mgr-cephadm-19.0.0-3156.g86f7587 2.8 MB/s | 142 kB 00:00 2024-04-22T07:17:44.497 INFO:teuthology.orchestra.run.smithi040.stdout:(31/150): rbd-mirror-19.0.0-3156.g86f7587a.el9. 3.0 MB/s | 3.1 MB 00:01 2024-04-22T07:17:44.605 INFO:teuthology.orchestra.run.smithi040.stdout:(32/150): ceph-mgr-dashboard-19.0.0-3156.g86f75 6.6 MB/s | 3.5 MB 00:00 2024-04-22T07:17:44.630 INFO:teuthology.orchestra.run.smithi040.stdout:(33/150): ceph-mgr-modules-core-19.0.0-3156.g86 1.8 MB/s | 249 kB 00:00 2024-04-22T07:17:44.681 INFO:teuthology.orchestra.run.smithi040.stdout:(34/150): ceph-mgr-rook-19.0.0-3156.g86f7587a.e 658 kB/s | 49 kB 00:00 2024-04-22T07:17:44.723 INFO:teuthology.orchestra.run.smithi040.stdout:(35/150): ceph-prometheus-alerts-19.0.0-3156.g8 179 kB/s | 16 kB 00:00 2024-04-22T07:17:44.831 INFO:teuthology.orchestra.run.smithi040.stdout:(36/150): ceph-mgr-diskprediction-local-19.0.0- 10 MB/s | 7.4 MB 00:00 2024-04-22T07:17:44.856 INFO:teuthology.orchestra.run.smithi040.stdout:(37/150): ceph-volume-19.0.0-3156.g86f7587a.el9 1.5 MB/s | 273 kB 00:00 2024-04-22T07:17:44.882 INFO:teuthology.orchestra.run.smithi040.stdout:(38/150): cephfs-top-19.0.0-3156.g86f7587a.el9. 365 kB/s | 18 kB 00:00 2024-04-22T07:17:44.924 INFO:teuthology.orchestra.run.smithi040.stdout:(39/150): cephadm-19.0.0-3156.g86f7587a.el9.noa 3.7 MB/s | 763 kB 00:00 2024-04-22T07:17:45.216 INFO:teuthology.orchestra.run.smithi040.stdout:(40/150): fuse-2.9.9-15.el9.x86_64.rpm 224 kB/s | 80 kB 00:00 2024-04-22T07:17:45.424 INFO:teuthology.orchestra.run.smithi040.stdout:(41/150): libquadmath-11.4.1-3.el9.x86_64.rpm 390 kB/s | 195 kB 00:00 2024-04-22T07:17:45.558 INFO:teuthology.orchestra.run.smithi040.stdout:(42/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 741 kB/s | 253 kB 00:00 2024-04-22T07:17:45.641 INFO:teuthology.orchestra.run.smithi040.stdout:(43/150): libgfortran-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 803 kB 00:00 2024-04-22T07:17:45.667 INFO:teuthology.orchestra.run.smithi040.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 981 kB/s | 106 kB 00:00 2024-04-22T07:17:45.750 INFO:teuthology.orchestra.run.smithi040.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-04-22T07:17:45.775 INFO:teuthology.orchestra.run.smithi040.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-04-22T07:17:45.884 INFO:teuthology.orchestra.run.smithi040.stdout:(47/150): python3-urllib3-1.26.5-5.el9.noarch.r 1.6 MB/s | 215 kB 00:00 2024-04-22T07:17:45.943 INFO:teuthology.orchestra.run.smithi040.stdout:(48/150): python3-cryptography-36.0.1-4.el9.x86 2.4 MB/s | 1.2 MB 00:00 2024-04-22T07:17:46.060 INFO:teuthology.orchestra.run.smithi040.stdout:(49/150): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 689 kB 00:00 2024-04-22T07:17:46.110 INFO:teuthology.orchestra.run.smithi040.stdout:(50/150): elfutils-libelf-devel-0.190-2.el9.x86 439 kB/s | 21 kB 00:00 2024-04-22T07:17:46.152 INFO:teuthology.orchestra.run.smithi040.stdout:(51/150): boost-program-options-1.75.0-8.el9.x8 512 kB/s | 107 kB 00:00 2024-04-22T07:17:46.185 INFO:teuthology.orchestra.run.smithi040.stdout:(52/150): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-04-22T07:17:46.219 INFO:teuthology.orchestra.run.smithi040.stdout:(53/150): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-04-22T07:17:46.244 INFO:teuthology.orchestra.run.smithi040.stdout:(54/150): flexiblas-3.0.4-8.el9.x86_64.rpm 355 kB/s | 33 kB 00:00 2024-04-22T07:17:46.295 INFO:teuthology.orchestra.run.smithi040.stdout:(55/150): flexiblas-openblas-openmp-3.0.4-8.el9 242 kB/s | 18 kB 00:00 2024-04-22T07:17:46.320 INFO:teuthology.orchestra.run.smithi040.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-04-22T07:17:46.378 INFO:teuthology.orchestra.run.smithi040.stdout:(57/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-04-22T07:17:46.404 INFO:teuthology.orchestra.run.smithi040.stdout:(58/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-04-22T07:17:46.429 INFO:teuthology.orchestra.run.smithi040.stdout:(59/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 416 kB/s | 45 kB 00:00 2024-04-22T07:17:46.462 INFO:teuthology.orchestra.run.smithi040.stdout:(60/150): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-04-22T07:17:46.496 INFO:teuthology.orchestra.run.smithi040.stdout:(61/150): libtool-2.4.6-45.el9.x86_64.rpm 6.2 MB/s | 582 kB 00:00 2024-04-22T07:17:46.522 INFO:teuthology.orchestra.run.smithi040.stdout:(62/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 276 kB/s | 25 kB 00:00 2024-04-22T07:17:46.547 INFO:teuthology.orchestra.run.smithi040.stdout:(63/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 564 kB/s | 47 kB 00:00 2024-04-22T07:17:46.572 INFO:teuthology.orchestra.run.smithi040.stdout:(64/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-04-22T07:17:46.597 INFO:teuthology.orchestra.run.smithi040.stdout:(65/150): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-04-22T07:17:46.623 INFO:teuthology.orchestra.run.smithi040.stdout:(66/150): openblas-0.3.21-2.el9.x86_64.rpm 467 kB/s | 35 kB 00:00 2024-04-22T07:17:46.740 INFO:teuthology.orchestra.run.smithi040.stdout:(67/150): openblas-openmp-0.3.21-2.el9.x86_64.r 28 MB/s | 4.7 MB 00:00 2024-04-22T07:17:46.823 INFO:teuthology.orchestra.run.smithi040.stdout:(68/150): openssl-devel-3.0.7-27.el9.x86_64.rpm 18 MB/s | 4.1 MB 00:00 2024-04-22T07:17:46.857 INFO:teuthology.orchestra.run.smithi040.stdout:(69/150): postgresql-contrib-13.14-1.el9.x86_64 7.6 MB/s | 911 kB 00:00 2024-04-22T07:17:46.898 INFO:teuthology.orchestra.run.smithi040.stdout:(70/150): postgresql-private-libs-13.14-1.el9.x 1.7 MB/s | 133 kB 00:00 2024-04-22T07:17:46.932 INFO:teuthology.orchestra.run.smithi040.stdout:(71/150): postgresql-13.14-1.el9.x86_64.rpm 5.1 MB/s | 1.6 MB 00:00 2024-04-22T07:17:46.999 INFO:teuthology.orchestra.run.smithi040.stdout:(72/150): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-04-22T07:17:47.024 INFO:teuthology.orchestra.run.smithi040.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 953 kB/s | 87 kB 00:00 2024-04-22T07:17:47.108 INFO:teuthology.orchestra.run.smithi040.stdout:(74/150): postgresql-server-13.14-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-04-22T07:17:47.158 INFO:teuthology.orchestra.run.smithi040.stdout:(75/150): python3-devel-3.9.18-3.el9.x86_64.rpm 1.8 MB/s | 244 kB 00:00 2024-04-22T07:17:47.192 INFO:teuthology.orchestra.run.smithi040.stdout:(76/150): python3-jinja2-2.11.3-5.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-04-22T07:17:47.276 INFO:teuthology.orchestra.run.smithi040.stdout:(77/150): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 6.0 MB 00:00 2024-04-22T07:17:47.301 INFO:teuthology.orchestra.run.smithi040.stdout:(78/150): python3-jsonpatch-1.21-16.el9.noarch. 180 kB/s | 26 kB 00:00 2024-04-22T07:17:47.326 INFO:teuthology.orchestra.run.smithi040.stdout:(79/150): python3-jsonpointer-2.0-4.el9.noarch. 143 kB/s | 19 kB 00:00 2024-04-22T07:17:47.351 INFO:teuthology.orchestra.run.smithi040.stdout:(80/150): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-04-22T07:17:47.376 INFO:teuthology.orchestra.run.smithi040.stdout:(81/150): python3-markupsafe-1.1.1-12.el9.x86_6 461 kB/s | 35 kB 00:00 2024-04-22T07:17:47.427 INFO:teuthology.orchestra.run.smithi040.stdout:(82/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.2 MB/s | 250 kB 00:00 2024-04-22T07:17:47.503 INFO:teuthology.orchestra.run.smithi040.stdout:(83/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 5.1 MB 00:00 2024-04-22T07:17:47.528 INFO:teuthology.orchestra.run.smithi040.stdout:(84/150): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 222 kB 00:00 2024-04-22T07:17:47.553 INFO:teuthology.orchestra.run.smithi040.stdout:(85/150): python3-packaging-20.9-5.el9.noarch.r 615 kB/s | 77 kB 00:00 2024-04-22T07:17:47.570 INFO:teuthology.orchestra.run.smithi040.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 629 kB/s | 42 kB 00:00 2024-04-22T07:17:47.595 INFO:teuthology.orchestra.run.smithi040.stdout:(87/150): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-04-22T07:17:47.620 INFO:teuthology.orchestra.run.smithi040.stdout:(88/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-04-22T07:17:47.646 INFO:teuthology.orchestra.run.smithi040.stdout:(89/150): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-04-22T07:17:47.670 INFO:teuthology.orchestra.run.smithi040.stdout:(90/150): python3-pytz-2021.1-5.el9.noarch.rpm 675 kB/s | 51 kB 00:00 2024-04-22T07:17:47.696 INFO:teuthology.orchestra.run.smithi040.stdout:(91/150): python3-requests-oauthlib-1.3.0-12.el 712 kB/s | 54 kB 00:00 2024-04-22T07:17:47.755 INFO:teuthology.orchestra.run.smithi040.stdout:(92/150): python3-toml-0.10.2-6.el9.noarch.rpm 496 kB/s | 42 kB 00:00 2024-04-22T07:17:47.780 INFO:teuthology.orchestra.run.smithi040.stdout:(93/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 525 kB/s | 44 kB 00:00 2024-04-22T07:17:47.822 INFO:teuthology.orchestra.run.smithi040.stdout:(94/150): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-04-22T07:17:47.847 INFO:teuthology.orchestra.run.smithi040.stdout:(95/150): qatlib-service-24.02.0-1.el9.x86_64.r 538 kB/s | 36 kB 00:00 2024-04-22T07:17:47.889 INFO:teuthology.orchestra.run.smithi040.stdout:(96/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 710 kB/s | 47 kB 00:00 2024-04-22T07:17:48.098 INFO:teuthology.orchestra.run.smithi040.stdout:(97/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 36 MB/s | 16 MB 00:00 2024-04-22T07:17:48.127 INFO:teuthology.orchestra.run.smithi040.stdout:(98/150): socat-1.7.4.1-5.el9.x86_64.rpm 1.1 MB/s | 305 kB 00:00 2024-04-22T07:17:48.177 INFO:teuthology.orchestra.run.smithi040.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 201 kB/s | 58 kB 00:00 2024-04-22T07:17:48.181 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - CRB 7.3 MB/s | 6.2 MB 00:00 2024-04-22T07:17:48.207 INFO:teuthology.orchestra.run.smithi040.stdout:(100/150): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 863 kB/s | 94 kB 00:00 2024-04-22T07:17:48.232 INFO:teuthology.orchestra.run.smithi040.stdout:(101/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 585 kB/s | 64 kB 00:00 2024-04-22T07:17:48.258 INFO:teuthology.orchestra.run.smithi040.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 556 kB/s | 45 kB 00:00 2024-04-22T07:17:48.300 INFO:teuthology.orchestra.run.smithi040.stdout:(103/150): lua-devel-5.4.4-4.el9.x86_64.rpm 242 kB/s | 22 kB 00:00 2024-04-22T07:17:48.333 INFO:teuthology.orchestra.run.smithi040.stdout:(104/150): protobuf-compiler-3.14.0-13.el9.x86_ 8.4 MB/s | 863 kB 00:00 2024-04-22T07:17:48.467 INFO:teuthology.orchestra.run.smithi040.stdout:(105/150): grpc-data-1.46.7-10.el9.noarch.rpm 146 kB/s | 19 kB 00:00 2024-04-22T07:17:48.536 INFO:teuthology.orchestra.run.smithi040.stdout:(106/150): gperftools-libs-2.9.1-2.el9.x86_64.r 1.3 MB/s | 309 kB 00:00 2024-04-22T07:17:48.567 INFO:teuthology.orchestra.run.smithi040.stdout:(107/150): abseil-cpp-20211102.0-3.el9.x86_64.r 1.7 MB/s | 548 kB 00:00 2024-04-22T07:17:48.601 INFO:teuthology.orchestra.run.smithi040.stdout:(108/150): libarrow-doc-9.0.0-10.el9.noarch.rpm 388 kB/s | 26 kB 00:00 2024-04-22T07:17:48.634 INFO:teuthology.orchestra.run.smithi040.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 726 kB/s | 49 kB 00:00 2024-04-22T07:17:48.660 INFO:teuthology.orchestra.run.smithi040.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-04-22T07:17:48.819 INFO:teuthology.orchestra.run.smithi040.stdout:(111/150): parquet-libs-9.0.0-10.el9.x86_64.rpm 5.2 MB/s | 838 kB 00:00 2024-04-22T07:17:48.852 INFO:teuthology.orchestra.run.smithi040.stdout:(112/150): luarocks-3.9.2-1.el9.noarch.rpm 695 kB/s | 151 kB 00:00 2024-04-22T07:17:48.911 INFO:teuthology.orchestra.run.smithi040.stdout:(113/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 744 kB/s | 43 kB 00:00 2024-04-22T07:17:48.945 INFO:teuthology.orchestra.run.smithi040.stdout:(114/150): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-04-22T07:17:48.970 INFO:teuthology.orchestra.run.smithi040.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 551 kB/s | 32 kB 00:00 2024-04-22T07:17:49.036 INFO:teuthology.orchestra.run.smithi040.stdout:(116/150): libarrow-9.0.0-10.el9.x86_64.rpm 7.8 MB/s | 4.4 MB 00:00 2024-04-22T07:17:49.062 INFO:teuthology.orchestra.run.smithi040.stdout:(117/150): python3-certifi-2021.10.8-2.el9.noar 128 kB/s | 15 kB 00:00 2024-04-22T07:17:49.079 INFO:teuthology.orchestra.run.smithi040.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-04-22T07:17:49.104 INFO:teuthology.orchestra.run.smithi040.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-04-22T07:17:49.129 INFO:teuthology.orchestra.run.smithi040.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-04-22T07:17:49.156 INFO:teuthology.orchestra.run.smithi040.stdout:(121/150): python3-colorama-0.4.4-12.el9.noarch 454 kB/s | 35 kB 00:00 2024-04-22T07:17:49.182 INFO:teuthology.orchestra.run.smithi040.stdout:(122/150): python3-google-auth-2.28.2-1.el9.noa 2.6 MB/s | 203 kB 00:00 2024-04-22T07:17:49.224 INFO:teuthology.orchestra.run.smithi040.stdout:(123/150): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-04-22T07:17:49.249 INFO:teuthology.orchestra.run.smithi040.stdout:(124/150): python3-jaraco-8.2.1-3.el9.noarch.rp 159 kB/s | 11 kB 00:00 2024-04-22T07:17:49.283 INFO:teuthology.orchestra.run.smithi040.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 301 kB/s | 18 kB 00:00 2024-04-22T07:17:49.308 INFO:teuthology.orchestra.run.smithi040.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 395 kB/s | 23 kB 00:00 2024-04-22T07:17:49.367 INFO:teuthology.orchestra.run.smithi040.stdout:(127/150): python3-grpcio-1.46.7-10.el9.x86_64. 8.6 MB/s | 2.0 MB 00:00 2024-04-22T07:17:49.392 INFO:teuthology.orchestra.run.smithi040.stdout:(128/150): python3-jaraco-functools-3.5.0-2.el9 179 kB/s | 19 kB 00:00 2024-04-22T07:17:49.417 INFO:teuthology.orchestra.run.smithi040.stdout:(129/150): python3-jaraco-text-3.2.0-6.el9.noar 181 kB/s | 20 kB 00:00 2024-04-22T07:17:49.484 INFO:teuthology.orchestra.run.smithi040.stdout:(130/150): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-04-22T07:17:49.509 INFO:teuthology.orchestra.run.smithi040.stdout:(131/150): python3-logutils-0.3.5-21.el9.noarch 504 kB/s | 46 kB 00:00 2024-04-22T07:17:49.534 INFO:teuthology.orchestra.run.smithi040.stdout:(132/150): python3-more-itertools-8.12.0-2.el9. 674 kB/s | 79 kB 00:00 2024-04-22T07:17:49.560 INFO:teuthology.orchestra.run.smithi040.stdout:(133/150): python3-natsort-7.1.1-5.el9.noarch.r 766 kB/s | 58 kB 00:00 2024-04-22T07:17:49.585 INFO:teuthology.orchestra.run.smithi040.stdout:(134/150): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-04-22T07:17:49.611 INFO:teuthology.orchestra.run.smithi040.stdout:(135/150): python3-portend-3.1.0-2.el9.noarch.r 217 kB/s | 16 kB 00:00 2024-04-22T07:17:49.636 INFO:teuthology.orchestra.run.smithi040.stdout:(136/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-04-22T07:17:49.677 INFO:teuthology.orchestra.run.smithi040.stdout:(137/150): python3-pyperclip-1.8.2-2.el9.noarch 307 kB/s | 28 kB 00:00 2024-04-22T07:17:49.703 INFO:teuthology.orchestra.run.smithi040.stdout:(138/150): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2024-04-22T07:17:49.720 INFO:teuthology.orchestra.run.smithi040.stdout:(139/150): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-04-22T07:17:49.745 INFO:teuthology.orchestra.run.smithi040.stdout:(140/150): python3-rsa-4.9-2.el9.noarch.rpm 880 kB/s | 59 kB 00:00 2024-04-22T07:17:49.795 INFO:teuthology.orchestra.run.smithi040.stdout:(141/150): python3-typing-extensions-4.4.0-2.el 679 kB/s | 51 kB 00:00 2024-04-22T07:17:49.821 INFO:teuthology.orchestra.run.smithi040.stdout:(142/150): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-22T07:17:49.854 INFO:teuthology.orchestra.run.smithi040.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-04-22T07:17:49.873 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 16 kB 00:00 2024-04-22T07:17:49.879 INFO:teuthology.orchestra.run.smithi040.stdout:(144/150): python3-tempora-5.0.0-2.el9.noarch.r 203 kB/s | 36 kB 00:00 2024-04-22T07:17:49.905 INFO:teuthology.orchestra.run.smithi040.stdout:(145/150): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-04-22T07:17:49.930 INFO:teuthology.orchestra.run.smithi040.stdout:(146/150): python3-zc-lockfile-2.0-10.el9.noarc 265 kB/s | 20 kB 00:00 2024-04-22T07:17:49.955 INFO:teuthology.orchestra.run.smithi040.stdout:(147/150): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-04-22T07:17:50.072 INFO:teuthology.orchestra.run.smithi040.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-04-22T07:17:50.247 INFO:teuthology.orchestra.run.smithi040.stdout:(149/150): librados2-19.0.0-3156.g86f7587a.el9. 11 MB/s | 3.4 MB 00:00 2024-04-22T07:17:50.572 INFO:teuthology.orchestra.run.smithi040.stdout:(150/150): librbd1-19.0.0-3156.g86f7587a.el9.x8 5.1 MB/s | 3.1 MB 00:00 2024-04-22T07:17:50.579 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-04-22T07:17:50.579 INFO:teuthology.orchestra.run.smithi040.stdout:Total 17 MB/s | 218 MB 00:12 2024-04-22T07:17:50.658 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 32 MB/s | 21 MB 00:00 2024-04-22T07:17:51.670 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-04-22T07:17:51.809 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-04-22T07:17:51.809 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-04-22T07:17:53.631 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-04-22T07:17:53.632 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-04-22T07:17:55.834 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-04-22T07:17:58.152 INFO:teuthology.orchestra.run.smithi062.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-22T07:17:58.153 INFO:teuthology.orchestra.run.smithi062.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-22T07:17:58.164 INFO:teuthology.orchestra.run.smithi062.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-22T07:17:58.165 INFO:teuthology.orchestra.run.smithi062.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-22T07:17:58.166 INFO:teuthology.orchestra.run.smithi062.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-22T07:17:58.167 INFO:teuthology.orchestra.run.smithi062.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-22T07:17:58.168 INFO:teuthology.orchestra.run.smithi062.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-22T07:17:58.171 INFO:teuthology.orchestra.run.smithi062.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-22T07:17:58.172 INFO:teuthology.orchestra.run.smithi062.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-22T07:17:58.238 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-22T07:17:58.248 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================= 2024-04-22T07:17:58.248 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-04-22T07:17:58.248 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================= 2024-04-22T07:17:58.249 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-22T07:17:58.249 INFO:teuthology.orchestra.run.smithi062.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-22T07:17:58.249 INFO:teuthology.orchestra.run.smithi062.stdout: ceph x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 6.6 k 2024-04-22T07:17:58.249 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 5.4 M 2024-04-22T07:17:58.249 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 890 k 2024-04-22T07:17:58.249 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 145 k 2024-04-22T07:17:58.249 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 1.5 M 2024-04-22T07:17:58.249 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 142 k 2024-04-22T07:17:58.249 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 3.5 M 2024-04-22T07:17:58.249 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 7.4 M 2024-04-22T07:17:58.249 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 49 k 2024-04-22T07:17:58.249 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 11 M 2024-04-22T07:17:58.249 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 49 M 2024-04-22T07:17:58.250 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-volume noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 273 k 2024-04-22T07:17:58.250 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 763 k 2024-04-22T07:17:58.250 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-mirror x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 225 k 2024-04-22T07:17:58.250 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-shell x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 27 k 2024-04-22T07:17:58.250 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-top noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 18 k 2024-04-22T07:17:58.250 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-22T07:17:58.250 INFO:teuthology.orchestra.run.smithi062.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-22T07:17:58.250 INFO:teuthology.orchestra.run.smithi062.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-22T07:17:58.250 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 32 k 2024-04-22T07:17:58.250 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 747 k 2024-04-22T07:17:58.250 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 127 k 2024-04-22T07:17:58.251 INFO:teuthology.orchestra.run.smithi062.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-22T07:17:58.251 INFO:teuthology.orchestra.run.smithi062.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-22T07:17:58.251 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-22T07:17:58.251 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-22T07:17:58.251 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-22T07:17:58.251 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-22T07:17:58.251 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 162 k 2024-04-22T07:17:58.251 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 320 k 2024-04-22T07:17:58.251 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 298 k 2024-04-22T07:17:58.252 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 100 k 2024-04-22T07:17:58.252 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 85 k 2024-04-22T07:17:58.252 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 3.1 M 2024-04-22T07:17:58.252 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 171 k 2024-04-22T07:17:58.252 INFO:teuthology.orchestra.run.smithi062.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-22T07:17:58.252 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrading: 2024-04-22T07:17:58.252 INFO:teuthology.orchestra.run.smithi062.stdout: librados2 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 3.4 M 2024-04-22T07:17:58.252 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 3.1 M 2024-04-22T07:17:58.252 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-04-22T07:17:58.252 INFO:teuthology.orchestra.run.smithi062.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-22T07:17:58.252 INFO:teuthology.orchestra.run.smithi062.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-22T07:17:58.252 INFO:teuthology.orchestra.run.smithi062.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-22T07:17:58.252 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 21 M 2024-04-22T07:17:58.252 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 34 k 2024-04-22T07:17:58.253 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 2.4 M 2024-04-22T07:17:58.253 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 249 k 2024-04-22T07:17:58.253 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 4.7 M 2024-04-22T07:17:58.253 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 17 M 2024-04-22T07:17:58.253 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3156.g86f7587a.el9 ceph-noarch 16 k 2024-04-22T07:17:58.253 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 25 k 2024-04-22T07:17:58.253 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-22T07:17:58.253 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-22T07:17:58.253 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-22T07:17:58.253 INFO:teuthology.orchestra.run.smithi062.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-22T07:17:58.253 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-22T07:17:58.253 INFO:teuthology.orchestra.run.smithi062.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-22T07:17:58.253 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-22T07:17:58.254 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-22T07:17:58.254 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 164 k 2024-04-22T07:17:58.254 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-22T07:17:58.254 INFO:teuthology.orchestra.run.smithi062.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-22T07:17:58.254 INFO:teuthology.orchestra.run.smithi062.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-22T07:17:58.254 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-22T07:17:58.254 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-22T07:17:58.254 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 500 k 2024-04-22T07:17:58.254 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-22T07:17:58.254 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2 x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 5.4 M 2024-04-22T07:17:58.254 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-22T07:17:58.254 INFO:teuthology.orchestra.run.smithi062.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-22T07:17:58.255 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-22T07:17:58.255 INFO:teuthology.orchestra.run.smithi062.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-22T07:17:58.255 INFO:teuthology.orchestra.run.smithi062.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-22T07:17:58.255 INFO:teuthology.orchestra.run.smithi062.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-22T07:17:58.255 INFO:teuthology.orchestra.run.smithi062.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-22T07:17:58.255 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-22T07:17:58.255 INFO:teuthology.orchestra.run.smithi062.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-22T07:17:58.255 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-22T07:17:58.255 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-22T07:17:58.255 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-22T07:17:58.255 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-22T07:17:58.255 INFO:teuthology.orchestra.run.smithi062.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-22T07:17:58.255 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-22T07:17:58.255 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-22T07:17:58.256 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-22T07:17:58.256 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 45 k 2024-04-22T07:17:58.256 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common x86_64 2:19.0.0-3156.g86f7587a.el9 ceph 135 k 2024-04-22T07:17:58.256 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-22T07:17:58.256 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-22T07:17:58.256 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-22T07:17:58.256 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-22T07:17:58.256 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-22T07:17:58.256 INFO:teuthology.orchestra.run.smithi062.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-22T07:17:58.256 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-22T07:17:58.256 INFO:teuthology.orchestra.run.smithi062.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-22T07:17:58.256 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-22T07:17:58.256 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-22T07:17:58.257 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-22T07:17:58.257 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-22T07:17:58.257 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-22T07:17:58.257 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-22T07:17:58.257 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-22T07:17:58.257 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-22T07:17:58.257 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-22T07:17:58.257 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-22T07:17:58.257 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-22T07:17:58.257 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-22T07:17:58.257 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-22T07:17:58.257 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-22T07:17:58.257 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-22T07:17:58.257 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-22T07:17:58.258 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-22T07:17:58.258 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-22T07:17:58.258 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-22T07:17:58.258 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-22T07:17:58.258 INFO:teuthology.orchestra.run.smithi062.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-22T07:17:58.258 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-22T07:17:58.258 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-22T07:17:58.258 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-22T07:17:58.258 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-22T07:17:58.258 INFO:teuthology.orchestra.run.smithi062.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-22T07:17:58.258 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-22T07:17:58.258 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-22T07:17:58.258 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-22T07:17:58.258 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-22T07:17:58.259 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-22T07:17:58.259 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-22T07:17:58.259 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-22T07:17:58.259 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-22T07:17:58.259 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-22T07:17:58.259 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-22T07:17:58.259 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-22T07:17:58.259 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-22T07:17:58.259 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-22T07:17:58.259 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-22T07:17:58.259 INFO:teuthology.orchestra.run.smithi062.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-22T07:17:58.259 INFO:teuthology.orchestra.run.smithi062.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-22T07:17:58.259 INFO:teuthology.orchestra.run.smithi062.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-22T07:17:58.260 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-22T07:17:58.260 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-22T07:17:58.260 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-22T07:17:58.260 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-22T07:17:58.260 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-22T07:17:58.260 INFO:teuthology.orchestra.run.smithi062.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-22T07:17:58.260 INFO:teuthology.orchestra.run.smithi062.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-22T07:17:58.260 INFO:teuthology.orchestra.run.smithi062.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-22T07:17:58.260 INFO:teuthology.orchestra.run.smithi062.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-22T07:17:58.260 INFO:teuthology.orchestra.run.smithi062.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-22T07:17:58.260 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-22T07:17:58.260 INFO:teuthology.orchestra.run.smithi062.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-22T07:17:58.260 INFO:teuthology.orchestra.run.smithi062.stdout:Installing weak dependencies: 2024-04-22T07:17:58.260 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-22T07:17:58.261 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:17:58.261 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-22T07:17:58.261 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================= 2024-04-22T07:17:58.261 INFO:teuthology.orchestra.run.smithi062.stdout:Install 148 Packages 2024-04-22T07:17:58.261 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrade 2 Packages 2024-04-22T07:17:58.261 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:17:58.262 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 218 M 2024-04-22T07:17:58.262 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-22T07:17:59.219 INFO:teuthology.orchestra.run.smithi062.stdout:(1/150): ceph-19.0.0-3156.g86f7587a.el9.x86_64. 37 kB/s | 6.6 kB 00:00 2024-04-22T07:17:59.410 INFO:teuthology.orchestra.run.smithi062.stdout:(2/150): ceph-fuse-19.0.0-3156.g86f7587a.el9.x8 4.5 MB/s | 890 kB 00:00 2024-04-22T07:17:59.469 INFO:teuthology.orchestra.run.smithi062.stdout:(3/150): ceph-immutable-object-cache-19.0.0-315 2.4 MB/s | 145 kB 00:00 2024-04-22T07:17:59.549 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-04-22T07:17:59.652 INFO:teuthology.orchestra.run.smithi062.stdout:(4/150): ceph-base-19.0.0-3156.g86f7587a.el9.x8 8.8 MB/s | 5.4 MB 00:00 2024-04-22T07:17:59.705 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-04-22T07:17:59.711 INFO:teuthology.orchestra.run.smithi062.stdout:(5/150): ceph-mds-19.0.0-3156.g86f7587a.el9.x86 9.8 MB/s | 2.4 MB 00:00 2024-04-22T07:17:59.761 INFO:teuthology.orchestra.run.smithi062.stdout:(6/150): ceph-mgr-19.0.0-3156.g86f7587a.el9.x86 14 MB/s | 1.5 MB 00:00 2024-04-22T07:17:59.885 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-04-22T07:17:59.931 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-04-22T07:18:00.203 INFO:teuthology.orchestra.run.smithi062.stdout:(7/150): ceph-mon-19.0.0-3156.g86f7587a.el9.x86 9.6 MB/s | 4.7 MB 00:00 2024-04-22T07:18:00.328 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-04-22T07:18:00.401 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librados2-2:19.0.0-3156.g86f7587a.el9.x86_64 5/152 2024-04-22T07:18:00.526 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:19.0.0-3156.g86f7587a.el9.x86_64 5/152 2024-04-22T07:18:00.552 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs2-2:19.0.0-3156.g86f7587a.el9.x86_64 6/152 2024-04-22T07:18:00.645 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephfs2-2:19.0.0-3156.g86f7587a.el9.x86_64 6/152 2024-04-22T07:18:00.687 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rados-2:19.0.0-3156.g86f7587a.el9.x86_64 7/152 2024-04-22T07:18:00.723 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-04-22T07:18:00.749 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-04-22T07:18:00.917 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-04-22T07:18:00.972 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-04-22T07:18:01.000 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephsqlite-2:19.0.0-3156.g86f7587a.el9.x86_64 12/152 2024-04-22T07:18:01.105 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3156.g86f7587a.el9.x86_64 12/152 2024-04-22T07:18:01.134 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libradosstriper1-2:19.0.0-3156.g86f7587a.el9.x86 13/152 2024-04-22T07:18:01.197 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3156.g86f7587a.el9.x86 13/152 2024-04-22T07:18:01.218 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-22T07:18:01.243 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-22T07:18:01.253 INFO:teuthology.orchestra.run.smithi062.stdout:(8/150): ceph-osd-19.0.0-3156.g86f7587a.el9.x86 11 MB/s | 17 MB 00:01 2024-04-22T07:18:01.312 INFO:teuthology.orchestra.run.smithi062.stdout:(9/150): ceph-selinux-19.0.0-3156.g86f7587a.el9 433 kB/s | 25 kB 00:00 2024-04-22T07:18:01.445 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-22T07:18:01.462 INFO:teuthology.orchestra.run.smithi062.stdout:(10/150): ceph-radosgw-19.0.0-3156.g86f7587a.el 8.4 MB/s | 11 MB 00:01 2024-04-22T07:18:01.477 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-22T07:18:01.546 INFO:teuthology.orchestra.run.smithi062.stdout:(11/150): cephfs-mirror-19.0.0-3156.g86f7587a.e 2.6 MB/s | 225 kB 00:00 2024-04-22T07:18:01.587 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-04-22T07:18:01.604 INFO:teuthology.orchestra.run.smithi062.stdout:(12/150): cephfs-shell-19.0.0-3156.g86f7587a.el 466 kB/s | 27 kB 00:00 2024-04-22T07:18:01.654 INFO:teuthology.orchestra.run.smithi062.stdout:(13/150): libcephfs-devel-19.0.0-3156.g86f7587a 634 kB/s | 32 kB 00:00 2024-04-22T07:18:01.695 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 17/152 2024-04-22T07:18:01.734 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-04-22T07:18:01.770 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-04-22T07:18:01.804 INFO:teuthology.orchestra.run.smithi062.stdout:(14/150): libcephfs2-19.0.0-3156.g86f7587a.el9. 4.9 MB/s | 747 kB 00:00 2024-04-22T07:18:01.847 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-04-22T07:18:01.871 INFO:teuthology.orchestra.run.smithi062.stdout:(15/150): libcephsqlite-19.0.0-3156.g86f7587a.e 2.4 MB/s | 164 kB 00:00 2024-04-22T07:18:01.885 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-04-22T07:18:01.929 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-04-22T07:18:01.955 INFO:teuthology.orchestra.run.smithi062.stdout:(16/150): librados-devel-19.0.0-3156.g86f7587a. 1.5 MB/s | 127 kB 00:00 2024-04-22T07:18:01.961 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-04-22T07:18:01.989 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-04-22T07:18:02.071 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-04-22T07:18:02.130 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/152 2024-04-22T07:18:02.159 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-04-22T07:18:02.164 INFO:teuthology.orchestra.run.smithi062.stdout:(17/150): ceph-common-19.0.0-3156.g86f7587a.el9 6.8 MB/s | 21 MB 00:03 2024-04-22T07:18:02.197 INFO:teuthology.orchestra.run.smithi062.stdout:(18/150): libradosstriper1-19.0.0-3156.g86f7587 2.0 MB/s | 500 kB 00:00 2024-04-22T07:18:02.203 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 28/152 2024-04-22T07:18:02.257 INFO:teuthology.orchestra.run.smithi062.stdout:(19/150): python3-ceph-argparse-19.0.0-3156.g86 773 kB/s | 45 kB 00:00 2024-04-22T07:18:02.282 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 29/152 2024-04-22T07:18:02.313 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-common-2:19.0.0-3156.g86f7587a.el9. 30/152 2024-04-22T07:18:02.323 INFO:teuthology.orchestra.run.smithi062.stdout:(20/150): python3-ceph-common-19.0.0-3156.g86f7 2.0 MB/s | 135 kB 00:00 2024-04-22T07:18:02.357 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-argparse-2:19.0.0-3156.g86f7587a.el 31/152 2024-04-22T07:18:02.385 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cephfs-2:19.0.0-3156.g86f7587a.el9.x86_6 32/152 2024-04-22T07:18:02.398 INFO:teuthology.orchestra.run.smithi062.stdout:(21/150): python3-cephfs-19.0.0-3156.g86f7587a. 2.1 MB/s | 162 kB 00:00 2024-04-22T07:18:02.460 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-04-22T07:18:02.482 INFO:teuthology.orchestra.run.smithi062.stdout:(22/150): python3-rados-19.0.0-3156.g86f7587a.e 3.8 MB/s | 320 kB 00:00 2024-04-22T07:18:02.509 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : luarocks-3.9.2-1.el9.noarch 34/152 2024-04-22T07:18:02.574 INFO:teuthology.orchestra.run.smithi062.stdout:(23/150): python3-rbd-19.0.0-3156.g86f7587a.el9 3.2 MB/s | 298 kB 00:00 2024-04-22T07:18:02.587 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-04-22T07:18:02.650 INFO:teuthology.orchestra.run.smithi062.stdout:(24/150): python3-rgw-19.0.0-3156.g86f7587a.el9 1.3 MB/s | 100 kB 00:00 2024-04-22T07:18:02.736 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-04-22T07:18:02.750 INFO:teuthology.orchestra.run.smithi062.stdout:(25/150): librgw2-19.0.0-3156.g86f7587a.el9.x86 9.2 MB/s | 5.4 MB 00:00 2024-04-22T07:18:02.784 INFO:teuthology.orchestra.run.smithi062.stdout:(26/150): rbd-fuse-19.0.0-3156.g86f7587a.el9.x8 640 kB/s | 85 kB 00:00 2024-04-22T07:18:02.796 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-04-22T07:18:02.859 INFO:teuthology.orchestra.run.smithi062.stdout:(27/150): rbd-nbd-19.0.0-3156.g86f7587a.el9.x86 2.2 MB/s | 171 kB 00:00 2024-04-22T07:18:02.926 INFO:teuthology.orchestra.run.smithi062.stdout:(28/150): ceph-grafana-dashboards-19.0.0-3156.g 515 kB/s | 34 kB 00:00 2024-04-22T07:18:03.001 INFO:teuthology.orchestra.run.smithi062.stdout:(29/150): ceph-mgr-cephadm-19.0.0-3156.g86f7587 1.9 MB/s | 142 kB 00:00 2024-04-22T07:18:03.102 INFO:teuthology.orchestra.run.smithi062.stdout:(30/150): rbd-mirror-19.0.0-3156.g86f7587a.el9. 8.8 MB/s | 3.1 MB 00:00 2024-04-22T07:18:03.401 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-04-22T07:18:03.477 INFO:teuthology.orchestra.run.smithi062.stdout:(31/150): ceph-mgr-dashboard-19.0.0-3156.g86f75 7.4 MB/s | 3.5 MB 00:00 2024-04-22T07:18:03.494 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-04-22T07:18:03.527 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 40/152 2024-04-22T07:18:03.569 INFO:teuthology.orchestra.run.smithi062.stdout:(32/150): ceph-mgr-modules-core-19.0.0-3156.g86 2.7 MB/s | 249 kB 00:00 2024-04-22T07:18:03.570 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-04-22T07:18:03.608 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librados-devel-2:19.0.0-3156.g86f7587a.el9.x86_6 42/152 2024-04-22T07:18:03.641 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-04-22T07:18:03.644 INFO:teuthology.orchestra.run.smithi062.stdout:(33/150): ceph-mgr-rook-19.0.0-3156.g86f7587a.e 660 kB/s | 49 kB 00:00 2024-04-22T07:18:03.699 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-04-22T07:18:03.719 INFO:teuthology.orchestra.run.smithi062.stdout:(34/150): ceph-prometheus-alerts-19.0.0-3156.g8 219 kB/s | 16 kB 00:00 2024-04-22T07:18:03.782 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/152 2024-04-22T07:18:03.803 INFO:teuthology.orchestra.run.smithi062.stdout:(35/150): ceph-volume-19.0.0-3156.g86f7587a.el9 3.2 MB/s | 273 kB 00:00 2024-04-22T07:18:03.817 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/152 2024-04-22T07:18:03.854 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/152 2024-04-22T07:18:03.902 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/152 2024-04-22T07:18:03.920 INFO:teuthology.orchestra.run.smithi062.stdout:(36/150): ceph-mgr-diskprediction-local-19.0.0- 9.1 MB/s | 7.4 MB 00:00 2024-04-22T07:18:03.936 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/152 2024-04-22T07:18:03.980 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/152 2024-04-22T07:18:03.987 INFO:teuthology.orchestra.run.smithi062.stdout:(37/150): cephadm-19.0.0-3156.g86f7587a.el9.noa 4.1 MB/s | 763 kB 00:00 2024-04-22T07:18:04.003 INFO:teuthology.orchestra.run.smithi062.stdout:(38/150): cephfs-top-19.0.0-3156.g86f7587a.el9. 218 kB/s | 18 kB 00:00 2024-04-22T07:18:04.022 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/152 2024-04-22T07:18:04.170 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/152 2024-04-22T07:18:04.219 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/152 2024-04-22T07:18:04.249 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/152 2024-04-22T07:18:04.292 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/152 2024-04-22T07:18:04.392 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-04-22T07:18:04.448 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 57/152 2024-04-22T07:18:04.489 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-04-22T07:18:04.522 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-04-22T07:18:04.547 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/152 2024-04-22T07:18:04.628 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-04-22T07:18:04.721 INFO:teuthology.orchestra.run.smithi062.stdout:(39/150): ceph-test-19.0.0-3156.g86f7587a.el9.x 14 MB/s | 49 MB 00:03 2024-04-22T07:18:04.766 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-04-22T07:18:04.804 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-04-22T07:18:04.832 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-04-22T07:18:04.867 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-04-22T07:18:04.912 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-04-22T07:18:04.949 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 67/152 2024-04-22T07:18:04.989 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-04-22T07:18:05.096 INFO:teuthology.orchestra.run.smithi062.stdout:(40/150): fuse-2.9.9-15.el9.x86_64.rpm 72 kB/s | 80 kB 00:01 2024-04-22T07:18:05.161 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-04-22T07:18:05.195 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-04-22T07:18:05.228 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-04-22T07:18:05.271 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-04-22T07:18:05.313 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-04-22T07:18:05.409 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-04-22T07:18:05.461 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-04-22T07:18:05.499 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-04-22T07:18:05.548 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-04-22T07:18:05.571 INFO:teuthology.orchestra.run.smithi062.stdout:(41/150): libquadmath-11.4.1-3.el9.x86_64.rpm 230 kB/s | 195 kB 00:00 2024-04-22T07:18:05.661 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-packaging-20.9-5.el9.noarch 78/152 2024-04-22T07:18:05.710 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/152 2024-04-22T07:18:06.038 INFO:teuthology.orchestra.run.smithi062.stdout:(42/150): libgfortran-11.4.1-3.el9.x86_64.rpm 395 kB/s | 803 kB 00:02 2024-04-22T07:18:06.063 INFO:teuthology.orchestra.run.smithi062.stdout:(43/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 262 kB/s | 253 kB 00:00 2024-04-22T07:18:06.516 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/152 2024-04-22T07:18:06.565 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/152 2024-04-22T07:18:06.598 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/152 2024-04-22T07:18:06.706 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/152 2024-04-22T07:18:06.755 INFO:teuthology.orchestra.run.smithi062.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 149 kB/s | 106 kB 00:00 2024-04-22T07:18:06.757 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 84/152 2024-04-22T07:18:06.847 INFO:teuthology.orchestra.run.smithi062.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 172 kB/s | 135 kB 00:00 2024-04-22T07:18:06.850 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-04-22T07:18:06.917 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-04-22T07:18:07.100 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-04-22T07:18:07.139 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-04-22T07:18:07.219 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-04-22T07:18:07.539 INFO:teuthology.orchestra.run.smithi062.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 159 kB/s | 125 kB 00:00 2024-04-22T07:18:07.698 INFO:teuthology.orchestra.run.smithi062.stdout:(47/150): python3-urllib3-1.26.5-5.el9.noarch.r 252 kB/s | 215 kB 00:00 2024-04-22T07:18:07.806 INFO:teuthology.orchestra.run.smithi062.stdout:(48/150): python3-cryptography-36.0.1-4.el9.x86 562 kB/s | 1.2 MB 00:02 2024-04-22T07:18:07.931 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-04-22T07:18:08.052 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-04-22T07:18:08.598 INFO:teuthology.orchestra.run.smithi062.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 140 kB/s | 107 kB 00:00 2024-04-22T07:18:09.057 INFO:teuthology.orchestra.run.smithi062.stdout:(50/150): automake-1.16.2-8.el9.noarch.rpm 454 kB/s | 689 kB 00:01 2024-04-22T07:18:09.174 INFO:teuthology.orchestra.run.smithi062.stdout:(51/150): elfutils-libelf-devel-0.190-2.el9.x86 37 kB/s | 21 kB 00:00 2024-04-22T07:18:09.421 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-04-22T07:18:09.502 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-04-22T07:18:09.521 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-04-22T07:18:09.554 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-04-22T07:18:09.566 INFO:teuthology.orchestra.run.smithi062.stdout:(52/150): bison-3.7.4-5.el9.x86_64.rpm 505 kB/s | 943 kB 00:01 2024-04-22T07:18:09.782 INFO:teuthology.orchestra.run.smithi062.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 54 kB/s | 33 kB 00:00 2024-04-22T07:18:09.875 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-04-22T07:18:09.917 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librbd1-2:19.0.0-3156.g86f7587a.el9.x86_64 97/152 2024-04-22T07:18:10.008 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:19.0.0-3156.g86f7587a.el9.x86_64 97/152 2024-04-22T07:18:10.039 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rbd-2:19.0.0-3156.g86f7587a.el9.x86_64 98/152 2024-04-22T07:18:10.058 INFO:teuthology.orchestra.run.smithi062.stdout:(54/150): flex-2.6.4-9.el9.x86_64.rpm 313 kB/s | 313 kB 00:01 2024-04-22T07:18:10.075 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-04-22T07:18:10.333 INFO:teuthology.orchestra.run.smithi062.stdout:(55/150): flexiblas-openblas-openmp-3.0.4-8.el9 33 kB/s | 18 kB 00:00 2024-04-22T07:18:10.567 INFO:teuthology.orchestra.run.smithi062.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 22 kB/s | 11 kB 00:00 2024-04-22T07:18:10.662 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 100/152 2024-04-22T07:18:10.695 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librgw2-2:19.0.0-3156.g86f7587a.el9.x86_64 101/152 2024-04-22T07:18:10.767 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librgw2-2:19.0.0-3156.g86f7587a.el9.x86_64 101/152 2024-04-22T07:18:10.796 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rgw-2:19.0.0-3156.g86f7587a.el9.x86_64 102/152 2024-04-22T07:18:11.175 INFO:teuthology.orchestra.run.smithi062.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 190 kB/s | 160 kB 00:00 2024-04-22T07:18:11.225 INFO:teuthology.orchestra.run.smithi062.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 72 kB/s | 45 kB 00:00 2024-04-22T07:18:12.559 INFO:teuthology.orchestra.run.smithi062.stdout:(59/150): libtool-2.4.6-45.el9.x86_64.rpm 437 kB/s | 582 kB 00:01 2024-04-22T07:18:12.676 INFO:teuthology.orchestra.run.smithi062.stdout:(60/150): librdkafka-1.6.1-102.el9.x86_64.rpm 442 kB/s | 662 kB 00:01 2024-04-22T07:18:13.143 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 103/152 2024-04-22T07:18:13.159 INFO:teuthology.orchestra.run.smithi062.stdout:(61/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 42 kB/s | 25 kB 00:00 2024-04-22T07:18:13.186 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 103/152 2024-04-22T07:18:13.318 INFO:teuthology.orchestra.run.smithi062.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 74 kB/s | 47 kB 00:00 2024-04-22T07:18:13.760 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 103/152 2024-04-22T07:18:13.806 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-base-2:19.0.0-3156.g86f7587a.el9.x86_64 104/152 2024-04-22T07:18:13.891 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-base-2:19.0.0-3156.g86f7587a.el9.x86_64 104/152 2024-04-22T07:18:13.892 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-22T07:18:13.892 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-22T07:18:13.892 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:18:13.924 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-selinux-2:19.0.0-3156.g86f7587a.el9.x86_64 105/152 2024-04-22T07:18:14.143 INFO:teuthology.orchestra.run.smithi062.stdout:(63/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 297 kB/s | 292 kB 00:00 2024-04-22T07:18:14.202 INFO:teuthology.orchestra.run.smithi062.stdout:(64/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 660 kB/s | 3.0 MB 00:04 2024-04-22T07:18:14.227 INFO:teuthology.orchestra.run.smithi062.stdout:(65/150): lua-5.4.4-4.el9.x86_64.rpm 207 kB/s | 188 kB 00:00 2024-04-22T07:18:14.777 INFO:teuthology.orchestra.run.smithi062.stdout:(66/150): openblas-0.3.21-2.el9.x86_64.rpm 56 kB/s | 35 kB 00:00 2024-04-22T07:18:17.386 INFO:teuthology.orchestra.run.smithi062.stdout:(67/150): postgresql-13.14-1.el9.x86_64.rpm 623 kB/s | 1.6 MB 00:02 2024-04-22T07:18:19.119 INFO:teuthology.orchestra.run.smithi062.stdout:(68/150): postgresql-contrib-13.14-1.el9.x86_64 526 kB/s | 911 kB 00:01 2024-04-22T07:18:19.969 INFO:teuthology.orchestra.run.smithi062.stdout:(69/150): postgresql-private-libs-13.14-1.el9.x 157 kB/s | 133 kB 00:00 2024-04-22T07:18:20.037 INFO:teuthology.orchestra.run.smithi062.stdout:(70/150): openssl-devel-3.0.7-27.el9.x86_64.rpm 728 kB/s | 4.1 MB 00:05 2024-04-22T07:18:20.895 INFO:teuthology.orchestra.run.smithi062.stdout:(71/150): openblas-openmp-0.3.21-2.el9.x86_64.r 725 kB/s | 4.7 MB 00:06 2024-04-22T07:18:21.620 INFO:teuthology.orchestra.run.smithi062.stdout:(72/150): python3-attrs-20.3.0-7.el9.noarch.rpm 121 kB/s | 87 kB 00:00 2024-04-22T07:18:21.956 INFO:teuthology.orchestra.run.smithi062.stdout:(73/150): protobuf-3.14.0-13.el9.x86_64.rpm 538 kB/s | 1.0 MB 00:01 2024-04-22T07:18:22.939 INFO:teuthology.orchestra.run.smithi062.stdout:(74/150): python3-devel-3.9.18-3.el9.x86_64.rpm 249 kB/s | 244 kB 00:00 2024-04-22T07:18:23.848 INFO:teuthology.orchestra.run.smithi062.stdout:(75/150): python3-jinja2-2.11.3-5.el9.noarch.rp 273 kB/s | 248 kB 00:00 2024-04-22T07:18:24.456 INFO:teuthology.orchestra.run.smithi062.stdout:(76/150): python3-jsonpatch-1.21-16.el9.noarch. 42 kB/s | 26 kB 00:00 2024-04-22T07:18:25.082 INFO:teuthology.orchestra.run.smithi062.stdout:(77/150): python3-jsonpointer-2.0-4.el9.noarch. 31 kB/s | 19 kB 00:00 2024-04-22T07:18:25.852 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3156.g86f7587a.el9.x86_64 105/152 2024-04-22T07:18:25.853 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /sys 2024-04-22T07:18:25.853 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /proc 2024-04-22T07:18:25.853 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /mnt 2024-04-22T07:18:25.853 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /var/tmp 2024-04-22T07:18:25.853 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /home 2024-04-22T07:18:25.853 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /root 2024-04-22T07:18:25.853 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /tmp 2024-04-22T07:18:25.853 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:18:25.948 INFO:teuthology.orchestra.run.smithi062.stdout:(78/150): python3-mako-1.1.4-6.el9.noarch.rpm 199 kB/s | 172 kB 00:00 2024-04-22T07:18:26.053 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-volume-2:19.0.0-3156.g86f7587a.el9.noarch 106/152 2024-04-22T07:18:26.069 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-volume-2:19.0.0-3156.g86f7587a.el9.noarch 106/152 2024-04-22T07:18:26.070 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:18:26.070 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-22T07:18:26.070 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:18:26.557 INFO:teuthology.orchestra.run.smithi062.stdout:(79/150): python3-markupsafe-1.1.1-12.el9.x86_6 57 kB/s | 35 kB 00:00 2024-04-22T07:18:27.606 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-osd-2:19.0.0-3156.g86f7587a.el9.x86_64 107/152 2024-04-22T07:18:27.633 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-osd-2:19.0.0-3156.g86f7587a.el9.x86_64 107/152 2024-04-22T07:18:27.633 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:18:27.634 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-22T07:18:27.634 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-22T07:18:27.634 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-22T07:18:27.634 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:18:27.882 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mds-2:19.0.0-3156.g86f7587a.el9.x86_64 108/152 2024-04-22T07:18:27.882 INFO:teuthology.orchestra.run.smithi062.stdout:(80/150): postgresql-server-13.14-1.el9.x86_64. 748 kB/s | 5.8 MB 00:07 2024-04-22T07:18:27.906 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mds-2:19.0.0-3156.g86f7587a.el9.x86_64 108/152 2024-04-22T07:18:27.906 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:18:27.906 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-22T07:18:27.906 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-22T07:18:27.906 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-22T07:18:27.906 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:18:28.374 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mon-2:19.0.0-3156.g86f7587a.el9.x86_64 109/152 2024-04-22T07:18:28.398 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mon-2:19.0.0-3156.g86f7587a.el9.x86_64 109/152 2024-04-22T07:18:28.398 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:18:28.398 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-22T07:18:28.398 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-22T07:18:28.399 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-22T07:18:28.399 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:18:28.514 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-04-22T07:18:28.573 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-04-22T07:18:28.636 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-04-22T07:18:28.799 INFO:teuthology.orchestra.run.smithi062.stdout:(81/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 274 kB/s | 250 kB 00:00 2024-04-22T07:18:28.835 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-04-22T07:18:28.884 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-04-22T07:18:28.966 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-04-22T07:18:29.064 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-04-22T07:18:29.217 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-04-22T07:18:29.259 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-04-22T07:18:29.291 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-04-22T07:18:29.318 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fuse-2.9.9-15.el9.x86_64 120/152 2024-04-22T07:18:29.591 INFO:teuthology.orchestra.run.smithi062.stdout:(82/150): python3-babel-2.9.1-2.el9.noarch.rpm 766 kB/s | 6.0 MB 00:07 2024-04-22T07:18:29.674 INFO:teuthology.orchestra.run.smithi062.stdout:(83/150): python3-oauthlib-3.1.1-5.el9.noarch.r 254 kB/s | 222 kB 00:00 2024-04-22T07:18:29.780 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 121/152 2024-04-22T07:18:29.808 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 121/152 2024-04-22T07:18:29.841 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3156.g86f7587a.e 122/152 2024-04-22T07:18:29.905 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3156.g86f7587a. 123/152 2024-04-22T07:18:29.931 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3156.g86f7587a.el9.noa 124/152 2024-04-22T07:18:30.300 INFO:teuthology.orchestra.run.smithi062.stdout:(84/150): python3-prettytable-0.7.2-27.el9.noar 68 kB/s | 42 kB 00:00 2024-04-22T07:18:30.333 INFO:teuthology.orchestra.run.smithi062.stdout:(85/150): python3-packaging-20.9-5.el9.noarch.r 104 kB/s | 77 kB 00:00 2024-04-22T07:18:31.036 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3156.g86f7587a.el9.noa 124/152 2024-04-22T07:18:31.083 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3156.g86f7587a.el9.n 125/152 2024-04-22T07:18:31.134 INFO:teuthology.orchestra.run.smithi062.stdout:(86/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 198 kB/s | 159 kB 00:00 2024-04-22T07:18:31.250 INFO:teuthology.orchestra.run.smithi062.stdout:(87/150): python3-protobuf-3.14.0-13.el9.noarch 284 kB/s | 269 kB 00:00 2024-04-22T07:18:31.893 INFO:teuthology.orchestra.run.smithi062.stdout:(88/150): python3-pytz-2021.1-5.el9.noarch.rpm 79 kB/s | 51 kB 00:00 2024-04-22T07:18:32.101 INFO:teuthology.orchestra.run.smithi062.stdout:(89/150): python3-pyasn1-modules-0.4.8-6.el9.no 288 kB/s | 279 kB 00:00 2024-04-22T07:18:32.101 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3156.g86f7587a.el9.n 125/152 2024-04-22T07:18:32.134 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3156.g86f 126/152 2024-04-22T07:18:32.245 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3156.g86f 126/152 2024-04-22T07:18:32.421 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3156.g86f7587a.el 127/152 2024-04-22T07:18:32.474 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-2:19.0.0-3156.g86f7587a.el9.x86_64 128/152 2024-04-22T07:18:32.499 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3156.g86f7587a.el9.x86_64 128/152 2024-04-22T07:18:32.499 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:18:32.499 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-22T07:18:32.499 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-22T07:18:32.500 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-22T07:18:32.500 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:18:32.534 INFO:teuthology.orchestra.run.smithi062.stdout:(90/150): python3-requests-oauthlib-1.3.0-12.el 84 kB/s | 54 kB 00:00 2024-04-22T07:18:32.553 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-rook-2:19.0.0-3156.g86f7587a.el9.noarch 129/152 2024-04-22T07:18:32.564 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3156.g86f7587a.el9.noarch 129/152 2024-04-22T07:18:32.666 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-2:19.0.0-3156.g86f7587a.el9.x86_64 130/152 2024-04-22T07:18:32.719 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 131/152 2024-04-22T07:18:33.218 INFO:teuthology.orchestra.run.smithi062.stdout:(91/150): python3-toml-0.10.2-6.el9.noarch.rpm 61 kB/s | 42 kB 00:00 2024-04-22T07:18:33.698 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libtool-2.4.6-45.el9.x86_64 132/152 2024-04-22T07:18:33.739 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-radosgw-2:19.0.0-3156.g86f7587a.el9.x86_64 133/152 2024-04-22T07:18:33.763 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3156.g86f7587a.el9.x86_64 133/152 2024-04-22T07:18:33.763 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:18:33.763 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-22T07:18:33.763 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-22T07:18:33.763 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-22T07:18:33.764 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:18:33.806 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3156.g86f75 134/152 2024-04-22T07:18:33.830 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3156.g86f75 134/152 2024-04-22T07:18:33.830 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:18:33.830 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-22T07:18:33.830 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:18:33.860 INFO:teuthology.orchestra.run.smithi062.stdout:(92/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 715 kB/s | 5.1 MB 00:07 2024-04-22T07:18:33.882 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 135/152 2024-04-22T07:18:33.885 INFO:teuthology.orchestra.run.smithi062.stdout:(93/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 66 kB/s | 44 kB 00:00 2024-04-22T07:18:33.906 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 135/152 2024-04-22T07:18:33.906 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:18:33.906 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-22T07:18:33.906 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-22T07:18:33.906 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-22T07:18:33.906 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:18:34.233 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 136/152 2024-04-22T07:18:34.257 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 136/152 2024-04-22T07:18:34.257 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:18:34.257 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-22T07:18:34.257 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-22T07:18:34.257 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-22T07:18:34.258 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:18:34.494 INFO:teuthology.orchestra.run.smithi062.stdout:(94/150): qatlib-service-24.02.0-1.el9.x86_64.r 59 kB/s | 36 kB 00:00 2024-04-22T07:18:34.711 INFO:teuthology.orchestra.run.smithi062.stdout:(95/150): qatlib-24.02.0-1.el9.x86_64.rpm 260 kB/s | 221 kB 00:00 2024-04-22T07:18:35.128 INFO:teuthology.orchestra.run.smithi062.stdout:(96/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 75 kB/s | 47 kB 00:00 2024-04-22T07:18:35.736 INFO:teuthology.orchestra.run.smithi062.stdout:(97/150): socat-1.7.4.1-5.el9.x86_64.rpm 297 kB/s | 305 kB 00:01 2024-04-22T07:18:35.786 INFO:teuthology.orchestra.run.smithi062.stdout:(98/150): uuid-1.6.2-55.el9.x86_64.rpm 88 kB/s | 58 kB 00:00 2024-04-22T07:18:36.445 INFO:teuthology.orchestra.run.smithi062.stdout:(99/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 97 kB/s | 64 kB 00:00 2024-04-22T07:18:36.470 INFO:teuthology.orchestra.run.smithi062.stdout:(100/150): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 128 kB/s | 94 kB 00:00 2024-04-22T07:18:36.571 INFO:teuthology.orchestra.run.smithi062.stdout:(101/150): lua-devel-5.4.4-4.el9.x86_64.rpm 223 kB/s | 22 kB 00:00 2024-04-22T07:18:36.813 INFO:teuthology.orchestra.run.smithi062.stdout:(102/150): protobuf-compiler-3.14.0-13.el9.x86_ 3.5 MB/s | 863 kB 00:00 2024-04-22T07:18:37.071 INFO:teuthology.orchestra.run.smithi062.stdout:(103/150): abseil-cpp-20211102.0-3.el9.x86_64.r 2.1 MB/s | 548 kB 00:00 2024-04-22T07:18:37.096 INFO:teuthology.orchestra.run.smithi062.stdout:(104/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 69 kB/s | 45 kB 00:00 2024-04-22T07:18:37.130 INFO:teuthology.orchestra.run.smithi062.stdout:(105/150): gperftools-libs-2.9.1-2.el9.x86_64.r 5.3 MB/s | 309 kB 00:00 2024-04-22T07:18:37.214 INFO:teuthology.orchestra.run.smithi062.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 166 kB/s | 19 kB 00:00 2024-04-22T07:18:37.264 INFO:teuthology.orchestra.run.smithi062.stdout:(107/150): libarrow-doc-9.0.0-10.el9.noarch.rpm 519 kB/s | 26 kB 00:00 2024-04-22T07:18:37.322 INFO:teuthology.orchestra.run.smithi062.stdout:(108/150): liboath-2.6.7-2.el9.x86_64.rpm 838 kB/s | 49 kB 00:00 2024-04-22T07:18:37.381 INFO:teuthology.orchestra.run.smithi062.stdout:(109/150): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-04-22T07:18:37.440 INFO:teuthology.orchestra.run.smithi062.stdout:(110/150): libarrow-9.0.0-10.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-04-22T07:18:37.498 INFO:teuthology.orchestra.run.smithi062.stdout:(111/150): luarocks-3.9.2-1.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2024-04-22T07:18:37.533 INFO:teuthology.orchestra.run.smithi062.stdout:(112/150): parquet-libs-9.0.0-10.el9.x86_64.rpm 8.9 MB/s | 838 kB 00:00 2024-04-22T07:18:37.582 INFO:teuthology.orchestra.run.smithi062.stdout:(113/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 869 kB/s | 43 kB 00:00 2024-04-22T07:18:37.616 INFO:teuthology.orchestra.run.smithi062.stdout:(114/150): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2024-04-22T07:18:37.641 INFO:teuthology.orchestra.run.smithi062.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 552 kB/s | 32 kB 00:00 2024-04-22T07:18:37.675 INFO:teuthology.orchestra.run.smithi062.stdout:(116/150): python3-certifi-2021.10.8-2.el9.noar 257 kB/s | 15 kB 00:00 2024-04-22T07:18:37.700 INFO:teuthology.orchestra.run.smithi062.stdout:(117/150): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-04-22T07:18:37.742 INFO:teuthology.orchestra.run.smithi062.stdout:(118/150): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-04-22T07:18:37.776 INFO:teuthology.orchestra.run.smithi062.stdout:(119/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-04-22T07:18:37.801 INFO:teuthology.orchestra.run.smithi062.stdout:(120/150): python3-colorama-0.4.4-12.el9.noarch 605 kB/s | 35 kB 00:00 2024-04-22T07:18:37.834 INFO:teuthology.orchestra.run.smithi062.stdout:(121/150): python3-google-auth-2.28.2-1.el9.noa 3.4 MB/s | 203 kB 00:00 2024-04-22T07:18:37.893 INFO:teuthology.orchestra.run.smithi062.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-04-22T07:18:37.952 INFO:teuthology.orchestra.run.smithi062.stdout:(123/150): python3-grpcio-1.46.7-10.el9.x86_64. 14 MB/s | 2.0 MB 00:00 2024-04-22T07:18:37.977 INFO:teuthology.orchestra.run.smithi062.stdout:(124/150): python3-jaraco-8.2.1-3.el9.noarch.rp 128 kB/s | 11 kB 00:00 2024-04-22T07:18:38.010 INFO:teuthology.orchestra.run.smithi062.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 302 kB/s | 18 kB 00:00 2024-04-22T07:18:38.036 INFO:teuthology.orchestra.run.smithi062.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 394 kB/s | 23 kB 00:00 2024-04-22T07:18:38.070 INFO:teuthology.orchestra.run.smithi062.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 333 kB/s | 19 kB 00:00 2024-04-22T07:18:38.095 INFO:teuthology.orchestra.run.smithi062.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 336 kB/s | 20 kB 00:00 2024-04-22T07:18:38.153 INFO:teuthology.orchestra.run.smithi062.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 797 kB/s | 46 kB 00:00 2024-04-22T07:18:38.187 INFO:teuthology.orchestra.run.smithi062.stdout:(130/150): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-04-22T07:18:38.221 INFO:teuthology.orchestra.run.smithi062.stdout:(131/150): python3-more-itertools-8.12.0-2.el9. 1.1 MB/s | 79 kB 00:00 2024-04-22T07:18:38.246 INFO:teuthology.orchestra.run.smithi062.stdout:(132/150): python3-natsort-7.1.1-5.el9.noarch.r 986 kB/s | 58 kB 00:00 2024-04-22T07:18:38.288 INFO:teuthology.orchestra.run.smithi062.stdout:(133/150): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-04-22T07:18:38.313 INFO:teuthology.orchestra.run.smithi062.stdout:(134/150): python3-portend-3.1.0-2.el9.noarch.r 245 kB/s | 16 kB 00:00 2024-04-22T07:18:38.347 INFO:teuthology.orchestra.run.smithi062.stdout:(135/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-04-22T07:18:38.372 INFO:teuthology.orchestra.run.smithi062.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 481 kB/s | 28 kB 00:00 2024-04-22T07:18:38.406 INFO:teuthology.orchestra.run.smithi062.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 526 kB/s | 31 kB 00:00 2024-04-22T07:18:38.431 INFO:teuthology.orchestra.run.smithi062.stdout:(138/150): python3-routes-2.5.1-5.el9.noarch.rp 3.2 MB/s | 188 kB 00:00 2024-04-22T07:18:38.464 INFO:teuthology.orchestra.run.smithi062.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-04-22T07:18:38.490 INFO:teuthology.orchestra.run.smithi062.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 610 kB/s | 36 kB 00:00 2024-04-22T07:18:38.523 INFO:teuthology.orchestra.run.smithi062.stdout:(141/150): python3-typing-extensions-4.4.0-2.el 871 kB/s | 51 kB 00:00 2024-04-22T07:18:38.549 INFO:teuthology.orchestra.run.smithi062.stdout:(142/150): python3-webob-1.8.7-6.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-04-22T07:18:38.582 INFO:teuthology.orchestra.run.smithi062.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-04-22T07:18:38.608 INFO:teuthology.orchestra.run.smithi062.stdout:(144/150): python3-werkzeug-2.0.3-3.el9.1.noarc 7.1 MB/s | 427 kB 00:00 2024-04-22T07:18:38.641 INFO:teuthology.orchestra.run.smithi062.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2024-04-22T07:18:38.666 INFO:teuthology.orchestra.run.smithi062.stdout:(146/150): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-04-22T07:18:38.750 INFO:teuthology.orchestra.run.smithi062.stdout:(147/150): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-04-22T07:18:38.984 INFO:teuthology.orchestra.run.smithi062.stdout:(148/150): librados2-19.0.0-3156.g86f7587a.el9. 11 MB/s | 3.4 MB 00:00 2024-04-22T07:18:39.084 INFO:teuthology.orchestra.run.smithi062.stdout:(149/150): librbd1-19.0.0-3156.g86f7587a.el9.x8 9.4 MB/s | 3.1 MB 00:00 2024-04-22T07:18:39.120 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-test-2:19.0.0-3156.g86f7587a.el9.x86_64 137/152 2024-04-22T07:18:39.161 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 138/152 2024-04-22T07:18:39.203 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-nbd-2:19.0.0-3156.g86f7587a.el9.x86_64 139/152 2024-04-22T07:18:39.234 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 140/152 2024-04-22T07:18:39.253 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 141/152 2024-04-22T07:18:39.448 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-shell-2:19.0.0-3156.g86f7587a.el9.x86_64 142/152 2024-04-22T07:18:39.499 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-04-22T07:18:39.528 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs-devel-2:19.0.0-3156.g86f7587a.el9.x86_ 144/152 2024-04-22T07:18:40.194 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-22T07:18:40.243 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-22T07:18:40.264 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-22T07:18:41.137 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-top-2:19.0.0-3156.g86f7587a.el9.noarch 146/152 2024-04-22T07:18:41.222 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 147/152 2024-04-22T07:18:41.265 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-04-22T07:18:41.362 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-04-22T07:18:41.394 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-04-22T07:18:41.394 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-22T07:18:41.486 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-22T07:18:41.486 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-22T07:18:47.431 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-22T07:18:47.431 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-2:19.0.0-3156.g86f7587a.el9.x86_64 1/152 2024-04-22T07:18:47.431 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-base-2:19.0.0-3156.g86f7587a.el9.x86_64 2/152 2024-04-22T07:18:47.431 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 3/152 2024-04-22T07:18:47.432 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 4/152 2024-04-22T07:18:47.432 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3156.g86f75 5/152 2024-04-22T07:18:47.432 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mds-2:19.0.0-3156.g86f7587a.el9.x86_64 6/152 2024-04-22T07:18:47.432 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-2:19.0.0-3156.g86f7587a.el9.x86_64 7/152 2024-04-22T07:18:47.432 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mon-2:19.0.0-3156.g86f7587a.el9.x86_64 8/152 2024-04-22T07:18:47.432 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-osd-2:19.0.0-3156.g86f7587a.el9.x86_64 9/152 2024-04-22T07:18:47.432 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-radosgw-2:19.0.0-3156.g86f7587a.el9.x86_64 10/152 2024-04-22T07:18:47.432 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-selinux-2:19.0.0-3156.g86f7587a.el9.x86_64 11/152 2024-04-22T07:18:47.432 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-test-2:19.0.0-3156.g86f7587a.el9.x86_64 12/152 2024-04-22T07:18:47.432 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 13/152 2024-04-22T07:18:47.432 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-shell-2:19.0.0-3156.g86f7587a.el9.x86_64 14/152 2024-04-22T07:18:47.432 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs-devel-2:19.0.0-3156.g86f7587a.el9.x86_ 15/152 2024-04-22T07:18:47.432 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs2-2:19.0.0-3156.g86f7587a.el9.x86_64 16/152 2024-04-22T07:18:47.433 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephsqlite-2:19.0.0-3156.g86f7587a.el9.x86_64 17/152 2024-04-22T07:18:47.433 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados-devel-2:19.0.0-3156.g86f7587a.el9.x86_6 18/152 2024-04-22T07:18:47.433 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libradosstriper1-2:19.0.0-3156.g86f7587a.el9.x86 19/152 2024-04-22T07:18:47.433 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librgw2-2:19.0.0-3156.g86f7587a.el9.x86_64 20/152 2024-04-22T07:18:47.433 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3156.g86f7587a.el 21/152 2024-04-22T07:18:47.433 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-common-2:19.0.0-3156.g86f7587a.el9. 22/152 2024-04-22T07:18:47.433 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cephfs-2:19.0.0-3156.g86f7587a.el9.x86_6 23/152 2024-04-22T07:18:47.433 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rados-2:19.0.0-3156.g86f7587a.el9.x86_64 24/152 2024-04-22T07:18:47.433 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rbd-2:19.0.0-3156.g86f7587a.el9.x86_64 25/152 2024-04-22T07:18:47.433 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rgw-2:19.0.0-3156.g86f7587a.el9.x86_64 26/152 2024-04-22T07:18:47.433 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 27/152 2024-04-22T07:18:47.433 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 28/152 2024-04-22T07:18:47.433 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-nbd-2:19.0.0-3156.g86f7587a.el9.x86_64 29/152 2024-04-22T07:18:47.434 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3156.g86f7587a. 30/152 2024-04-22T07:18:47.445 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3156.g86f7587a.el9.noa 31/152 2024-04-22T07:18:47.445 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3156.g86f7587a.el9.n 32/152 2024-04-22T07:18:47.445 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3156.g86f 33/152 2024-04-22T07:18:47.445 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3156.g86f7587a.el 34/152 2024-04-22T07:18:47.446 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3156.g86f7587a.el9.noarch 35/152 2024-04-22T07:18:47.446 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3156.g86f7587a.e 36/152 2024-04-22T07:18:47.446 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-volume-2:19.0.0-3156.g86f7587a.el9.noarch 37/152 2024-04-22T07:18:47.446 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 38/152 2024-04-22T07:18:47.446 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-top-2:19.0.0-3156.g86f7587a.el9.noarch 39/152 2024-04-22T07:18:47.446 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/152 2024-04-22T07:18:47.446 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-04-22T07:18:47.446 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-04-22T07:18:47.446 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-04-22T07:18:47.446 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-04-22T07:18:47.446 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-04-22T07:18:47.446 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-04-22T07:18:47.447 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-04-22T07:18:47.447 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/152 2024-04-22T07:18:47.447 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-04-22T07:18:47.447 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-04-22T07:18:47.447 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-04-22T07:18:47.447 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/152 2024-04-22T07:18:47.447 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-04-22T07:18:47.447 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-04-22T07:18:47.447 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-04-22T07:18:47.448 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-04-22T07:18:47.448 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-04-22T07:18:47.448 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-04-22T07:18:47.448 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-04-22T07:18:47.448 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-04-22T07:18:47.448 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/152 2024-04-22T07:18:47.448 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-04-22T07:18:47.448 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-04-22T07:18:47.448 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-04-22T07:18:47.448 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-04-22T07:18:47.448 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-04-22T07:18:47.448 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-04-22T07:18:47.449 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 68/152 2024-04-22T07:18:47.449 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-04-22T07:18:47.449 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-04-22T07:18:47.449 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-04-22T07:18:47.449 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-04-22T07:18:47.449 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-04-22T07:18:47.449 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-04-22T07:18:47.449 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-04-22T07:18:47.449 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/152 2024-04-22T07:18:47.449 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/152 2024-04-22T07:18:47.449 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/152 2024-04-22T07:18:47.449 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/152 2024-04-22T07:18:47.449 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/152 2024-04-22T07:18:47.449 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/152 2024-04-22T07:18:47.450 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/152 2024-04-22T07:18:47.450 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/152 2024-04-22T07:18:47.450 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/152 2024-04-22T07:18:47.450 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/152 2024-04-22T07:18:47.450 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/152 2024-04-22T07:18:47.450 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/152 2024-04-22T07:18:47.450 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/152 2024-04-22T07:18:47.450 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/152 2024-04-22T07:18:47.450 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/152 2024-04-22T07:18:47.450 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/152 2024-04-22T07:18:47.450 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/152 2024-04-22T07:18:47.450 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/152 2024-04-22T07:18:47.451 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/152 2024-04-22T07:18:47.451 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/152 2024-04-22T07:18:47.451 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/152 2024-04-22T07:18:47.451 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/152 2024-04-22T07:18:47.451 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/152 2024-04-22T07:18:47.451 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/152 2024-04-22T07:18:47.451 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/152 2024-04-22T07:18:47.451 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/152 2024-04-22T07:18:47.451 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/152 2024-04-22T07:18:47.451 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/152 2024-04-22T07:18:47.451 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/152 2024-04-22T07:18:47.451 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/152 2024-04-22T07:18:47.451 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/152 2024-04-22T07:18:47.451 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/152 2024-04-22T07:18:47.451 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/152 2024-04-22T07:18:47.452 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/152 2024-04-22T07:18:47.452 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/152 2024-04-22T07:18:47.452 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/152 2024-04-22T07:18:47.452 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/152 2024-04-22T07:18:47.452 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/152 2024-04-22T07:18:47.452 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/152 2024-04-22T07:18:47.452 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/152 2024-04-22T07:18:47.452 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/152 2024-04-22T07:18:47.452 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/152 2024-04-22T07:18:47.452 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/152 2024-04-22T07:18:47.452 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/152 2024-04-22T07:18:47.452 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/152 2024-04-22T07:18:47.452 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/152 2024-04-22T07:18:47.452 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 122/152 2024-04-22T07:18:47.452 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-04-22T07:18:47.453 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-04-22T07:18:47.453 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-04-22T07:18:47.453 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-04-22T07:18:47.453 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-04-22T07:18:47.453 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-04-22T07:18:47.453 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-04-22T07:18:47.453 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-04-22T07:18:47.453 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-04-22T07:18:47.453 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-04-22T07:18:47.453 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-04-22T07:18:47.453 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-04-22T07:18:47.453 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-04-22T07:18:47.453 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-04-22T07:18:47.453 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-04-22T07:18:47.454 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-04-22T07:18:47.454 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-04-22T07:18:47.454 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-04-22T07:18:47.454 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-04-22T07:18:47.454 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/152 2024-04-22T07:18:47.454 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-04-22T07:18:47.454 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-04-22T07:18:47.454 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-04-22T07:18:47.454 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-04-22T07:18:47.454 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-04-22T07:18:47.454 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-04-22T07:18:47.454 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:19.0.0-3156.g86f7587a.el9.x86_64 149/152 2024-04-22T07:18:47.454 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-04-22T07:18:47.455 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:19.0.0-3156.g86f7587a.el9.x86_64 151/152 2024-04-22T07:18:49.555 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-04-22T07:18:49.555 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:18:49.556 INFO:teuthology.orchestra.run.smithi040.stdout:Upgraded: 2024-04-22T07:18:49.556 INFO:teuthology.orchestra.run.smithi040.stdout: librados2-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.556 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.556 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-04-22T07:18:49.556 INFO:teuthology.orchestra.run.smithi040.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-22T07:18:49.556 INFO:teuthology.orchestra.run.smithi040.stdout: automake-1.16.2-8.el9.noarch 2024-04-22T07:18:49.556 INFO:teuthology.orchestra.run.smithi040.stdout: bison-3.7.4-5.el9.x86_64 2024-04-22T07:18:49.556 INFO:teuthology.orchestra.run.smithi040.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-22T07:18:49.556 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.556 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.556 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.556 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.556 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:18:49.556 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.557 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.557 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.557 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:18:49.557 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:18:49.557 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:18:49.557 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:18:49.557 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:18:49.557 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.557 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.557 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:18:49.557 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.557 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.557 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.557 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-volume-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:18:49.558 INFO:teuthology.orchestra.run.smithi040.stdout: cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:18:49.558 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.558 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-shell-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.558 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-top-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:18:49.558 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-22T07:18:49.558 INFO:teuthology.orchestra.run.smithi040.stdout: flex-2.6.4-9.el9.x86_64 2024-04-22T07:18:49.558 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-22T07:18:49.558 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-22T07:18:49.558 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-22T07:18:49.558 INFO:teuthology.orchestra.run.smithi040.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-22T07:18:49.558 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-22T07:18:49.558 INFO:teuthology.orchestra.run.smithi040.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-22T07:18:49.559 INFO:teuthology.orchestra.run.smithi040.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-22T07:18:49.559 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-22T07:18:49.559 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-22T07:18:49.559 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.559 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.559 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.559 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-22T07:18:49.559 INFO:teuthology.orchestra.run.smithi040.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-22T07:18:49.559 INFO:teuthology.orchestra.run.smithi040.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-22T07:18:49.559 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-22T07:18:49.559 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-22T07:18:49.559 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.559 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.560 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-22T07:18:49.560 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.560 INFO:teuthology.orchestra.run.smithi040.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-22T07:18:49.560 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-22T07:18:49.560 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-22T07:18:49.560 INFO:teuthology.orchestra.run.smithi040.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-22T07:18:49.560 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-22T07:18:49.560 INFO:teuthology.orchestra.run.smithi040.stdout: lua-5.4.4-4.el9.x86_64 2024-04-22T07:18:49.560 INFO:teuthology.orchestra.run.smithi040.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-22T07:18:49.560 INFO:teuthology.orchestra.run.smithi040.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-22T07:18:49.560 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-22T07:18:49.560 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-22T07:18:49.560 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-22T07:18:49.560 INFO:teuthology.orchestra.run.smithi040.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-22T07:18:49.561 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-13.14-1.el9.x86_64 2024-04-22T07:18:49.561 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-22T07:18:49.561 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-22T07:18:49.561 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-22T07:18:49.561 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-22T07:18:49.561 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-22T07:18:49.561 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-22T07:18:49.561 INFO:teuthology.orchestra.run.smithi040.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-22T07:18:49.561 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-22T07:18:49.561 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-22T07:18:49.561 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-22T07:18:49.561 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.561 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.561 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.562 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-22T07:18:49.562 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-22T07:18:49.562 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-22T07:18:49.562 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-22T07:18:49.562 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-22T07:18:49.562 INFO:teuthology.orchestra.run.smithi040.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-22T07:18:49.562 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-22T07:18:49.562 INFO:teuthology.orchestra.run.smithi040.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-22T07:18:49.562 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-22T07:18:49.562 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-22T07:18:49.562 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-22T07:18:49.562 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-22T07:18:49.562 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-22T07:18:49.562 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-22T07:18:49.563 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-22T07:18:49.563 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-22T07:18:49.563 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-22T07:18:49.563 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-22T07:18:49.563 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-22T07:18:49.563 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-22T07:18:49.563 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-22T07:18:49.563 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-22T07:18:49.563 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-22T07:18:49.563 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-22T07:18:49.563 INFO:teuthology.orchestra.run.smithi040.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-22T07:18:49.563 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-22T07:18:49.563 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-22T07:18:49.563 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-22T07:18:49.564 INFO:teuthology.orchestra.run.smithi040.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-22T07:18:49.564 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-22T07:18:49.564 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ply-3.11-14.el9.noarch 2024-04-22T07:18:49.564 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-22T07:18:49.564 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-22T07:18:49.564 INFO:teuthology.orchestra.run.smithi040.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-22T07:18:49.564 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-22T07:18:49.564 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-22T07:18:49.564 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-22T07:18:49.564 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-22T07:18:49.564 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-22T07:18:49.564 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-22T07:18:49.564 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.564 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.565 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-22T07:18:49.565 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-22T07:18:49.565 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-22T07:18:49.565 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.565 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-22T07:18:49.565 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-22T07:18:49.565 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-22T07:18:49.565 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-22T07:18:49.565 INFO:teuthology.orchestra.run.smithi040.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-22T07:18:49.565 INFO:teuthology.orchestra.run.smithi040.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-22T07:18:49.565 INFO:teuthology.orchestra.run.smithi040.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-22T07:18:49.565 INFO:teuthology.orchestra.run.smithi040.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-22T07:18:49.565 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-22T07:18:49.565 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-22T07:18:49.565 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-22T07:18:49.566 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-22T07:18:49.566 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-22T07:18:49.566 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-22T07:18:49.566 INFO:teuthology.orchestra.run.smithi040.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-22T07:18:49.566 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.566 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.566 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:18:49.566 INFO:teuthology.orchestra.run.smithi040.stdout: re2-1:20211101-3.el9.x86_64 2024-04-22T07:18:49.566 INFO:teuthology.orchestra.run.smithi040.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-22T07:18:49.566 INFO:teuthology.orchestra.run.smithi040.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-22T07:18:49.566 INFO:teuthology.orchestra.run.smithi040.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-22T07:18:49.566 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-22T07:18:49.566 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-22T07:18:49.567 INFO:teuthology.orchestra.run.smithi040.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-22T07:18:49.567 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:18:49.567 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-04-22T07:18:49.916 DEBUG:teuthology.parallel:result is None 2024-04-22T07:18:52.758 INFO:teuthology.orchestra.run.smithi062.stdout:(150/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 806 kB/s | 16 MB 00:20 2024-04-22T07:18:52.762 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-22T07:18:52.762 INFO:teuthology.orchestra.run.smithi062.stdout:Total 4.0 MB/s | 218 MB 00:54 2024-04-22T07:18:53.850 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-22T07:18:53.992 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-22T07:18:53.992 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-22T07:18:55.820 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-22T07:18:55.821 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-22T07:19:01.876 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-22T07:19:01.952 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-04-22T07:19:01.977 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-04-22T07:19:02.022 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-04-22T07:19:02.367 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-04-22T07:19:02.469 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librados2-2:19.0.0-3156.g86f7587a.el9.x86_64 5/152 2024-04-22T07:19:02.594 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:19.0.0-3156.g86f7587a.el9.x86_64 5/152 2024-04-22T07:19:02.620 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs2-2:19.0.0-3156.g86f7587a.el9.x86_64 6/152 2024-04-22T07:19:02.696 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephfs2-2:19.0.0-3156.g86f7587a.el9.x86_64 6/152 2024-04-22T07:19:02.738 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rados-2:19.0.0-3156.g86f7587a.el9.x86_64 7/152 2024-04-22T07:19:02.767 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-04-22T07:19:02.800 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-04-22T07:19:02.970 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-04-22T07:19:03.031 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-04-22T07:19:03.067 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephsqlite-2:19.0.0-3156.g86f7587a.el9.x86_64 12/152 2024-04-22T07:19:03.172 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3156.g86f7587a.el9.x86_64 12/152 2024-04-22T07:19:03.201 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libradosstriper1-2:19.0.0-3156.g86f7587a.el9.x86 13/152 2024-04-22T07:19:03.264 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3156.g86f7587a.el9.x86 13/152 2024-04-22T07:19:03.294 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-22T07:19:03.318 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-22T07:19:03.554 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-22T07:19:03.586 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-22T07:19:03.706 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-04-22T07:19:03.815 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 17/152 2024-04-22T07:19:03.851 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-04-22T07:19:03.887 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-04-22T07:19:03.964 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-04-22T07:19:04.028 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-04-22T07:19:04.080 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-04-22T07:19:04.129 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-04-22T07:19:04.156 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-04-22T07:19:04.231 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-04-22T07:19:04.290 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/152 2024-04-22T07:19:04.318 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-04-22T07:19:04.370 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 28/152 2024-04-22T07:19:04.450 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 29/152 2024-04-22T07:19:04.480 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-common-2:19.0.0-3156.g86f7587a.el9. 30/152 2024-04-22T07:19:04.525 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-argparse-2:19.0.0-3156.g86f7587a.el 31/152 2024-04-22T07:19:04.561 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cephfs-2:19.0.0-3156.g86f7587a.el9.x86_6 32/152 2024-04-22T07:19:04.638 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-04-22T07:19:04.694 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : luarocks-3.9.2-1.el9.noarch 34/152 2024-04-22T07:19:04.772 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-04-22T07:19:04.923 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-04-22T07:19:04.981 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-04-22T07:19:05.563 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-04-22T07:19:05.653 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-04-22T07:19:05.686 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 40/152 2024-04-22T07:19:05.729 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-04-22T07:19:05.775 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librados-devel-2:19.0.0-3156.g86f7587a.el9.x86_6 42/152 2024-04-22T07:19:05.808 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-04-22T07:19:05.866 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-04-22T07:19:05.941 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/152 2024-04-22T07:19:05.984 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/152 2024-04-22T07:19:06.021 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/152 2024-04-22T07:19:06.070 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/152 2024-04-22T07:19:06.103 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/152 2024-04-22T07:19:06.148 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/152 2024-04-22T07:19:06.198 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/152 2024-04-22T07:19:06.354 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/152 2024-04-22T07:19:06.403 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/152 2024-04-22T07:19:06.433 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/152 2024-04-22T07:19:06.475 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/152 2024-04-22T07:19:06.576 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-04-22T07:19:06.607 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 57/152 2024-04-22T07:19:06.648 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-04-22T07:19:06.681 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-04-22T07:19:06.706 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/152 2024-04-22T07:19:06.795 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-04-22T07:19:06.933 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-04-22T07:19:06.972 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-04-22T07:19:06.999 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-04-22T07:19:07.034 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-04-22T07:19:07.079 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-04-22T07:19:07.117 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 67/152 2024-04-22T07:19:07.156 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-04-22T07:19:07.186 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-04-22T07:19:07.250 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-04-22T07:19:07.286 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-04-22T07:19:07.329 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-04-22T07:19:07.362 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-04-22T07:19:07.455 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-04-22T07:19:07.503 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-04-22T07:19:07.532 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-04-22T07:19:07.581 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-04-22T07:19:07.695 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-packaging-20.9-5.el9.noarch 78/152 2024-04-22T07:19:07.761 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/152 2024-04-22T07:19:08.569 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/152 2024-04-22T07:19:08.623 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/152 2024-04-22T07:19:08.656 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/152 2024-04-22T07:19:08.766 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/152 2024-04-22T07:19:08.824 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 84/152 2024-04-22T07:19:08.917 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-04-22T07:19:08.970 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-04-22T07:19:09.152 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-04-22T07:19:09.181 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-04-22T07:19:09.261 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-04-22T07:19:09.969 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-04-22T07:19:10.086 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-04-22T07:19:11.445 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-04-22T07:19:11.534 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-04-22T07:19:11.562 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-04-22T07:19:11.595 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-04-22T07:19:11.924 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-04-22T07:19:11.966 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librbd1-2:19.0.0-3156.g86f7587a.el9.x86_64 97/152 2024-04-22T07:19:12.057 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:19.0.0-3156.g86f7587a.el9.x86_64 97/152 2024-04-22T07:19:12.087 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rbd-2:19.0.0-3156.g86f7587a.el9.x86_64 98/152 2024-04-22T07:19:12.124 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-04-22T07:19:12.629 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 100/152 2024-04-22T07:19:12.660 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librgw2-2:19.0.0-3156.g86f7587a.el9.x86_64 101/152 2024-04-22T07:19:12.716 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librgw2-2:19.0.0-3156.g86f7587a.el9.x86_64 101/152 2024-04-22T07:19:12.745 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rgw-2:19.0.0-3156.g86f7587a.el9.x86_64 102/152 2024-04-22T07:19:15.095 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 103/152 2024-04-22T07:19:15.133 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 103/152 2024-04-22T07:19:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 103/152 2024-04-22T07:19:15.745 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-base-2:19.0.0-3156.g86f7587a.el9.x86_64 104/152 2024-04-22T07:19:15.837 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-base-2:19.0.0-3156.g86f7587a.el9.x86_64 104/152 2024-04-22T07:19:15.838 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-22T07:19:15.838 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-22T07:19:15.838 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:15.871 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-selinux-2:19.0.0-3156.g86f7587a.el9.x86_64 105/152 2024-04-22T07:19:27.893 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3156.g86f7587a.el9.x86_64 105/152 2024-04-22T07:19:27.893 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /sys 2024-04-22T07:19:27.893 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /proc 2024-04-22T07:19:27.893 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /mnt 2024-04-22T07:19:27.893 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /var/tmp 2024-04-22T07:19:27.893 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /home 2024-04-22T07:19:27.893 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /root 2024-04-22T07:19:27.893 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /tmp 2024-04-22T07:19:27.893 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:28.081 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-volume-2:19.0.0-3156.g86f7587a.el9.noarch 106/152 2024-04-22T07:19:28.098 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-volume-2:19.0.0-3156.g86f7587a.el9.noarch 106/152 2024-04-22T07:19:28.098 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:19:28.098 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-22T07:19:28.098 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:29.634 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-osd-2:19.0.0-3156.g86f7587a.el9.x86_64 107/152 2024-04-22T07:19:29.661 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-osd-2:19.0.0-3156.g86f7587a.el9.x86_64 107/152 2024-04-22T07:19:29.661 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:19:29.661 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-22T07:19:29.661 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-22T07:19:29.661 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-22T07:19:29.662 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:29.893 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mds-2:19.0.0-3156.g86f7587a.el9.x86_64 108/152 2024-04-22T07:19:29.917 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mds-2:19.0.0-3156.g86f7587a.el9.x86_64 108/152 2024-04-22T07:19:29.917 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:19:29.917 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-22T07:19:29.917 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-22T07:19:29.917 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-22T07:19:29.917 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:30.386 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mon-2:19.0.0-3156.g86f7587a.el9.x86_64 109/152 2024-04-22T07:19:30.410 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mon-2:19.0.0-3156.g86f7587a.el9.x86_64 109/152 2024-04-22T07:19:30.410 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:19:30.410 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-22T07:19:30.410 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-22T07:19:30.410 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-22T07:19:30.410 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:30.516 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-04-22T07:19:30.575 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-04-22T07:19:30.638 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-04-22T07:19:30.836 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-04-22T07:19:30.886 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-04-22T07:19:30.967 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-04-22T07:19:31.058 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-04-22T07:19:31.202 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-04-22T07:19:31.245 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-04-22T07:19:31.285 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-04-22T07:19:31.312 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : fuse-2.9.9-15.el9.x86_64 120/152 2024-04-22T07:19:31.775 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 121/152 2024-04-22T07:19:31.802 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 121/152 2024-04-22T07:19:31.835 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3156.g86f7587a.e 122/152 2024-04-22T07:19:31.899 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3156.g86f7587a. 123/152 2024-04-22T07:19:31.925 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3156.g86f7587a.el9.noa 124/152 2024-04-22T07:19:33.026 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3156.g86f7587a.el9.noa 124/152 2024-04-22T07:19:33.060 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3156.g86f7587a.el9.n 125/152 2024-04-22T07:19:34.077 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3156.g86f7587a.el9.n 125/152 2024-04-22T07:19:34.102 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3156.g86f 126/152 2024-04-22T07:19:34.212 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3156.g86f 126/152 2024-04-22T07:19:34.381 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3156.g86f7587a.el 127/152 2024-04-22T07:19:34.412 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-2:19.0.0-3156.g86f7587a.el9.x86_64 128/152 2024-04-22T07:19:34.437 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3156.g86f7587a.el9.x86_64 128/152 2024-04-22T07:19:34.437 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:19:34.437 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-22T07:19:34.437 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-22T07:19:34.437 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-22T07:19:34.438 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:34.488 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-rook-2:19.0.0-3156.g86f7587a.el9.noarch 129/152 2024-04-22T07:19:34.499 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3156.g86f7587a.el9.noarch 129/152 2024-04-22T07:19:34.601 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-2:19.0.0-3156.g86f7587a.el9.x86_64 130/152 2024-04-22T07:19:34.658 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 131/152 2024-04-22T07:19:35.631 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libtool-2.4.6-45.el9.x86_64 132/152 2024-04-22T07:19:35.665 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-radosgw-2:19.0.0-3156.g86f7587a.el9.x86_64 133/152 2024-04-22T07:19:35.690 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3156.g86f7587a.el9.x86_64 133/152 2024-04-22T07:19:35.690 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:19:35.690 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-22T07:19:35.690 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-22T07:19:35.690 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-22T07:19:35.690 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:35.732 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3156.g86f75 134/152 2024-04-22T07:19:35.756 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3156.g86f75 134/152 2024-04-22T07:19:35.756 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:19:35.756 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-22T07:19:35.756 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:35.808 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephfs-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 135/152 2024-04-22T07:19:35.832 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 135/152 2024-04-22T07:19:35.832 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:19:35.832 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-22T07:19:35.832 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-22T07:19:35.832 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-22T07:19:35.832 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:36.150 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 136/152 2024-04-22T07:19:36.174 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 136/152 2024-04-22T07:19:36.174 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-22T07:19:36.174 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-22T07:19:36.174 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-22T07:19:36.174 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-22T07:19:36.174 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:41.038 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-test-2:19.0.0-3156.g86f7587a.el9.x86_64 137/152 2024-04-22T07:19:41.079 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 138/152 2024-04-22T07:19:41.121 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-nbd-2:19.0.0-3156.g86f7587a.el9.x86_64 139/152 2024-04-22T07:19:41.151 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 140/152 2024-04-22T07:19:41.179 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 141/152 2024-04-22T07:19:41.382 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephfs-shell-2:19.0.0-3156.g86f7587a.el9.x86_64 142/152 2024-04-22T07:19:41.425 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-04-22T07:19:41.454 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs-devel-2:19.0.0-3156.g86f7587a.el9.x86_ 144/152 2024-04-22T07:19:42.090 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-22T07:19:42.143 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-22T07:19:42.163 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-22T07:19:43.026 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephfs-top-2:19.0.0-3156.g86f7587a.el9.noarch 146/152 2024-04-22T07:19:43.106 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 147/152 2024-04-22T07:19:43.148 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-04-22T07:19:43.242 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-04-22T07:19:43.276 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-04-22T07:19:43.276 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-22T07:19:43.360 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-22T07:19:43.360 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-22T07:19:49.118 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-22T07:19:49.119 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-2:19.0.0-3156.g86f7587a.el9.x86_64 1/152 2024-04-22T07:19:49.119 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-base-2:19.0.0-3156.g86f7587a.el9.x86_64 2/152 2024-04-22T07:19:49.119 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 3/152 2024-04-22T07:19:49.119 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 4/152 2024-04-22T07:19:49.119 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3156.g86f75 5/152 2024-04-22T07:19:49.119 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mds-2:19.0.0-3156.g86f7587a.el9.x86_64 6/152 2024-04-22T07:19:49.119 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-2:19.0.0-3156.g86f7587a.el9.x86_64 7/152 2024-04-22T07:19:49.119 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mon-2:19.0.0-3156.g86f7587a.el9.x86_64 8/152 2024-04-22T07:19:49.119 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-osd-2:19.0.0-3156.g86f7587a.el9.x86_64 9/152 2024-04-22T07:19:49.119 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-radosgw-2:19.0.0-3156.g86f7587a.el9.x86_64 10/152 2024-04-22T07:19:49.119 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-selinux-2:19.0.0-3156.g86f7587a.el9.x86_64 11/152 2024-04-22T07:19:49.119 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-test-2:19.0.0-3156.g86f7587a.el9.x86_64 12/152 2024-04-22T07:19:49.120 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephfs-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 13/152 2024-04-22T07:19:49.120 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephfs-shell-2:19.0.0-3156.g86f7587a.el9.x86_64 14/152 2024-04-22T07:19:49.120 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs-devel-2:19.0.0-3156.g86f7587a.el9.x86_ 15/152 2024-04-22T07:19:49.120 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs2-2:19.0.0-3156.g86f7587a.el9.x86_64 16/152 2024-04-22T07:19:49.120 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephsqlite-2:19.0.0-3156.g86f7587a.el9.x86_64 17/152 2024-04-22T07:19:49.120 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados-devel-2:19.0.0-3156.g86f7587a.el9.x86_6 18/152 2024-04-22T07:19:49.120 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libradosstriper1-2:19.0.0-3156.g86f7587a.el9.x86 19/152 2024-04-22T07:19:49.120 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librgw2-2:19.0.0-3156.g86f7587a.el9.x86_64 20/152 2024-04-22T07:19:49.120 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3156.g86f7587a.el 21/152 2024-04-22T07:19:49.120 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-common-2:19.0.0-3156.g86f7587a.el9. 22/152 2024-04-22T07:19:49.120 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cephfs-2:19.0.0-3156.g86f7587a.el9.x86_6 23/152 2024-04-22T07:19:49.120 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rados-2:19.0.0-3156.g86f7587a.el9.x86_64 24/152 2024-04-22T07:19:49.120 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rbd-2:19.0.0-3156.g86f7587a.el9.x86_64 25/152 2024-04-22T07:19:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rgw-2:19.0.0-3156.g86f7587a.el9.x86_64 26/152 2024-04-22T07:19:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 27/152 2024-04-22T07:19:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 28/152 2024-04-22T07:19:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-nbd-2:19.0.0-3156.g86f7587a.el9.x86_64 29/152 2024-04-22T07:19:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3156.g86f7587a. 30/152 2024-04-22T07:19:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3156.g86f7587a.el9.noa 31/152 2024-04-22T07:19:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3156.g86f7587a.el9.n 32/152 2024-04-22T07:19:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3156.g86f 33/152 2024-04-22T07:19:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3156.g86f7587a.el 34/152 2024-04-22T07:19:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3156.g86f7587a.el9.noarch 35/152 2024-04-22T07:19:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3156.g86f7587a.e 36/152 2024-04-22T07:19:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-volume-2:19.0.0-3156.g86f7587a.el9.noarch 37/152 2024-04-22T07:19:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 38/152 2024-04-22T07:19:49.121 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephfs-top-2:19.0.0-3156.g86f7587a.el9.noarch 39/152 2024-04-22T07:19:49.122 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/152 2024-04-22T07:19:49.122 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-04-22T07:19:49.122 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-04-22T07:19:49.122 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-04-22T07:19:49.122 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-04-22T07:19:49.122 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-04-22T07:19:49.122 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-04-22T07:19:49.122 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-04-22T07:19:49.122 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/152 2024-04-22T07:19:49.122 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-04-22T07:19:49.122 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-04-22T07:19:49.122 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-04-22T07:19:49.122 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/152 2024-04-22T07:19:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-04-22T07:19:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-04-22T07:19:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-04-22T07:19:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-04-22T07:19:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-04-22T07:19:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-04-22T07:19:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-04-22T07:19:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-04-22T07:19:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/152 2024-04-22T07:19:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-04-22T07:19:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-04-22T07:19:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-04-22T07:19:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-04-22T07:19:49.123 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-04-22T07:19:49.124 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-04-22T07:19:49.124 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 68/152 2024-04-22T07:19:49.124 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-04-22T07:19:49.124 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-04-22T07:19:49.127 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-04-22T07:19:49.127 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-04-22T07:19:49.127 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-04-22T07:19:49.127 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-04-22T07:19:49.127 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-04-22T07:19:49.127 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/152 2024-04-22T07:19:49.127 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/152 2024-04-22T07:19:49.127 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/152 2024-04-22T07:19:49.127 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/152 2024-04-22T07:19:49.127 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/152 2024-04-22T07:19:49.128 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/152 2024-04-22T07:19:49.128 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/152 2024-04-22T07:19:49.128 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/152 2024-04-22T07:19:49.128 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/152 2024-04-22T07:19:49.128 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/152 2024-04-22T07:19:49.128 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/152 2024-04-22T07:19:49.128 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/152 2024-04-22T07:19:49.128 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/152 2024-04-22T07:19:49.128 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/152 2024-04-22T07:19:49.128 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/152 2024-04-22T07:19:49.128 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/152 2024-04-22T07:19:49.128 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/152 2024-04-22T07:19:49.128 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/152 2024-04-22T07:19:49.128 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/152 2024-04-22T07:19:49.129 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/152 2024-04-22T07:19:49.129 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/152 2024-04-22T07:19:49.129 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/152 2024-04-22T07:19:49.129 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/152 2024-04-22T07:19:49.129 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/152 2024-04-22T07:19:49.129 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/152 2024-04-22T07:19:49.129 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/152 2024-04-22T07:19:49.129 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/152 2024-04-22T07:19:49.129 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/152 2024-04-22T07:19:49.129 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/152 2024-04-22T07:19:49.129 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/152 2024-04-22T07:19:49.129 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/152 2024-04-22T07:19:49.129 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/152 2024-04-22T07:19:49.130 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/152 2024-04-22T07:19:49.130 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/152 2024-04-22T07:19:49.130 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/152 2024-04-22T07:19:49.130 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/152 2024-04-22T07:19:49.130 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/152 2024-04-22T07:19:49.130 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/152 2024-04-22T07:19:49.130 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/152 2024-04-22T07:19:49.130 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/152 2024-04-22T07:19:49.130 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/152 2024-04-22T07:19:49.130 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/152 2024-04-22T07:19:49.130 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/152 2024-04-22T07:19:49.130 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/152 2024-04-22T07:19:49.130 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/152 2024-04-22T07:19:49.130 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/152 2024-04-22T07:19:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 122/152 2024-04-22T07:19:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-04-22T07:19:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-04-22T07:19:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-04-22T07:19:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-04-22T07:19:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-04-22T07:19:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-04-22T07:19:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-04-22T07:19:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-04-22T07:19:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-04-22T07:19:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-04-22T07:19:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-04-22T07:19:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-04-22T07:19:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-04-22T07:19:49.131 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-04-22T07:19:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-04-22T07:19:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-04-22T07:19:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-04-22T07:19:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-04-22T07:19:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-04-22T07:19:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/152 2024-04-22T07:19:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-04-22T07:19:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-04-22T07:19:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-04-22T07:19:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-04-22T07:19:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-04-22T07:19:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-04-22T07:19:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:19.0.0-3156.g86f7587a.el9.x86_64 149/152 2024-04-22T07:19:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-04-22T07:19:49.132 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:19.0.0-3156.g86f7587a.el9.x86_64 151/152 2024-04-22T07:19:51.351 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-04-22T07:19:51.351 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:51.351 INFO:teuthology.orchestra.run.smithi062.stdout:Upgraded: 2024-04-22T07:19:51.351 INFO:teuthology.orchestra.run.smithi062.stdout: librados2-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.351 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.351 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-22T07:19:51.351 INFO:teuthology.orchestra.run.smithi062.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-22T07:19:51.351 INFO:teuthology.orchestra.run.smithi062.stdout: automake-1.16.2-8.el9.noarch 2024-04-22T07:19:51.351 INFO:teuthology.orchestra.run.smithi062.stdout: bison-3.7.4-5.el9.x86_64 2024-04-22T07:19:51.351 INFO:teuthology.orchestra.run.smithi062.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-22T07:19:51.351 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.352 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.352 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.352 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.352 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:19:51.352 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.352 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.352 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.352 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:19:51.352 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:19:51.352 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:19:51.352 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:19:51.352 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:19:51.352 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.353 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.353 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:19:51.353 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.353 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.353 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.353 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-volume-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:19:51.353 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:19:51.353 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.353 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-shell-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.353 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-top-2:19.0.0-3156.g86f7587a.el9.noarch 2024-04-22T07:19:51.353 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-22T07:19:51.353 INFO:teuthology.orchestra.run.smithi062.stdout: flex-2.6.4-9.el9.x86_64 2024-04-22T07:19:51.353 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-22T07:19:51.353 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-22T07:19:51.354 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-22T07:19:51.354 INFO:teuthology.orchestra.run.smithi062.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-22T07:19:51.354 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-22T07:19:51.354 INFO:teuthology.orchestra.run.smithi062.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-22T07:19:51.354 INFO:teuthology.orchestra.run.smithi062.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-22T07:19:51.354 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-22T07:19:51.354 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-22T07:19:51.354 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.354 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.354 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.354 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-22T07:19:51.354 INFO:teuthology.orchestra.run.smithi062.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-22T07:19:51.354 INFO:teuthology.orchestra.run.smithi062.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-22T07:19:51.355 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-22T07:19:51.355 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-22T07:19:51.355 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.355 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.355 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-22T07:19:51.355 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.355 INFO:teuthology.orchestra.run.smithi062.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-22T07:19:51.355 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-22T07:19:51.355 INFO:teuthology.orchestra.run.smithi062.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-22T07:19:51.355 INFO:teuthology.orchestra.run.smithi062.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-22T07:19:51.355 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-22T07:19:51.355 INFO:teuthology.orchestra.run.smithi062.stdout: lua-5.4.4-4.el9.x86_64 2024-04-22T07:19:51.356 INFO:teuthology.orchestra.run.smithi062.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-22T07:19:51.356 INFO:teuthology.orchestra.run.smithi062.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-22T07:19:51.356 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-22T07:19:51.356 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-22T07:19:51.356 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-22T07:19:51.356 INFO:teuthology.orchestra.run.smithi062.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-22T07:19:51.356 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-13.14-1.el9.x86_64 2024-04-22T07:19:51.356 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-22T07:19:51.356 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-22T07:19:51.356 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-22T07:19:51.356 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-22T07:19:51.356 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-22T07:19:51.356 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-22T07:19:51.356 INFO:teuthology.orchestra.run.smithi062.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-22T07:19:51.357 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-22T07:19:51.357 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-22T07:19:51.357 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-22T07:19:51.357 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.357 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.357 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.357 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-22T07:19:51.357 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-22T07:19:51.357 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-22T07:19:51.357 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-22T07:19:51.357 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-22T07:19:51.357 INFO:teuthology.orchestra.run.smithi062.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-22T07:19:51.357 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-22T07:19:51.357 INFO:teuthology.orchestra.run.smithi062.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-22T07:19:51.358 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-22T07:19:51.358 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-22T07:19:51.358 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-22T07:19:51.358 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-22T07:19:51.358 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-22T07:19:51.358 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-22T07:19:51.358 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-22T07:19:51.358 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-22T07:19:51.358 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-22T07:19:51.358 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-22T07:19:51.358 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-22T07:19:51.358 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-22T07:19:51.358 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-22T07:19:51.358 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-22T07:19:51.359 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-22T07:19:51.359 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-22T07:19:51.359 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-22T07:19:51.359 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-22T07:19:51.359 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-22T07:19:51.359 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-22T07:19:51.359 INFO:teuthology.orchestra.run.smithi062.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-22T07:19:51.359 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-22T07:19:51.359 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ply-3.11-14.el9.noarch 2024-04-22T07:19:51.359 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-22T07:19:51.359 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-22T07:19:51.359 INFO:teuthology.orchestra.run.smithi062.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-22T07:19:51.359 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-22T07:19:51.359 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-22T07:19:51.360 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-22T07:19:51.360 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-22T07:19:51.360 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-22T07:19:51.360 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-22T07:19:51.360 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.360 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.360 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-22T07:19:51.360 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-22T07:19:51.360 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-22T07:19:51.360 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.360 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-22T07:19:51.360 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-22T07:19:51.360 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-22T07:19:51.360 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-22T07:19:51.360 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-22T07:19:51.361 INFO:teuthology.orchestra.run.smithi062.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-22T07:19:51.361 INFO:teuthology.orchestra.run.smithi062.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-22T07:19:51.361 INFO:teuthology.orchestra.run.smithi062.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-22T07:19:51.361 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-22T07:19:51.361 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-22T07:19:51.361 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-22T07:19:51.361 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-22T07:19:51.361 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-22T07:19:51.361 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-22T07:19:51.361 INFO:teuthology.orchestra.run.smithi062.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-22T07:19:51.361 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.361 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.361 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd-2:19.0.0-3156.g86f7587a.el9.x86_64 2024-04-22T07:19:51.361 INFO:teuthology.orchestra.run.smithi062.stdout: re2-1:20211101-3.el9.x86_64 2024-04-22T07:19:51.361 INFO:teuthology.orchestra.run.smithi062.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-22T07:19:51.361 INFO:teuthology.orchestra.run.smithi062.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-22T07:19:51.361 INFO:teuthology.orchestra.run.smithi062.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-22T07:19:51.362 INFO:teuthology.orchestra.run.smithi062.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-22T07:19:51.362 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-22T07:19:51.362 INFO:teuthology.orchestra.run.smithi062.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-22T07:19:51.362 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:51.362 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-22T07:19:51.744 DEBUG:teuthology.parallel:result is None 2024-04-22T07:19:51.745 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=86f7587a5a09af35f0895e1a2d08527638fae697 2024-04-22T07:19:51.922 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-22T07:19:51.949 INFO:teuthology.orchestra.run.smithi040.stdout:19.0.0-3156.g86f7587a.el9 2024-04-22T07:19:51.949 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156.g86f7587a.el9 2024-04-22T07:19:51.950 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156.g86f7587a is installed. 2024-04-22T07:19:51.951 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=86f7587a5a09af35f0895e1a2d08527638fae697 2024-04-22T07:19:52.111 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-22T07:19:52.133 INFO:teuthology.orchestra.run.smithi062.stdout:19.0.0-3156.g86f7587a.el9 2024-04-22T07:19:52.133 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156.g86f7587a.el9 2024-04-22T07:19:52.133 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156.g86f7587a is installed. 2024-04-22T07:19:52.135 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-22T07:19:52.135 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:19:52.135 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-22T07:19:52.168 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-22T07:19:52.168 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-22T07:19:52.202 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-22T07:19:52.202 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:19:52.202 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/daemon-helper 2024-04-22T07:19:52.236 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-22T07:19:52.303 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-22T07:19:52.303 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/daemon-helper 2024-04-22T07:19:52.327 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-22T07:19:52.393 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-22T07:19:52.393 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:19:52.393 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-22T07:19:52.420 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-22T07:19:52.487 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-22T07:19:52.487 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-22T07:19:52.514 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-22T07:19:52.579 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-22T07:19:52.579 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:19:52.579 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/stdin-killer 2024-04-22T07:19:52.603 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-22T07:19:52.668 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-22T07:19:52.668 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/stdin-killer 2024-04-22T07:19:52.694 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-22T07:19:52.760 INFO:teuthology.run_tasks:Running task ceph... 2024-04-22T07:19:52.843 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-22T07:19:52.843 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 777 /var/log/ceph 2024-04-22T07:19:52.846 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 777 /var/log/ceph 2024-04-22T07:19:52.877 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-22T07:19:52.877 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-22T07:19:52.920 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-22T07:19:52.946 INFO:tasks.ceph:Creating extra log directories... 2024-04-22T07:19:52.947 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-22T07:19:52.985 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-22T07:19:53.017 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-22T07:19:53.017 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-22T07:19:53.018 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-22T07:19:53.018 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:19:53.018 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-22T07:19:53.064 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-22T07:19:53.181 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-22T07:19:53.205 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-22T07:19:53.205 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-22T07:19:53.220 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-22T07:19:53.341 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-22T07:19:53.371 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-22T07:19:53.371 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-22T07:19:53.372 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668168', 'branch': 'wip-lusov-quiescer', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/suites/iozone}}', 'email': None, 'first_in_suite': False, 'job_id': '7668168', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-lusov-quiescer'}, 'ceph': {'cephfs': {'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-quiescer', 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 4362, 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697', 'sleep_before_teardown': 0, 'subset': '222/111111', 'suite': 'fs', 'suite_branch': 'wip-lusov-quiescer', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_86f7587a5a09af35f0895e1a2d08527638fae697/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '86f7587a5a09af35f0895e1a2d08527638fae697', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi040.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB5rKvGg7MW1fGzHX36ncn+v0vACzRssTv+vZv5MDgb2UXo7CKroeabdmmAYZbrsg3VJ33DcBRZ4ShgvJosgzM8=', 'smithi062.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDYDkvdit+d7zM2oNGn+ltPuzX+t1N84Q3t9ZzL8j17qLHcKMRJmhP+VMLq6+15LBS9xmZicRTP5wVr4XWejcx0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '86f7587a5a09af35f0895e1a2d08527638fae697', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'quiescer': None}, {'workunit': {'clients': {'all': ['suites/iozone.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-22_05:52:53', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-22T07:19:53.372 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-22T07:19:53.374 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-22T07:19:53.421 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/run/ceph 2024-04-22T07:19:53.429 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/run/ceph 2024-04-22T07:19:53.485 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:19:53.485 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/scratch_devs of=/dev/stdout 2024-04-22T07:19:53.507 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-22T07:19:53.507 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_1 2024-04-22T07:19:53.561 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-22T07:19:53.562 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T07:19:53.562 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-22T07:19:53.562 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T07:19:53.562 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-04-22T07:19:53.562 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-04-22 07:18:42.022875065 +0000 2024-04-22T07:19:53.562 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-04-22 07:16:42.917338105 +0000 2024-04-22T07:19:53.562 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-04-22 07:16:42.917338105 +0000 2024-04-22T07:19:53.562 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-04-22 07:16:42.917338105 +0000 2024-04-22T07:19:53.562 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-22T07:19:53.624 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-04-22T07:19:53.624 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-04-22T07:19:53.624 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000203539 s, 2.5 MB/s 2024-04-22T07:19:53.626 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-22T07:19:53.681 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_2 2024-04-22T07:19:53.737 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-22T07:19:53.737 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T07:19:53.737 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-22T07:19:53.737 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T07:19:53.737 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-04-22T07:19:53.737 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-04-22 07:18:42.023875052 +0000 2024-04-22T07:19:53.737 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-04-22 07:16:43.273333449 +0000 2024-04-22T07:19:53.737 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-04-22 07:16:43.273333449 +0000 2024-04-22T07:19:53.737 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-04-22 07:16:43.273333449 +0000 2024-04-22T07:19:53.738 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-22T07:19:53.800 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-04-22T07:19:53.800 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-04-22T07:19:53.800 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000204877 s, 2.5 MB/s 2024-04-22T07:19:53.801 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-22T07:19:53.857 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_3 2024-04-22T07:19:53.912 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-22T07:19:53.913 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T07:19:53.913 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-22T07:19:53.913 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T07:19:53.913 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-04-22T07:19:53.913 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-04-22 07:18:42.023875052 +0000 2024-04-22T07:19:53.913 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-04-22 07:16:43.615328975 +0000 2024-04-22T07:19:53.913 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-04-22 07:16:43.615328975 +0000 2024-04-22T07:19:53.913 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-04-22 07:16:43.615328975 +0000 2024-04-22T07:19:53.913 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-22T07:19:53.975 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-04-22T07:19:53.975 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-04-22T07:19:53.975 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000219263 s, 2.3 MB/s 2024-04-22T07:19:53.976 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-22T07:19:54.032 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_4 2024-04-22T07:19:54.088 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-22T07:19:54.088 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T07:19:54.088 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-22T07:19:54.088 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T07:19:54.088 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-04-22T07:19:54.088 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-04-22 07:18:42.023875052 +0000 2024-04-22T07:19:54.088 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-04-22 07:16:43.960324462 +0000 2024-04-22T07:19:54.088 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-04-22 07:16:43.961324449 +0000 2024-04-22T07:19:54.088 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-04-22 07:16:43.960324462 +0000 2024-04-22T07:19:54.089 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-22T07:19:54.151 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-04-22T07:19:54.151 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-04-22T07:19:54.151 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000214512 s, 2.4 MB/s 2024-04-22T07:19:54.152 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-22T07:19:54.208 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-22T07:19:54.209 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-22T07:19:54.209 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/scratch_devs of=/dev/stdout 2024-04-22T07:19:54.225 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-22T07:19:54.225 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_1 2024-04-22T07:19:54.281 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-22T07:19:54.281 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T07:19:54.281 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-22T07:19:54.281 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T07:19:54.281 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-04-22T07:19:54.282 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-04-22 07:19:43.882232677 +0000 2024-04-22T07:19:54.282 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-04-22 07:16:58.727171168 +0000 2024-04-22T07:19:54.282 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-04-22 07:16:58.727171168 +0000 2024-04-22T07:19:54.282 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-04-22 07:16:58.727171168 +0000 2024-04-22T07:19:54.282 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-22T07:19:54.345 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-04-22T07:19:54.346 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-04-22T07:19:54.346 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000266633 s, 1.9 MB/s 2024-04-22T07:19:54.347 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-22T07:19:54.405 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_2 2024-04-22T07:19:54.461 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-22T07:19:54.461 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T07:19:54.462 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-22T07:19:54.462 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T07:19:54.462 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-04-22T07:19:54.462 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-04-22 07:19:43.882232677 +0000 2024-04-22T07:19:54.462 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-04-22 07:16:59.088165130 +0000 2024-04-22T07:19:54.462 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-04-22 07:16:59.088165130 +0000 2024-04-22T07:19:54.462 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-04-22 07:16:59.088165130 +0000 2024-04-22T07:19:54.462 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-22T07:19:54.524 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-04-22T07:19:54.524 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-04-22T07:19:54.524 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000193772 s, 2.6 MB/s 2024-04-22T07:19:54.525 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-22T07:19:54.582 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_3 2024-04-22T07:19:54.637 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-22T07:19:54.637 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T07:19:54.637 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-22T07:19:54.638 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T07:19:54.638 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-04-22T07:19:54.638 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-04-22 07:19:43.882232677 +0000 2024-04-22T07:19:54.638 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-04-22 07:16:59.459158925 +0000 2024-04-22T07:19:54.638 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-04-22 07:16:59.459158925 +0000 2024-04-22T07:19:54.638 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-04-22 07:16:59.459158925 +0000 2024-04-22T07:19:54.638 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-22T07:19:54.700 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-04-22T07:19:54.700 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-04-22T07:19:54.700 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000186726 s, 2.7 MB/s 2024-04-22T07:19:54.701 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-22T07:19:54.757 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_4 2024-04-22T07:19:54.812 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-22T07:19:54.813 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-22T07:19:54.813 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-22T07:19:54.813 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T07:19:54.813 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-04-22T07:19:54.813 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-04-22 07:19:43.883232661 +0000 2024-04-22T07:19:54.813 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-04-22 07:16:59.812153021 +0000 2024-04-22T07:19:54.813 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-04-22 07:16:59.812153021 +0000 2024-04-22T07:19:54.813 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-04-22 07:16:59.812153021 +0000 2024-04-22T07:19:54.813 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-22T07:19:54.877 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-04-22T07:19:54.878 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-04-22T07:19:54.878 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000219617 s, 2.3 MB/s 2024-04-22T07:19:54.879 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-22T07:19:54.935 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-22T07:19:54.945 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-22T07:19:54.945 INFO:tasks.ceph:Generating config... 2024-04-22T07:19:54.946 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-22T07:19:54.946 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-04-22T07:19:54.946 INFO:tasks.ceph:[client] debug client = 20 2024-04-22T07:19:54.946 INFO:tasks.ceph:[client] debug ms = 1 2024-04-22T07:19:54.946 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-22T07:19:54.947 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-22T07:19:54.947 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-22T07:19:54.947 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-22T07:19:54.947 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-22T07:19:54.947 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-22T07:19:54.947 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-22T07:19:54.947 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-22T07:19:54.947 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-22T07:19:54.947 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-22T07:19:54.947 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-22T07:19:54.947 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-22T07:19:54.947 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-04-22T07:19:54.947 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-22T07:19:54.947 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-22T07:19:54.947 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-04-22T07:19:54.948 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-04-22T07:19:54.948 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-22T07:19:54.948 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-22T07:19:54.948 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-22T07:19:54.948 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-22T07:19:54.948 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-22T07:19:54.948 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-22T07:19:54.948 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-22T07:19:54.948 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-22T07:19:54.948 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-22T07:19:54.948 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-22T07:19:54.948 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-22T07:19:54.948 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-22T07:19:54.948 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-22T07:19:54.949 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-22T07:19:54.949 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-22T07:19:54.949 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-22T07:19:54.949 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-22T07:19:54.949 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-22T07:19:54.949 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-22T07:19:54.949 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-22T07:19:54.949 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-22T07:19:54.949 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-22T07:19:54.949 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-22T07:19:54.949 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-22T07:19:54.949 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-22T07:19:54.949 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-22T07:19:54.950 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-22T07:19:54.950 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-22T07:19:54.950 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-22T07:19:54.950 INFO:tasks.ceph:Setting up mon.a... 2024-04-22T07:19:54.950 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-22T07:19:55.002 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.keyring 2024-04-22T07:19:55.005 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-22T07:19:55.048 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-22T07:19:55.113 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.40'), ('mon.b', '172.21.15.62'), ('mon.c', '[v2:172.21.15.62:3301,v1:172.21.15.62:6790]')] 2024-04-22T07:19:55.114 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.40,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-22T07:19:55.115 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:19:55.115 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-22T07:19:55.169 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.40 --add b 172.21.15.62 --addv c '[v2:172.21.15.62:3301,v1:172.21.15.62:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-22T07:19:55.255 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-22T07:19:55.255 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: generated fsid dd5b16e4-89fe-4602-b37f-062846793158 2024-04-22T07:19:55.255 INFO:teuthology.orchestra.run.smithi040.stdout:setting min_mon_release = quincy 2024-04-22T07:19:55.255 INFO:teuthology.orchestra.run.smithi040.stdout:epoch 0 2024-04-22T07:19:55.255 INFO:teuthology.orchestra.run.smithi040.stdout:fsid dd5b16e4-89fe-4602-b37f-062846793158 2024-04-22T07:19:55.255 INFO:teuthology.orchestra.run.smithi040.stdout:last_changed 2024-04-22T07:19:55.258296+0000 2024-04-22T07:19:55.255 INFO:teuthology.orchestra.run.smithi040.stdout:created 2024-04-22T07:19:55.258296+0000 2024-04-22T07:19:55.255 INFO:teuthology.orchestra.run.smithi040.stdout:min_mon_release 17 (quincy) 2024-04-22T07:19:55.255 INFO:teuthology.orchestra.run.smithi040.stdout:election_strategy: 1 2024-04-22T07:19:55.255 INFO:teuthology.orchestra.run.smithi040.stdout:0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2024-04-22T07:19:55.256 INFO:teuthology.orchestra.run.smithi040.stdout:1: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.b 2024-04-22T07:19:55.256 INFO:teuthology.orchestra.run.smithi040.stdout:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-04-22T07:19:55.256 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-22T07:19:55.257 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-22T07:19:55.271 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID dd5b16e4-89fe-4602-b37f-062846793158... 2024-04-22T07:19:55.272 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-22T07:19:55.314 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-22T07:19:55.353 INFO:teuthology.orchestra.run.smithi040.stdout:[global] 2024-04-22T07:19:55.354 INFO:teuthology.orchestra.run.smithi040.stdout: chdir = "" 2024-04-22T07:19:55.354 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-22T07:19:55.354 INFO:teuthology.orchestra.run.smithi040.stdout: auth supported = cephx 2024-04-22T07:19:55.354 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.354 INFO:teuthology.orchestra.run.smithi040.stdout: filestore xattr use omap = true 2024-04-22T07:19:55.354 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.354 INFO:teuthology.orchestra.run.smithi040.stdout: mon clock drift allowed = 1.000 2024-04-22T07:19:55.354 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.354 INFO:teuthology.orchestra.run.smithi040.stdout: osd crush chooseleaf type = 0 2024-04-22T07:19:55.354 INFO:teuthology.orchestra.run.smithi040.stdout: auth debug = true 2024-04-22T07:19:55.354 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.354 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on old message = true 2024-04-22T07:19:55.355 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on bug = true 2024-04-22T07:19:55.355 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.355 INFO:teuthology.orchestra.run.smithi040.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-22T07:19:55.355 INFO:teuthology.orchestra.run.smithi040.stdout: mon pg warn max object skew = 0 2024-04-22T07:19:55.355 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.355 INFO:teuthology.orchestra.run.smithi040.stdout: # disable pg_autoscaler by default for new pools 2024-04-22T07:19:55.355 INFO:teuthology.orchestra.run.smithi040.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-22T07:19:55.355 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.355 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default size = 2 2024-04-22T07:19:55.355 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.355 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow primary affinity = true 2024-04-22T07:19:55.355 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow pg remap = true 2024-04-22T07:19:55.355 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on legacy crush tunables = false 2024-04-22T07:19:55.355 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on crush straw calc version zero = false 2024-04-22T07:19:55.355 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on no sortbitwise = false 2024-04-22T07:19:55.356 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on osd down out interval zero = false 2024-04-22T07:19:55.356 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on too few osds = false 2024-04-22T07:19:55.356 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-22T07:19:55.356 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-22T07:19:55.356 INFO:teuthology.orchestra.run.smithi040.stdout: mon_allow_pool_size_one = true 2024-04-22T07:19:55.356 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.356 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-22T07:19:55.356 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.356 INFO:teuthology.orchestra.run.smithi040.stdout: osd default data pool replay window = 5 2024-04-22T07:19:55.356 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.356 INFO:teuthology.orchestra.run.smithi040.stdout: mon allow pool delete = true 2024-04-22T07:19:55.356 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.356 INFO:teuthology.orchestra.run.smithi040.stdout: mon cluster log file level = debug 2024-04-22T07:19:55.356 INFO:teuthology.orchestra.run.smithi040.stdout: debug asserts on shutdown = true 2024-04-22T07:19:55.356 INFO:teuthology.orchestra.run.smithi040.stdout: mon health detail to clog = false 2024-04-22T07:19:55.357 INFO:teuthology.orchestra.run.smithi040.stdout: mon host = "172.21.15.40,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]" 2024-04-22T07:19:55.357 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on skipped message = False 2024-04-22T07:19:55.357 INFO:teuthology.orchestra.run.smithi040.stdout: fsid = dd5b16e4-89fe-4602-b37f-062846793158 2024-04-22T07:19:55.357 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.357 INFO:teuthology.orchestra.run.smithi040.stdout:[osd] 2024-04-22T07:19:55.357 INFO:teuthology.orchestra.run.smithi040.stdout: osd journal size = 100 2024-04-22T07:19:55.357 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.357 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub load threshold = 5.0 2024-04-22T07:19:55.357 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub max interval = 600 2024-04-22T07:19:55.357 INFO:teuthology.orchestra.run.smithi040.stdout: osd mclock profile = high_recovery_ops 2024-04-22T07:19:55.357 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.357 INFO:teuthology.orchestra.run.smithi040.stdout: osd recover clone overlap = true 2024-04-22T07:19:55.357 INFO:teuthology.orchestra.run.smithi040.stdout: osd recovery max chunk = 1048576 2024-04-22T07:19:55.357 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.357 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug shutdown = true 2024-04-22T07:19:55.357 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug op order = true 2024-04-22T07:19:55.358 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug verify stray on activate = true 2024-04-22T07:19:55.358 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug trim objects = true 2024-04-22T07:19:55.358 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.358 INFO:teuthology.orchestra.run.smithi040.stdout: osd open classes on start = true 2024-04-22T07:19:55.358 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug pg log writeout = true 2024-04-22T07:19:55.358 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.358 INFO:teuthology.orchestra.run.smithi040.stdout: osd deep scrub update digest min age = 30 2024-04-22T07:19:55.358 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.358 INFO:teuthology.orchestra.run.smithi040.stdout: osd map max advance = 10 2024-04-22T07:19:55.358 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.358 INFO:teuthology.orchestra.run.smithi040.stdout: journal zero on create = true 2024-04-22T07:19:55.358 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.358 INFO:teuthology.orchestra.run.smithi040.stdout: filestore ondisk finisher threads = 3 2024-04-22T07:19:55.359 INFO:teuthology.orchestra.run.smithi040.stdout: filestore apply finisher threads = 3 2024-04-22T07:19:55.359 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.359 INFO:teuthology.orchestra.run.smithi040.stdout: bdev debug aio = true 2024-04-22T07:19:55.359 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug misdirected ops = true 2024-04-22T07:19:55.359 INFO:teuthology.orchestra.run.smithi040.stdout: bdev async discard = True 2024-04-22T07:19:55.359 INFO:teuthology.orchestra.run.smithi040.stdout: bdev enable discard = True 2024-04-22T07:19:55.359 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore allocator = bitmap 2024-04-22T07:19:55.359 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore block size = 96636764160 2024-04-22T07:19:55.359 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore fsck on mount = True 2024-04-22T07:19:55.359 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluefs = 1/20 2024-04-22T07:19:55.359 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluestore = 1/20 2024-04-22T07:19:55.359 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-04-22T07:19:55.359 INFO:teuthology.orchestra.run.smithi040.stdout: debug osd = 20 2024-04-22T07:19:55.359 INFO:teuthology.orchestra.run.smithi040.stdout: debug rocksdb = 4/10 2024-04-22T07:19:55.360 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd backfillfull_ratio = 0.85 2024-04-22T07:19:55.360 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd full ratio = 0.9 2024-04-22T07:19:55.360 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd nearfull ratio = 0.8 2024-04-22T07:19:55.360 INFO:teuthology.orchestra.run.smithi040.stdout: osd blocked scrub grace period = 3600 2024-04-22T07:19:55.360 INFO:teuthology.orchestra.run.smithi040.stdout: osd failsafe full ratio = 0.95 2024-04-22T07:19:55.360 INFO:teuthology.orchestra.run.smithi040.stdout: osd max markdown count = 1000 2024-04-22T07:19:55.360 INFO:teuthology.orchestra.run.smithi040.stdout: osd objectstore = bluestore 2024-04-22T07:19:55.360 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2024-04-22T07:19:55.360 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.360 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr] 2024-04-22T07:19:55.360 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-04-22T07:19:55.360 INFO:teuthology.orchestra.run.smithi040.stdout: debug mgr = 20 2024-04-22T07:19:55.360 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2024-04-22T07:19:55.360 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2024-04-22T07:19:55.361 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2024-04-22T07:19:55.361 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2024-04-22T07:19:55.361 INFO:teuthology.orchestra.run.smithi040.stdout: mgr/telemetry/nag = false 2024-04-22T07:19:55.361 INFO:teuthology.orchestra.run.smithi040.stdout: debug client = 20 2024-04-22T07:19:55.361 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.361 INFO:teuthology.orchestra.run.smithi040.stdout:[mon] 2024-04-22T07:19:55.361 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-04-22T07:19:55.361 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2024-04-22T07:19:55.361 INFO:teuthology.orchestra.run.smithi040.stdout: debug paxos = 20 2024-04-22T07:19:55.361 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2024-04-22T07:19:55.361 INFO:teuthology.orchestra.run.smithi040.stdout: mon data avail warn = 5 2024-04-22T07:19:55.361 INFO:teuthology.orchestra.run.smithi040.stdout: mon mgr mkfs grace = 240 2024-04-22T07:19:55.361 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2024-04-22T07:19:55.361 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd reporter subtree level = osd 2024-04-22T07:19:55.361 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd prime pg temp = true 2024-04-22T07:19:55.361 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2024-04-22T07:19:55.362 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.362 INFO:teuthology.orchestra.run.smithi040.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-22T07:19:55.362 INFO:teuthology.orchestra.run.smithi040.stdout: auth mon ticket ttl = 660 # 11m 2024-04-22T07:19:55.362 INFO:teuthology.orchestra.run.smithi040.stdout: auth service ticket ttl = 240 # 4m 2024-04-22T07:19:55.362 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.362 INFO:teuthology.orchestra.run.smithi040.stdout: # don't complain about insecure global_id in the test suite 2024-04-22T07:19:55.362 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-22T07:19:55.362 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-22T07:19:55.362 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.362 INFO:teuthology.orchestra.run.smithi040.stdout: # 1m isn't quite enough 2024-04-22T07:19:55.362 INFO:teuthology.orchestra.run.smithi040.stdout: mon_down_mkfs_grace = 2m 2024-04-22T07:19:55.362 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.362 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_filestore_osds = false 2024-04-22T07:19:55.363 INFO:teuthology.orchestra.run.smithi040.stdout: mon down mkfs grace = 300 2024-04-22T07:19:55.363 INFO:teuthology.orchestra.run.smithi040.stdout: mon op complaint time = 120 2024-04-22T07:19:55.363 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:19:55.363 INFO:teuthology.orchestra.run.smithi040.stdout:[client] 2024-04-22T07:19:55.363 INFO:teuthology.orchestra.run.smithi040.stdout: rgw cache enabled = true 2024-04-22T07:19:55.363 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable ops log = true 2024-04-22T07:19:55.363 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable usage log = true 2024-04-22T07:19:55.363 INFO:teuthology.orchestra.run.smithi040.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-22T07:19:55.363 INFO:teuthology.orchestra.run.smithi040.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-22T07:19:55.363 INFO:teuthology.orchestra.run.smithi040.stdout: client mount timeout = 600 2024-04-22T07:19:55.363 INFO:teuthology.orchestra.run.smithi040.stdout: client_shutdown_timeout = 120 2024-04-22T07:19:55.363 INFO:teuthology.orchestra.run.smithi040.stdout: debug client = 20 2024-04-22T07:19:55.363 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-04-22T07:19:55.363 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2024-04-22T07:19:55.363 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2024-04-22T07:19:55.364 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.a] 2024-04-22T07:19:55.364 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.b] 2024-04-22T07:19:55.364 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.c] 2024-04-22T07:19:55.364 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2024-04-22T07:19:55.364 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c] 2024-04-22T07:19:55.364 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.e] 2024-04-22T07:19:55.364 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2024-04-22T07:19:55.364 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.d] 2024-04-22T07:19:55.364 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.f] 2024-04-22T07:19:55.364 INFO:teuthology.orchestra.run.smithi040.stdout:[mds] 2024-04-22T07:19:55.364 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds = 20 2024-04-22T07:19:55.364 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds balancer = 20 2024-04-22T07:19:55.364 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-04-22T07:19:55.364 INFO:teuthology.orchestra.run.smithi040.stdout: mds bal fragment size max = 10000 2024-04-22T07:19:55.364 INFO:teuthology.orchestra.run.smithi040.stdout: mds bal merge size = 5 2024-04-22T07:19:55.365 INFO:teuthology.orchestra.run.smithi040.stdout: mds bal split bits = 3 2024-04-22T07:19:55.365 INFO:teuthology.orchestra.run.smithi040.stdout: mds bal split size = 100 2024-04-22T07:19:55.365 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug frag = True 2024-04-22T07:19:55.365 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug scatterstat = True 2024-04-22T07:19:55.365 INFO:teuthology.orchestra.run.smithi040.stdout: mds oft prefetch dirfrags = True 2024-04-22T07:19:55.365 INFO:teuthology.orchestra.run.smithi040.stdout: mds op complaint time = 180 2024-04-22T07:19:55.365 INFO:teuthology.orchestra.run.smithi040.stdout: mds verify scatter = True 2024-04-22T07:19:55.365 INFO:teuthology.orchestra.run.smithi040.stdout: mds_dir_prefetch = True 2024-04-22T07:19:55.365 INFO:teuthology.orchestra.run.smithi040.stdout: mds_sleep_rank_change = 5000000.0 2024-04-22T07:19:55.365 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2024-04-22T07:19:55.365 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2024-04-22T07:19:55.365 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2024-04-22T07:19:55.366 INFO:teuthology.orchestra.run.smithi062.stdout:[global] 2024-04-22T07:19:55.366 INFO:teuthology.orchestra.run.smithi062.stdout: chdir = "" 2024-04-22T07:19:55.366 INFO:teuthology.orchestra.run.smithi062.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-22T07:19:55.366 INFO:teuthology.orchestra.run.smithi062.stdout: auth supported = cephx 2024-04-22T07:19:55.366 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.366 INFO:teuthology.orchestra.run.smithi062.stdout: filestore xattr use omap = true 2024-04-22T07:19:55.366 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.366 INFO:teuthology.orchestra.run.smithi062.stdout: mon clock drift allowed = 1.000 2024-04-22T07:19:55.366 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.366 INFO:teuthology.orchestra.run.smithi062.stdout: osd crush chooseleaf type = 0 2024-04-22T07:19:55.366 INFO:teuthology.orchestra.run.smithi062.stdout: auth debug = true 2024-04-22T07:19:55.366 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.367 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on old message = true 2024-04-22T07:19:55.367 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on bug = true 2024-04-22T07:19:55.367 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.367 INFO:teuthology.orchestra.run.smithi062.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-22T07:19:55.367 INFO:teuthology.orchestra.run.smithi062.stdout: mon pg warn max object skew = 0 2024-04-22T07:19:55.367 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.367 INFO:teuthology.orchestra.run.smithi062.stdout: # disable pg_autoscaler by default for new pools 2024-04-22T07:19:55.367 INFO:teuthology.orchestra.run.smithi062.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-22T07:19:55.367 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.367 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default size = 2 2024-04-22T07:19:55.367 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.367 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow primary affinity = true 2024-04-22T07:19:55.367 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow pg remap = true 2024-04-22T07:19:55.367 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on legacy crush tunables = false 2024-04-22T07:19:55.367 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on crush straw calc version zero = false 2024-04-22T07:19:55.368 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on no sortbitwise = false 2024-04-22T07:19:55.368 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on osd down out interval zero = false 2024-04-22T07:19:55.368 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on too few osds = false 2024-04-22T07:19:55.368 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-22T07:19:55.368 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-22T07:19:55.368 INFO:teuthology.orchestra.run.smithi062.stdout: mon_allow_pool_size_one = true 2024-04-22T07:19:55.368 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.368 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-22T07:19:55.368 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.368 INFO:teuthology.orchestra.run.smithi062.stdout: osd default data pool replay window = 5 2024-04-22T07:19:55.368 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.368 INFO:teuthology.orchestra.run.smithi062.stdout: mon allow pool delete = true 2024-04-22T07:19:55.368 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.369 INFO:teuthology.orchestra.run.smithi062.stdout: mon cluster log file level = debug 2024-04-22T07:19:55.369 INFO:teuthology.orchestra.run.smithi062.stdout: debug asserts on shutdown = true 2024-04-22T07:19:55.369 INFO:teuthology.orchestra.run.smithi062.stdout: mon health detail to clog = false 2024-04-22T07:19:55.369 INFO:teuthology.orchestra.run.smithi062.stdout: mon host = "172.21.15.40,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]" 2024-04-22T07:19:55.369 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on skipped message = False 2024-04-22T07:19:55.369 INFO:teuthology.orchestra.run.smithi062.stdout: fsid = dd5b16e4-89fe-4602-b37f-062846793158 2024-04-22T07:19:55.369 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.369 INFO:teuthology.orchestra.run.smithi062.stdout:[osd] 2024-04-22T07:19:55.369 INFO:teuthology.orchestra.run.smithi062.stdout: osd journal size = 100 2024-04-22T07:19:55.369 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.369 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub load threshold = 5.0 2024-04-22T07:19:55.369 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub max interval = 600 2024-04-22T07:19:55.369 INFO:teuthology.orchestra.run.smithi062.stdout: osd mclock profile = high_recovery_ops 2024-04-22T07:19:55.369 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.370 INFO:teuthology.orchestra.run.smithi062.stdout: osd recover clone overlap = true 2024-04-22T07:19:55.370 INFO:teuthology.orchestra.run.smithi062.stdout: osd recovery max chunk = 1048576 2024-04-22T07:19:55.370 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.370 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug shutdown = true 2024-04-22T07:19:55.370 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug op order = true 2024-04-22T07:19:55.370 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug verify stray on activate = true 2024-04-22T07:19:55.370 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug trim objects = true 2024-04-22T07:19:55.370 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.370 INFO:teuthology.orchestra.run.smithi062.stdout: osd open classes on start = true 2024-04-22T07:19:55.370 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug pg log writeout = true 2024-04-22T07:19:55.370 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.370 INFO:teuthology.orchestra.run.smithi062.stdout: osd deep scrub update digest min age = 30 2024-04-22T07:19:55.370 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.370 INFO:teuthology.orchestra.run.smithi062.stdout: osd map max advance = 10 2024-04-22T07:19:55.371 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.371 INFO:teuthology.orchestra.run.smithi062.stdout: journal zero on create = true 2024-04-22T07:19:55.371 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.371 INFO:teuthology.orchestra.run.smithi062.stdout: filestore ondisk finisher threads = 3 2024-04-22T07:19:55.371 INFO:teuthology.orchestra.run.smithi062.stdout: filestore apply finisher threads = 3 2024-04-22T07:19:55.371 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.371 INFO:teuthology.orchestra.run.smithi062.stdout: bdev debug aio = true 2024-04-22T07:19:55.371 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug misdirected ops = true 2024-04-22T07:19:55.371 INFO:teuthology.orchestra.run.smithi062.stdout: bdev async discard = True 2024-04-22T07:19:55.371 INFO:teuthology.orchestra.run.smithi062.stdout: bdev enable discard = True 2024-04-22T07:19:55.371 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore allocator = bitmap 2024-04-22T07:19:55.371 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore block size = 96636764160 2024-04-22T07:19:55.371 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore fsck on mount = True 2024-04-22T07:19:55.371 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluefs = 1/20 2024-04-22T07:19:55.371 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluestore = 1/20 2024-04-22T07:19:55.372 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-04-22T07:19:55.372 INFO:teuthology.orchestra.run.smithi062.stdout: debug osd = 20 2024-04-22T07:19:55.372 INFO:teuthology.orchestra.run.smithi062.stdout: debug rocksdb = 4/10 2024-04-22T07:19:55.372 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd backfillfull_ratio = 0.85 2024-04-22T07:19:55.372 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd full ratio = 0.9 2024-04-22T07:19:55.372 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd nearfull ratio = 0.8 2024-04-22T07:19:55.372 INFO:teuthology.orchestra.run.smithi062.stdout: osd blocked scrub grace period = 3600 2024-04-22T07:19:55.372 INFO:teuthology.orchestra.run.smithi062.stdout: osd failsafe full ratio = 0.95 2024-04-22T07:19:55.372 INFO:teuthology.orchestra.run.smithi062.stdout: osd max markdown count = 1000 2024-04-22T07:19:55.372 INFO:teuthology.orchestra.run.smithi062.stdout: osd objectstore = bluestore 2024-04-22T07:19:55.372 INFO:teuthology.orchestra.run.smithi062.stdout: osd op complaint time = 180 2024-04-22T07:19:55.372 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.372 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr] 2024-04-22T07:19:55.372 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-04-22T07:19:55.372 INFO:teuthology.orchestra.run.smithi062.stdout: debug mgr = 20 2024-04-22T07:19:55.373 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2024-04-22T07:19:55.373 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2024-04-22T07:19:55.373 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2024-04-22T07:19:55.373 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2024-04-22T07:19:55.373 INFO:teuthology.orchestra.run.smithi062.stdout: mgr/telemetry/nag = false 2024-04-22T07:19:55.373 INFO:teuthology.orchestra.run.smithi062.stdout: debug client = 20 2024-04-22T07:19:55.373 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.373 INFO:teuthology.orchestra.run.smithi062.stdout:[mon] 2024-04-22T07:19:55.373 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-04-22T07:19:55.373 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2024-04-22T07:19:55.373 INFO:teuthology.orchestra.run.smithi062.stdout: debug paxos = 20 2024-04-22T07:19:55.373 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2024-04-22T07:19:55.373 INFO:teuthology.orchestra.run.smithi062.stdout: mon data avail warn = 5 2024-04-22T07:19:55.373 INFO:teuthology.orchestra.run.smithi062.stdout: mon mgr mkfs grace = 240 2024-04-22T07:19:55.373 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2024-04-22T07:19:55.373 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd reporter subtree level = osd 2024-04-22T07:19:55.374 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd prime pg temp = true 2024-04-22T07:19:55.374 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2024-04-22T07:19:55.374 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.374 INFO:teuthology.orchestra.run.smithi062.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-22T07:19:55.374 INFO:teuthology.orchestra.run.smithi062.stdout: auth mon ticket ttl = 660 # 11m 2024-04-22T07:19:55.374 INFO:teuthology.orchestra.run.smithi062.stdout: auth service ticket ttl = 240 # 4m 2024-04-22T07:19:55.374 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.374 INFO:teuthology.orchestra.run.smithi062.stdout: # don't complain about insecure global_id in the test suite 2024-04-22T07:19:55.374 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-22T07:19:55.374 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-22T07:19:55.374 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.374 INFO:teuthology.orchestra.run.smithi062.stdout: # 1m isn't quite enough 2024-04-22T07:19:55.374 INFO:teuthology.orchestra.run.smithi062.stdout: mon_down_mkfs_grace = 2m 2024-04-22T07:19:55.374 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.375 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_filestore_osds = false 2024-04-22T07:19:55.375 INFO:teuthology.orchestra.run.smithi062.stdout: mon down mkfs grace = 300 2024-04-22T07:19:55.375 INFO:teuthology.orchestra.run.smithi062.stdout: mon op complaint time = 120 2024-04-22T07:19:55.375 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-22T07:19:55.375 INFO:teuthology.orchestra.run.smithi062.stdout:[client] 2024-04-22T07:19:55.375 INFO:teuthology.orchestra.run.smithi062.stdout: rgw cache enabled = true 2024-04-22T07:19:55.375 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable ops log = true 2024-04-22T07:19:55.375 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable usage log = true 2024-04-22T07:19:55.375 INFO:teuthology.orchestra.run.smithi062.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-22T07:19:55.375 INFO:teuthology.orchestra.run.smithi062.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-22T07:19:55.375 INFO:teuthology.orchestra.run.smithi062.stdout: client mount timeout = 600 2024-04-22T07:19:55.375 INFO:teuthology.orchestra.run.smithi062.stdout: client_shutdown_timeout = 120 2024-04-22T07:19:55.375 INFO:teuthology.orchestra.run.smithi062.stdout: debug client = 20 2024-04-22T07:19:55.375 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-04-22T07:19:55.375 INFO:teuthology.orchestra.run.smithi062.stdout: rados mon op timeout = 900 2024-04-22T07:19:55.375 INFO:teuthology.orchestra.run.smithi062.stdout: rados osd op timeout = 900 2024-04-22T07:19:55.375 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.a] 2024-04-22T07:19:55.376 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.b] 2024-04-22T07:19:55.376 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.c] 2024-04-22T07:19:55.376 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2024-04-22T07:19:55.376 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.c] 2024-04-22T07:19:55.376 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.e] 2024-04-22T07:19:55.376 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b] 2024-04-22T07:19:55.376 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.d] 2024-04-22T07:19:55.376 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.f] 2024-04-22T07:19:55.376 INFO:teuthology.orchestra.run.smithi062.stdout:[mds] 2024-04-22T07:19:55.376 INFO:teuthology.orchestra.run.smithi062.stdout: debug mds = 20 2024-04-22T07:19:55.376 INFO:teuthology.orchestra.run.smithi062.stdout: debug mds balancer = 20 2024-04-22T07:19:55.376 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-04-22T07:19:55.376 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal fragment size max = 10000 2024-04-22T07:19:55.376 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal merge size = 5 2024-04-22T07:19:55.376 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal split bits = 3 2024-04-22T07:19:55.376 INFO:teuthology.orchestra.run.smithi062.stdout: mds bal split size = 100 2024-04-22T07:19:55.376 INFO:teuthology.orchestra.run.smithi062.stdout: mds debug frag = True 2024-04-22T07:19:55.377 INFO:teuthology.orchestra.run.smithi062.stdout: mds debug scatterstat = True 2024-04-22T07:19:55.377 INFO:teuthology.orchestra.run.smithi062.stdout: mds oft prefetch dirfrags = True 2024-04-22T07:19:55.377 INFO:teuthology.orchestra.run.smithi062.stdout: mds op complaint time = 180 2024-04-22T07:19:55.377 INFO:teuthology.orchestra.run.smithi062.stdout: mds verify scatter = True 2024-04-22T07:19:55.377 INFO:teuthology.orchestra.run.smithi062.stdout: mds_dir_prefetch = True 2024-04-22T07:19:55.377 INFO:teuthology.orchestra.run.smithi062.stdout: mds_sleep_rank_change = 5000000.0 2024-04-22T07:19:55.377 INFO:teuthology.orchestra.run.smithi062.stdout: osd op complaint time = 180 2024-04-22T07:19:55.377 INFO:teuthology.orchestra.run.smithi062.stdout: rados mon op timeout = 900 2024-04-22T07:19:55.377 INFO:teuthology.orchestra.run.smithi062.stdout: rados osd op timeout = 900 2024-04-22T07:19:55.378 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-22T07:19:55.379 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-22T07:19:55.471 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-22T07:19:55.471 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:19:55.471 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-22T07:19:55.487 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:19:55.487 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-22T07:19:55.541 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi040.front.sepia.ceph.com 2024-04-22T07:19:55.541 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:19:55.541 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-22T07:19:55.542 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-22T07:19:55.615 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:19:55.615 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-22T07:19:55.671 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi062.front.sepia.ceph.com 2024-04-22T07:19:55.671 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-22T07:19:55.671 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-22T07:19:55.671 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-22T07:19:55.706 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-22T07:19:55.706 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-22T07:19:55.762 INFO:tasks.ceph:Setting up mon nodes... 2024-04-22T07:19:55.762 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-22T07:19:55.763 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-22T07:19:55.813 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-22T07:19:55.815 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-22T07:19:55.908 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-22T07:19:55.910 INFO:tasks.ceph:Setting up mds nodes... 2024-04-22T07:19:55.911 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-22T07:19:55.961 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-22T07:19:55.963 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-22T07:19:55.988 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-22T07:19:56.077 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-22T07:19:56.080 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-22T07:19:56.104 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-22T07:19:56.194 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-22T07:19:56.196 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-22T07:19:56.220 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-22T07:19:56.272 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-22T07:19:56.275 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-22T07:19:56.299 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-22T07:19:56.389 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-22T07:19:56.391 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-22T07:19:56.416 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-22T07:19:56.504 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-22T07:19:56.507 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-22T07:19:56.531 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-22T07:19:56.531 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-22T07:19:56.573 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-22T07:19:56.585 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-22T07:19:56.585 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-22T07:19:56.585 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-22T07:19:56.649 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-22T07:19:56.650 INFO:tasks.ceph:role: osd.0 2024-04-22T07:19:56.650 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com 2024-04-22T07:19:56.650 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-22T07:19:56.721 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T07:19:56.721 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T07:19:56.721 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T07:19:56.721 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-22T07:19:56.721 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T07:19:56.721 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2024-04-22T07:19:56.721 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T07:19:56.721 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-22T07:19:56.721 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T07:19:56.721 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T07:19:57.223 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2024-04-22T07:19:57.225 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2024-04-22T07:19:57.225 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-22T07:19:57.352 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-22T07:19:57.384 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-22T07:19:57.448 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-22T07:19:57.448 INFO:tasks.ceph:role: osd.1 2024-04-22T07:19:57.448 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com 2024-04-22T07:19:57.448 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-22T07:19:57.520 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T07:19:57.520 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T07:19:57.521 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T07:19:57.521 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-22T07:19:57.521 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T07:19:57.521 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2024-04-22T07:19:57.521 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T07:19:57.521 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-22T07:19:57.521 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T07:19:57.521 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T07:19:57.974 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2024-04-22T07:19:57.976 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2024-04-22T07:19:57.976 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-22T07:19:58.070 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-22T07:19:58.100 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-22T07:19:58.165 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-22T07:19:58.165 INFO:tasks.ceph:role: osd.2 2024-04-22T07:19:58.165 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com 2024-04-22T07:19:58.165 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-22T07:19:58.237 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T07:19:58.237 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T07:19:58.237 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T07:19:58.237 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-22T07:19:58.238 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T07:19:58.238 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2024-04-22T07:19:58.238 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T07:19:58.238 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-22T07:19:58.238 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T07:19:58.238 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T07:19:58.725 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2024-04-22T07:19:58.727 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2024-04-22T07:19:58.727 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-22T07:19:58.852 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-22T07:19:58.881 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-22T07:19:58.946 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-22T07:19:58.946 INFO:tasks.ceph:role: osd.3 2024-04-22T07:19:58.946 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com 2024-04-22T07:19:58.946 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-22T07:19:59.021 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T07:19:59.021 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T07:19:59.021 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T07:19:59.021 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-22T07:19:59.021 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T07:19:59.021 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2024-04-22T07:19:59.022 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T07:19:59.022 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-22T07:19:59.022 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T07:19:59.022 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T07:19:59.542 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2024-04-22T07:19:59.544 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2024-04-22T07:19:59.545 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-22T07:19:59.689 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-22T07:19:59.721 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T07:19:59.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:19:59.818+0000 7f06a6625640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-22T07:19:59.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:19:59.818+0000 7f06a6625640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-22T07:19:59.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:19:59.818+0000 7f06a6625640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-22T07:19:59.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:19:59.818+0000 7f06a6625640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-22T07:19:59.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:19:59.818+0000 7f06a6625640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-22T07:19:59.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:19:59.819+0000 7f06a6625640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-22T07:20:02.669 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-22T07:20:02.699 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T07:20:02.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:02.792+0000 7fbaa1817640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-22T07:20:02.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:02.792+0000 7fbaa1817640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-22T07:20:02.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:02.792+0000 7fbaa1817640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-22T07:20:02.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:02.792+0000 7fbaa1817640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-22T07:20:02.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:02.792+0000 7fbaa1817640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-22T07:20:02.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:02.793+0000 7fbaa1817640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-22T07:20:05.641 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-22T07:20:05.670 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T07:20:05.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:05.764+0000 7fb0bac0f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-22T07:20:05.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:05.764+0000 7fb0bac0f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-22T07:20:05.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:05.764+0000 7fb0bac0f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-22T07:20:05.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:05.764+0000 7fb0bac0f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-22T07:20:05.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:05.764+0000 7fb0bac0f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-22T07:20:05.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:05.765+0000 7fb0bac0f640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-22T07:20:08.621 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-22T07:20:08.650 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T07:20:08.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:08.744+0000 7fbc03bb4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-22T07:20:08.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:08.744+0000 7fbc03bb4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-22T07:20:08.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:08.744+0000 7fbc03bb4640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-22T07:20:08.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:08.744+0000 7fbc03bb4640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-22T07:20:08.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:08.744+0000 7fbc03bb4640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-22T07:20:08.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:08.745+0000 7fbc03bb4640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-22T07:20:11.595 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-22T07:20:11.625 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-22T07:20:11.655 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-22T07:20:11.655 INFO:tasks.ceph:role: osd.4 2024-04-22T07:20:11.655 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com 2024-04-22T07:20:11.655 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-22T07:20:11.732 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T07:20:11.732 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T07:20:11.732 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T07:20:11.732 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-22T07:20:11.732 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T07:20:11.732 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-04-22T07:20:11.732 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T07:20:11.732 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-22T07:20:11.732 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T07:20:11.732 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T07:20:12.229 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-04-22T07:20:12.231 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-04-22T07:20:12.231 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-22T07:20:12.356 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-22T07:20:12.386 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-22T07:20:12.450 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-22T07:20:12.450 INFO:tasks.ceph:role: osd.5 2024-04-22T07:20:12.451 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com 2024-04-22T07:20:12.451 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-22T07:20:12.522 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T07:20:12.522 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T07:20:12.523 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T07:20:12.523 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-22T07:20:12.523 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T07:20:12.523 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-04-22T07:20:12.523 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T07:20:12.523 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-22T07:20:12.523 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T07:20:12.523 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T07:20:12.989 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-04-22T07:20:12.991 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-04-22T07:20:12.991 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-22T07:20:13.083 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-22T07:20:13.111 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-22T07:20:13.176 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-22T07:20:13.176 INFO:tasks.ceph:role: osd.6 2024-04-22T07:20:13.176 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com 2024-04-22T07:20:13.176 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-22T07:20:13.247 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T07:20:13.247 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T07:20:13.247 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T07:20:13.247 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-22T07:20:13.247 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T07:20:13.247 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-04-22T07:20:13.247 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T07:20:13.247 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-22T07:20:13.247 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T07:20:13.247 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T07:20:13.731 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-04-22T07:20:13.733 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-04-22T07:20:13.733 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-22T07:20:13.851 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-22T07:20:13.881 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-22T07:20:13.946 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-22T07:20:13.946 INFO:tasks.ceph:role: osd.7 2024-04-22T07:20:13.946 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com 2024-04-22T07:20:13.946 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-22T07:20:14.018 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-22T07:20:14.018 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-22T07:20:14.018 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-22T07:20:14.018 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-22T07:20:14.018 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-22T07:20:14.019 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-04-22T07:20:14.019 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-22T07:20:14.019 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-22T07:20:14.019 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-22T07:20:14.019 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-22T07:20:14.526 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-04-22T07:20:14.528 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-04-22T07:20:14.528 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-22T07:20:14.667 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-22T07:20:14.699 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T07:20:14.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:14.797+0000 7f1b7a96e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-22T07:20:14.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:14.798+0000 7f1b7a96e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-22T07:20:14.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:14.798+0000 7f1b7a96e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-22T07:20:14.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:14.798+0000 7f1b7a96e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-22T07:20:14.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:14.798+0000 7f1b7a96e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-22T07:20:14.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:14.798+0000 7f1b7a96e640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-22T07:20:17.646 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-22T07:20:17.675 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T07:20:17.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:17.767+0000 7f1fa2a0c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-22T07:20:17.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:17.767+0000 7f1fa2a0c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-22T07:20:17.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:17.767+0000 7f1fa2a0c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-22T07:20:17.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:17.767+0000 7f1fa2a0c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-22T07:20:17.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:17.767+0000 7f1fa2a0c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-22T07:20:17.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:17.768+0000 7f1fa2a0c640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-22T07:20:20.620 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-22T07:20:20.650 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T07:20:20.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:20.742+0000 7f37b602c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-22T07:20:20.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:20.743+0000 7f37b602c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-22T07:20:20.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:20.743+0000 7f37b602c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-22T07:20:20.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:20.743+0000 7f37b602c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-22T07:20:20.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:20.743+0000 7f37b602c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-22T07:20:20.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:20.743+0000 7f37b602c640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-22T07:20:23.373 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:20:23.376 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:20:23.601 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-22T07:20:23.629 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-22T07:20:23.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:23.722+0000 7f2298d66640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-22T07:20:23.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:23.722+0000 7f2298d66640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-22T07:20:23.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:23.722+0000 7f2298d66640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-22T07:20:23.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:23.722+0000 7f2298d66640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-22T07:20:23.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:23.722+0000 7f2298d66640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-22T07:20:23.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:23.723+0000 7f2298d66640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-22T07:20:26.574 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-22T07:20:26.601 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-22T07:20:26.601 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:20:26.601 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-22T07:20:26.631 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:20:26.631 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-22T07:20:26.700 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:20:26.701 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-22T07:20:26.769 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:20:26.769 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-22T07:20:26.837 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:20:26.838 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-22T07:20:26.905 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:20:26.905 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-22T07:20:26.972 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:20:26.972 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-22T07:20:27.039 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:20:27.039 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-22T07:20:27.105 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-22T07:20:27.105 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-22T07:20:27.135 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-22T07:20:27.135 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-22T07:20:27.203 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-22T07:20:27.203 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-22T07:20:27.270 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-22T07:20:27.270 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-22T07:20:27.337 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-22T07:20:27.337 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-22T07:20:27.403 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-22T07:20:27.403 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-22T07:20:27.470 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-22T07:20:27.471 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-22T07:20:27.536 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-22T07:20:27.536 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-22T07:20:27.602 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:20:27.602 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-22T07:20:27.620 INFO:tasks.ceph:Adding keys to all mons... 2024-04-22T07:20:27.620 DEBUG:teuthology.orchestra.run.smithi040:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-22T07:20:27.668 DEBUG:teuthology.orchestra.run.smithi062:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-22T07:20:27.687 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.y] 2024-04-22T07:20:27.687 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCbDyZm5xisMBAA25X2phQv9DGp94tlBypl8g== 2024-04-22T07:20:27.688 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2024-04-22T07:20:27.688 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCbDyZmrAt+ORAAvplmPjxWYzTi/lmvvFpFpQ== 2024-04-22T07:20:27.688 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c] 2024-04-22T07:20:27.688 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCcDyZmMR/WBBAAUEkZmKDOMZCMwSqVmIJTQg== 2024-04-22T07:20:27.688 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.e] 2024-04-22T07:20:27.688 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCcDyZmAPfJCxAA0+JcQt77cqf1jrkBJaoRBA== 2024-04-22T07:20:27.688 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.0] 2024-04-22T07:20:27.688 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCfDyZmZRrVMBAAgpEPROAoHcXfEHCmbKETeg== 2024-04-22T07:20:27.688 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.1] 2024-04-22T07:20:27.688 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCiDyZmCxFKLxAAziFVhFZk99bKOhKXVZF5GQ== 2024-04-22T07:20:27.688 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.2] 2024-04-22T07:20:27.688 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQClDyZmM+agLRAAxKO2vudewoHxLgNgKvfTnw== 2024-04-22T07:20:27.688 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.3] 2024-04-22T07:20:27.689 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCoDyZmFZ1wLBAAty3eyuNAz455Okk3hk2OhQ== 2024-04-22T07:20:27.689 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.x] 2024-04-22T07:20:27.689 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCbDyZmLsBYNhAApWXDqD8wH2lIzjjOZvG7iQ== 2024-04-22T07:20:27.689 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2024-04-22T07:20:27.689 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCcDyZmYpZ0EBAA52V7nBUuxpDWBX1HFG52Kw== 2024-04-22T07:20:27.689 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.d] 2024-04-22T07:20:27.689 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCcDyZm4l1mFxAAelVjHregkH95/246Wp/iFA== 2024-04-22T07:20:27.689 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.f] 2024-04-22T07:20:27.689 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCcDyZm8nVKHhAA93E8I0OXJ2kfbmVqMedAig== 2024-04-22T07:20:27.689 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.4] 2024-04-22T07:20:27.689 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCuDyZmRPWZLxAA8qG4oUzJHbcu7az2NzGiNg== 2024-04-22T07:20:27.689 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.5] 2024-04-22T07:20:27.689 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCxDyZmWazOLRAA6/ILnG4XU4cnU+6n6jLFJw== 2024-04-22T07:20:27.689 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.6] 2024-04-22T07:20:27.689 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQC0DyZmf4lSLBAAlQ78Hw3hcK7V++XOdx/wHQ== 2024-04-22T07:20:27.690 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.7] 2024-04-22T07:20:27.690 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQC3DyZm+c4YKxAAei6E3EK1RAc4xC3hf1+hOw== 2024-04-22T07:20:27.690 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2024-04-22T07:20:27.690 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCcDyZmg+deIhAADuqfpHzGCVxfPW0py7F94w== 2024-04-22T07:20:27.691 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.y] 2024-04-22T07:20:27.691 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCbDyZm5xisMBAA25X2phQv9DGp94tlBypl8g== 2024-04-22T07:20:27.691 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2024-04-22T07:20:27.691 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCbDyZmrAt+ORAAvplmPjxWYzTi/lmvvFpFpQ== 2024-04-22T07:20:27.691 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.c] 2024-04-22T07:20:27.691 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCcDyZmMR/WBBAAUEkZmKDOMZCMwSqVmIJTQg== 2024-04-22T07:20:27.692 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.e] 2024-04-22T07:20:27.692 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCcDyZmAPfJCxAA0+JcQt77cqf1jrkBJaoRBA== 2024-04-22T07:20:27.692 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.0] 2024-04-22T07:20:27.692 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCfDyZmZRrVMBAAgpEPROAoHcXfEHCmbKETeg== 2024-04-22T07:20:27.692 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.1] 2024-04-22T07:20:27.692 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCiDyZmCxFKLxAAziFVhFZk99bKOhKXVZF5GQ== 2024-04-22T07:20:27.692 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.2] 2024-04-22T07:20:27.692 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQClDyZmM+agLRAAxKO2vudewoHxLgNgKvfTnw== 2024-04-22T07:20:27.692 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.3] 2024-04-22T07:20:27.692 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCoDyZmFZ1wLBAAty3eyuNAz455Okk3hk2OhQ== 2024-04-22T07:20:27.692 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.x] 2024-04-22T07:20:27.692 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCbDyZmLsBYNhAApWXDqD8wH2lIzjjOZvG7iQ== 2024-04-22T07:20:27.692 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b] 2024-04-22T07:20:27.692 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCcDyZmYpZ0EBAA52V7nBUuxpDWBX1HFG52Kw== 2024-04-22T07:20:27.693 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.d] 2024-04-22T07:20:27.693 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCcDyZm4l1mFxAAelVjHregkH95/246Wp/iFA== 2024-04-22T07:20:27.693 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.f] 2024-04-22T07:20:27.693 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCcDyZm8nVKHhAA93E8I0OXJ2kfbmVqMedAig== 2024-04-22T07:20:27.693 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.4] 2024-04-22T07:20:27.693 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCuDyZmRPWZLxAA8qG4oUzJHbcu7az2NzGiNg== 2024-04-22T07:20:27.693 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.5] 2024-04-22T07:20:27.693 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCxDyZmWazOLRAA6/ILnG4XU4cnU+6n6jLFJw== 2024-04-22T07:20:27.693 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.6] 2024-04-22T07:20:27.693 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQC0DyZmf4lSLBAAlQ78Hw3hcK7V++XOdx/wHQ== 2024-04-22T07:20:27.693 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.7] 2024-04-22T07:20:27.693 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQC3DyZm+c4YKxAAei6E3EK1RAc4xC3hf1+hOw== 2024-04-22T07:20:27.693 INFO:teuthology.orchestra.run.smithi062.stdout:[client.0] 2024-04-22T07:20:27.693 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCcDyZmg+deIhAADuqfpHzGCVxfPW0py7F94w== 2024-04-22T07:20:27.694 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-22T07:20:27.734 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-22T07:20:27.789 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T07:20:27.792 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T07:20:27.847 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T07:20:27.849 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T07:20:27.903 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T07:20:27.906 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T07:20:27.960 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:20:27.963 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:20:28.013 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:20:28.015 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:20:28.065 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:20:28.068 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:20:28.118 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:20:28.120 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:20:28.170 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-22T07:20:28.172 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-22T07:20:28.222 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T07:20:28.224 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T07:20:28.278 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T07:20:28.280 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T07:20:28.333 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T07:20:28.335 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-22T07:20:28.387 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:20:28.390 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:20:28.439 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:20:28.442 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:20:28.492 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:20:28.495 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:20:28.545 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:20:28.548 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-22T07:20:28.598 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-22T07:20:28.600 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-22T07:20:28.653 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-22T07:20:28.653 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-22T07:20:28.679 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-22T07:20:28.774 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-22T07:20:28.799 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-22T07:20:28.825 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-22T07:20:28.920 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-22T07:20:28.944 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-22T07:20:29.008 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-22T07:20:29.108 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-22T07:20:29.133 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-22T07:20:29.136 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-22T07:20:29.189 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-22T07:20:29.189 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-22T07:20:29.189 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-22T07:20:29.192 INFO:tasks.ceph.mon.a:Started 2024-04-22T07:20:29.192 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-22T07:20:29.192 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-22T07:20:29.232 INFO:tasks.ceph.mon.b:Started 2024-04-22T07:20:29.232 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-22T07:20:29.232 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-22T07:20:29.234 INFO:tasks.ceph.mon.c:Started 2024-04-22T07:20:29.234 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-22T07:20:29.234 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-22T07:20:29.236 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-22T07:20:29.238 INFO:tasks.ceph.mgr.y:Started 2024-04-22T07:20:29.238 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-22T07:20:29.239 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-22T07:20:29.240 INFO:tasks.ceph.mgr.x:Started 2024-04-22T07:20:29.241 INFO:tasks.ceph:Setting crush tunables to default 2024-04-22T07:20:29.241 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd crush tunables default 2024-04-22T07:20:29.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.343+0000 7fb2236d2640 1 Processor -- start 2024-04-22T07:20:29.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.343+0000 7fb2236d2640 1 -- start start 2024-04-22T07:20:29.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.344+0000 7fb2236d2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb21c0c8fe0 0x7fb21c0cb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:29.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.344+0000 7fb2236d2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb21c0cb590 0x7fb21c15c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:29.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.344+0000 7fb2236d2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb21c0ca230 con 0x7fb21c152f20 2024-04-22T07:20:29.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.344+0000 7fb2236d2640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fb21c0ca510 con 0x7fb21c0cb590 2024-04-22T07:20:29.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.344+0000 7fb2236d2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb21c0ca7f0 con 0x7fb21c0c8fe0 2024-04-22T07:20:29.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.344+0000 7fb220c6d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb21c0c8fe0 0x7fb21c0cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:29.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.345+0000 7fb221c6f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb21c0cb590 0x7fb21c15c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:29.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.345+0000 7fb220c6d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb21c0c8fe0 0x7fb21c0cb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.40:58540/0 (socket says 172.21.15.40:58540) 2024-04-22T07:20:29.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.345+0000 7fb220c6d640 1 -- 172.21.15.40:0/2508909689 learned_addr learned my addr 172.21.15.40:0/2508909689 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:29.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.345+0000 7fb220c6d640 1 -- 172.21.15.40:0/2508909689 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb21c0c8fe0 msgr2=0x7fb21c0cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-22T07:20:29.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.345+0000 7fb220c6d640 1 -- 172.21.15.40:0/2508909689 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb21c0c8fe0 msgr2=0x7fb21c0cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-22T07:20:29.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.345+0000 7fb220c6d640 1 --2- 172.21.15.40:0/2508909689 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb21c0c8fe0 0x7fb21c0cb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-22T07:20:29.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.345+0000 7fb221c6f640 1 -- 172.21.15.40:0/2508909689 >> v2:172.21.15.62:3300/0 conn(0x7fb21c0cb590 msgr2=0x7fb21c15c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-22T07:20:29.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.345+0000 7fb221c6f640 1 -- 172.21.15.40:0/2508909689 >> v2:172.21.15.62:3300/0 conn(0x7fb21c0cb590 msgr2=0x7fb21c15c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-22T07:20:29.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.345+0000 7fb221c6f640 1 --2- 172.21.15.40:0/2508909689 >> v2:172.21.15.62:3300/0 conn(0x7fb21c0cb590 0x7fb21c15c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-22T07:20:29.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.345+0000 7fb220c6d640 1 --2- 172.21.15.40:0/2508909689 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb21c0c8fe0 0x7fb21c0cb050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T07:20:29.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.345+0000 7fb221c6f640 1 --2- 172.21.15.40:0/2508909689 >> v2:172.21.15.62:3300/0 conn(0x7fb21c0cb590 0x7fb21c15c5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-22T07:20:29.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.503+0000 7fb213fff640 1 -- 172.21.15.40:0/2508909689 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2015316909 0 0) 0x7fb21c0ca230 con 0x7fb21c152f20 2024-04-22T07:20:29.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.503+0000 7fb213fff640 1 -- 172.21.15.40:0/2508909689 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb208003520 con 0x7fb21c152f20 2024-04-22T07:20:29.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.505+0000 7fb213fff640 1 -- 172.21.15.40:0/2508909689 <== mon.1 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2916441050 0 0) 0x7fb208003520 con 0x7fb21c152f20 2024-04-22T07:20:29.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.505+0000 7fb213fff640 1 -- 172.21.15.40:0/2508909689 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb21c0c8fe0 msgr2=0x7fb21c0cb050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T07:20:29.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.505+0000 7fb213fff640 1 --2- 172.21.15.40:0/2508909689 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb21c0c8fe0 0x7fb21c0cb050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:29.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.505+0000 7fb213fff640 1 -- 172.21.15.40:0/2508909689 >> v2:172.21.15.62:3300/0 conn(0x7fb21c0cb590 msgr2=0x7fb21c15c5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T07:20:29.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.505+0000 7fb213fff640 1 --2- 172.21.15.40:0/2508909689 >> v2:172.21.15.62:3300/0 conn(0x7fb21c0cb590 0x7fb21c15c5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:29.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.505+0000 7fb213fff640 1 -- 172.21.15.40:0/2508909689 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21c0caad0 con 0x7fb21c152f20 2024-04-22T07:20:29.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.505+0000 7fb213fff640 1 -- 172.21.15.40:0/2508909689 <== mon.1 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7fb20c001670 con 0x7fb21c152f20 2024-04-22T07:20:29.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.505+0000 7fb213fff640 1 -- 172.21.15.40:0/2508909689 >> v1:172.21.15.62:6789/0 conn(0x7fb21c152f20 legacy=0x7fb21c0c3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:29.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.505+0000 7fb213fff640 1 --2- 172.21.15.40:0/2508909689 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb21c0c8fe0 0x7fb2080039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:29.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.505+0000 7fb213fff640 1 --2- 172.21.15.40:0/2508909689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb208004030 0x7fb208004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:29.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.505+0000 7fb213fff640 1 --2- 172.21.15.40:0/2508909689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb208004d40 0x7fb2080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:29.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.505+0000 7fb213fff640 1 -- 172.21.15.40:0/2508909689 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c0ca510 con 0x7fb208004030 2024-04-22T07:20:29.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.505+0000 7fb213fff640 1 -- 172.21.15.40:0/2508909689 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c0ca7f0 con 0x7fb208004d40 2024-04-22T07:20:29.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.505+0000 7fb213fff640 1 -- 172.21.15.40:0/2508909689 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb20800bb20 con 0x7fb21c0c8fe0 2024-04-22T07:20:29.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.505+0000 7fb220c6d640 1 --2- 172.21.15.40:0/2508909689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb208004030 0x7fb208004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:29.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.505+0000 7fb22146e640 1 --2- 172.21.15.40:0/2508909689 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb21c0c8fe0 0x7fb2080039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:29.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.505+0000 7fb221c6f640 1 --2- 172.21.15.40:0/2508909689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb208004d40 0x7fb2080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:29.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.505+0000 7fb220c6d640 1 -- 172.21.15.40:0/2508909689 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb21c0c8fe0 msgr2=0x7fb2080039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:29.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.505+0000 7fb220c6d640 1 --2- 172.21.15.40:0/2508909689 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb21c0c8fe0 0x7fb2080039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:29.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.505+0000 7fb220c6d640 1 -- 172.21.15.40:0/2508909689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb208004d40 msgr2=0x7fb2080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:29.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.505+0000 7fb220c6d640 1 --2- 172.21.15.40:0/2508909689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb208004d40 0x7fb2080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:29.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.505+0000 7fb220c6d640 1 -- 172.21.15.40:0/2508909689 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb208003520 con 0x7fb208004030 2024-04-22T07:20:29.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.506+0000 7fb220c6d640 1 --2- 172.21.15.40:0/2508909689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb208004030 0x7fb208004800 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb218009890 tx=0x7fb208005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c24f196524df5dff server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:29.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.507+0000 7fb213fff640 1 -- 172.21.15.40:0/2508909689 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb218034070 con 0x7fb208004030 2024-04-22T07:20:29.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.507+0000 7fb213fff640 1 -- 172.21.15.40:0/2508909689 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb218030660 con 0x7fb208004030 2024-04-22T07:20:29.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.507+0000 7fb213fff640 1 -- 172.21.15.40:0/2508909689 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21800f040 con 0x7fb208004030 2024-04-22T07:20:29.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.508+0000 7fb2236d2640 1 -- 172.21.15.40:0/2508909689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb208004030 msgr2=0x7fb208004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:29.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.508+0000 7fb2236d2640 1 --2- 172.21.15.40:0/2508909689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb208004030 0x7fb208004800 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb218009890 tx=0x7fb208005830 comp rx=0 tx=0).stop 2024-04-22T07:20:29.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.508+0000 7fb221c6f640 1 -- 172.21.15.40:0/2508909689 reap_dead start 2024-04-22T07:20:29.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.508+0000 7fb2236d2640 1 -- 172.21.15.40:0/2508909689 shutdown_connections 2024-04-22T07:20:29.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.508+0000 7fb2236d2640 1 -- 172.21.15.40:0/2508909689 >> 172.21.15.40:0/2508909689 conn(0x7fb21c071530 msgr2=0x7fb21c071910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:29.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.508+0000 7fb2236d2640 1 -- 172.21.15.40:0/2508909689 shutdown_connections 2024-04-22T07:20:29.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.508+0000 7fb2236d2640 1 -- 172.21.15.40:0/2508909689 wait complete. 2024-04-22T07:20:29.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.510+0000 7fb2236d2640 1 Processor -- start 2024-04-22T07:20:29.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.510+0000 7fb2236d2640 1 -- start start 2024-04-22T07:20:29.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.511+0000 7fb2236d2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb208004030 0x7fb21c157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:29.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.511+0000 7fb2236d2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb21c15afe0 0x7fb21c1f2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:29.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.511+0000 7fb2236d2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb21c1ef810 0x7fb21c148350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:29.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.511+0000 7fb2236d2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c0cb050 con 0x7fb21c15afe0 2024-04-22T07:20:29.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.511+0000 7fb2236d2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c070580 con 0x7fb21c1ef810 2024-04-22T07:20:29.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.511+0000 7fb2236d2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb21c0cb1d0 con 0x7fb208004030 2024-04-22T07:20:29.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.511+0000 7fb22146e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb208004030 0x7fb21c157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:29.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.511+0000 7fb220c6d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb21c15afe0 0x7fb21c1f2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:29.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.511+0000 7fb22146e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb208004030 0x7fb21c157740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.40:58582/0 (socket says 172.21.15.40:58582) 2024-04-22T07:20:29.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.511+0000 7fb220c6d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb21c15afe0 0x7fb21c1f2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46978/0 (socket says 172.21.15.40:46978) 2024-04-22T07:20:29.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.511+0000 7fb22146e640 1 -- 172.21.15.40:0/2918499846 learned_addr learned my addr 172.21.15.40:0/2918499846 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:29.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.511+0000 7fb221c6f640 1 --2- 172.21.15.40:0/2918499846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb21c1ef810 0x7fb21c148350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:29.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.511+0000 7fb220c6d640 1 -- 172.21.15.40:0/2918499846 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb208004030 msgr2=0x7fb21c157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:29.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.511+0000 7fb220c6d640 1 --2- 172.21.15.40:0/2918499846 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb208004030 0x7fb21c157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:29.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.511+0000 7fb220c6d640 1 -- 172.21.15.40:0/2918499846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb21c1ef810 msgr2=0x7fb21c148350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:29.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.511+0000 7fb220c6d640 1 --2- 172.21.15.40:0/2918499846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb21c1ef810 0x7fb21c148350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:29.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.512+0000 7fb220c6d640 1 -- 172.21.15.40:0/2918499846 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21c15bea0 con 0x7fb21c15afe0 2024-04-22T07:20:29.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.512+0000 7fb22146e640 1 --2- 172.21.15.40:0/2918499846 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb208004030 0x7fb21c157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:20:29.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.512+0000 7fb220c6d640 1 --2- 172.21.15.40:0/2918499846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb21c15afe0 0x7fb21c1f2ae0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb20800ba70 tx=0x7fb218004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:29.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.512+0000 7fb211ffb640 1 -- 172.21.15.40:0/2918499846 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb218034040 con 0x7fb21c15afe0 2024-04-22T07:20:29.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.512+0000 7fb211ffb640 1 -- 172.21.15.40:0/2918499846 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb21800f000 con 0x7fb21c15afe0 2024-04-22T07:20:29.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.512+0000 7fb2236d2640 1 -- 172.21.15.40:0/2918499846 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb21c1f3020 con 0x7fb21c15afe0 2024-04-22T07:20:29.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.512+0000 7fb211ffb640 1 -- 172.21.15.40:0/2918499846 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21803a9a0 con 0x7fb21c15afe0 2024-04-22T07:20:29.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.512+0000 7fb2236d2640 1 -- 172.21.15.40:0/2918499846 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb21c15bbc0 con 0x7fb21c15afe0 2024-04-22T07:20:29.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.512+0000 7fb211ffb640 1 -- 172.21.15.40:0/2918499846 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb218037070 con 0x7fb21c15afe0 2024-04-22T07:20:29.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.512+0000 7fb211ffb640 1 -- 172.21.15.40:0/2918499846 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb21804cbf0 con 0x7fb21c15afe0 2024-04-22T07:20:29.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.513+0000 7fb2236d2640 1 -- 172.21.15.40:0/2918499846 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb21c069f50 con 0x7fb21c15afe0 2024-04-22T07:20:29.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.516+0000 7fb211ffb640 1 -- 172.21.15.40:0/2918499846 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb21804c400 con 0x7fb21c15afe0 2024-04-22T07:20:29.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.582+0000 7fb2236d2640 1 -- 172.21.15.40:0/2918499846 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fb21c04fdc0 con 0x7fb21c15afe0 2024-04-22T07:20:29.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.584+0000 7fb211ffb640 1 -- 172.21.15.40:0/2918499846 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fb21803ab60 con 0x7fb21c15afe0 2024-04-22T07:20:29.582 INFO:teuthology.orchestra.run.smithi040.stderr:adjusted tunables profile to default 2024-04-22T07:20:29.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.585+0000 7fb2236d2640 1 -- 172.21.15.40:0/2918499846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb21c15afe0 msgr2=0x7fb21c1f2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:29.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.585+0000 7fb2236d2640 1 --2- 172.21.15.40:0/2918499846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb21c15afe0 0x7fb21c1f2ae0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb20800ba70 tx=0x7fb218004730 comp rx=0 tx=0).stop 2024-04-22T07:20:29.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.585+0000 7fb2236d2640 1 -- 172.21.15.40:0/2918499846 shutdown_connections 2024-04-22T07:20:29.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.585+0000 7fb2236d2640 1 --2- 172.21.15.40:0/2918499846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb21c1ef810 0x7fb21c148350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:29.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.585+0000 7fb2236d2640 1 --2- 172.21.15.40:0/2918499846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb21c15afe0 0x7fb21c1f2ae0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:29.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.585+0000 7fb2236d2640 1 --2- 172.21.15.40:0/2918499846 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb208004030 0x7fb21c157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:29.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.585+0000 7fb2236d2640 1 -- 172.21.15.40:0/2918499846 >> 172.21.15.40:0/2918499846 conn(0x7fb21c071530 msgr2=0x7fb21c1511e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:29.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.585+0000 7fb2236d2640 1 -- 172.21.15.40:0/2918499846 shutdown_connections 2024-04-22T07:20:29.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:29.585+0000 7fb2236d2640 1 -- 172.21.15.40:0/2918499846 wait complete. 2024-04-22T07:20:29.594 INFO:tasks.ceph:check_enable_crimson: False 2024-04-22T07:20:29.594 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-22T07:20:29.594 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:20:29.594 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-22T07:20:29.616 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-22T07:20:29.618+0000 7f93dedf1040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-22T07:20:29.619 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:20:29.619 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-22T07:20:29.620 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-22T07:20:29.622+0000 7fb57443f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-22T07:20:29.684 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:20:29.684 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-22T07:20:29.748 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:20:29.748 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-22T07:20:29.779 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-22T07:20:29.781+0000 7fb57443f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-22T07:20:29.780 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-22T07:20:29.782+0000 7f93dedf1040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-22T07:20:29.803 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-22T07:20:29.803 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-22T07:20:29.829 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-22T07:20:29.829 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-22T07:20:29.836 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-22T07:20:29.839+0000 7f93dedf1040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-22T07:20:29.837 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-22T07:20:29.840+0000 7fb57443f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-22T07:20:29.862 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-22T07:20:29.862 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-22T07:20:29.926 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-22T07:20:29.926 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-22T07:20:29.991 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 32238b7e-228b-4a67-bfca-16e8f0020a92 0 2024-04-22T07:20:30.100 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-22T07:20:30.102+0000 7f93dedf1040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-22T07:20:30.102 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-22T07:20:30.104+0000 7fb57443f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-22T07:20:30.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.135+0000 7f915d923640 1 Processor -- start 2024-04-22T07:20:30.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.135+0000 7f915d923640 1 -- start start 2024-04-22T07:20:30.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.136+0000 7f915d923640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91581550f0 0x7f915815ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:30.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.136+0000 7f915d923640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f91580cba00 0x7f91580c5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:30.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.136+0000 7f915d923640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f915815afd0 con 0x7f91580cb5b0 2024-04-22T07:20:30.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.136+0000 7f915d923640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f915815b290 con 0x7f91580cba00 2024-04-22T07:20:30.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.136+0000 7f915d923640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f915815b570 con 0x7f91581550f0 2024-04-22T07:20:30.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.136+0000 7f91577fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f91580cba00 0x7f91580c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:30.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.136+0000 7f9156ffd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91581550f0 0x7f915815ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:30.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.136+0000 7f91577fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f91580cba00 0x7f91580c5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40288/0 (socket says 172.21.15.62:40288) 2024-04-22T07:20:30.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.136+0000 7f91577fe640 1 -- 172.21.15.62:0/2121720863 learned_addr learned my addr 172.21.15.62:0/2121720863 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-22T07:20:30.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.136+0000 7f9156ffd640 1 -- 172.21.15.62:0/2121720863 >> v2:172.21.15.62:3300/0 conn(0x7f91580cba00 msgr2=0x7f91580c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:30.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.136+0000 7f9156ffd640 1 --2- 172.21.15.62:0/2121720863 >> v2:172.21.15.62:3300/0 conn(0x7f91580cba00 0x7f91580c5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.136+0000 7f9156ffd640 1 -- 172.21.15.62:0/2121720863 >> v1:172.21.15.40:6789/0 conn(0x7f91580cb5b0 legacy=0x7f91580cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:30.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.136+0000 7f9156ffd640 1 -- 172.21.15.62:0/2121720863 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f915815b850 con 0x7f91581550f0 2024-04-22T07:20:30.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.136+0000 7f91577fe640 1 --2- 172.21.15.62:0/2121720863 >> v2:172.21.15.62:3300/0 conn(0x7f91580cba00 0x7f91580c5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:20:30.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.137+0000 7f9156ffd640 1 --2- 172.21.15.62:0/2121720863 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91581550f0 0x7f915815ed60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f914c0097a0 tx=0x7f914c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36893b2ffcf8fe4 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:30.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.137+0000 7f9155ffb640 1 -- 172.21.15.62:0/2121720863 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914c0315a0 con 0x7f91581550f0 2024-04-22T07:20:30.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.137+0000 7f9155ffb640 1 -- 172.21.15.62:0/2121720863 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f914c037070 con 0x7f91581550f0 2024-04-22T07:20:30.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.137+0000 7f9155ffb640 1 -- 172.21.15.62:0/2121720863 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914c031960 con 0x7f91581550f0 2024-04-22T07:20:30.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.138+0000 7f915d923640 1 -- 172.21.15.62:0/2121720863 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91581550f0 msgr2=0x7f915815ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:30.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.138+0000 7f915d923640 1 --2- 172.21.15.62:0/2121720863 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91581550f0 0x7f915815ed60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f914c0097a0 tx=0x7f914c02b840 comp rx=0 tx=0).stop 2024-04-22T07:20:30.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.138+0000 7f915d923640 1 -- 172.21.15.62:0/2121720863 shutdown_connections 2024-04-22T07:20:30.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.138+0000 7f915d923640 1 --2- 172.21.15.62:0/2121720863 >> v2:172.21.15.62:3300/0 conn(0x7f91580cba00 0x7f91580c5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.138+0000 7f915d923640 1 --2- 172.21.15.62:0/2121720863 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91581550f0 0x7f915815ed60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.138+0000 7f915d923640 1 -- 172.21.15.62:0/2121720863 >> 172.21.15.62:0/2121720863 conn(0x7f915806b920 msgr2=0x7f915806bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:30.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.138+0000 7f915d923640 1 -- 172.21.15.62:0/2121720863 shutdown_connections 2024-04-22T07:20:30.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.138+0000 7f915d923640 1 -- 172.21.15.62:0/2121720863 wait complete. 2024-04-22T07:20:30.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.139+0000 7f915d923640 1 Processor -- start 2024-04-22T07:20:30.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.139+0000 7f915d923640 1 -- start start 2024-04-22T07:20:30.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.140+0000 7f915d923640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91580cb5b0 0x7f91581e4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:30.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.140+0000 7f915d923640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91580cba00 0x7f915815ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:30.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.140+0000 7f915d923640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91581550f0 0x7f915814a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:30.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.140+0000 7f915d923640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f91580cd750 con 0x7f91580cba00 2024-04-22T07:20:30.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.140+0000 7f915d923640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f91581554d0 con 0x7f91580cb5b0 2024-04-22T07:20:30.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.140+0000 7f915d923640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f91580cd8d0 con 0x7f91581550f0 2024-04-22T07:20:30.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.140+0000 7f91577fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91581550f0 0x7f915814a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:30.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.140+0000 7f9156ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91580cb5b0 0x7f91581e4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:30.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.140+0000 7f91577fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91581550f0 0x7f915814a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:59382/0 (socket says 172.21.15.62:59382) 2024-04-22T07:20:30.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.140+0000 7f91577fe640 1 -- 172.21.15.62:0/3782592783 learned_addr learned my addr 172.21.15.62:0/3782592783 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-22T07:20:30.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.140+0000 7f9156ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91580cb5b0 0x7f91581e4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40292/0 (socket says 172.21.15.62:40292) 2024-04-22T07:20:30.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.140+0000 7f91567fc640 1 --2- 172.21.15.62:0/3782592783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91580cba00 0x7f915815ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:30.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.140+0000 7f9156ffd640 1 -- 172.21.15.62:0/3782592783 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91581550f0 msgr2=0x7f915814a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:30.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.140+0000 7f9156ffd640 1 --2- 172.21.15.62:0/3782592783 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91581550f0 0x7f915814a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.140+0000 7f9156ffd640 1 -- 172.21.15.62:0/3782592783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91580cba00 msgr2=0x7f915815ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:30.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.140+0000 7f9156ffd640 1 --2- 172.21.15.62:0/3782592783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91580cba00 0x7f915815ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.140+0000 7f9156ffd640 1 -- 172.21.15.62:0/3782592783 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f915815e330 con 0x7f91580cb5b0 2024-04-22T07:20:30.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.140+0000 7f9156ffd640 1 --2- 172.21.15.62:0/3782592783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91580cb5b0 0x7f91581e4270 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f914c033000 tx=0x7f914c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:30.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.141+0000 7f913ffff640 1 -- 172.21.15.62:0/3782592783 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914c032630 con 0x7f91580cb5b0 2024-04-22T07:20:30.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.141+0000 7f913ffff640 1 -- 172.21.15.62:0/3782592783 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f914c032810 con 0x7f91580cb5b0 2024-04-22T07:20:30.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.141+0000 7f915d923640 1 -- 172.21.15.62:0/3782592783 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f915815cb70 con 0x7f91580cb5b0 2024-04-22T07:20:30.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.141+0000 7f913ffff640 1 -- 172.21.15.62:0/3782592783 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914c032c00 con 0x7f91580cb5b0 2024-04-22T07:20:30.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.141+0000 7f915d923640 1 -- 172.21.15.62:0/3782592783 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f915815ce30 con 0x7f91580cb5b0 2024-04-22T07:20:30.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.141+0000 7f913ffff640 1 -- 172.21.15.62:0/3782592783 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f914c006020 con 0x7f91580cb5b0 2024-04-22T07:20:30.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.141+0000 7f913ffff640 1 -- 172.21.15.62:0/3782592783 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f914c02f030 con 0x7f91580cb5b0 2024-04-22T07:20:30.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.142+0000 7f915d923640 1 -- 172.21.15.62:0/3782592783 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f915815db50 con 0x7f91580cb5b0 2024-04-22T07:20:30.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.144+0000 7f913ffff640 1 -- 172.21.15.62:0/3782592783 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f914c063e50 con 0x7f91580cb5b0 2024-04-22T07:20:30.147 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-22T07:20:30.149+0000 7f93dedf1040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-22T07:20:30.151 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-22T07:20:30.154+0000 7fb57443f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-22T07:20:30.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.219+0000 7f915d923640 1 -- 172.21.15.62:0/3782592783 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "32238b7e-228b-4a67-bfca-16e8f0020a92", "id": 0} v 0) -- 0x7f915804fdc0 con 0x7f91580cb5b0 2024-04-22T07:20:30.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.222+0000 7f913ffff640 1 -- 172.21.15.62:0/3782592783 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "32238b7e-228b-4a67-bfca-16e8f0020a92", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f914c052070 con 0x7f91580cb5b0 2024-04-22T07:20:30.219 INFO:teuthology.orchestra.run.smithi062.stdout:0 2024-04-22T07:20:30.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.223+0000 7f915d923640 1 -- 172.21.15.62:0/3782592783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91580cb5b0 msgr2=0x7f91581e4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:30.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.223+0000 7f915d923640 1 --2- 172.21.15.62:0/3782592783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91580cb5b0 0x7f91581e4270 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f914c033000 tx=0x7f914c0046c0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.223+0000 7f915d923640 1 -- 172.21.15.62:0/3782592783 shutdown_connections 2024-04-22T07:20:30.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.223+0000 7f915d923640 1 --2- 172.21.15.62:0/3782592783 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91581550f0 0x7f915814a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.223+0000 7f915d923640 1 --2- 172.21.15.62:0/3782592783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91580cba00 0x7f915815ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.223+0000 7f915d923640 1 --2- 172.21.15.62:0/3782592783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91580cb5b0 0x7f91581e4270 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.223+0000 7f915d923640 1 -- 172.21.15.62:0/3782592783 >> 172.21.15.62:0/3782592783 conn(0x7f915806b920 msgr2=0x7f91580ce4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:30.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.223+0000 7f915d923640 1 -- 172.21.15.62:0/3782592783 shutdown_connections 2024-04-22T07:20:30.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.223+0000 7f915d923640 1 -- 172.21.15.62:0/3782592783 wait complete. 2024-04-22T07:20:30.231 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 5ad8da43-39b1-4295-b4d1-0f1e1d06fc0d 1 2024-04-22T07:20:30.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.333+0000 7fc92aa32640 1 Processor -- start 2024-04-22T07:20:30.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.333+0000 7fc92aa32640 1 -- start start 2024-04-22T07:20:30.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.334+0000 7fc92aa32640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc924151a70 0x7fc9240728b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:30.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.334+0000 7fc92aa32640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc9240738d0 0x7fc924072df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:30.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.334+0000 7fc92aa32640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc9240c85e0 0x7fc9240c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:30.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.334+0000 7fc92aa32640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fc9240c94b0 con 0x7fc9240738d0 2024-04-22T07:20:30.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.334+0000 7fc92aa32640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fc9240c8f70 con 0x7fc9240c85e0 2024-04-22T07:20:30.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.334+0000 7fc92aa32640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc9240c49c0 con 0x7fc924151a70 2024-04-22T07:20:30.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.334+0000 7fc923fff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc924151a70 0x7fc9240728b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:30.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.334+0000 7fc928fcf640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc9240c85e0 0x7fc9240c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:30.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.334+0000 7fc923fff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc924151a70 0x7fc9240728b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:59386/0 (socket says 172.21.15.62:59386) 2024-04-22T07:20:30.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.334+0000 7fc923fff640 1 -- 172.21.15.62:0/3217854410 learned_addr learned my addr 172.21.15.62:0/3217854410 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-22T07:20:30.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.334+0000 7fc9237fe640 1 --2- 172.21.15.62:0/3217854410 >> v2:172.21.15.40:3300/0 conn(0x7fc9240738d0 0x7fc924072df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:30.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.334+0000 7fc928fcf640 1 -- 172.21.15.62:0/3217854410 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc924151a70 msgr2=0x7fc9240728b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:30.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.334+0000 7fc928fcf640 1 --2- 172.21.15.62:0/3217854410 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc924151a70 0x7fc9240728b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.334+0000 7fc928fcf640 1 -- 172.21.15.62:0/3217854410 >> v2:172.21.15.40:3300/0 conn(0x7fc9240738d0 msgr2=0x7fc924072df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:30.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.334+0000 7fc928fcf640 1 --2- 172.21.15.62:0/3217854410 >> v2:172.21.15.40:3300/0 conn(0x7fc9240738d0 0x7fc924072df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.334+0000 7fc928fcf640 1 -- 172.21.15.62:0/3217854410 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9240c4c60 con 0x7fc9240c85e0 2024-04-22T07:20:30.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.334+0000 7fc923fff640 1 --2- 172.21.15.62:0/3217854410 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc924151a70 0x7fc9240728b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:20:30.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.335+0000 7fc928fcf640 1 --2- 172.21.15.62:0/3217854410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9240c85e0 0x7fc9240c8a30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc9240c82b0 tx=0x7fc91c02e0b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b41aebb5d68cf16 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:30.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.335+0000 7fc922ffd640 1 -- 172.21.15.62:0/3217854410 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c02ea50 con 0x7fc9240c85e0 2024-04-22T07:20:30.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.335+0000 7fc922ffd640 1 -- 172.21.15.62:0/3217854410 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc91c02ebf0 con 0x7fc9240c85e0 2024-04-22T07:20:30.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.335+0000 7fc922ffd640 1 -- 172.21.15.62:0/3217854410 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c009540 con 0x7fc9240c85e0 2024-04-22T07:20:30.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.336+0000 7fc92aa32640 1 -- 172.21.15.62:0/3217854410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9240c85e0 msgr2=0x7fc9240c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:30.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.336+0000 7fc92aa32640 1 --2- 172.21.15.62:0/3217854410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9240c85e0 0x7fc9240c8a30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc9240c82b0 tx=0x7fc91c02e0b0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.336+0000 7fc92aa32640 1 -- 172.21.15.62:0/3217854410 shutdown_connections 2024-04-22T07:20:30.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.336+0000 7fc92aa32640 1 --2- 172.21.15.62:0/3217854410 >> v2:172.21.15.40:3300/0 conn(0x7fc9240738d0 0x7fc924072df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.336+0000 7fc92aa32640 1 --2- 172.21.15.62:0/3217854410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9240c85e0 0x7fc9240c8a30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.336+0000 7fc92aa32640 1 --2- 172.21.15.62:0/3217854410 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc924151a70 0x7fc9240728b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.336+0000 7fc92aa32640 1 -- 172.21.15.62:0/3217854410 >> 172.21.15.62:0/3217854410 conn(0x7fc9240c9eb0 msgr2=0x7fc9240ca2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:30.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.336+0000 7fc92aa32640 1 -- 172.21.15.62:0/3217854410 shutdown_connections 2024-04-22T07:20:30.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.336+0000 7fc92aa32640 1 -- 172.21.15.62:0/3217854410 wait complete. 2024-04-22T07:20:30.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.337+0000 7fc92aa32640 1 Processor -- start 2024-04-22T07:20:30.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.337+0000 7fc92aa32640 1 -- start start 2024-04-22T07:20:30.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.338+0000 7fc92aa32640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9240738d0 0x7fc92406c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:30.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.338+0000 7fc92aa32640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9240c85e0 0x7fc92413dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:30.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.338+0000 7fc92aa32640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc924151a70 0x7fc92413e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:30.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.338+0000 7fc92aa32640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc9240c99e0 con 0x7fc924151a70 2024-04-22T07:20:30.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.338+0000 7fc92aa32640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc9240c9700 con 0x7fc9240738d0 2024-04-22T07:20:30.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.338+0000 7fc92aa32640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc9240c7db0 con 0x7fc9240c85e0 2024-04-22T07:20:30.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.338+0000 7fc923fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9240738d0 0x7fc92406c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:30.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.338+0000 7fc9237fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9240c85e0 0x7fc92413dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:30.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.338+0000 7fc9237fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9240c85e0 0x7fc92413dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:59396/0 (socket says 172.21.15.62:59396) 2024-04-22T07:20:30.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.338+0000 7fc923fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9240738d0 0x7fc92406c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40314/0 (socket says 172.21.15.62:40314) 2024-04-22T07:20:30.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.338+0000 7fc9237fe640 1 -- 172.21.15.62:0/4151300654 learned_addr learned my addr 172.21.15.62:0/4151300654 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-22T07:20:30.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.338+0000 7fc928fcf640 1 --2- 172.21.15.62:0/4151300654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc924151a70 0x7fc92413e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:30.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.339+0000 7fc9237fe640 1 -- 172.21.15.62:0/4151300654 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9240738d0 msgr2=0x7fc92406c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:30.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.339+0000 7fc9237fe640 1 --2- 172.21.15.62:0/4151300654 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9240738d0 0x7fc92406c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.339+0000 7fc9237fe640 1 -- 172.21.15.62:0/4151300654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc924151a70 msgr2=0x7fc92413e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:30.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.339+0000 7fc9237fe640 1 --2- 172.21.15.62:0/4151300654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc924151a70 0x7fc92413e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.339+0000 7fc9237fe640 1 -- 172.21.15.62:0/4151300654 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc924152420 con 0x7fc9240c85e0 2024-04-22T07:20:30.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.339+0000 7fc9237fe640 1 --2- 172.21.15.62:0/4151300654 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9240c85e0 0x7fc92413dc30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc91400e8a0 tx=0x7fc91400ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:30.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.339+0000 7fc920ff9640 1 -- 172.21.15.62:0/4151300654 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc914017070 con 0x7fc9240c85e0 2024-04-22T07:20:30.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.339+0000 7fc920ff9640 1 -- 172.21.15.62:0/4151300654 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc91400ee90 con 0x7fc9240c85e0 2024-04-22T07:20:30.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.339+0000 7fc920ff9640 1 -- 172.21.15.62:0/4151300654 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91400cb80 con 0x7fc9240c85e0 2024-04-22T07:20:30.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.339+0000 7fc92aa32640 1 -- 172.21.15.62:0/4151300654 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9241526a0 con 0x7fc9240c85e0 2024-04-22T07:20:30.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.339+0000 7fc92aa32640 1 -- 172.21.15.62:0/4151300654 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc924152c60 con 0x7fc9240c85e0 2024-04-22T07:20:30.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.339+0000 7fc920ff9640 1 -- 172.21.15.62:0/4151300654 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc91401a070 con 0x7fc9240c85e0 2024-04-22T07:20:30.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.339+0000 7fc920ff9640 1 -- 172.21.15.62:0/4151300654 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fc9140067e0 con 0x7fc9240c85e0 2024-04-22T07:20:30.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.340+0000 7fc92aa32640 1 -- 172.21.15.62:0/4151300654 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc92414b730 con 0x7fc9240c85e0 2024-04-22T07:20:30.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.342+0000 7fc920ff9640 1 -- 172.21.15.62:0/4151300654 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fc924152420 con 0x7fc9240c85e0 2024-04-22T07:20:30.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.416+0000 7fc92aa32640 1 -- 172.21.15.62:0/4151300654 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5ad8da43-39b1-4295-b4d1-0f1e1d06fc0d", "id": 1} v 0) -- 0x7fc92406faa0 con 0x7fc9240c85e0 2024-04-22T07:20:30.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.422+0000 7fc920ff9640 1 -- 172.21.15.62:0/4151300654 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5ad8da43-39b1-4295-b4d1-0f1e1d06fc0d", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fc91400cd70 con 0x7fc9240c85e0 2024-04-22T07:20:30.420 INFO:teuthology.orchestra.run.smithi062.stdout:1 2024-04-22T07:20:30.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.423+0000 7fc92aa32640 1 -- 172.21.15.62:0/4151300654 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9240c85e0 msgr2=0x7fc92413dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:30.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.423+0000 7fc92aa32640 1 --2- 172.21.15.62:0/4151300654 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9240c85e0 0x7fc92413dc30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc91400e8a0 tx=0x7fc91400ed60 comp rx=0 tx=0).stop 2024-04-22T07:20:30.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.423+0000 7fc92aa32640 1 -- 172.21.15.62:0/4151300654 shutdown_connections 2024-04-22T07:20:30.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.423+0000 7fc92aa32640 1 --2- 172.21.15.62:0/4151300654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc924151a70 0x7fc92413e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.423+0000 7fc92aa32640 1 --2- 172.21.15.62:0/4151300654 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9240c85e0 0x7fc92413dc30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.423+0000 7fc92aa32640 1 --2- 172.21.15.62:0/4151300654 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9240738d0 0x7fc92406c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.423+0000 7fc92aa32640 1 -- 172.21.15.62:0/4151300654 >> 172.21.15.62:0/4151300654 conn(0x7fc9240c9eb0 msgr2=0x7fc9240ca290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:30.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.423+0000 7fc92aa32640 1 -- 172.21.15.62:0/4151300654 shutdown_connections 2024-04-22T07:20:30.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.423+0000 7fc92aa32640 1 -- 172.21.15.62:0/4151300654 wait complete. 2024-04-22T07:20:30.431 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 7d2c6d50-719d-4232-ad47-f04dcf1a8bc1 2 2024-04-22T07:20:30.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.534+0000 7fa2e17ce640 1 Processor -- start 2024-04-22T07:20:30.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.534+0000 7fa2e17ce640 1 -- start start 2024-04-22T07:20:30.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.535+0000 7fa2e17ce640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa2dc06b920 0x7fa2dc166710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:30.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.535+0000 7fa2e17ce640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2dc0c8960 con 0x7fa2dc154ff0 2024-04-22T07:20:30.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.535+0000 7fa2e17ce640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2dc06d040 con 0x7fa2dc06cb70 2024-04-22T07:20:30.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.535+0000 7fa2e17ce640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fa2dc06d320 con 0x7fa2dc06b920 2024-04-22T07:20:30.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.535+0000 7fa2da7fc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa2dc06cb70 0x7fa2dc15ad80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40976/0 (socket says 172.21.15.62:40976) 2024-04-22T07:20:30.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.535+0000 7fa2da7fc640 1 -- 172.21.15.62:0/3922733049 learned_addr learned my addr 172.21.15.62:0/3922733049 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-22T07:20:30.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.535+0000 7fa2db7fe640 1 --2- 172.21.15.62:0/3922733049 >> v2:172.21.15.40:3300/0 conn(0x7fa2dc06b920 0x7fa2dc166710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:30.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.535+0000 7fa2d9ffb640 1 -- 172.21.15.62:0/3922733049 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1242537554 0 0) 0x7fa2dc06d040 con 0x7fa2dc06cb70 2024-04-22T07:20:30.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.536+0000 7fa2d9ffb640 1 -- 172.21.15.62:0/3922733049 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2c4003520 con 0x7fa2dc06cb70 2024-04-22T07:20:30.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.536+0000 7fa2db7fe640 1 -- 172.21.15.62:0/3922733049 >> v1:172.21.15.62:6789/0 conn(0x7fa2dc06cb70 legacy=0x7fa2dc15ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:30.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.536+0000 7fa2db7fe640 1 -- 172.21.15.62:0/3922733049 >> v1:172.21.15.40:6789/0 conn(0x7fa2dc154ff0 legacy=0x7fa2dc0676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:30.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.536+0000 7fa2d9ffb640 1 -- 172.21.15.62:0/3922733049 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2836129185 0 0) 0x7fa2dc0c8960 con 0x7fa2dc154ff0 2024-04-22T07:20:30.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.536+0000 7fa2db7fe640 1 -- 172.21.15.62:0/3922733049 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2dc0c8c00 con 0x7fa2dc06b920 2024-04-22T07:20:30.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.536+0000 7fa2db7fe640 1 --2- 172.21.15.62:0/3922733049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2dc06b920 0x7fa2dc166710 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4009d90 tx=0x7fa2d402bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e91c5648e273636 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:30.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.537+0000 7fa2d9ffb640 1 -- 172.21.15.62:0/3922733049 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4039070 con 0x7fa2dc06b920 2024-04-22T07:20:30.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.537+0000 7fa2d9ffb640 1 -- 172.21.15.62:0/3922733049 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2d402cd80 con 0x7fa2dc06b920 2024-04-22T07:20:30.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.537+0000 7fa2d9ffb640 1 -- 172.21.15.62:0/3922733049 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4034660 con 0x7fa2dc06b920 2024-04-22T07:20:30.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.537+0000 7fa2e17ce640 1 -- 172.21.15.62:0/3922733049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2dc06b920 msgr2=0x7fa2dc166710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.537+0000 7fa2e17ce640 1 --2- 172.21.15.62:0/3922733049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2dc06b920 0x7fa2dc166710 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4009d90 tx=0x7fa2d402bfd0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.537+0000 7fa2e17ce640 1 -- 172.21.15.62:0/3922733049 shutdown_connections 2024-04-22T07:20:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.537+0000 7fa2e17ce640 1 --2- 172.21.15.62:0/3922733049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2dc06b920 0x7fa2dc166710 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.537+0000 7fa2e17ce640 1 -- 172.21.15.62:0/3922733049 >> 172.21.15.62:0/3922733049 conn(0x7fa2dc0c9eb0 msgr2=0x7fa2dc0ca2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.537+0000 7fa2e17ce640 1 -- 172.21.15.62:0/3922733049 shutdown_connections 2024-04-22T07:20:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.537+0000 7fa2e17ce640 1 -- 172.21.15.62:0/3922733049 wait complete. 2024-04-22T07:20:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.539+0000 7fa2e17ce640 1 Processor -- start 2024-04-22T07:20:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.539+0000 7fa2e17ce640 1 -- start start 2024-04-22T07:20:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.539+0000 7fa2e17ce640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2dc06b920 0x7fa2dc0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.539+0000 7fa2e17ce640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2dc06cb70 0x7fa2dc0c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.539+0000 7fa2e17ce640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2dc154ff0 0x7fa2dc14d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.539+0000 7fa2e17ce640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa2dc1553d0 con 0x7fa2dc06cb70 2024-04-22T07:20:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.539+0000 7fa2e17ce640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa2dc0c9250 con 0x7fa2dc154ff0 2024-04-22T07:20:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.539+0000 7fa2e17ce640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa2dc067dc0 con 0x7fa2dc06b920 2024-04-22T07:20:30.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.539+0000 7fa2db7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2dc154ff0 0x7fa2dc14d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:30.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.540+0000 7fa2daffd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2dc06b920 0x7fa2dc0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:30.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.540+0000 7fa2db7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2dc154ff0 0x7fa2dc14d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40324/0 (socket says 172.21.15.62:40324) 2024-04-22T07:20:30.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.540+0000 7fa2db7fe640 1 -- 172.21.15.62:0/660321587 learned_addr learned my addr 172.21.15.62:0/660321587 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-22T07:20:30.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.540+0000 7fa2da7fc640 1 --2- 172.21.15.62:0/660321587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2dc06cb70 0x7fa2dc0c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:30.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.540+0000 7fa2db7fe640 1 -- 172.21.15.62:0/660321587 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2dc06b920 msgr2=0x7fa2dc0c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:30.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.540+0000 7fa2db7fe640 1 --2- 172.21.15.62:0/660321587 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2dc06b920 0x7fa2dc0c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.540+0000 7fa2db7fe640 1 -- 172.21.15.62:0/660321587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2dc06cb70 msgr2=0x7fa2dc0c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:30.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.540+0000 7fa2db7fe640 1 --2- 172.21.15.62:0/660321587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2dc06cb70 0x7fa2dc0c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.540+0000 7fa2db7fe640 1 -- 172.21.15.62:0/660321587 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2dc1544c0 con 0x7fa2dc154ff0 2024-04-22T07:20:30.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.540+0000 7fa2daffd640 1 --2- 172.21.15.62:0/660321587 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2dc06b920 0x7fa2dc0c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:20:30.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.540+0000 7fa2da7fc640 1 --2- 172.21.15.62:0/660321587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2dc06cb70 0x7fa2dc0c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:20:30.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.540+0000 7fa2db7fe640 1 --2- 172.21.15.62:0/660321587 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2dc154ff0 0x7fa2dc14d5c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4009d90 tx=0x7fa2d4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:30.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.540+0000 7fa2c37fe640 1 -- 172.21.15.62:0/660321587 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4039050 con 0x7fa2dc154ff0 2024-04-22T07:20:30.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.540+0000 7fa2c37fe640 1 -- 172.21.15.62:0/660321587 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2d403a040 con 0x7fa2dc154ff0 2024-04-22T07:20:30.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.540+0000 7fa2e17ce640 1 -- 172.21.15.62:0/660321587 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2dc14c170 con 0x7fa2dc154ff0 2024-04-22T07:20:30.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.540+0000 7fa2c37fe640 1 -- 172.21.15.62:0/660321587 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4009450 con 0x7fa2dc154ff0 2024-04-22T07:20:30.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.540+0000 7fa2e17ce640 1 -- 172.21.15.62:0/660321587 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2dc14c730 con 0x7fa2dc154ff0 2024-04-22T07:20:30.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.540+0000 7fa2c37fe640 1 -- 172.21.15.62:0/660321587 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa2d4047020 con 0x7fa2dc154ff0 2024-04-22T07:20:30.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.540+0000 7fa2c37fe640 1 -- 172.21.15.62:0/660321587 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fa2d403e610 con 0x7fa2dc154ff0 2024-04-22T07:20:30.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.542+0000 7fa2e17ce640 1 -- 172.21.15.62:0/660321587 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2dc0c4550 con 0x7fa2dc154ff0 2024-04-22T07:20:30.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.544+0000 7fa2c37fe640 1 -- 172.21.15.62:0/660321587 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fa2d404e020 con 0x7fa2dc154ff0 2024-04-22T07:20:30.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.618+0000 7fa2e17ce640 1 -- 172.21.15.62:0/660321587 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7d2c6d50-719d-4232-ad47-f04dcf1a8bc1", "id": 2} v 0) -- 0x7fa2dc04fdc0 con 0x7fa2dc154ff0 2024-04-22T07:20:30.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.624+0000 7fa2c37fe640 1 -- 172.21.15.62:0/660321587 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7d2c6d50-719d-4232-ad47-f04dcf1a8bc1", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fa2dc1544c0 con 0x7fa2dc154ff0 2024-04-22T07:20:30.622 INFO:teuthology.orchestra.run.smithi062.stdout:2 2024-04-22T07:20:30.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.624+0000 7fa2e17ce640 1 -- 172.21.15.62:0/660321587 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2dc154ff0 msgr2=0x7fa2dc14d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:30.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.625+0000 7fa2e17ce640 1 --2- 172.21.15.62:0/660321587 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2dc154ff0 0x7fa2dc14d5c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4009d90 tx=0x7fa2d4004a40 comp rx=0 tx=0).stop 2024-04-22T07:20:30.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.625+0000 7fa2e17ce640 1 -- 172.21.15.62:0/660321587 shutdown_connections 2024-04-22T07:20:30.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.625+0000 7fa2e17ce640 1 --2- 172.21.15.62:0/660321587 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2dc154ff0 0x7fa2dc14d5c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.625+0000 7fa2e17ce640 1 --2- 172.21.15.62:0/660321587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2dc06cb70 0x7fa2dc0c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.625+0000 7fa2e17ce640 1 --2- 172.21.15.62:0/660321587 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa2dc06b920 0x7fa2dc0c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.625+0000 7fa2e17ce640 1 -- 172.21.15.62:0/660321587 >> 172.21.15.62:0/660321587 conn(0x7fa2dc0c9eb0 msgr2=0x7fa2dc073450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:30.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.625+0000 7fa2e17ce640 1 -- 172.21.15.62:0/660321587 shutdown_connections 2024-04-22T07:20:30.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.625+0000 7fa2e17ce640 1 -- 172.21.15.62:0/660321587 wait complete. 2024-04-22T07:20:30.633 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new af42e7d6-a6bf-403e-92e7-162d7c4fbf0e 3 2024-04-22T07:20:30.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.735+0000 7fee2572b640 1 Processor -- start 2024-04-22T07:20:30.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.735+0000 7fee2572b640 1 -- start start 2024-04-22T07:20:30.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.736+0000 7fee2572b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fee200c9ac0 0x7fee20158570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:30.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.736+0000 7fee2572b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee20157ab0 con 0x7fee200c9ea0 2024-04-22T07:20:30.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.736+0000 7fee2572b640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee2006c0d0 con 0x7fee20071fd0 2024-04-22T07:20:30.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.736+0000 7fee2572b640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fee200c9640 con 0x7fee200c9ac0 2024-04-22T07:20:30.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.736+0000 7fee1effd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fee200c9ac0 0x7fee20158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:30.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.736+0000 7fee1effd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fee200c9ac0 0x7fee20158570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40328/0 (socket says 172.21.15.62:40328) 2024-04-22T07:20:30.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.736+0000 7fee1effd640 1 -- 172.21.15.62:0/1341704540 learned_addr learned my addr 172.21.15.62:0/1341704540 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-22T07:20:30.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.737+0000 7fee1effd640 1 -- 172.21.15.62:0/1341704540 >> v1:172.21.15.62:6789/0 conn(0x7fee20071fd0 legacy=0x7fee20151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:30.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.737+0000 7fee1effd640 1 -- 172.21.15.62:0/1341704540 >> v1:172.21.15.40:6789/0 conn(0x7fee200c9ea0 legacy=0x7fee2015bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:30.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.737+0000 7fee1effd640 1 -- 172.21.15.62:0/1341704540 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee2006c3b0 con 0x7fee200c9ac0 2024-04-22T07:20:30.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.737+0000 7fee1effd640 1 --2- 172.21.15.62:0/1341704540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee200c9ac0 0x7fee20158570 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fee14009870 tx=0x7fee1402ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fb78210929aae1a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:30.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.737+0000 7fee1dffb640 1 -- 172.21.15.62:0/1341704540 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1402f850 con 0x7fee200c9ac0 2024-04-22T07:20:30.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.738+0000 7fee1dffb640 1 -- 172.21.15.62:0/1341704540 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee1402f9f0 con 0x7fee200c9ac0 2024-04-22T07:20:30.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.738+0000 7fee1dffb640 1 -- 172.21.15.62:0/1341704540 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1402fdc0 con 0x7fee200c9ac0 2024-04-22T07:20:30.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.738+0000 7fee2572b640 1 -- 172.21.15.62:0/1341704540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee200c9ac0 msgr2=0x7fee20158570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:30.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.738+0000 7fee2572b640 1 --2- 172.21.15.62:0/1341704540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee200c9ac0 0x7fee20158570 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fee14009870 tx=0x7fee1402ba30 comp rx=0 tx=0).stop 2024-04-22T07:20:30.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.738+0000 7fee2572b640 1 -- 172.21.15.62:0/1341704540 shutdown_connections 2024-04-22T07:20:30.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.738+0000 7fee2572b640 1 --2- 172.21.15.62:0/1341704540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee200c9ac0 0x7fee20158570 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.738+0000 7fee2572b640 1 -- 172.21.15.62:0/1341704540 >> 172.21.15.62:0/1341704540 conn(0x7fee200701f0 msgr2=0x7fee2006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:30.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.738+0000 7fee2572b640 1 -- 172.21.15.62:0/1341704540 shutdown_connections 2024-04-22T07:20:30.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.738+0000 7fee2572b640 1 -- 172.21.15.62:0/1341704540 wait complete. 2024-04-22T07:20:30.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.740+0000 7fee2572b640 1 Processor -- start 2024-04-22T07:20:30.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.740+0000 7fee2572b640 1 -- start start 2024-04-22T07:20:30.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.740+0000 7fee2572b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee20071fd0 0x7fee20163e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:30.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.740+0000 7fee2572b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fee200c9ac0 0x7fee20150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:30.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.740+0000 7fee2572b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee200c9ea0 0x7fee20143b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:30.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.740+0000 7fee2572b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fee20157d70 con 0x7fee200c9ea0 2024-04-22T07:20:30.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.740+0000 7fee2572b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fee20158ab0 con 0x7fee20071fd0 2024-04-22T07:20:30.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.740+0000 7fee2572b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fee20158050 con 0x7fee200c9ac0 2024-04-22T07:20:30.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.740+0000 7fee1e7fc640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fee200c9ac0 0x7fee20150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:30.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.740+0000 7fee1effd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee20071fd0 0x7fee20163e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:30.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.740+0000 7fee1e7fc640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fee200c9ac0 0x7fee20150750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:59420/0 (socket says 172.21.15.62:59420) 2024-04-22T07:20:30.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.740+0000 7fee1effd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee20071fd0 0x7fee20163e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40332/0 (socket says 172.21.15.62:40332) 2024-04-22T07:20:30.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.740+0000 7fee1e7fc640 1 -- 172.21.15.62:0/1462834998 learned_addr learned my addr 172.21.15.62:0/1462834998 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-22T07:20:30.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.740+0000 7fee1f7fe640 1 --2- 172.21.15.62:0/1462834998 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee200c9ea0 0x7fee20143b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:30.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.741+0000 7fee1effd640 1 -- 172.21.15.62:0/1462834998 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fee200c9ac0 msgr2=0x7fee20150750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:30.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.741+0000 7fee1effd640 1 --2- 172.21.15.62:0/1462834998 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fee200c9ac0 0x7fee20150750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.741+0000 7fee1effd640 1 -- 172.21.15.62:0/1462834998 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee200c9ea0 msgr2=0x7fee20143b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:30.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.741+0000 7fee1effd640 1 --2- 172.21.15.62:0/1462834998 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee200c9ea0 0x7fee20143b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.741+0000 7fee1effd640 1 -- 172.21.15.62:0/1462834998 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee20164db0 con 0x7fee20071fd0 2024-04-22T07:20:30.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.741+0000 7fee1e7fc640 1 --2- 172.21.15.62:0/1462834998 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fee200c9ac0 0x7fee20150750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:20:30.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.741+0000 7fee1f7fe640 1 --2- 172.21.15.62:0/1462834998 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee200c9ea0 0x7fee20143b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:20:30.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.741+0000 7fee1effd640 1 --2- 172.21.15.62:0/1462834998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee20071fd0 0x7fee20163e50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fee2006f020 tx=0x7fee14004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:30.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.741+0000 7fee077fe640 1 -- 172.21.15.62:0/1462834998 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14047070 con 0x7fee20071fd0 2024-04-22T07:20:30.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.741+0000 7fee077fe640 1 -- 172.21.15.62:0/1462834998 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee14042480 con 0x7fee20071fd0 2024-04-22T07:20:30.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.741+0000 7fee077fe640 1 -- 172.21.15.62:0/1462834998 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14042870 con 0x7fee20071fd0 2024-04-22T07:20:30.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.741+0000 7fee2572b640 1 -- 172.21.15.62:0/1462834998 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee20165090 con 0x7fee20071fd0 2024-04-22T07:20:30.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.741+0000 7fee2572b640 1 -- 172.21.15.62:0/1462834998 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee20143370 con 0x7fee20071fd0 2024-04-22T07:20:30.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.741+0000 7fee077fe640 1 -- 172.21.15.62:0/1462834998 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fee1404a070 con 0x7fee20071fd0 2024-04-22T07:20:30.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.741+0000 7fee077fe640 1 -- 172.21.15.62:0/1462834998 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fee1402d870 con 0x7fee20071fd0 2024-04-22T07:20:30.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.742+0000 7fee2572b640 1 -- 172.21.15.62:0/1462834998 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee2006f580 con 0x7fee20071fd0 2024-04-22T07:20:30.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.746+0000 7fee077fe640 1 -- 172.21.15.62:0/1462834998 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fee2006f580 con 0x7fee20071fd0 2024-04-22T07:20:30.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.820+0000 7fee2572b640 1 -- 172.21.15.62:0/1462834998 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "af42e7d6-a6bf-403e-92e7-162d7c4fbf0e", "id": 3} v 0) -- 0x7fee200c9430 con 0x7fee20071fd0 2024-04-22T07:20:30.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.826+0000 7fee077fe640 1 -- 172.21.15.62:0/1462834998 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "af42e7d6-a6bf-403e-92e7-162d7c4fbf0e", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fee200c9430 con 0x7fee20071fd0 2024-04-22T07:20:30.823 INFO:teuthology.orchestra.run.smithi062.stdout:3 2024-04-22T07:20:30.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.826+0000 7fee2572b640 1 -- 172.21.15.62:0/1462834998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee20071fd0 msgr2=0x7fee20163e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:30.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.826+0000 7fee2572b640 1 --2- 172.21.15.62:0/1462834998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee20071fd0 0x7fee20163e50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fee2006f020 tx=0x7fee14004730 comp rx=0 tx=0).stop 2024-04-22T07:20:30.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.826+0000 7fee2572b640 1 -- 172.21.15.62:0/1462834998 shutdown_connections 2024-04-22T07:20:30.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.826+0000 7fee2572b640 1 --2- 172.21.15.62:0/1462834998 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee200c9ea0 0x7fee20143b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.826+0000 7fee2572b640 1 --2- 172.21.15.62:0/1462834998 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fee200c9ac0 0x7fee20150750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.826+0000 7fee2572b640 1 --2- 172.21.15.62:0/1462834998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee20071fd0 0x7fee20163e50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.826+0000 7fee2572b640 1 -- 172.21.15.62:0/1462834998 >> 172.21.15.62:0/1462834998 conn(0x7fee200701f0 msgr2=0x7fee20072440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:30.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.826+0000 7fee2572b640 1 -- 172.21.15.62:0/1462834998 shutdown_connections 2024-04-22T07:20:30.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.827+0000 7fee2572b640 1 -- 172.21.15.62:0/1462834998 wait complete. 2024-04-22T07:20:30.835 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new f8e89e0d-be96-4f19-88c0-69c408df7d98 4 2024-04-22T07:20:30.886 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-22T07:20:30.888+0000 7f93dedf1040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-22T07:20:30.904 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-22T07:20:30.906+0000 7fb57443f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-22T07:20:30.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.938+0000 7fd855070640 1 Processor -- start 2024-04-22T07:20:30.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.938+0000 7fd855070640 1 -- start start 2024-04-22T07:20:30.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.939+0000 7fd855070640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd850153100 0x7fd85015c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:30.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.939+0000 7fd855070640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd850158d90 con 0x7fd8500c6cc0 2024-04-22T07:20:30.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.939+0000 7fd855070640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd850159070 con 0x7fd8500c70a0 2024-04-22T07:20:30.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.939+0000 7fd855070640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fd8501599a0 con 0x7fd850153100 2024-04-22T07:20:30.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.939+0000 7fd84f59e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd850153100 0x7fd85015c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:30.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.939+0000 7fd84f59e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd850153100 0x7fd85015c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40334/0 (socket says 172.21.15.62:40334) 2024-04-22T07:20:30.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.939+0000 7fd84e59c640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd8500c70a0 0x7fd8501529f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40980/0 (socket says 172.21.15.62:40980) 2024-04-22T07:20:30.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.939+0000 7fd84f59e640 1 -- 172.21.15.62:0/3762984395 learned_addr learned my addr 172.21.15.62:0/3762984395 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-22T07:20:30.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.939+0000 7fd84f59e640 1 -- 172.21.15.62:0/3762984395 >> v1:172.21.15.62:6789/0 conn(0x7fd8500c70a0 legacy=0x7fd8501529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:30.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.939+0000 7fd84dd9b640 1 -- 172.21.15.62:0/3762984395 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3793151656 0 0) 0x7fd850158d90 con 0x7fd8500c6cc0 2024-04-22T07:20:30.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.939+0000 7fd84f59e640 1 -- 172.21.15.62:0/3762984395 >> v1:172.21.15.40:6789/0 conn(0x7fd8500c6cc0 legacy=0x7fd8500c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:30.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.939+0000 7fd84f59e640 1 -- 172.21.15.62:0/3762984395 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd850159350 con 0x7fd850153100 2024-04-22T07:20:30.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.940+0000 7fd84f59e640 1 --2- 172.21.15.62:0/3762984395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd850153100 0x7fd85015c2e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd848009e50 tx=0x7fd84802c010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc5a428cc2288437 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:30.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.940+0000 7fd84dd9b640 1 -- 172.21.15.62:0/3762984395 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84802cbb0 con 0x7fd850153100 2024-04-22T07:20:30.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.940+0000 7fd84dd9b640 1 -- 172.21.15.62:0/3762984395 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd84802cd50 con 0x7fd850153100 2024-04-22T07:20:30.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.940+0000 7fd84dd9b640 1 -- 172.21.15.62:0/3762984395 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd848034610 con 0x7fd850153100 2024-04-22T07:20:30.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.941+0000 7fd855070640 1 -- 172.21.15.62:0/3762984395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd850153100 msgr2=0x7fd85015c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:30.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.941+0000 7fd855070640 1 --2- 172.21.15.62:0/3762984395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd850153100 0x7fd85015c2e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd848009e50 tx=0x7fd84802c010 comp rx=0 tx=0).stop 2024-04-22T07:20:30.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.941+0000 7fd855070640 1 -- 172.21.15.62:0/3762984395 shutdown_connections 2024-04-22T07:20:30.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.941+0000 7fd855070640 1 --2- 172.21.15.62:0/3762984395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd850153100 0x7fd85015c2e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.941+0000 7fd855070640 1 -- 172.21.15.62:0/3762984395 >> 172.21.15.62:0/3762984395 conn(0x7fd8500ca470 msgr2=0x7fd8500cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:30.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.941+0000 7fd855070640 1 -- 172.21.15.62:0/3762984395 shutdown_connections 2024-04-22T07:20:30.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.941+0000 7fd855070640 1 -- 172.21.15.62:0/3762984395 wait complete. 2024-04-22T07:20:30.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.943+0000 7fd855070640 1 Processor -- start 2024-04-22T07:20:30.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.943+0000 7fd855070640 1 -- start start 2024-04-22T07:20:30.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.944+0000 7fd855070640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8500c6cc0 0x7fd85014a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:30.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.944+0000 7fd855070640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8500c70a0 0x7fd8500cc400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:30.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.944+0000 7fd855070640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd850153100 0x7fd85014e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:30.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.944+0000 7fd855070640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd850072f70 con 0x7fd8500c70a0 2024-04-22T07:20:30.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.944+0000 7fd855070640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd8500c85d0 con 0x7fd8500c6cc0 2024-04-22T07:20:30.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.944+0000 7fd855070640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fd8500730f0 con 0x7fd850153100 2024-04-22T07:20:30.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.945+0000 7fd84ed9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8500c6cc0 0x7fd85014a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:30.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.945+0000 7fd84f59e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd850153100 0x7fd85014e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:30.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.945+0000 7fd84ed9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8500c6cc0 0x7fd85014a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40340/0 (socket says 172.21.15.62:40340) 2024-04-22T07:20:30.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.945+0000 7fd84ed9d640 1 -- 172.21.15.62:0/53638056 learned_addr learned my addr 172.21.15.62:0/53638056 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-22T07:20:30.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.945+0000 7fd84f59e640 1 --2- 172.21.15.62:0/53638056 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd850153100 0x7fd85014e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:59428/0 (socket says 172.21.15.62:59428) 2024-04-22T07:20:30.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.945+0000 7fd84e59c640 1 --2- 172.21.15.62:0/53638056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8500c70a0 0x7fd8500cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:30.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.945+0000 7fd84ed9d640 1 -- 172.21.15.62:0/53638056 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd850153100 msgr2=0x7fd85014e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:30.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.945+0000 7fd84ed9d640 1 --2- 172.21.15.62:0/53638056 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd850153100 0x7fd85014e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.945+0000 7fd84ed9d640 1 -- 172.21.15.62:0/53638056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8500c70a0 msgr2=0x7fd8500cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:30.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.945+0000 7fd84ed9d640 1 --2- 172.21.15.62:0/53638056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8500c70a0 0x7fd8500cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:30.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.945+0000 7fd84ed9d640 1 -- 172.21.15.62:0/53638056 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85014c680 con 0x7fd8500c6cc0 2024-04-22T07:20:30.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.945+0000 7fd84f59e640 1 --2- 172.21.15.62:0/53638056 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd850153100 0x7fd85014e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:20:30.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.945+0000 7fd84e59c640 1 --2- 172.21.15.62:0/53638056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8500c70a0 0x7fd8500cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:20:30.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.945+0000 7fd84ed9d640 1 --2- 172.21.15.62:0/53638056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8500c6cc0 0x7fd85014a100 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd84000c460 tx=0x7fd84000c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:30.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.945+0000 7fd8377fe640 1 -- 172.21.15.62:0/53638056 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd840005480 con 0x7fd8500c6cc0 2024-04-22T07:20:30.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.945+0000 7fd8377fe640 1 -- 172.21.15.62:0/53638056 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8400035f0 con 0x7fd8500c6cc0 2024-04-22T07:20:30.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.945+0000 7fd8377fe640 1 -- 172.21.15.62:0/53638056 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd840003a00 con 0x7fd8500c6cc0 2024-04-22T07:20:30.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.945+0000 7fd855070640 1 -- 172.21.15.62:0/53638056 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd85014a640 con 0x7fd8500c6cc0 2024-04-22T07:20:30.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.945+0000 7fd855070640 1 -- 172.21.15.62:0/53638056 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd85014b200 con 0x7fd8500c6cc0 2024-04-22T07:20:30.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.946+0000 7fd8377fe640 1 -- 172.21.15.62:0/53638056 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd840003ba0 con 0x7fd8500c6cc0 2024-04-22T07:20:30.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.946+0000 7fd8377fe640 1 -- 172.21.15.62:0/53638056 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fd840012950 con 0x7fd8500c6cc0 2024-04-22T07:20:30.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.946+0000 7fd855070640 1 -- 172.21.15.62:0/53638056 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd850157880 con 0x7fd8500c6cc0 2024-04-22T07:20:30.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:30.948+0000 7fd8377fe640 1 -- 172.21.15.62:0/53638056 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fd850157880 con 0x7fd8500c6cc0 2024-04-22T07:20:30.978 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-22T07:20:30.980+0000 7f93dedf1040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-22T07:20:30.999 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-22T07:20:31.002+0000 7fb57443f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-22T07:20:31.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.023+0000 7fd855070640 1 -- 172.21.15.62:0/53638056 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f8e89e0d-be96-4f19-88c0-69c408df7d98", "id": 4} v 0) -- 0x7fd8501575a0 con 0x7fd8500c6cc0 2024-04-22T07:20:31.022 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-22T07:20:31.025+0000 7f93dedf1040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-22T07:20:31.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.028+0000 7fd8377fe640 1 -- 172.21.15.62:0/53638056 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f8e89e0d-be96-4f19-88c0-69c408df7d98", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fd8501575a0 con 0x7fd8500c6cc0 2024-04-22T07:20:31.025 INFO:teuthology.orchestra.run.smithi062.stdout:4 2024-04-22T07:20:31.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.029+0000 7fd855070640 1 -- 172.21.15.62:0/53638056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8500c6cc0 msgr2=0x7fd85014a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:31.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.029+0000 7fd855070640 1 --2- 172.21.15.62:0/53638056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8500c6cc0 0x7fd85014a100 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd84000c460 tx=0x7fd84000c920 comp rx=0 tx=0).stop 2024-04-22T07:20:31.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.029+0000 7fd855070640 1 -- 172.21.15.62:0/53638056 shutdown_connections 2024-04-22T07:20:31.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.029+0000 7fd855070640 1 --2- 172.21.15.62:0/53638056 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd850153100 0x7fd85014e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.029+0000 7fd855070640 1 --2- 172.21.15.62:0/53638056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8500c70a0 0x7fd8500cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.029+0000 7fd855070640 1 --2- 172.21.15.62:0/53638056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8500c6cc0 0x7fd85014a100 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.029+0000 7fd855070640 1 -- 172.21.15.62:0/53638056 >> 172.21.15.62:0/53638056 conn(0x7fd8500ca470 msgr2=0x7fd850151700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:31.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.029+0000 7fd855070640 1 -- 172.21.15.62:0/53638056 shutdown_connections 2024-04-22T07:20:31.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.029+0000 7fd855070640 1 -- 172.21.15.62:0/53638056 wait complete. 2024-04-22T07:20:31.037 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new ba6dc1bc-272b-4f80-b55f-40bc4a0c3ff6 5 2024-04-22T07:20:31.045 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-22T07:20:31.048+0000 7fb57443f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-22T07:20:31.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.139+0000 7fd3fa159640 1 Processor -- start 2024-04-22T07:20:31.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.139+0000 7fd3fa159640 1 -- start start 2024-04-22T07:20:31.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.140+0000 7fd3fa159640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd3f4156550 0x7fd3f40c3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:31.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.140+0000 7fd3fa159640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd3f4159690 0x7fd3f40c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:31.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.140+0000 7fd3fa159640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3f40c91c0 con 0x7fd3f40ca080 2024-04-22T07:20:31.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.140+0000 7fd3fa159640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fd3f40c8f70 con 0x7fd3f4156550 2024-04-22T07:20:31.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.140+0000 7fd3fa159640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fd3f40c94a0 con 0x7fd3f4159690 2024-04-22T07:20:31.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.140+0000 7fd3f3fff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd3f4159690 0x7fd3f40c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:31.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.140+0000 7fd3f37fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd3f4156550 0x7fd3f40c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:31.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.140+0000 7fd3f3fff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd3f4159690 0x7fd3f40c3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:59430/0 (socket says 172.21.15.62:59430) 2024-04-22T07:20:31.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.140+0000 7fd3f37fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd3f4156550 0x7fd3f40c3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40348/0 (socket says 172.21.15.62:40348) 2024-04-22T07:20:31.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.140+0000 7fd3f3fff640 1 -- 172.21.15.62:0/1324102529 learned_addr learned my addr 172.21.15.62:0/1324102529 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-22T07:20:31.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.140+0000 7fd3f3fff640 1 -- 172.21.15.62:0/1324102529 >> v2:172.21.15.62:3300/0 conn(0x7fd3f4156550 msgr2=0x7fd3f40c3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:31.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.140+0000 7fd3f3fff640 1 --2- 172.21.15.62:0/1324102529 >> v2:172.21.15.62:3300/0 conn(0x7fd3f4156550 0x7fd3f40c3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.140+0000 7fd3f3fff640 1 -- 172.21.15.62:0/1324102529 >> v1:172.21.15.40:6789/0 conn(0x7fd3f40ca080 legacy=0x7fd3f4070030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:31.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.140+0000 7fd3f3fff640 1 -- 172.21.15.62:0/1324102529 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f406f550 con 0x7fd3f4159690 2024-04-22T07:20:31.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.140+0000 7fd3f27fc640 1 -- 172.21.15.62:0/1324102529 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3664070026 0 0) 0x7fd3f40c91c0 con 0x7fd3f40ca080 2024-04-22T07:20:31.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.140+0000 7fd3f37fe640 1 --2- 172.21.15.62:0/1324102529 >> v2:172.21.15.62:3300/0 conn(0x7fd3f4156550 0x7fd3f40c3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:20:31.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.141+0000 7fd3f3fff640 1 --2- 172.21.15.62:0/1324102529 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd3f4159690 0x7fd3f40c3dc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec009e50 tx=0x7fd3ec02bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c42ac70b983bc588 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:31.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.141+0000 7fd3f27fc640 1 -- 172.21.15.62:0/1324102529 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec02cb90 con 0x7fd3f4159690 2024-04-22T07:20:31.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.141+0000 7fd3f27fc640 1 -- 172.21.15.62:0/1324102529 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3ec02cd30 con 0x7fd3f4159690 2024-04-22T07:20:31.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.141+0000 7fd3f27fc640 1 -- 172.21.15.62:0/1324102529 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec034610 con 0x7fd3f4159690 2024-04-22T07:20:31.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.142+0000 7fd3fa159640 1 -- 172.21.15.62:0/1324102529 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd3f4159690 msgr2=0x7fd3f40c3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:31.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.142+0000 7fd3fa159640 1 --2- 172.21.15.62:0/1324102529 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd3f4159690 0x7fd3f40c3dc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec009e50 tx=0x7fd3ec02bff0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.142+0000 7fd3fa159640 1 -- 172.21.15.62:0/1324102529 shutdown_connections 2024-04-22T07:20:31.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.142+0000 7fd3fa159640 1 --2- 172.21.15.62:0/1324102529 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd3f4159690 0x7fd3f40c3dc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.142+0000 7fd3fa159640 1 --2- 172.21.15.62:0/1324102529 >> v2:172.21.15.62:3300/0 conn(0x7fd3f4156550 0x7fd3f40c3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.142+0000 7fd3fa159640 1 -- 172.21.15.62:0/1324102529 >> 172.21.15.62:0/1324102529 conn(0x7fd3f406db30 msgr2=0x7fd3f406df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:31.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.142+0000 7fd3fa159640 1 -- 172.21.15.62:0/1324102529 shutdown_connections 2024-04-22T07:20:31.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.142+0000 7fd3fa159640 1 -- 172.21.15.62:0/1324102529 wait complete. 2024-04-22T07:20:31.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.143+0000 7fd3fa159640 1 Processor -- start 2024-04-22T07:20:31.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.143+0000 7fd3fa159640 1 -- start start 2024-04-22T07:20:31.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.144+0000 7fd3fa159640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3f40ca080 0x7fd3f41ef3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:31.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.144+0000 7fd3fa159640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd3f4156550 0x7fd3f40b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:31.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.144+0000 7fd3fa159640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3f4159690 0x7fd3f414ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:31.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.144+0000 7fd3fa159640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f4159b20 con 0x7fd3f40ca080 2024-04-22T07:20:31.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.144+0000 7fd3fa159640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f406fb10 con 0x7fd3f4159690 2024-04-22T07:20:31.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.144+0000 7fd3fa159640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fd3f4070ea0 con 0x7fd3f4156550 2024-04-22T07:20:31.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.144+0000 7fd3f2ffd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd3f4156550 0x7fd3f40b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:31.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.144+0000 7fd3f3fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3f4159690 0x7fd3f414ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:31.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.144+0000 7fd3f2ffd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd3f4156550 0x7fd3f40b1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:59436/0 (socket says 172.21.15.62:59436) 2024-04-22T07:20:31.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.144+0000 7fd3f37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3f40ca080 0x7fd3f41ef3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:31.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.144+0000 7fd3f2ffd640 1 -- 172.21.15.62:0/1669641403 learned_addr learned my addr 172.21.15.62:0/1669641403 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-22T07:20:31.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.144+0000 7fd3f3fff640 1 -- 172.21.15.62:0/1669641403 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd3f4156550 msgr2=0x7fd3f40b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:31.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.144+0000 7fd3f3fff640 1 --2- 172.21.15.62:0/1669641403 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd3f4156550 0x7fd3f40b1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.144+0000 7fd3f3fff640 1 -- 172.21.15.62:0/1669641403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3f40ca080 msgr2=0x7fd3f41ef3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:31.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.144+0000 7fd3f3fff640 1 --2- 172.21.15.62:0/1669641403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3f40ca080 0x7fd3f41ef3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.144+0000 7fd3f3fff640 1 -- 172.21.15.62:0/1669641403 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f40b3b40 con 0x7fd3f4159690 2024-04-22T07:20:31.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.144+0000 7fd3f2ffd640 1 --2- 172.21.15.62:0/1669641403 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd3f4156550 0x7fd3f40b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:20:31.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.144+0000 7fd3f37fe640 1 --2- 172.21.15.62:0/1669641403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3f40ca080 0x7fd3f41ef3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:20:31.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.144+0000 7fd3f3fff640 1 --2- 172.21.15.62:0/1669641403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3f4159690 0x7fd3f414ca10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec032000 tx=0x7fd3ec004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:31.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.145+0000 7fd3dbfff640 1 -- 172.21.15.62:0/1669641403 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec043020 con 0x7fd3f4159690 2024-04-22T07:20:31.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.145+0000 7fd3dbfff640 1 -- 172.21.15.62:0/1669641403 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3ec03e450 con 0x7fd3f4159690 2024-04-22T07:20:31.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.145+0000 7fd3dbfff640 1 -- 172.21.15.62:0/1669641403 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec009510 con 0x7fd3f4159690 2024-04-22T07:20:31.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.145+0000 7fd3fa159640 1 -- 172.21.15.62:0/1669641403 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3f40ce2a0 con 0x7fd3f4159690 2024-04-22T07:20:31.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.145+0000 7fd3fa159640 1 -- 172.21.15.62:0/1669641403 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3f40ce860 con 0x7fd3f4159690 2024-04-22T07:20:31.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.145+0000 7fd3dbfff640 1 -- 172.21.15.62:0/1669641403 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd3ec046020 con 0x7fd3f4159690 2024-04-22T07:20:31.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.145+0000 7fd3dbfff640 1 -- 172.21.15.62:0/1669641403 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fd3ec048980 con 0x7fd3f4159690 2024-04-22T07:20:31.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.146+0000 7fd3fa159640 1 -- 172.21.15.62:0/1669641403 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3f4154250 con 0x7fd3f4159690 2024-04-22T07:20:31.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.148+0000 7fd3dbfff640 1 -- 172.21.15.62:0/1669641403 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fd3f4154250 con 0x7fd3f4159690 2024-04-22T07:20:31.195 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-22T07:20:31.198+0000 7f93dedf1040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-22T07:20:31.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.221+0000 7fd3fa159640 1 -- 172.21.15.62:0/1669641403 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ba6dc1bc-272b-4f80-b55f-40bc4a0c3ff6", "id": 5} v 0) -- 0x7fd3f40b0f60 con 0x7fd3f4159690 2024-04-22T07:20:31.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.226+0000 7fd3dbfff640 1 -- 172.21.15.62:0/1669641403 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ba6dc1bc-272b-4f80-b55f-40bc4a0c3ff6", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fd3f40b0f60 con 0x7fd3f4159690 2024-04-22T07:20:31.224 INFO:teuthology.orchestra.run.smithi062.stdout:5 2024-04-22T07:20:31.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.227+0000 7fd3fa159640 1 -- 172.21.15.62:0/1669641403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3f4159690 msgr2=0x7fd3f414ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:31.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.227+0000 7fd3fa159640 1 --2- 172.21.15.62:0/1669641403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3f4159690 0x7fd3f414ca10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec032000 tx=0x7fd3ec004a40 comp rx=0 tx=0).stop 2024-04-22T07:20:31.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.227+0000 7fd3fa159640 1 -- 172.21.15.62:0/1669641403 shutdown_connections 2024-04-22T07:20:31.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.227+0000 7fd3fa159640 1 --2- 172.21.15.62:0/1669641403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3f4159690 0x7fd3f414ca10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.227+0000 7fd3fa159640 1 --2- 172.21.15.62:0/1669641403 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd3f4156550 0x7fd3f40b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.227+0000 7fd3fa159640 1 --2- 172.21.15.62:0/1669641403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3f40ca080 0x7fd3f41ef3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.227+0000 7fd3fa159640 1 -- 172.21.15.62:0/1669641403 >> 172.21.15.62:0/1669641403 conn(0x7fd3f406db30 msgr2=0x7fd3f4158ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:31.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.228+0000 7fd3fa159640 1 -- 172.21.15.62:0/1669641403 shutdown_connections 2024-04-22T07:20:31.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.228+0000 7fd3fa159640 1 -- 172.21.15.62:0/1669641403 wait complete. 2024-04-22T07:20:31.229 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-22T07:20:31.232+0000 7fb57443f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-22T07:20:31.235 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 834fcd74-14bf-45ec-a10a-0374f4ce9bf6 6 2024-04-22T07:20:31.245 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-22T07:20:31.247+0000 7f93dedf1040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-22T07:20:31.287 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-22T07:20:31.290+0000 7fb57443f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-22T07:20:31.300 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-22T07:20:31.302+0000 7f93dedf1040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-22T07:20:31.344 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-22T07:20:31.346+0000 7fb57443f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-22T07:20:31.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.378+0000 7f59194ba640 1 Processor -- start 2024-04-22T07:20:31.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.378+0000 7f59194ba640 1 -- start start 2024-04-22T07:20:31.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.379+0000 7f59194ba640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f591415ea00 0x7f591406cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:31.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.379+0000 7f59194ba640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f591406d150 con 0x7f5914070dc0 2024-04-22T07:20:31.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.379+0000 7f59194ba640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f591415b050 con 0x7f5914154f40 2024-04-22T07:20:31.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.379+0000 7f59194ba640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f591415b980 con 0x7f591415ea00 2024-04-22T07:20:31.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.379+0000 7f59137fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f591415ea00 0x7f591406cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:31.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.379+0000 7f59137fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f591415ea00 0x7f591406cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40358/0 (socket says 172.21.15.62:40358) 2024-04-22T07:20:31.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.379+0000 7f59137fe640 1 -- 172.21.15.62:0/4273506992 learned_addr learned my addr 172.21.15.62:0/4273506992 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-22T07:20:31.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.380+0000 7f59137fe640 1 -- 172.21.15.62:0/4273506992 >> v1:172.21.15.62:6789/0 conn(0x7f5914154f40 legacy=0x7f591406be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:31.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.380+0000 7f59137fe640 1 -- 172.21.15.62:0/4273506992 >> v1:172.21.15.40:6789/0 conn(0x7f5914070dc0 legacy=0x7f591415e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:31.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.380+0000 7f5911ffb640 1 -- 172.21.15.62:0/4273506992 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1855910569 0 0) 0x7f591406d150 con 0x7f5914070dc0 2024-04-22T07:20:31.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.380+0000 7f59137fe640 1 -- 172.21.15.62:0/4273506992 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f591415b330 con 0x7f591415ea00 2024-04-22T07:20:31.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.380+0000 7f59137fe640 1 --2- 172.21.15.62:0/4273506992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f591415ea00 0x7f591406cac0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f591415bb00 tx=0x7f590c02c070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ed860b12409364a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:31.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.381+0000 7f5911ffb640 1 -- 172.21.15.62:0/4273506992 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c02cc10 con 0x7f591415ea00 2024-04-22T07:20:31.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.381+0000 7f5911ffb640 1 -- 172.21.15.62:0/4273506992 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f590c02cdb0 con 0x7f591415ea00 2024-04-22T07:20:31.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.381+0000 7f5911ffb640 1 -- 172.21.15.62:0/4273506992 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c034610 con 0x7f591415ea00 2024-04-22T07:20:31.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.381+0000 7f59194ba640 1 -- 172.21.15.62:0/4273506992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f591415ea00 msgr2=0x7f591406cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:31.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.381+0000 7f59194ba640 1 --2- 172.21.15.62:0/4273506992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f591415ea00 0x7f591406cac0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f591415bb00 tx=0x7f590c02c070 comp rx=0 tx=0).stop 2024-04-22T07:20:31.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.381+0000 7f59194ba640 1 -- 172.21.15.62:0/4273506992 shutdown_connections 2024-04-22T07:20:31.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.381+0000 7f59194ba640 1 --2- 172.21.15.62:0/4273506992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f591415ea00 0x7f591406cac0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.381+0000 7f59194ba640 1 -- 172.21.15.62:0/4273506992 >> 172.21.15.62:0/4273506992 conn(0x7f59140c9fb0 msgr2=0x7f59140ca390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:31.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.381+0000 7f59194ba640 1 -- 172.21.15.62:0/4273506992 shutdown_connections 2024-04-22T07:20:31.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.381+0000 7f59194ba640 1 -- 172.21.15.62:0/4273506992 wait complete. 2024-04-22T07:20:31.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.383+0000 7f59194ba640 1 Processor -- start 2024-04-22T07:20:31.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.383+0000 7f59194ba640 1 -- start start 2024-04-22T07:20:31.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.383+0000 7f59194ba640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5914070dc0 0x7f59140c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:31.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.383+0000 7f59194ba640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5914154f40 0x7f5914153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:31.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.383+0000 7f59194ba640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f591415ea00 0x7f59141525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:31.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.383+0000 7f59194ba640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5914155320 con 0x7f5914070dc0 2024-04-22T07:20:31.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.383+0000 7f59194ba640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f591415ad00 con 0x7f591415ea00 2024-04-22T07:20:31.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.383+0000 7f59194ba640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f591406c540 con 0x7f5914154f40 2024-04-22T07:20:31.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.383+0000 7f59127fc640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5914154f40 0x7f5914153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:31.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.383+0000 7f59137fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f591415ea00 0x7f59141525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:31.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.383+0000 7f59127fc640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5914154f40 0x7f5914153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:59446/0 (socket says 172.21.15.62:59446) 2024-04-22T07:20:31.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.383+0000 7f59137fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f591415ea00 0x7f59141525b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40360/0 (socket says 172.21.15.62:40360) 2024-04-22T07:20:31.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.384+0000 7f59127fc640 1 -- 172.21.15.62:0/1225066410 learned_addr learned my addr 172.21.15.62:0/1225066410 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-22T07:20:31.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.384+0000 7f5912ffd640 1 --2- 172.21.15.62:0/1225066410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5914070dc0 0x7f59140c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:31.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.384+0000 7f59137fe640 1 -- 172.21.15.62:0/1225066410 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5914154f40 msgr2=0x7f5914153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:31.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.384+0000 7f59137fe640 1 --2- 172.21.15.62:0/1225066410 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5914154f40 0x7f5914153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.384+0000 7f59137fe640 1 -- 172.21.15.62:0/1225066410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5914070dc0 msgr2=0x7f59140c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:31.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.384+0000 7f59137fe640 1 --2- 172.21.15.62:0/1225066410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5914070dc0 0x7f59140c67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.384+0000 7f59137fe640 1 -- 172.21.15.62:0/1225066410 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59140c71e0 con 0x7f591415ea00 2024-04-22T07:20:31.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.384+0000 7f59127fc640 1 --2- 172.21.15.62:0/1225066410 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5914154f40 0x7f5914153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:20:31.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.384+0000 7f5912ffd640 1 --2- 172.21.15.62:0/1225066410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5914070dc0 0x7f59140c67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:20:31.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.384+0000 7f59137fe640 1 --2- 172.21.15.62:0/1225066410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f591415ea00 0x7f59141525b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f591415f380 tx=0x7f590c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:31.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.384+0000 7f58fb7fe640 1 -- 172.21.15.62:0/1225066410 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c043020 con 0x7f591415ea00 2024-04-22T07:20:31.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.384+0000 7f58fb7fe640 1 -- 172.21.15.62:0/1225066410 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f590c03e450 con 0x7f591415ea00 2024-04-22T07:20:31.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.384+0000 7f59194ba640 1 -- 172.21.15.62:0/1225066410 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5914154530 con 0x7f591415ea00 2024-04-22T07:20:31.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.384+0000 7f58fb7fe640 1 -- 172.21.15.62:0/1225066410 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c009510 con 0x7f591415ea00 2024-04-22T07:20:31.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.384+0000 7f59194ba640 1 -- 172.21.15.62:0/1225066410 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59141f3f40 con 0x7f591415ea00 2024-04-22T07:20:31.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.384+0000 7f58fb7fe640 1 -- 172.21.15.62:0/1225066410 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f590c046020 con 0x7f591415ea00 2024-04-22T07:20:31.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.384+0000 7f58fb7fe640 1 -- 172.21.15.62:0/1225066410 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f590c048a90 con 0x7f591415ea00 2024-04-22T07:20:31.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.385+0000 7f59194ba640 1 -- 172.21.15.62:0/1225066410 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f591404fdc0 con 0x7f591415ea00 2024-04-22T07:20:31.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.387+0000 7f58fb7fe640 1 -- 172.21.15.62:0/1225066410 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f590c04d030 con 0x7f591415ea00 2024-04-22T07:20:31.417 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-22T07:20:31.419+0000 7f93dedf1040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-22T07:20:31.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.460+0000 7f59194ba640 1 -- 172.21.15.62:0/1225066410 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "834fcd74-14bf-45ec-a10a-0374f4ce9bf6", "id": 6} v 0) -- 0x7f59140ca5a0 con 0x7f591415ea00 2024-04-22T07:20:31.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.465+0000 7f58fb7fe640 1 -- 172.21.15.62:0/1225066410 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "834fcd74-14bf-45ec-a10a-0374f4ce9bf6", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f590c02ccf0 con 0x7f591415ea00 2024-04-22T07:20:31.463 INFO:teuthology.orchestra.run.smithi062.stdout:6 2024-04-22T07:20:31.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.466+0000 7f59194ba640 1 -- 172.21.15.62:0/1225066410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f591415ea00 msgr2=0x7f59141525b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:31.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.466+0000 7f59194ba640 1 --2- 172.21.15.62:0/1225066410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f591415ea00 0x7f59141525b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f591415f380 tx=0x7f590c004a40 comp rx=0 tx=0).stop 2024-04-22T07:20:31.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.466+0000 7f59194ba640 1 -- 172.21.15.62:0/1225066410 shutdown_connections 2024-04-22T07:20:31.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.466+0000 7f59194ba640 1 --2- 172.21.15.62:0/1225066410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f591415ea00 0x7f59141525b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.466+0000 7f59194ba640 1 --2- 172.21.15.62:0/1225066410 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5914154f40 0x7f5914153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.466+0000 7f59194ba640 1 --2- 172.21.15.62:0/1225066410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5914070dc0 0x7f59140c67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.466+0000 7f59194ba640 1 -- 172.21.15.62:0/1225066410 >> 172.21.15.62:0/1225066410 conn(0x7f59140c9fb0 msgr2=0x7f591406be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:31.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.466+0000 7f59194ba640 1 -- 172.21.15.62:0/1225066410 shutdown_connections 2024-04-22T07:20:31.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.466+0000 7f59194ba640 1 -- 172.21.15.62:0/1225066410 wait complete. 2024-04-22T07:20:31.465 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-22T07:20:31.468+0000 7fb57443f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-22T07:20:31.474 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 831c9a73-960e-4d2e-b86a-33a6916be059 7 2024-04-22T07:20:31.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.617+0000 7fdd9e24e640 1 Processor -- start 2024-04-22T07:20:31.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.617+0000 7fdd9e24e640 1 -- start start 2024-04-22T07:20:31.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.618+0000 7fdd9e24e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdd98152f60 0x7fdd980cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:31.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.618+0000 7fdd9e24e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd980c54e0 con 0x7fdd980cb2f0 2024-04-22T07:20:31.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.618+0000 7fdd9e24e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd9815d030 con 0x7fdd9806feb0 2024-04-22T07:20:31.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.618+0000 7fdd9e24e640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fdd9815c4b0 con 0x7fdd98152f60 2024-04-22T07:20:31.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.618+0000 7fdd977fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdd98152f60 0x7fdd980cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:31.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.618+0000 7fdd977fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdd98152f60 0x7fdd980cadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40376/0 (socket says 172.21.15.62:40376) 2024-04-22T07:20:31.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.618+0000 7fdd977fe640 1 -- 172.21.15.62:0/2464400579 learned_addr learned my addr 172.21.15.62:0/2464400579 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-22T07:20:31.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.618+0000 7fdd977fe640 1 -- 172.21.15.62:0/2464400579 >> v1:172.21.15.62:6789/0 conn(0x7fdd9806feb0 legacy=0x7fdd9815a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:31.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.618+0000 7fdd977fe640 1 -- 172.21.15.62:0/2464400579 >> v1:172.21.15.40:6789/0 conn(0x7fdd980cb2f0 legacy=0x7fdd9806f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:31.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.618+0000 7fdd977fe640 1 -- 172.21.15.62:0/2464400579 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd9815c790 con 0x7fdd98152f60 2024-04-22T07:20:31.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.619+0000 7fdd977fe640 1 --2- 172.21.15.62:0/2464400579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd98152f60 0x7fdd980cadb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdd80009870 tx=0x7fdd8002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f847a365ed563e4b server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:31.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.619+0000 7fdd967fc640 1 -- 172.21.15.62:0/2464400579 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd80034070 con 0x7fdd98152f60 2024-04-22T07:20:31.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.619+0000 7fdd967fc640 1 -- 172.21.15.62:0/2464400579 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd80030860 con 0x7fdd98152f60 2024-04-22T07:20:31.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.619+0000 7fdd967fc640 1 -- 172.21.15.62:0/2464400579 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd80030c30 con 0x7fdd98152f60 2024-04-22T07:20:31.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.620+0000 7fdd9e24e640 1 -- 172.21.15.62:0/2464400579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd98152f60 msgr2=0x7fdd980cadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:31.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.620+0000 7fdd9e24e640 1 --2- 172.21.15.62:0/2464400579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd98152f60 0x7fdd980cadb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdd80009870 tx=0x7fdd8002b9a0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.620+0000 7fdd9e24e640 1 -- 172.21.15.62:0/2464400579 shutdown_connections 2024-04-22T07:20:31.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.620+0000 7fdd9e24e640 1 --2- 172.21.15.62:0/2464400579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd98152f60 0x7fdd980cadb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.620+0000 7fdd9e24e640 1 -- 172.21.15.62:0/2464400579 >> 172.21.15.62:0/2464400579 conn(0x7fdd98067ce0 msgr2=0x7fdd9806db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:31.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.620+0000 7fdd9e24e640 1 -- 172.21.15.62:0/2464400579 shutdown_connections 2024-04-22T07:20:31.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.620+0000 7fdd9e24e640 1 -- 172.21.15.62:0/2464400579 wait complete. 2024-04-22T07:20:31.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.621+0000 7fdd9e24e640 1 Processor -- start 2024-04-22T07:20:31.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.621+0000 7fdd9e24e640 1 -- start start 2024-04-22T07:20:31.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.622+0000 7fdd9e24e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd9806feb0 0x7fdd981e1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:31.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.622+0000 7fdd9e24e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd980cb2f0 0x7fdd980c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:31.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.622+0000 7fdd9e24e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdd98152f60 0x7fdd98146cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:31.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.622+0000 7fdd9e24e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdd9815a110 con 0x7fdd980cb2f0 2024-04-22T07:20:31.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.622+0000 7fdd9e24e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdd9815cd50 con 0x7fdd9806feb0 2024-04-22T07:20:31.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.622+0000 7fdd9e24e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fdd9815c0e0 con 0x7fdd98152f60 2024-04-22T07:20:31.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.622+0000 7fdd977fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd9806feb0 0x7fdd981e1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:31.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.622+0000 7fdd97fff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdd98152f60 0x7fdd98146cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:31.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.622+0000 7fdd977fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd9806feb0 0x7fdd981e1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52274/0 (socket says 172.21.15.62:52274) 2024-04-22T07:20:31.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.622+0000 7fdd977fe640 1 -- 172.21.15.62:0/3152675351 learned_addr learned my addr 172.21.15.62:0/3152675351 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-22T07:20:31.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.622+0000 7fdd96ffd640 1 --2- 172.21.15.62:0/3152675351 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd980cb2f0 0x7fdd980c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:31.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.623+0000 7fdd977fe640 1 -- 172.21.15.62:0/3152675351 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdd98152f60 msgr2=0x7fdd98146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:31.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.623+0000 7fdd977fe640 1 --2- 172.21.15.62:0/3152675351 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdd98152f60 0x7fdd98146cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.623+0000 7fdd977fe640 1 -- 172.21.15.62:0/3152675351 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd980cb2f0 msgr2=0x7fdd980c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:31.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.623+0000 7fdd977fe640 1 --2- 172.21.15.62:0/3152675351 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd980cb2f0 0x7fdd980c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.623+0000 7fdd977fe640 1 -- 172.21.15.62:0/3152675351 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd981e2480 con 0x7fdd9806feb0 2024-04-22T07:20:31.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.623+0000 7fdd977fe640 1 --2- 172.21.15.62:0/3152675351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd9806feb0 0x7fdd981e1f40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdd80000c00 tx=0x7fdd80004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:31.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.623+0000 7fdd8ffff640 1 -- 172.21.15.62:0/3152675351 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd80048070 con 0x7fdd9806feb0 2024-04-22T07:20:31.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.623+0000 7fdd8ffff640 1 -- 172.21.15.62:0/3152675351 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd80039d90 con 0x7fdd9806feb0 2024-04-22T07:20:31.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.623+0000 7fdd8ffff640 1 -- 172.21.15.62:0/3152675351 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd80034040 con 0x7fdd9806feb0 2024-04-22T07:20:31.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.623+0000 7fdd9e24e640 1 -- 172.21.15.62:0/3152675351 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd981eeec0 con 0x7fdd9806feb0 2024-04-22T07:20:31.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.623+0000 7fdd9e24e640 1 -- 172.21.15.62:0/3152675351 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd981ef480 con 0x7fdd9806feb0 2024-04-22T07:20:31.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.623+0000 7fdd8ffff640 1 -- 172.21.15.62:0/3152675351 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdd8004b070 con 0x7fdd9806feb0 2024-04-22T07:20:31.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.623+0000 7fdd8ffff640 1 -- 172.21.15.62:0/3152675351 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fdd80043e00 con 0x7fdd9806feb0 2024-04-22T07:20:31.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.624+0000 7fdd9e24e640 1 -- 172.21.15.62:0/3152675351 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd98069f50 con 0x7fdd9806feb0 2024-04-22T07:20:31.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.626+0000 7fdd8ffff640 1 -- 172.21.15.62:0/3152675351 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fdd80030720 con 0x7fdd9806feb0 2024-04-22T07:20:31.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.700+0000 7fdd9e24e640 1 -- 172.21.15.62:0/3152675351 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "831c9a73-960e-4d2e-b86a-33a6916be059", "id": 7} v 0) -- 0x7fdd9806dcc0 con 0x7fdd9806feb0 2024-04-22T07:20:31.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.706+0000 7fdd8ffff640 1 -- 172.21.15.62:0/3152675351 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "831c9a73-960e-4d2e-b86a-33a6916be059", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fdd80043630 con 0x7fdd9806feb0 2024-04-22T07:20:31.704 INFO:teuthology.orchestra.run.smithi062.stdout:7 2024-04-22T07:20:31.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.707+0000 7fdd9e24e640 1 -- 172.21.15.62:0/3152675351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd9806feb0 msgr2=0x7fdd981e1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:31.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.707+0000 7fdd9e24e640 1 --2- 172.21.15.62:0/3152675351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd9806feb0 0x7fdd981e1f40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdd80000c00 tx=0x7fdd80004730 comp rx=0 tx=0).stop 2024-04-22T07:20:31.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.707+0000 7fdd9e24e640 1 -- 172.21.15.62:0/3152675351 shutdown_connections 2024-04-22T07:20:31.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.707+0000 7fdd9e24e640 1 --2- 172.21.15.62:0/3152675351 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdd98152f60 0x7fdd98146cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.707+0000 7fdd9e24e640 1 --2- 172.21.15.62:0/3152675351 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd980cb2f0 0x7fdd980c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.707+0000 7fdd9e24e640 1 --2- 172.21.15.62:0/3152675351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd9806feb0 0x7fdd981e1f40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.707+0000 7fdd9e24e640 1 -- 172.21.15.62:0/3152675351 >> 172.21.15.62:0/3152675351 conn(0x7fdd98067ce0 msgr2=0x7fdd98150740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:31.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.707+0000 7fdd9e24e640 1 -- 172.21.15.62:0/3152675351 shutdown_connections 2024-04-22T07:20:31.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-22T07:20:31.707+0000 7fdd9e24e640 1 -- 172.21.15.62:0/3152675351 wait complete. 2024-04-22T07:20:31.715 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-22T07:20:31.715 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-22T07:20:31.717 INFO:tasks.ceph.osd.0:Started 2024-04-22T07:20:31.718 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-22T07:20:31.718 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-22T07:20:31.720 INFO:tasks.ceph.osd.1:Started 2024-04-22T07:20:31.720 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-22T07:20:31.720 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-22T07:20:31.722 INFO:tasks.ceph.osd.2:Started 2024-04-22T07:20:31.722 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-22T07:20:31.722 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-22T07:20:31.724 INFO:tasks.ceph.osd.3:Started 2024-04-22T07:20:31.725 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-22T07:20:31.725 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-22T07:20:31.727 INFO:tasks.ceph.osd.4:Started 2024-04-22T07:20:31.727 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-22T07:20:31.727 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-22T07:20:31.729 INFO:tasks.ceph.osd.5:Started 2024-04-22T07:20:31.729 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-22T07:20:31.729 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-22T07:20:31.731 INFO:tasks.ceph.osd.6:Started 2024-04-22T07:20:31.732 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-22T07:20:31.732 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-22T07:20:31.734 INFO:tasks.ceph.osd.7:Started 2024-04-22T07:20:31.734 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:20:31.854 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-22T07:20:31.856+0000 7f93dedf1040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-22T07:20:31.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.857+0000 7f5d2265c640 1 Processor -- start 2024-04-22T07:20:31.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.857+0000 7f5d2265c640 1 -- start start 2024-04-22T07:20:31.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.858+0000 7f5d2265c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d1c154ff0 0x7f5d1c15b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:31.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.858+0000 7f5d2265c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5d1c0cb360 0x7f5d1c0c5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:31.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.858+0000 7f5d1b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5d1c0cb360 0x7f5d1c0c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:31.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.858+0000 7f5d1b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5d1c0cb360 0x7f5d1c0c5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45910/0 (socket says 172.21.15.40:45910) 2024-04-22T07:20:31.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.858+0000 7f5d1b7fe640 1 -- 172.21.15.40:0/1433958823 learned_addr learned my addr 172.21.15.40:0/1433958823 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:31.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.858+0000 7f5d2265c640 1 -- 172.21.15.40:0/1433958823 --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d1c0c5ac0 con 0x7f5d1c15ef30 2024-04-22T07:20:31.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.858+0000 7f5d1bfff640 1 --2- 172.21.15.40:0/1433958823 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d1c154ff0 0x7f5d1c15b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:31.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.858+0000 7f5d2265c640 1 -- 172.21.15.40:0/1433958823 --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f5d1c15eaa0 con 0x7f5d1c0cb360 2024-04-22T07:20:31.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.858+0000 7f5d2265c640 1 -- 172.21.15.40:0/1433958823 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5d1c15bcc0 con 0x7f5d1c154ff0 2024-04-22T07:20:31.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.859+0000 7f5d1b7fe640 1 -- 172.21.15.40:0/1433958823 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d1c154ff0 msgr2=0x7f5d1c15b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:31.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.859+0000 7f5d1b7fe640 1 --2- 172.21.15.40:0/1433958823 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d1c154ff0 0x7f5d1c15b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.859+0000 7f5d1b7fe640 1 -- 172.21.15.40:0/1433958823 >> v1:172.21.15.62:6789/0 conn(0x7f5d1c15ef30 legacy=0x7f5d1c0d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:31.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.859+0000 7f5d1affd640 1 -- 172.21.15.40:0/1433958823 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2865952487 0 0) 0x7f5d1c0c5ac0 con 0x7f5d1c15ef30 2024-04-22T07:20:31.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.859+0000 7f5d1b7fe640 1 -- 172.21.15.40:0/1433958823 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d1c0cbc90 con 0x7f5d1c0cb360 2024-04-22T07:20:31.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.859+0000 7f5d1b7fe640 1 --2- 172.21.15.40:0/1433958823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d1c0cb360 0x7f5d1c0c5580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c009870 tx=0x7f5d0c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77dc80b7fb9d2061 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:31.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.860+0000 7f5d1affd640 1 -- 172.21.15.40:0/1433958823 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c02f840 con 0x7f5d1c0cb360 2024-04-22T07:20:31.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.860+0000 7f5d1affd640 1 -- 172.21.15.40:0/1433958823 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d0c02f9e0 con 0x7f5d1c0cb360 2024-04-22T07:20:31.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.860+0000 7f5d1affd640 1 -- 172.21.15.40:0/1433958823 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c02fdb0 con 0x7f5d1c0cb360 2024-04-22T07:20:31.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.860+0000 7f5d2265c640 1 -- 172.21.15.40:0/1433958823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d1c0cb360 msgr2=0x7f5d1c0c5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:31.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.860+0000 7f5d2265c640 1 --2- 172.21.15.40:0/1433958823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d1c0cb360 0x7f5d1c0c5580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c009870 tx=0x7f5d0c02ba20 comp rx=0 tx=0).stop 2024-04-22T07:20:31.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.860+0000 7f5d2265c640 1 -- 172.21.15.40:0/1433958823 shutdown_connections 2024-04-22T07:20:31.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.860+0000 7f5d2265c640 1 --2- 172.21.15.40:0/1433958823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d1c0cb360 0x7f5d1c0c5580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.860+0000 7f5d2265c640 1 --2- 172.21.15.40:0/1433958823 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d1c154ff0 0x7f5d1c15b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.860+0000 7f5d2265c640 1 -- 172.21.15.40:0/1433958823 >> 172.21.15.40:0/1433958823 conn(0x7f5d1c067890 msgr2=0x7f5d1c06ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:31.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.860+0000 7f5d2265c640 1 -- 172.21.15.40:0/1433958823 shutdown_connections 2024-04-22T07:20:31.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.860+0000 7f5d2265c640 1 -- 172.21.15.40:0/1433958823 wait complete. 2024-04-22T07:20:31.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.861+0000 7f5d2265c640 1 Processor -- start 2024-04-22T07:20:31.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.862+0000 7f5d2265c640 1 -- start start 2024-04-22T07:20:31.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.862+0000 7f5d2265c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d1c0cb360 0x7f5d1c0d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:31.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.862+0000 7f5d2265c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d1c154ff0 0x7f5d1c145590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:31.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.862+0000 7f5d2265c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d1c15ef30 0x7f5d1c151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:31.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.862+0000 7f5d2265c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1c0ccbf0 con 0x7f5d1c15ef30 2024-04-22T07:20:31.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.862+0000 7f5d2265c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5d1c0cc950 con 0x7f5d1c154ff0 2024-04-22T07:20:31.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.862+0000 7f5d2265c640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5d1c15e730 con 0x7f5d1c0cb360 2024-04-22T07:20:31.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.862+0000 7f5d1bfff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d1c0cb360 0x7f5d1c0d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:31.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.863+0000 7f5d1bfff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d1c0cb360 0x7f5d1c0d05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.40:48052/0 (socket says 172.21.15.40:48052) 2024-04-22T07:20:31.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.863+0000 7f5d20bf9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d1c15ef30 0x7f5d1c151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:31.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.863+0000 7f5d1bfff640 1 -- 172.21.15.40:0/2578074862 learned_addr learned my addr 172.21.15.40:0/2578074862 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:31.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.863+0000 7f5d1b7fe640 1 --2- 172.21.15.40:0/2578074862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d1c154ff0 0x7f5d1c145590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:31.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.863+0000 7f5d20bf9640 1 -- 172.21.15.40:0/2578074862 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d1c0cb360 msgr2=0x7f5d1c0d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:31.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.863+0000 7f5d20bf9640 1 --2- 172.21.15.40:0/2578074862 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d1c0cb360 0x7f5d1c0d05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.863+0000 7f5d20bf9640 1 -- 172.21.15.40:0/2578074862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d1c154ff0 msgr2=0x7f5d1c145590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:31.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.863+0000 7f5d20bf9640 1 --2- 172.21.15.40:0/2578074862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d1c154ff0 0x7f5d1c145590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.863+0000 7f5d20bf9640 1 -- 172.21.15.40:0/2578074862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d1c0ce560 con 0x7f5d1c15ef30 2024-04-22T07:20:31.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.863+0000 7f5d1bfff640 1 --2- 172.21.15.40:0/2578074862 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d1c0cb360 0x7f5d1c0d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:20:31.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.863+0000 7f5d20bf9640 1 --2- 172.21.15.40:0/2578074862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d1c15ef30 0x7f5d1c151ab0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5d1400c780 tx=0x7f5d1400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:31.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.863+0000 7f5d18ff9640 1 -- 172.21.15.40:0/2578074862 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d14003b70 con 0x7f5d1c15ef30 2024-04-22T07:20:31.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.863+0000 7f5d18ff9640 1 -- 172.21.15.40:0/2578074862 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d14003d30 con 0x7f5d1c15ef30 2024-04-22T07:20:31.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.863+0000 7f5d2265c640 1 -- 172.21.15.40:0/2578074862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d1c0ce800 con 0x7f5d1c15ef30 2024-04-22T07:20:31.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.863+0000 7f5d18ff9640 1 -- 172.21.15.40:0/2578074862 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d140052b0 con 0x7f5d1c15ef30 2024-04-22T07:20:31.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.863+0000 7f5d2265c640 1 -- 172.21.15.40:0/2578074862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d1c0cfdb0 con 0x7f5d1c15ef30 2024-04-22T07:20:31.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.864+0000 7f5d18ff9640 1 -- 172.21.15.40:0/2578074862 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5d14005450 con 0x7f5d1c15ef30 2024-04-22T07:20:31.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.864+0000 7f5d18ff9640 1 -- 172.21.15.40:0/2578074862 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f5d14005740 con 0x7f5d1c15ef30 2024-04-22T07:20:31.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.864+0000 7f5d2265c640 1 -- 172.21.15.40:0/2578074862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d1c068b20 con 0x7f5d1c15ef30 2024-04-22T07:20:31.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.867+0000 7f5d18ff9640 1 -- 172.21.15.40:0/2578074862 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5d1400a640 con 0x7f5d1c15ef30 2024-04-22T07:20:31.908 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-22T07:20:31.910+0000 7fb57443f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-22T07:20:31.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.929+0000 7f5d2265c640 1 -- 172.21.15.40:0/2578074862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d1c0c5df0 con 0x7f5d1c15ef30 2024-04-22T07:20:31.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.929+0000 7f5d18ff9640 1 -- 172.21.15.40:0/2578074862 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f5d1400a820 con 0x7f5d1c15ef30 2024-04-22T07:20:31.927 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:20:31.927 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":10,"fsid":"dd5b16e4-89fe-4602-b37f-062846793158","created":"2024-04-22T07:20:29.488892+0000","modified":"2024-04-22T07:20:31.702551+0000","last_up_change":"0.000000","last_in_change":"2024-04-22T07:20:31.702551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"32238b7e-228b-4a67-bfca-16e8f0020a92","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5ad8da43-39b1-4295-b4d1-0f1e1d06fc0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7d2c6d50-719d-4232-ad47-f04dcf1a8bc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"af42e7d6-a6bf-403e-92e7-162d7c4fbf0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f8e89e0d-be96-4f19-88c0-69c408df7d98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ba6dc1bc-272b-4f80-b55f-40bc4a0c3ff6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"834fcd74-14bf-45ec-a10a-0374f4ce9bf6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"831c9a73-960e-4d2e-b86a-33a6916be059","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:20:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.930+0000 7f5d2265c640 1 -- 172.21.15.40:0/2578074862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d1c15ef30 msgr2=0x7f5d1c151ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.930+0000 7f5d2265c640 1 --2- 172.21.15.40:0/2578074862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d1c15ef30 0x7f5d1c151ab0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5d1400c780 tx=0x7f5d1400cc40 comp rx=0 tx=0).stop 2024-04-22T07:20:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.930+0000 7f5d2265c640 1 -- 172.21.15.40:0/2578074862 shutdown_connections 2024-04-22T07:20:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.930+0000 7f5d2265c640 1 --2- 172.21.15.40:0/2578074862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d1c15ef30 0x7f5d1c151ab0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.930+0000 7f5d2265c640 1 --2- 172.21.15.40:0/2578074862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5d1c154ff0 0x7f5d1c145590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.930+0000 7f5d2265c640 1 --2- 172.21.15.40:0/2578074862 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5d1c0cb360 0x7f5d1c0d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.930+0000 7f5d2265c640 1 -- 172.21.15.40:0/2578074862 >> 172.21.15.40:0/2578074862 conn(0x7f5d1c067890 msgr2=0x7f5d1c153d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.930+0000 7f5d2265c640 1 -- 172.21.15.40:0/2578074862 shutdown_connections 2024-04-22T07:20:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:31.930+0000 7f5d2265c640 1 -- 172.21.15.40:0/2578074862 wait complete. 2024-04-22T07:20:31.939 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-22T07:20:31.939 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-22T07:20:32.127 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-22T07:20:32.130+0000 7f93dedf1040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-22T07:20:32.178 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-22T07:20:32.181+0000 7fb57443f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-22T07:20:32.181 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-22T07:20:32.184+0000 7f93dedf1040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-22T07:20:32.233 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-22T07:20:32.235+0000 7fb57443f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-22T07:20:32.303 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-22T07:20:32.305+0000 7f93dedf1040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-22T07:20:32.323 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-04-22T07:20:32.325+0000 7f283b41d640 -1 Falling back to public interface 2024-04-22T07:20:32.323 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-04-22T07:20:32.325+0000 7fcce020d640 -1 Falling back to public interface 2024-04-22T07:20:32.331 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-04-22T07:20:32.333+0000 7f6e62821640 -1 Falling back to public interface 2024-04-22T07:20:32.336 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-04-22T07:20:32.338+0000 7f7f2bea4640 -1 Falling back to public interface 2024-04-22T07:20:32.343 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-04-22T07:20:32.345+0000 7f3574018640 -1 Falling back to public interface 2024-04-22T07:20:32.347 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-04-22T07:20:32.349+0000 7fa5f5419640 -1 Falling back to public interface 2024-04-22T07:20:32.347 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-04-22T07:20:32.350+0000 7f152ae0e640 -1 Falling back to public interface 2024-04-22T07:20:32.350 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-04-22T07:20:32.352+0000 7fa215e0c640 -1 Falling back to public interface 2024-04-22T07:20:32.355 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-22T07:20:32.358+0000 7fb57443f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-22T07:20:32.603 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-22T07:20:32.605+0000 7f93dedf1040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-22T07:20:32.650 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-22T07:20:32.652+0000 7fb57443f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-22T07:20:32.653 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-22T07:20:32.655+0000 7f93dedf1040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-22T07:20:32.699 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-22T07:20:32.702+0000 7fb57443f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-22T07:20:32.745 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-22T07:20:32.817 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-22T07:20:32.820+0000 7f93dedf1040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-22T07:20:32.837 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.840+0000 7fbc6f6e0640 1 Processor -- start 2024-04-22T07:20:32.837 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.840+0000 7fbc6f6e0640 1 -- start start 2024-04-22T07:20:32.839 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.841+0000 7fbc6f6e0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbc6815b7e0 0x7fbc6815c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:32.839 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.841+0000 7fbc6f6e0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbc6815ce50 0x7fbc681656e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:32.839 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.841+0000 7fbc6f6e0640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc6806c420 con 0x7fbc68155110 2024-04-22T07:20:32.839 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.841+0000 7fbc6f6e0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fbc6806b930 con 0x7fbc6815ce50 2024-04-22T07:20:32.839 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.841+0000 7fbc6f6e0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fbc6815c480 con 0x7fbc6815b7e0 2024-04-22T07:20:32.839 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.841+0000 7fbc6dc7d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbc6815ce50 0x7fbc681656e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:32.839 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.841+0000 7fbc6dc7d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbc6815ce50 0x7fbc681656e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45922/0 (socket says 172.21.15.40:45922) 2024-04-22T07:20:32.839 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.841+0000 7fbc6dc7d640 1 -- 172.21.15.40:0/235101027 learned_addr learned my addr 172.21.15.40:0/235101027 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:32.839 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.841+0000 7fbc6d47c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbc68155110 0x7fbc680cae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49254/0 (socket says 172.21.15.40:49254) 2024-04-22T07:20:32.840 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.841+0000 7fbc6cc7b640 1 --2- 172.21.15.40:0/235101027 >> v2:172.21.15.62:3300/0 conn(0x7fbc6815b7e0 0x7fbc6815c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:32.840 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.841+0000 7fbc6dc7d640 1 -- 172.21.15.40:0/235101027 >> v2:172.21.15.62:3300/0 conn(0x7fbc6815b7e0 msgr2=0x7fbc6815c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:32.840 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.841+0000 7fbc6dc7d640 1 --2- 172.21.15.40:0/235101027 >> v2:172.21.15.62:3300/0 conn(0x7fbc6815b7e0 0x7fbc6815c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:32.840 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.841+0000 7fbc6dc7d640 1 -- 172.21.15.40:0/235101027 >> v1:172.21.15.40:6789/0 conn(0x7fbc68155110 legacy=0x7fbc680cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:32.840 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.841+0000 7fbc6dc7d640 1 -- 172.21.15.40:0/235101027 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc6806bb80 con 0x7fbc6815ce50 2024-04-22T07:20:32.841 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.842+0000 7fbc6dc7d640 1 --2- 172.21.15.40:0/235101027 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc6815ce50 0x7fbc681656e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbc6806f540 tx=0x7fbc6002c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0de2bae30d0daf server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:32.841 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.842+0000 7fbc5ffff640 1 -- 172.21.15.40:0/235101027 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6002cbb0 con 0x7fbc6815ce50 2024-04-22T07:20:32.841 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.842+0000 7fbc5ffff640 1 -- 172.21.15.40:0/235101027 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc6002cd50 con 0x7fbc6815ce50 2024-04-22T07:20:32.841 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.842+0000 7fbc5ffff640 1 -- 172.21.15.40:0/235101027 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc60034610 con 0x7fbc6815ce50 2024-04-22T07:20:32.841 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.842+0000 7fbc6f6e0640 1 -- 172.21.15.40:0/235101027 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc6815ce50 msgr2=0x7fbc681656e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:32.841 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.843+0000 7fbc6f6e0640 1 --2- 172.21.15.40:0/235101027 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc6815ce50 0x7fbc681656e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbc6806f540 tx=0x7fbc6002c010 comp rx=0 tx=0).stop 2024-04-22T07:20:32.842 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.843+0000 7fbc6f6e0640 1 -- 172.21.15.40:0/235101027 shutdown_connections 2024-04-22T07:20:32.842 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.843+0000 7fbc6f6e0640 1 --2- 172.21.15.40:0/235101027 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc6815ce50 0x7fbc681656e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:32.842 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.843+0000 7fbc6f6e0640 1 --2- 172.21.15.40:0/235101027 >> v2:172.21.15.62:3300/0 conn(0x7fbc6815b7e0 0x7fbc6815c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:32.842 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.843+0000 7fbc6f6e0640 1 -- 172.21.15.40:0/235101027 >> 172.21.15.40:0/235101027 conn(0x7fbc68062cd0 msgr2=0x7fbc6806db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:32.842 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.843+0000 7fbc6f6e0640 1 -- 172.21.15.40:0/235101027 shutdown_connections 2024-04-22T07:20:32.842 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.843+0000 7fbc6f6e0640 1 -- 172.21.15.40:0/235101027 wait complete. 2024-04-22T07:20:32.842 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.845+0000 7fbc6f6e0640 1 Processor -- start 2024-04-22T07:20:32.842 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.845+0000 7fbc6f6e0640 1 -- start start 2024-04-22T07:20:32.845 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.846+0000 7fbc6f6e0640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc68155110 0x7fbc681f1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:32.845 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.846+0000 7fbc6f6e0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc6815b7e0 0x7fbc680aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:32.845 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.846+0000 7fbc6f6e0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc6815ce50 0x7fbc680af030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:32.845 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.846+0000 7fbc6f6e0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6815bc30 con 0x7fbc6815ce50 2024-04-22T07:20:32.845 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.846+0000 7fbc6f6e0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbc681554f0 con 0x7fbc6815b7e0 2024-04-22T07:20:32.845 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.846+0000 7fbc6f6e0640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fbc6806c140 con 0x7fbc68155110 2024-04-22T07:20:32.846 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.846+0000 7fbc6dc7d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc6815ce50 0x7fbc680af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:32.846 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.846+0000 7fbc6dc7d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc6815ce50 0x7fbc680af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45936/0 (socket says 172.21.15.40:45936) 2024-04-22T07:20:32.846 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.846+0000 7fbc6dc7d640 1 -- 172.21.15.40:0/1548520993 learned_addr learned my addr 172.21.15.40:0/1548520993 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:32.846 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.846+0000 7fbc6d47c640 1 --2- 172.21.15.40:0/1548520993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc68155110 0x7fbc681f1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:32.846 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.846+0000 7fbc6cc7b640 1 --2- 172.21.15.40:0/1548520993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc6815b7e0 0x7fbc680aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:32.846 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.846+0000 7fbc6dc7d640 1 -- 172.21.15.40:0/1548520993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc68155110 msgr2=0x7fbc681f1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:32.846 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.846+0000 7fbc6dc7d640 1 --2- 172.21.15.40:0/1548520993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc68155110 0x7fbc681f1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:32.846 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.846+0000 7fbc6dc7d640 1 -- 172.21.15.40:0/1548520993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc6815b7e0 msgr2=0x7fbc680aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:32.846 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.846+0000 7fbc6dc7d640 1 --2- 172.21.15.40:0/1548520993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc6815b7e0 0x7fbc680aeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:32.846 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.846+0000 7fbc6dc7d640 1 -- 172.21.15.40:0/1548520993 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc6814f400 con 0x7fbc6815ce50 2024-04-22T07:20:32.846 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.846+0000 7fbc6dc7d640 1 --2- 172.21.15.40:0/1548520993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc6815ce50 0x7fbc680af030 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbc60009f40 tx=0x7fbc60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:32.846 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.847+0000 7fbc5dffb640 1 -- 172.21.15.40:0/1548520993 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc60043020 con 0x7fbc6815ce50 2024-04-22T07:20:32.846 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.847+0000 7fbc5dffb640 1 -- 172.21.15.40:0/1548520993 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc6003e450 con 0x7fbc6815ce50 2024-04-22T07:20:32.846 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.847+0000 7fbc6f6e0640 1 -- 172.21.15.40:0/1548520993 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc6814f6a0 con 0x7fbc6815ce50 2024-04-22T07:20:32.846 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.847+0000 7fbc5dffb640 1 -- 172.21.15.40:0/1548520993 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc60009510 con 0x7fbc6815ce50 2024-04-22T07:20:32.847 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.847+0000 7fbc6f6e0640 1 -- 172.21.15.40:0/1548520993 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc6814fc60 con 0x7fbc6815ce50 2024-04-22T07:20:32.847 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.847+0000 7fbc5dffb640 1 -- 172.21.15.40:0/1548520993 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbc60046020 con 0x7fbc6815ce50 2024-04-22T07:20:32.847 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.847+0000 7fbc5dffb640 1 -- 172.21.15.40:0/1548520993 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fbc60004020 con 0x7fbc6815ce50 2024-04-22T07:20:32.847 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.848+0000 7fbc6f6e0640 1 -- 172.21.15.40:0/1548520993 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc6804fce0 con 0x7fbc6815ce50 2024-04-22T07:20:32.847 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.850+0000 7fbc5dffb640 1 -- 172.21.15.40:0/1548520993 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fbc6004d070 con 0x7fbc6815ce50 2024-04-22T07:20:32.863 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-22T07:20:32.866+0000 7fb57443f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-22T07:20:32.910 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.912+0000 7fbc6f6e0640 1 -- 172.21.15.40:0/1548520993 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc68068fa0 con 0x7fbc6815ce50 2024-04-22T07:20:32.910 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.913+0000 7fbc5dffb640 1 -- 172.21.15.40:0/1548520993 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fbc6002cbc0 con 0x7fbc6815ce50 2024-04-22T07:20:32.911 INFO:teuthology.misc.health.smithi040.stdout: 2024-04-22T07:20:32.911 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":10,"fsid":"dd5b16e4-89fe-4602-b37f-062846793158","created":"2024-04-22T07:20:29.488892+0000","modified":"2024-04-22T07:20:31.702551+0000","last_up_change":"0.000000","last_in_change":"2024-04-22T07:20:31.702551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"32238b7e-228b-4a67-bfca-16e8f0020a92","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5ad8da43-39b1-4295-b4d1-0f1e1d06fc0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7d2c6d50-719d-4232-ad47-f04dcf1a8bc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"af42e7d6-a6bf-403e-92e7-162d7c4fbf0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f8e89e0d-be96-4f19-88c0-69c408df7d98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ba6dc1bc-272b-4f80-b55f-40bc4a0c3ff6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"834fcd74-14bf-45ec-a10a-0374f4ce9bf6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"831c9a73-960e-4d2e-b86a-33a6916be059","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:20:32.912 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.914+0000 7fbc6f6e0640 1 -- 172.21.15.40:0/1548520993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc6815ce50 msgr2=0x7fbc680af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:32.912 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.914+0000 7fbc6f6e0640 1 --2- 172.21.15.40:0/1548520993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc6815ce50 0x7fbc680af030 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbc60009f40 tx=0x7fbc60004a40 comp rx=0 tx=0).stop 2024-04-22T07:20:32.912 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.914+0000 7fbc6f6e0640 1 -- 172.21.15.40:0/1548520993 shutdown_connections 2024-04-22T07:20:32.912 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.914+0000 7fbc6f6e0640 1 --2- 172.21.15.40:0/1548520993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc6815ce50 0x7fbc680af030 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:32.912 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.914+0000 7fbc6f6e0640 1 --2- 172.21.15.40:0/1548520993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbc6815b7e0 0x7fbc680aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:32.912 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.914+0000 7fbc6f6e0640 1 --2- 172.21.15.40:0/1548520993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbc68155110 0x7fbc681f1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:32.913 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.914+0000 7fbc6f6e0640 1 -- 172.21.15.40:0/1548520993 >> 172.21.15.40:0/1548520993 conn(0x7fbc68062cd0 msgr2=0x7fbc6815ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:32.913 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.914+0000 7fbc6f6e0640 1 -- 172.21.15.40:0/1548520993 shutdown_connections 2024-04-22T07:20:32.913 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:32.914+0000 7fbc6f6e0640 1 -- 172.21.15.40:0/1548520993 wait complete. 2024-04-22T07:20:32.921 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-22T07:20:32.965 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-22T07:20:32.968+0000 7f93dedf1040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-22T07:20:33.007 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-22T07:20:33.009+0000 7fb57443f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-22T07:20:33.017 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-22T07:20:33.019+0000 7f93dedf1040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-22T07:20:33.058 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-22T07:20:33.061+0000 7fb57443f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-22T07:20:33.090 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-22T07:20:33.093+0000 7f93dedf1040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-22T07:20:33.132 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-22T07:20:33.134+0000 7fb57443f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-22T07:20:33.137 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-22T07:20:33.140+0000 7f93dedf1040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-22T07:20:33.179 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-22T07:20:33.181+0000 7fb57443f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-22T07:20:33.640 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-22T07:20:33.642+0000 7f93dedf1040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-22T07:20:33.681 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-22T07:20:33.684+0000 7fb57443f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-22T07:20:33.761 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-22T07:20:33.763+0000 7f93dedf1040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-22T07:20:33.805 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-04-22T07:20:33.808+0000 7fb57443f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-22T07:20:34.778 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-22T07:20:34.780+0000 7f93801ef640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-22T07:20:34.778 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-22T07:20:34.780+0000 7f93801ef640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-22T07:20:35.765 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-04-22T07:20:35.767+0000 7f283b41d640 -1 osd.4 0 log_to_monitors true 2024-04-22T07:20:35.796 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-04-22T07:20:35.798+0000 7fcce020d640 -1 osd.0 0 log_to_monitors true 2024-04-22T07:20:35.805 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-04-22T07:20:35.807+0000 7f6e62821640 -1 osd.5 0 log_to_monitors true 2024-04-22T07:20:35.834 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-04-22T07:20:35.836+0000 7f7f2bea4640 -1 osd.7 0 log_to_monitors true 2024-04-22T07:20:35.842 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-04-22T07:20:35.844+0000 7fa5f5419640 -1 osd.3 0 log_to_monitors true 2024-04-22T07:20:35.842 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-04-22T07:20:35.845+0000 7fa215e0c640 -1 osd.6 0 log_to_monitors true 2024-04-22T07:20:35.867 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-04-22T07:20:35.870+0000 7f3574018640 -1 osd.1 0 log_to_monitors true 2024-04-22T07:20:35.875 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-04-22T07:20:35.878+0000 7f152ae0e640 -1 osd.2 0 log_to_monitors true 2024-04-22T07:20:37.683 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-04-22T07:20:37.685+0000 7f283766d640 -1 osd.4 0 waiting for initial osdmap 2024-04-22T07:20:37.694 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-04-22T07:20:37.697+0000 7f282ec8a640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T07:20:39.391 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-04-22T07:20:39.393+0000 7f7f27e3a640 -1 osd.7 0 waiting for initial osdmap 2024-04-22T07:20:39.412 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-04-22T07:20:39.414+0000 7f7f1fc5a640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T07:20:39.458 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-04-22T07:20:39.461+0000 7f6e5e288640 -1 osd.5 0 waiting for initial osdmap 2024-04-22T07:20:39.469 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-04-22T07:20:39.472+0000 7f6e560a8640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T07:20:39.520 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-04-22T07:20:39.522+0000 7fa211f3e640 -1 osd.6 0 waiting for initial osdmap 2024-04-22T07:20:39.529 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-04-22T07:20:39.532+0000 7fa20954a640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T07:20:39.723 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-04-22T07:20:39.725+0000 7fa5f0de7640 -1 osd.3 0 waiting for initial osdmap 2024-04-22T07:20:39.727 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-22T07:20:39.737 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-04-22T07:20:39.740+0000 7fa5e8c07640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T07:20:39.829 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-04-22T07:20:39.831+0000 7f356fa59640 -1 osd.1 0 waiting for initial osdmap 2024-04-22T07:20:39.842 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-04-22T07:20:39.845+0000 7f3567879640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T07:20:39.872 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.875+0000 7f08356d5640 1 Processor -- start 2024-04-22T07:20:39.873 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.875+0000 7f08356d5640 1 -- start start 2024-04-22T07:20:39.874 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.876+0000 7f08356d5640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0830151c70 0x7f083015b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:39.875 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.876+0000 7f08356d5640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08300ca020 con 0x7f083015b990 2024-04-22T07:20:39.875 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.876+0000 7f08356d5640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08300cc930 con 0x7f08300c9b90 2024-04-22T07:20:39.875 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.876+0000 7f08356d5640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f08300cab40 con 0x7f0830151c70 2024-04-22T07:20:39.875 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.876+0000 7f082e7fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f083015b990 0x7f08300cbb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45438/0 (socket says 172.21.15.40:45438) 2024-04-22T07:20:39.875 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.876+0000 7f082e7fc640 1 -- 172.21.15.40:0/2167464864 learned_addr learned my addr 172.21.15.40:0/2167464864 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:20:39.875 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.876+0000 7f082f7fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f08300c9b90 0x7f08300cc220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.40:33860/0 (socket says 172.21.15.40:33860) 2024-04-22T07:20:39.875 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.876+0000 7f082effd640 1 --2- 172.21.15.40:0/2167464864 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0830151c70 0x7f083015b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:39.875 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.877+0000 7f082dffb640 1 -- 172.21.15.40:0/2167464864 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3739608515 0 0) 0x7f08300cc930 con 0x7f08300c9b90 2024-04-22T07:20:39.875 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.877+0000 7f082dffb640 1 -- 172.21.15.40:0/2167464864 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0818003520 con 0x7f08300c9b90 2024-04-22T07:20:39.875 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.877+0000 7f082dffb640 1 -- 172.21.15.40:0/2167464864 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 575649161 0 0) 0x7f08300ca020 con 0x7f083015b990 2024-04-22T07:20:39.875 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.877+0000 7f082effd640 1 -- 172.21.15.40:0/2167464864 >> v1:172.21.15.62:6789/0 conn(0x7f08300c9b90 legacy=0x7f08300cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:39.875 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.877+0000 7f082effd640 1 -- 172.21.15.40:0/2167464864 >> v1:172.21.15.40:6789/0 conn(0x7f083015b990 legacy=0x7f08300cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:39.875 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.877+0000 7f082effd640 1 -- 172.21.15.40:0/2167464864 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08300cae20 con 0x7f0830151c70 2024-04-22T07:20:39.877 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.878+0000 7f082effd640 1 --2- 172.21.15.40:0/2167464864 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0830151c70 0x7f083015b450 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f08200097d0 tx=0x7f082002b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c094147b714c32a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:39.877 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.878+0000 7f082dffb640 1 -- 172.21.15.40:0/2167464864 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0820034070 con 0x7f0830151c70 2024-04-22T07:20:39.877 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.878+0000 7f082dffb640 1 -- 172.21.15.40:0/2167464864 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0820030880 con 0x7f0830151c70 2024-04-22T07:20:39.877 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.878+0000 7f082dffb640 1 -- 172.21.15.40:0/2167464864 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0820030c50 con 0x7f0830151c70 2024-04-22T07:20:39.877 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.879+0000 7f08356d5640 1 -- 172.21.15.40:0/2167464864 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0830151c70 msgr2=0x7f083015b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:39.877 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.879+0000 7f08356d5640 1 --2- 172.21.15.40:0/2167464864 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0830151c70 0x7f083015b450 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f08200097d0 tx=0x7f082002b9c0 comp rx=0 tx=0).stop 2024-04-22T07:20:39.877 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.879+0000 7f08356d5640 1 -- 172.21.15.40:0/2167464864 shutdown_connections 2024-04-22T07:20:39.877 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.879+0000 7f08356d5640 1 --2- 172.21.15.40:0/2167464864 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0830151c70 0x7f083015b450 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:39.877 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.879+0000 7f08356d5640 1 -- 172.21.15.40:0/2167464864 >> 172.21.15.40:0/2167464864 conn(0x7f083006fc20 msgr2=0x7f0830070030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:39.877 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.879+0000 7f08356d5640 1 -- 172.21.15.40:0/2167464864 shutdown_connections 2024-04-22T07:20:39.878 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.879+0000 7f08356d5640 1 -- 172.21.15.40:0/2167464864 wait complete. 2024-04-22T07:20:39.878 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-04-22T07:20:39.880+0000 7fccdbb43640 -1 osd.0 0 waiting for initial osdmap 2024-04-22T07:20:39.879 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.881+0000 7f08356d5640 1 Processor -- start 2024-04-22T07:20:39.879 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.881+0000 7f08356d5640 1 -- start start 2024-04-22T07:20:39.881 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.882+0000 7f08356d5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08300c9b90 0x7f083014f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:39.881 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.882+0000 7f08356d5640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0830151c70 0x7f0830158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:39.881 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.882+0000 7f08356d5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f083015b990 0x7f083014fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:39.881 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.882+0000 7f08356d5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f08300cb6c0 con 0x7f08300c9b90 2024-04-22T07:20:39.882 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.882+0000 7f08356d5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f08300cb3e0 con 0x7f083015b990 2024-04-22T07:20:39.882 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.882+0000 7f08356d5640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f083015bdb0 con 0x7f0830151c70 2024-04-22T07:20:39.882 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.882+0000 7f082e7fc640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0830151c70 0x7f0830158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:39.882 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.882+0000 7f082effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08300c9b90 0x7f083014f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:39.882 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.882+0000 7f082e7fc640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0830151c70 0x7f0830158c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.40:55522/0 (socket says 172.21.15.40:55522) 2024-04-22T07:20:39.882 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.882+0000 7f082e7fc640 1 -- 172.21.15.40:0/1379367210 learned_addr learned my addr 172.21.15.40:0/1379367210 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:39.882 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.882+0000 7f082f7fe640 1 --2- 172.21.15.40:0/1379367210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f083015b990 0x7f083014fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:39.882 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.883+0000 7f082e7fc640 1 -- 172.21.15.40:0/1379367210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f083015b990 msgr2=0x7f083014fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:39.882 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.883+0000 7f082e7fc640 1 --2- 172.21.15.40:0/1379367210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f083015b990 0x7f083014fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:39.883 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.883+0000 7f082e7fc640 1 -- 172.21.15.40:0/1379367210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08300c9b90 msgr2=0x7f083014f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:39.883 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.883+0000 7f082e7fc640 1 --2- 172.21.15.40:0/1379367210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08300c9b90 0x7f083014f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:39.883 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.883+0000 7f082e7fc640 1 -- 172.21.15.40:0/1379367210 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0830166850 con 0x7f0830151c70 2024-04-22T07:20:39.883 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.883+0000 7f082effd640 1 --2- 172.21.15.40:0/1379367210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08300c9b90 0x7f083014f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:20:39.883 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.883+0000 7f082e7fc640 1 --2- 172.21.15.40:0/1379367210 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0830151c70 0x7f0830158c60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f082400c420 tx=0x7f082400c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:39.885 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.887+0000 7f08177fe640 1 -- 172.21.15.40:0/1379367210 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08240074e0 con 0x7f0830151c70 2024-04-22T07:20:39.885 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.887+0000 7f08177fe640 1 -- 172.21.15.40:0/1379367210 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08240047e0 con 0x7f0830151c70 2024-04-22T07:20:39.885 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.887+0000 7f08356d5640 1 -- 172.21.15.40:0/1379367210 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f083014f7e0 con 0x7f0830151c70 2024-04-22T07:20:39.885 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.887+0000 7f08177fe640 1 -- 172.21.15.40:0/1379367210 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0824004c10 con 0x7f0830151c70 2024-04-22T07:20:39.885 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.887+0000 7f08356d5640 1 -- 172.21.15.40:0/1379367210 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f08300cc5c0 con 0x7f0830151c70 2024-04-22T07:20:39.886 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.888+0000 7f08356d5640 1 -- 172.21.15.40:0/1379367210 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f083004fce0 con 0x7f0830151c70 2024-04-22T07:20:39.886 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.888+0000 7f08177fe640 1 -- 172.21.15.40:0/1379367210 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f0824011070 con 0x7f0830151c70 2024-04-22T07:20:39.887 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.889+0000 7f08177fe640 1 --2- 172.21.15.40:0/1379367210 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f081c06c8e0 0x7f081c06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:39.887 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.889+0000 7f082effd640 1 --2- 172.21.15.40:0/1379367210 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f081c06c8e0 0x7f081c06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:39.887 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.890+0000 7f082effd640 1 --2- 172.21.15.40:0/1379367210 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f081c06c8e0 0x7f081c06eda0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0820036000 tx=0x7f0820008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:39.889 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.891+0000 7f08177fe640 1 -- 172.21.15.40:0/1379367210 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(14..14 src has 1..14) ==== 2511+0+0 (secure 0 0 0) 0x7f08240573e0 con 0x7f0830151c70 2024-04-22T07:20:39.891 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-04-22T07:20:39.894+0000 7fccd3963640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T07:20:39.894 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:39.896+0000 7f08177fe640 1 -- 172.21.15.40:0/1379367210 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0824059340 con 0x7f0830151c70 2024-04-22T07:20:39.897 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-04-22T07:20:39.900+0000 7f1526da4640 -1 osd.2 0 waiting for initial osdmap 2024-04-22T07:20:39.916 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-04-22T07:20:39.919+0000 7f151ebc4640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-22T07:20:40.081 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:40.083+0000 7f08356d5640 1 -- 172.21.15.40:0/1379367210 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f08300701a0 con 0x7f0830151c70 2024-04-22T07:20:40.082 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:40.084+0000 7f08177fe640 1 -- 172.21.15.40:0/1379367210 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7578 (secure 0 0 0) 0x7f082405d640 con 0x7f0830151c70 2024-04-22T07:20:40.082 INFO:teuthology.misc.health.smithi040.stdout: 2024-04-22T07:20:40.082 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":14,"fsid":"dd5b16e4-89fe-4602-b37f-062846793158","created":"2024-04-22T07:20:29.488892+0000","modified":"2024-04-22T07:20:39.108448+0000","last_up_change":"2024-04-22T07:20:37.777665+0000","last_in_change":"2024-04-22T07:20:31.702551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"32238b7e-228b-4a67-bfca-16e8f0020a92","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5ad8da43-39b1-4295-b4d1-0f1e1d06fc0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7d2c6d50-719d-4232-ad47-f04dcf1a8bc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"af42e7d6-a6bf-403e-92e7-162d7c4fbf0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f8e89e0d-be96-4f19-88c0-69c408df7d98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6801","nonce":2251435758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6803","nonce":2251435758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6807","nonce":2251435758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6805","nonce":2251435758}]},"public_addr":"172.21.15.62:6801/2251435758","cluster_addr":"172.21.15.62:6803/2251435758","heartbeat_back_addr":"172.21.15.62:6807/2251435758","heartbeat_front_addr":"172.21.15.62:6805/2251435758","state":["exists","up"]},{"osd":5,"uuid":"ba6dc1bc-272b-4f80-b55f-40bc4a0c3ff6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"834fcd74-14bf-45ec-a10a-0374f4ce9bf6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"831c9a73-960e-4d2e-b86a-33a6916be059","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:37.686796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:20:40.084 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:40.086+0000 7f08356d5640 1 -- 172.21.15.40:0/1379367210 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f081c06c8e0 msgr2=0x7f081c06eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:40.084 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:40.086+0000 7f08356d5640 1 --2- 172.21.15.40:0/1379367210 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f081c06c8e0 0x7f081c06eda0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0820036000 tx=0x7f0820008030 comp rx=0 tx=0).stop 2024-04-22T07:20:40.084 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:40.086+0000 7f08356d5640 1 -- 172.21.15.40:0/1379367210 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0830151c70 msgr2=0x7f0830158c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:40.085 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:40.086+0000 7f08356d5640 1 --2- 172.21.15.40:0/1379367210 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0830151c70 0x7f0830158c60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f082400c420 tx=0x7f082400c8e0 comp rx=0 tx=0).stop 2024-04-22T07:20:40.085 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:40.086+0000 7f08356d5640 1 -- 172.21.15.40:0/1379367210 shutdown_connections 2024-04-22T07:20:40.085 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:40.086+0000 7f08356d5640 1 --2- 172.21.15.40:0/1379367210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f083015b990 0x7f083014fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:40.085 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:40.086+0000 7f08356d5640 1 --2- 172.21.15.40:0/1379367210 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0830151c70 0x7f0830158c60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:40.085 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:40.086+0000 7f08356d5640 1 --2- 172.21.15.40:0/1379367210 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f081c06c8e0 0x7f081c06eda0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:40.085 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:40.086+0000 7f08356d5640 1 --2- 172.21.15.40:0/1379367210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08300c9b90 0x7f083014f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:40.085 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:40.086+0000 7f08356d5640 1 -- 172.21.15.40:0/1379367210 >> 172.21.15.40:0/1379367210 conn(0x7f083006fc20 msgr2=0x7f08300720f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:40.085 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:40.086+0000 7f08356d5640 1 -- 172.21.15.40:0/1379367210 shutdown_connections 2024-04-22T07:20:40.085 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:40.086+0000 7f08356d5640 1 -- 172.21.15.40:0/1379367210 wait complete. 2024-04-22T07:20:40.094 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-04-22T07:20:46.900 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-22T07:20:47.000 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.002+0000 7fe0a97d5640 1 Processor -- start 2024-04-22T07:20:47.000 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.002+0000 7fe0a97d5640 1 -- start start 2024-04-22T07:20:47.004 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.003+0000 7fe0a97d5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe0a406b930 0x7fe0a406bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:47.005 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.003+0000 7fe0a97d5640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0a415ad90 con 0x7fe0a415e810 2024-04-22T07:20:47.005 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.003+0000 7fe0a97d5640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0a415b050 con 0x7fe0a4155160 2024-04-22T07:20:47.005 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.003+0000 7fe0a97d5640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fe0a406c2e0 con 0x7fe0a406b930 2024-04-22T07:20:47.005 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.003+0000 7fe0a37fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe0a415e810 0x7fe0a415ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45444/0 (socket says 172.21.15.40:45444) 2024-04-22T07:20:47.005 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.003+0000 7fe0a37fe640 1 -- 172.21.15.40:0/3812315913 learned_addr learned my addr 172.21.15.40:0/3812315913 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:20:47.005 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.003+0000 7fe0a27fc640 1 --2- 172.21.15.40:0/3812315913 >> v2:172.21.15.62:3300/0 conn(0x7fe0a406b930 0x7fe0a406bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:47.005 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.003+0000 7fe0a1ffb640 1 -- 172.21.15.40:0/3812315913 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2374419479 0 0) 0x7fe0a415ad90 con 0x7fe0a415e810 2024-04-22T07:20:47.005 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.003+0000 7fe0a1ffb640 1 -- 172.21.15.40:0/3812315913 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe08c003520 con 0x7fe0a415e810 2024-04-22T07:20:47.005 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.004+0000 7fe0a1ffb640 1 -- 172.21.15.40:0/3812315913 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2438316267 0 0) 0x7fe08c003520 con 0x7fe0a415e810 2024-04-22T07:20:47.005 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.004+0000 7fe0a1ffb640 1 -- 172.21.15.40:0/3812315913 >> v2:172.21.15.62:3300/0 conn(0x7fe0a406b930 msgr2=0x7fe0a406bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:47.005 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.004+0000 7fe0a1ffb640 1 --2- 172.21.15.40:0/3812315913 >> v2:172.21.15.62:3300/0 conn(0x7fe0a406b930 0x7fe0a406bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.005 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.004+0000 7fe0a1ffb640 1 -- 172.21.15.40:0/3812315913 >> v1:172.21.15.62:6789/0 conn(0x7fe0a4155160 legacy=0x7fe0a40cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:47.006 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.004+0000 7fe0a1ffb640 1 -- 172.21.15.40:0/3812315913 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a415b330 con 0x7fe0a415e810 2024-04-22T07:20:47.006 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.004+0000 7fe0a1ffb640 1 -- 172.21.15.40:0/3812315913 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7fe0940019f0 con 0x7fe0a415e810 2024-04-22T07:20:47.006 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.004+0000 7fe0a27fc640 1 --2- 172.21.15.40:0/3812315913 >> v2:172.21.15.62:3300/0 conn(0x7fe0a406b930 0x7fe0a406bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:20:47.006 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.004+0000 7fe0a1ffb640 1 -- 172.21.15.40:0/3812315913 >> v1:172.21.15.40:6789/0 conn(0x7fe0a415e810 legacy=0x7fe0a415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:47.006 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.004+0000 7fe0a1ffb640 1 --2- 172.21.15.40:0/3812315913 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe08c0039b0 0x7fe08c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:47.006 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.004+0000 7fe0a1ffb640 1 --2- 172.21.15.40:0/3812315913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe08c004800 0x7fe08c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:47.006 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.004+0000 7fe0a1ffb640 1 --2- 172.21.15.40:0/3812315913 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe08c0051c0 0x7fe08c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:47.006 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.004+0000 7fe0a1ffb640 1 -- 172.21.15.40:0/3812315913 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe08c00c030 con 0x7fe08c004800 2024-04-22T07:20:47.006 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.004+0000 7fe0a1ffb640 1 -- 172.21.15.40:0/3812315913 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe08c00c1e0 con 0x7fe08c0039b0 2024-04-22T07:20:47.006 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.004+0000 7fe0a1ffb640 1 -- 172.21.15.40:0/3812315913 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe08c00c3e0 con 0x7fe08c0051c0 2024-04-22T07:20:47.006 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.004+0000 7fe0a27fc640 1 --2- 172.21.15.40:0/3812315913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe08c004800 0x7fe08c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:47.006 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.004+0000 7fe0a2ffd640 1 --2- 172.21.15.40:0/3812315913 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe08c0039b0 0x7fe08c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:47.006 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.004+0000 7fe0a37fe640 1 --2- 172.21.15.40:0/3812315913 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe08c0051c0 0x7fe08c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:47.007 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.004+0000 7fe0a27fc640 1 -- 172.21.15.40:0/3812315913 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe08c0051c0 msgr2=0x7fe08c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:47.007 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.004+0000 7fe0a27fc640 1 --2- 172.21.15.40:0/3812315913 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe08c0051c0 0x7fe08c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.007 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.004+0000 7fe0a27fc640 1 -- 172.21.15.40:0/3812315913 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe08c0039b0 msgr2=0x7fe08c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:47.007 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.004+0000 7fe0a27fc640 1 --2- 172.21.15.40:0/3812315913 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe08c0039b0 0x7fe08c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.007 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.004+0000 7fe0a27fc640 1 -- 172.21.15.40:0/3812315913 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08c003520 con 0x7fe08c004800 2024-04-22T07:20:47.007 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.004+0000 7fe0a37fe640 1 --2- 172.21.15.40:0/3812315913 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe08c0051c0 0x7fe08c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:20:47.007 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.004+0000 7fe0a37fe640 1 -- 172.21.15.40:0/3812315913 reap_dead start 2024-04-22T07:20:47.007 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.005+0000 7fe0a27fc640 1 --2- 172.21.15.40:0/3812315913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe08c004800 0x7fe08c004c80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe098009c90 tx=0x7fe08c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1508c38410956762 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:47.007 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.005+0000 7fe0a1ffb640 1 -- 172.21.15.40:0/3812315913 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe098039070 con 0x7fe08c004800 2024-04-22T07:20:47.007 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.005+0000 7fe0a1ffb640 1 -- 172.21.15.40:0/3812315913 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe09802c8f0 con 0x7fe08c004800 2024-04-22T07:20:47.007 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.005+0000 7fe0a1ffb640 1 -- 172.21.15.40:0/3812315913 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe098009860 con 0x7fe08c004800 2024-04-22T07:20:47.007 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.005+0000 7fe0a97d5640 1 -- 172.21.15.40:0/3812315913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe08c004800 msgr2=0x7fe08c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:47.008 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.005+0000 7fe0a97d5640 1 --2- 172.21.15.40:0/3812315913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe08c004800 0x7fe08c004c80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe098009c90 tx=0x7fe08c005830 comp rx=0 tx=0).stop 2024-04-22T07:20:47.008 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.006+0000 7fe0a97d5640 1 -- 172.21.15.40:0/3812315913 shutdown_connections 2024-04-22T07:20:47.008 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.006+0000 7fe0a97d5640 1 --2- 172.21.15.40:0/3812315913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe08c004800 0x7fe08c004c80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.008 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.006+0000 7fe0a97d5640 1 -- 172.21.15.40:0/3812315913 >> 172.21.15.40:0/3812315913 conn(0x7fe0a40629c0 msgr2=0x7fe0a40d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:47.008 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.006+0000 7fe0a97d5640 1 -- 172.21.15.40:0/3812315913 shutdown_connections 2024-04-22T07:20:47.008 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.006+0000 7fe0a97d5640 1 -- 172.21.15.40:0/3812315913 wait complete. 2024-04-22T07:20:47.008 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.007+0000 7fe0a97d5640 1 Processor -- start 2024-04-22T07:20:47.008 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.007+0000 7fe0a97d5640 1 -- start start 2024-04-22T07:20:47.010 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.008+0000 7fe0a97d5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe08c004800 0x7fe0a4155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:47.011 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.008+0000 7fe0a97d5640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0a4158600 0x7fe0a41f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:47.011 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.008+0000 7fe0a97d5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0a415ab20 0x7fe0a41f1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:47.011 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.008+0000 7fe0a97d5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a415bbd0 con 0x7fe0a415ab20 2024-04-22T07:20:47.011 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.008+0000 7fe0a97d5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a415b8f0 con 0x7fe08c004800 2024-04-22T07:20:47.011 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.008+0000 7fe0a97d5640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe0a40cca60 con 0x7fe0a4158600 2024-04-22T07:20:47.011 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.008+0000 7fe0a37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0a415ab20 0x7fe0a41f1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:47.011 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.008+0000 7fe0a37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0a415ab20 0x7fe0a41f1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54486/0 (socket says 172.21.15.40:54486) 2024-04-22T07:20:47.011 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.008+0000 7fe0a37fe640 1 -- 172.21.15.40:0/944804161 learned_addr learned my addr 172.21.15.40:0/944804161 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:47.011 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.008+0000 7fe0a2ffd640 1 --2- 172.21.15.40:0/944804161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe08c004800 0x7fe0a4155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:47.011 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.008+0000 7fe0a27fc640 1 --2- 172.21.15.40:0/944804161 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0a4158600 0x7fe0a41f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:47.011 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.008+0000 7fe0a37fe640 1 -- 172.21.15.40:0/944804161 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0a4158600 msgr2=0x7fe0a41f4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:47.011 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.008+0000 7fe0a37fe640 1 --2- 172.21.15.40:0/944804161 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0a4158600 0x7fe0a41f4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.011 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.008+0000 7fe0a37fe640 1 -- 172.21.15.40:0/944804161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe08c004800 msgr2=0x7fe0a4155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:47.011 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.008+0000 7fe0a37fe640 1 --2- 172.21.15.40:0/944804161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe08c004800 0x7fe0a4155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.012 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.008+0000 7fe0a37fe640 1 -- 172.21.15.40:0/944804161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a4157740 con 0x7fe0a415ab20 2024-04-22T07:20:47.012 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.008+0000 7fe0a37fe640 1 --2- 172.21.15.40:0/944804161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0a415ab20 0x7fe0a41f1600 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe094001ee0 tx=0x7fe09400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:47.012 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.009+0000 7fe08b7fe640 1 -- 172.21.15.40:0/944804161 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09400eda0 con 0x7fe0a415ab20 2024-04-22T07:20:47.012 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.009+0000 7fe08b7fe640 1 -- 172.21.15.40:0/944804161 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe094018070 con 0x7fe0a415ab20 2024-04-22T07:20:47.012 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.009+0000 7fe0a97d5640 1 -- 172.21.15.40:0/944804161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0a41579e0 con 0x7fe0a415ab20 2024-04-22T07:20:47.012 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.009+0000 7fe08b7fe640 1 -- 172.21.15.40:0/944804161 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe094013660 con 0x7fe0a415ab20 2024-04-22T07:20:47.012 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.009+0000 7fe0a97d5640 1 -- 172.21.15.40:0/944804161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0a41f4800 con 0x7fe0a415ab20 2024-04-22T07:20:47.012 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.010+0000 7fe0a97d5640 1 -- 172.21.15.40:0/944804161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0a4157f00 con 0x7fe0a415ab20 2024-04-22T07:20:47.012 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.010+0000 7fe08b7fe640 1 -- 172.21.15.40:0/944804161 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe094013800 con 0x7fe0a415ab20 2024-04-22T07:20:47.012 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.011+0000 7fe08b7fe640 1 --2- 172.21.15.40:0/944804161 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe09006c920 0x7fe09006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:47.012 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.011+0000 7fe0a2ffd640 1 --2- 172.21.15.40:0/944804161 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe09006c920 0x7fe09006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:47.012 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.011+0000 7fe08b7fe640 1 -- 172.21.15.40:0/944804161 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fe09408b950 con 0x7fe0a415ab20 2024-04-22T07:20:47.012 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.011+0000 7fe0a2ffd640 1 --2- 172.21.15.40:0/944804161 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe09006c920 0x7fe09006ede0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe09c000c00 tx=0x7fe09c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:47.013 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.015+0000 7fe08b7fe640 1 -- 172.21.15.40:0/944804161 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe0a4157f00 con 0x7fe0a415ab20 2024-04-22T07:20:47.197 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.199+0000 7fe0a97d5640 1 -- 172.21.15.40:0/944804161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0a404fce0 con 0x7fe0a415ab20 2024-04-22T07:20:47.198 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.200+0000 7fe08b7fe640 1 -- 172.21.15.40:0/944804161 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12812 (secure 0 0 0) 0x7fe0940599f0 con 0x7fe0a415ab20 2024-04-22T07:20:47.198 INFO:teuthology.misc.health.smithi040.stdout: 2024-04-22T07:20:47.198 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":19,"fsid":"dd5b16e4-89fe-4602-b37f-062846793158","created":"2024-04-22T07:20:29.488892+0000","modified":"2024-04-22T07:20:44.743795+0000","last_up_change":"2024-04-22T07:20:40.397383+0000","last_in_change":"2024-04-22T07:20:31.702551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:20:41.793179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32238b7e-228b-4a67-bfca-16e8f0020a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6801","nonce":1526385055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6803","nonce":1526385055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6807","nonce":1526385055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6805","nonce":1526385055}]},"public_addr":"172.21.15.40:6801/1526385055","cluster_addr":"172.21.15.40:6803/1526385055","heartbeat_back_addr":"172.21.15.40:6807/1526385055","heartbeat_front_addr":"172.21.15.40:6805/1526385055","state":["exists","up"]},{"osd":1,"uuid":"5ad8da43-39b1-4295-b4d1-0f1e1d06fc0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6809","nonce":623026645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6811","nonce":623026645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6815","nonce":623026645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6813","nonce":623026645}]},"public_addr":"172.21.15.40:6809/623026645","cluster_addr":"172.21.15.40:6811/623026645","heartbeat_back_addr":"172.21.15.40:6815/623026645","heartbeat_front_addr":"172.21.15.40:6813/623026645","state":["exists","up"]},{"osd":2,"uuid":"7d2c6d50-719d-4232-ad47-f04dcf1a8bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6820","nonce":1885686505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6824","nonce":1885686505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6831","nonce":1885686505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6828","nonce":1885686505}]},"public_addr":"172.21.15.40:6820/1885686505","cluster_addr":"172.21.15.40:6824/1885686505","heartbeat_back_addr":"172.21.15.40:6831/1885686505","heartbeat_front_addr":"172.21.15.40:6828/1885686505","state":["exists","up"]},{"osd":3,"uuid":"af42e7d6-a6bf-403e-92e7-162d7c4fbf0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6817","nonce":130276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6819","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6821","nonce":130276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6829","nonce":130276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6823","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6825","nonce":130276746}]},"public_addr":"172.21.15.40:6817/130276746","cluster_addr":"172.21.15.40:6821/130276746","heartbeat_back_addr":"172.21.15.40:6829/130276746","heartbeat_front_addr":"172.21.15.40:6825/130276746","state":["exists","up"]},{"osd":4,"uuid":"f8e89e0d-be96-4f19-88c0-69c408df7d98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6801","nonce":2251435758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6803","nonce":2251435758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6807","nonce":2251435758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6805","nonce":2251435758}]},"public_addr":"172.21.15.62:6801/2251435758","cluster_addr":"172.21.15.62:6803/2251435758","heartbeat_back_addr":"172.21.15.62:6807/2251435758","heartbeat_front_addr":"172.21.15.62:6805/2251435758","state":["exists","up"]},{"osd":5,"uuid":"ba6dc1bc-272b-4f80-b55f-40bc4a0c3ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6809","nonce":3509322231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6811","nonce":3509322231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6815","nonce":3509322231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6813","nonce":3509322231}]},"public_addr":"172.21.15.62:6809/3509322231","cluster_addr":"172.21.15.62:6811/3509322231","heartbeat_back_addr":"172.21.15.62:6815/3509322231","heartbeat_front_addr":"172.21.15.62:6813/3509322231","state":["exists","up"]},{"osd":6,"uuid":"834fcd74-14bf-45ec-a10a-0374f4ce9bf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6825","nonce":3094315954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6827","nonce":3094315954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6831","nonce":3094315954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6829","nonce":3094315954}]},"public_addr":"172.21.15.62:6825/3094315954","cluster_addr":"172.21.15.62:6827/3094315954","heartbeat_back_addr":"172.21.15.62:6831/3094315954","heartbeat_front_addr":"172.21.15.62:6829/3094315954","state":["exists","up"]},{"osd":7,"uuid":"831c9a73-960e-4d2e-b86a-33a6916be059","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6817","nonce":147453972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6819","nonce":147453972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6823","nonce":147453972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6821","nonce":147453972}]},"public_addr":"172.21.15.62:6817/147453972","cluster_addr":"172.21.15.62:6819/147453972","heartbeat_back_addr":"172.21.15.62:6823/147453972","heartbeat_front_addr":"172.21.15.62:6821/147453972","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.828738+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.873471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.908090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.894782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:37.686796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.801123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.852323+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.812139+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:20:47.200 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.202+0000 7fe0a97d5640 1 -- 172.21.15.40:0/944804161 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe09006c920 msgr2=0x7fe09006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:47.200 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.202+0000 7fe0a97d5640 1 --2- 172.21.15.40:0/944804161 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe09006c920 0x7fe09006ede0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe09c000c00 tx=0x7fe09c009040 comp rx=0 tx=0).stop 2024-04-22T07:20:47.200 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.202+0000 7fe0a97d5640 1 -- 172.21.15.40:0/944804161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0a415ab20 msgr2=0x7fe0a41f1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:47.201 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.202+0000 7fe0a97d5640 1 --2- 172.21.15.40:0/944804161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0a415ab20 0x7fe0a41f1600 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe094001ee0 tx=0x7fe09400e530 comp rx=0 tx=0).stop 2024-04-22T07:20:47.201 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.202+0000 7fe0a97d5640 1 -- 172.21.15.40:0/944804161 shutdown_connections 2024-04-22T07:20:47.201 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.202+0000 7fe0a97d5640 1 --2- 172.21.15.40:0/944804161 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe09006c920 0x7fe09006ede0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.201 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.202+0000 7fe0a97d5640 1 --2- 172.21.15.40:0/944804161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0a415ab20 0x7fe0a41f1600 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.201 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.202+0000 7fe0a97d5640 1 --2- 172.21.15.40:0/944804161 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0a4158600 0x7fe0a41f4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.201 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.202+0000 7fe0a97d5640 1 --2- 172.21.15.40:0/944804161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe08c004800 0x7fe0a4155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.201 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.202+0000 7fe0a97d5640 1 -- 172.21.15.40:0/944804161 >> 172.21.15.40:0/944804161 conn(0x7fe0a40629c0 msgr2=0x7fe0a40cbd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:47.201 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.202+0000 7fe0a97d5640 1 -- 172.21.15.40:0/944804161 shutdown_connections 2024-04-22T07:20:47.201 INFO:teuthology.misc.health.smithi040.stderr:2024-04-22T07:20:47.202+0000 7fe0a97d5640 1 -- 172.21.15.40:0/944804161 wait complete. 2024-04-22T07:20:47.210 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-22T07:20:47.210 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-22T07:20:47.210 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-22T07:20:47.211 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-22T07:20:47.213 INFO:tasks.ceph.mds.a:Started 2024-04-22T07:20:47.213 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-22T07:20:47.213 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-22T07:20:47.215 INFO:tasks.ceph.mds.c:Started 2024-04-22T07:20:47.215 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-22T07:20:47.215 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-04-22T07:20:47.217 INFO:tasks.ceph.mds.e:Started 2024-04-22T07:20:47.217 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-22T07:20:47.217 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-22T07:20:47.220 INFO:tasks.ceph.mds.b:Started 2024-04-22T07:20:47.221 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-22T07:20:47.221 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-22T07:20:47.223 INFO:tasks.ceph.mds.d:Started 2024-04-22T07:20:47.223 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-22T07:20:47.223 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-04-22T07:20:47.225 INFO:tasks.ceph.mds.f:Started 2024-04-22T07:20:47.225 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-22T07:20:47.226 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:20:47.290 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2024-04-22T07:20:47.291 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2024-04-22T07:20:47.295 INFO:tasks.ceph.mds.e.smithi040.stdout:starting mds.e at 2024-04-22T07:20:47.311 INFO:tasks.ceph.mds.b.smithi062.stdout:starting mds.b at 2024-04-22T07:20:47.311 INFO:tasks.ceph.mds.f.smithi062.stdout:starting mds.f at 2024-04-22T07:20:47.311 INFO:tasks.ceph.mds.d.smithi062.stdout:starting mds.d at 2024-04-22T07:20:47.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.337+0000 7f43d2315640 1 Processor -- start 2024-04-22T07:20:47.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.337+0000 7f43d2315640 1 -- start start 2024-04-22T07:20:47.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.338+0000 7f43d2315640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f43cc0cb360 0x7f43cc15b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:47.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.338+0000 7f43d2315640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43cc15ef30 0x7f43cc0d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:47.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.338+0000 7f43d2315640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43cc0cbc90 con 0x7f43cc154ff0 2024-04-22T07:20:47.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.338+0000 7f43d2315640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f43cc15eaa0 con 0x7f43cc0cb360 2024-04-22T07:20:47.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.338+0000 7f43d2315640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f43cc15bcc0 con 0x7f43cc15ef30 2024-04-22T07:20:47.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.338+0000 7f43cbfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f43cc154ff0 0x7f43cc0c5580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45468/0 (socket says 172.21.15.40:45468) 2024-04-22T07:20:47.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.338+0000 7f43cbfff640 1 -- 172.21.15.40:0/3993478134 learned_addr learned my addr 172.21.15.40:0/3993478134 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:20:47.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.338+0000 7f43cb7fe640 1 --2- 172.21.15.40:0/3993478134 >> v2:172.21.15.62:3300/0 conn(0x7f43cc0cb360 0x7f43cc15b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:47.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.338+0000 7f43d08b2640 1 --2- 172.21.15.40:0/3993478134 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43cc15ef30 0x7f43cc0d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:47.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.338+0000 7f43caffd640 1 -- 172.21.15.40:0/3993478134 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3444522578 0 0) 0x7f43c0001110 con 0x7f43cc154ff0 2024-04-22T07:20:47.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.338+0000 7f43caffd640 1 -- 172.21.15.40:0/3993478134 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43b4003520 con 0x7f43cc154ff0 2024-04-22T07:20:47.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.339+0000 7f43cb7fe640 1 -- 172.21.15.40:0/3993478134 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43cc15ef30 msgr2=0x7f43cc0d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:47.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.339+0000 7f43cb7fe640 1 --2- 172.21.15.40:0/3993478134 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43cc15ef30 0x7f43cc0d0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.339+0000 7f43cb7fe640 1 -- 172.21.15.40:0/3993478134 >> v1:172.21.15.40:6789/0 conn(0x7f43cc154ff0 legacy=0x7f43cc0c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:47.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.339+0000 7f43cb7fe640 1 -- 172.21.15.40:0/3993478134 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43cc0cc950 con 0x7f43cc0cb360 2024-04-22T07:20:47.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.339+0000 7f43cb7fe640 1 --2- 172.21.15.40:0/3993478134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43cc0cb360 0x7f43cc15b780 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f43bc0097a0 tx=0x7f43bc02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3e3d9b298460acf server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:47.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.340+0000 7f43caffd640 1 -- 172.21.15.40:0/3993478134 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc034070 con 0x7f43cc0cb360 2024-04-22T07:20:47.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.340+0000 7f43caffd640 1 -- 172.21.15.40:0/3993478134 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43bc030610 con 0x7f43cc0cb360 2024-04-22T07:20:47.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.340+0000 7f43caffd640 1 -- 172.21.15.40:0/3993478134 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc0309c0 con 0x7f43cc0cb360 2024-04-22T07:20:47.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.340+0000 7f43d2315640 1 -- 172.21.15.40:0/3993478134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43cc0cb360 msgr2=0x7f43cc15b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:47.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.340+0000 7f43d2315640 1 --2- 172.21.15.40:0/3993478134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43cc0cb360 0x7f43cc15b780 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f43bc0097a0 tx=0x7f43bc02b960 comp rx=0 tx=0).stop 2024-04-22T07:20:47.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.340+0000 7f43d2315640 1 -- 172.21.15.40:0/3993478134 shutdown_connections 2024-04-22T07:20:47.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.340+0000 7f43d2315640 1 --2- 172.21.15.40:0/3993478134 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43cc15ef30 0x7f43cc0d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.340+0000 7f43d2315640 1 --2- 172.21.15.40:0/3993478134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43cc0cb360 0x7f43cc15b780 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.340+0000 7f43d2315640 1 -- 172.21.15.40:0/3993478134 >> 172.21.15.40:0/3993478134 conn(0x7f43cc067890 msgr2=0x7f43cc06ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:47.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.340+0000 7f43d2315640 1 -- 172.21.15.40:0/3993478134 shutdown_connections 2024-04-22T07:20:47.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.340+0000 7f43d2315640 1 -- 172.21.15.40:0/3993478134 wait complete. 2024-04-22T07:20:47.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.341+0000 7f43d2315640 1 Processor -- start 2024-04-22T07:20:47.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.342+0000 7f43d2315640 1 -- start start 2024-04-22T07:20:47.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.342+0000 7f43d2315640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43cc0cb360 0x7f43cc159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:47.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.342+0000 7f43d2315640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43cc154ff0 0x7f43cc159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:47.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.343+0000 7f43d2315640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43cc15ef30 0x7f43cc15a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:47.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.343+0000 7f43d2315640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f43cc15e730 con 0x7f43cc154ff0 2024-04-22T07:20:47.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.343+0000 7f43d2315640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f43cc0ccbf0 con 0x7f43cc0cb360 2024-04-22T07:20:47.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.343+0000 7f43d2315640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f43cc1553d0 con 0x7f43cc15ef30 2024-04-22T07:20:47.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.343+0000 7f43cb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43cc154ff0 0x7f43cc159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:47.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.343+0000 7f43cb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43cc154ff0 0x7f43cc159c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54536/0 (socket says 172.21.15.40:54536) 2024-04-22T07:20:47.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.343+0000 7f43cbfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43cc0cb360 0x7f43cc159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:47.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.343+0000 7f43cb7fe640 1 -- 172.21.15.40:0/3931297003 learned_addr learned my addr 172.21.15.40:0/3931297003 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:47.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.343+0000 7f43d08b2640 1 --2- 172.21.15.40:0/3931297003 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43cc15ef30 0x7f43cc15a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:47.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.343+0000 7f43cb7fe640 1 -- 172.21.15.40:0/3931297003 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43cc15ef30 msgr2=0x7f43cc15a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:47.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.343+0000 7f43cb7fe640 1 --2- 172.21.15.40:0/3931297003 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43cc15ef30 0x7f43cc15a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.343+0000 7f43cb7fe640 1 -- 172.21.15.40:0/3931297003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43cc0cb360 msgr2=0x7f43cc159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:47.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.343+0000 7f43cb7fe640 1 --2- 172.21.15.40:0/3931297003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43cc0cb360 0x7f43cc159110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.343+0000 7f43cb7fe640 1 -- 172.21.15.40:0/3931297003 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43cc1e6d20 con 0x7f43cc154ff0 2024-04-22T07:20:47.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.343+0000 7f43cb7fe640 1 --2- 172.21.15.40:0/3931297003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43cc154ff0 0x7f43cc159c50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f43bc0098c0 tx=0x7f43bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:47.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.343+0000 7f43c8ff9640 1 -- 172.21.15.40:0/3931297003 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc034040 con 0x7f43cc154ff0 2024-04-22T07:20:47.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.343+0000 7f43c8ff9640 1 -- 172.21.15.40:0/3931297003 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43bc030410 con 0x7f43cc154ff0 2024-04-22T07:20:47.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.343+0000 7f43c8ff9640 1 -- 172.21.15.40:0/3931297003 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc006e10 con 0x7f43cc154ff0 2024-04-22T07:20:47.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.343+0000 7f43d2315640 1 -- 172.21.15.40:0/3931297003 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43cc1e4c50 con 0x7f43cc154ff0 2024-04-22T07:20:47.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.343+0000 7f43d2315640 1 -- 172.21.15.40:0/3931297003 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43cc1e5210 con 0x7f43cc154ff0 2024-04-22T07:20:47.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.345+0000 7f43d2315640 1 -- 172.21.15.40:0/3931297003 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43cc0c76a0 con 0x7f43cc154ff0 2024-04-22T07:20:47.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.345+0000 7f43c8ff9640 1 -- 172.21.15.40:0/3931297003 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f43bc037070 con 0x7f43cc154ff0 2024-04-22T07:20:47.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.346+0000 7f43c8ff9640 1 --2- 172.21.15.40:0/3931297003 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f43b806c8f0 0x7f43b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:47.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.346+0000 7f43cbfff640 1 --2- 172.21.15.40:0/3931297003 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f43b806c8f0 0x7f43b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:47.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.346+0000 7f43c8ff9640 1 -- 172.21.15.40:0/3931297003 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f43bc0ad580 con 0x7f43cc154ff0 2024-04-22T07:20:47.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.346+0000 7f43cbfff640 1 --2- 172.21.15.40:0/3931297003 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f43b806c8f0 0x7f43b806edb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f43c0005880 tx=0x7f43c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:47.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.350+0000 7f43c8ff9640 1 -- 172.21.15.40:0/3931297003 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f43cc0c76a0 con 0x7f43cc154ff0 2024-04-22T07:20:47.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.536+0000 7f43d2315640 1 -- 172.21.15.40:0/3931297003 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f43cc068b20 con 0x7f43cc154ff0 2024-04-22T07:20:47.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.537+0000 7f43c8ff9640 1 -- 172.21.15.40:0/3931297003 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12812 (secure 0 0 0) 0x7f43bc07b6b0 con 0x7f43cc154ff0 2024-04-22T07:20:47.535 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:20:47.535 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":19,"fsid":"dd5b16e4-89fe-4602-b37f-062846793158","created":"2024-04-22T07:20:29.488892+0000","modified":"2024-04-22T07:20:44.743795+0000","last_up_change":"2024-04-22T07:20:40.397383+0000","last_in_change":"2024-04-22T07:20:31.702551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:20:41.793179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32238b7e-228b-4a67-bfca-16e8f0020a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6801","nonce":1526385055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6803","nonce":1526385055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6807","nonce":1526385055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6805","nonce":1526385055}]},"public_addr":"172.21.15.40:6801/1526385055","cluster_addr":"172.21.15.40:6803/1526385055","heartbeat_back_addr":"172.21.15.40:6807/1526385055","heartbeat_front_addr":"172.21.15.40:6805/1526385055","state":["exists","up"]},{"osd":1,"uuid":"5ad8da43-39b1-4295-b4d1-0f1e1d06fc0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6809","nonce":623026645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6811","nonce":623026645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6815","nonce":623026645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6813","nonce":623026645}]},"public_addr":"172.21.15.40:6809/623026645","cluster_addr":"172.21.15.40:6811/623026645","heartbeat_back_addr":"172.21.15.40:6815/623026645","heartbeat_front_addr":"172.21.15.40:6813/623026645","state":["exists","up"]},{"osd":2,"uuid":"7d2c6d50-719d-4232-ad47-f04dcf1a8bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6820","nonce":1885686505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6824","nonce":1885686505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6831","nonce":1885686505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6828","nonce":1885686505}]},"public_addr":"172.21.15.40:6820/1885686505","cluster_addr":"172.21.15.40:6824/1885686505","heartbeat_back_addr":"172.21.15.40:6831/1885686505","heartbeat_front_addr":"172.21.15.40:6828/1885686505","state":["exists","up"]},{"osd":3,"uuid":"af42e7d6-a6bf-403e-92e7-162d7c4fbf0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6817","nonce":130276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6819","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6821","nonce":130276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6829","nonce":130276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6823","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6825","nonce":130276746}]},"public_addr":"172.21.15.40:6817/130276746","cluster_addr":"172.21.15.40:6821/130276746","heartbeat_back_addr":"172.21.15.40:6829/130276746","heartbeat_front_addr":"172.21.15.40:6825/130276746","state":["exists","up"]},{"osd":4,"uuid":"f8e89e0d-be96-4f19-88c0-69c408df7d98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6801","nonce":2251435758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6803","nonce":2251435758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6807","nonce":2251435758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6805","nonce":2251435758}]},"public_addr":"172.21.15.62:6801/2251435758","cluster_addr":"172.21.15.62:6803/2251435758","heartbeat_back_addr":"172.21.15.62:6807/2251435758","heartbeat_front_addr":"172.21.15.62:6805/2251435758","state":["exists","up"]},{"osd":5,"uuid":"ba6dc1bc-272b-4f80-b55f-40bc4a0c3ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6809","nonce":3509322231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6811","nonce":3509322231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6815","nonce":3509322231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6813","nonce":3509322231}]},"public_addr":"172.21.15.62:6809/3509322231","cluster_addr":"172.21.15.62:6811/3509322231","heartbeat_back_addr":"172.21.15.62:6815/3509322231","heartbeat_front_addr":"172.21.15.62:6813/3509322231","state":["exists","up"]},{"osd":6,"uuid":"834fcd74-14bf-45ec-a10a-0374f4ce9bf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6825","nonce":3094315954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6827","nonce":3094315954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6831","nonce":3094315954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6829","nonce":3094315954}]},"public_addr":"172.21.15.62:6825/3094315954","cluster_addr":"172.21.15.62:6827/3094315954","heartbeat_back_addr":"172.21.15.62:6831/3094315954","heartbeat_front_addr":"172.21.15.62:6829/3094315954","state":["exists","up"]},{"osd":7,"uuid":"831c9a73-960e-4d2e-b86a-33a6916be059","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6817","nonce":147453972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6819","nonce":147453972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6823","nonce":147453972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6821","nonce":147453972}]},"public_addr":"172.21.15.62:6817/147453972","cluster_addr":"172.21.15.62:6819/147453972","heartbeat_back_addr":"172.21.15.62:6823/147453972","heartbeat_front_addr":"172.21.15.62:6821/147453972","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.828738+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.873471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.908090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.894782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:37.686796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.801123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.852323+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.812139+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:20:47.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.538+0000 7f43d2315640 1 -- 172.21.15.40:0/3931297003 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f43b806c8f0 msgr2=0x7f43b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:47.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.538+0000 7f43d2315640 1 --2- 172.21.15.40:0/3931297003 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f43b806c8f0 0x7f43b806edb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f43c0005880 tx=0x7f43c0009040 comp rx=0 tx=0).stop 2024-04-22T07:20:47.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.539+0000 7f43d2315640 1 -- 172.21.15.40:0/3931297003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43cc154ff0 msgr2=0x7f43cc159c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:47.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.539+0000 7f43d2315640 1 --2- 172.21.15.40:0/3931297003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43cc154ff0 0x7f43cc159c50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f43bc0098c0 tx=0x7f43bc0046c0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.539+0000 7f43d2315640 1 -- 172.21.15.40:0/3931297003 shutdown_connections 2024-04-22T07:20:47.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.539+0000 7f43d2315640 1 --2- 172.21.15.40:0/3931297003 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43cc15ef30 0x7f43cc15a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.539+0000 7f43d2315640 1 --2- 172.21.15.40:0/3931297003 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f43b806c8f0 0x7f43b806edb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.539+0000 7f43d2315640 1 --2- 172.21.15.40:0/3931297003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43cc154ff0 0x7f43cc159c50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.539+0000 7f43d2315640 1 --2- 172.21.15.40:0/3931297003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43cc0cb360 0x7f43cc159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.539+0000 7f43d2315640 1 -- 172.21.15.40:0/3931297003 >> 172.21.15.40:0/3931297003 conn(0x7f43cc067890 msgr2=0x7f43cc153c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:47.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.539+0000 7f43d2315640 1 -- 172.21.15.40:0/3931297003 shutdown_connections 2024-04-22T07:20:47.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.539+0000 7f43d2315640 1 -- 172.21.15.40:0/3931297003 wait complete. 2024-04-22T07:20:47.547 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T07:20:41.793179+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-22T07:20:47.548 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T07:20:47.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.653+0000 7f8b3d359640 1 Processor -- start 2024-04-22T07:20:47.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.653+0000 7f8b3d359640 1 -- start start 2024-04-22T07:20:47.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.654+0000 7f8b3d359640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8b38156550 0x7f8b380c3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:47.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.654+0000 7f8b3d359640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8b380ca080 0x7f8b38159690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:47.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.654+0000 7f8b3d359640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b380c91c0 con 0x7f8b38070030 2024-04-22T07:20:47.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.654+0000 7f8b3d359640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f8b38159bd0 con 0x7f8b38156550 2024-04-22T07:20:47.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.654+0000 7f8b3d359640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f8b380c8f70 con 0x7f8b380ca080 2024-04-22T07:20:47.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.654+0000 7f8b36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8b38156550 0x7f8b380c3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:47.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.654+0000 7f8b377fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8b38070030 0x7f8b380c3dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45478/0 (socket says 172.21.15.40:45478) 2024-04-22T07:20:47.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.654+0000 7f8b377fe640 1 -- 172.21.15.40:0/1463464404 learned_addr learned my addr 172.21.15.40:0/1463464404 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:20:47.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.654+0000 7f8b367fc640 1 --2- 172.21.15.40:0/1463464404 >> v2:172.21.15.62:3300/0 conn(0x7f8b380ca080 0x7f8b38159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:47.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.655+0000 7f8b36ffd640 1 -- 172.21.15.40:0/1463464404 >> v2:172.21.15.62:3300/0 conn(0x7f8b380ca080 msgr2=0x7f8b38159690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:47.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.655+0000 7f8b36ffd640 1 --2- 172.21.15.40:0/1463464404 >> v2:172.21.15.62:3300/0 conn(0x7f8b380ca080 0x7f8b38159690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.655+0000 7f8b36ffd640 1 -- 172.21.15.40:0/1463464404 >> v1:172.21.15.40:6789/0 conn(0x7f8b38070030 legacy=0x7f8b380c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:47.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.655+0000 7f8b35ffb640 1 -- 172.21.15.40:0/1463464404 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 607007860 0 0) 0x7f8b380c91c0 con 0x7f8b38070030 2024-04-22T07:20:47.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.655+0000 7f8b36ffd640 1 -- 172.21.15.40:0/1463464404 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b380c94a0 con 0x7f8b38156550 2024-04-22T07:20:47.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.655+0000 7f8b367fc640 1 --2- 172.21.15.40:0/1463464404 >> v2:172.21.15.62:3300/0 conn(0x7f8b380ca080 0x7f8b38159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:20:47.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.655+0000 7f8b36ffd640 1 --2- 172.21.15.40:0/1463464404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b38156550 0x7f8b380c3590 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8b38071200 tx=0x7f8b3002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f596ae1118c148f server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:47.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.655+0000 7f8b35ffb640 1 -- 172.21.15.40:0/1463464404 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b30034070 con 0x7f8b38156550 2024-04-22T07:20:47.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.656+0000 7f8b35ffb640 1 -- 172.21.15.40:0/1463464404 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b30030610 con 0x7f8b38156550 2024-04-22T07:20:47.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.656+0000 7f8b35ffb640 1 -- 172.21.15.40:0/1463464404 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b300309e0 con 0x7f8b38156550 2024-04-22T07:20:47.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.656+0000 7f8b3d359640 1 -- 172.21.15.40:0/1463464404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b38156550 msgr2=0x7f8b380c3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:47.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.656+0000 7f8b3d359640 1 --2- 172.21.15.40:0/1463464404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b38156550 0x7f8b380c3590 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8b38071200 tx=0x7f8b3002b960 comp rx=0 tx=0).stop 2024-04-22T07:20:47.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.656+0000 7f8b3d359640 1 -- 172.21.15.40:0/1463464404 shutdown_connections 2024-04-22T07:20:47.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.656+0000 7f8b3d359640 1 --2- 172.21.15.40:0/1463464404 >> v2:172.21.15.62:3300/0 conn(0x7f8b380ca080 0x7f8b38159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.656+0000 7f8b3d359640 1 --2- 172.21.15.40:0/1463464404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b38156550 0x7f8b380c3590 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.656+0000 7f8b3d359640 1 -- 172.21.15.40:0/1463464404 >> 172.21.15.40:0/1463464404 conn(0x7f8b3806db30 msgr2=0x7f8b3806df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:47.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.656+0000 7f8b3d359640 1 -- 172.21.15.40:0/1463464404 shutdown_connections 2024-04-22T07:20:47.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.656+0000 7f8b3d359640 1 -- 172.21.15.40:0/1463464404 wait complete. 2024-04-22T07:20:47.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.657+0000 7f8b3d359640 1 Processor -- start 2024-04-22T07:20:47.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.657+0000 7f8b3d359640 1 -- start start 2024-04-22T07:20:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.658+0000 7f8b3d359640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b38070030 0x7f8b381f2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.658+0000 7f8b3d359640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b380ca080 0x7f8b381e44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.658+0000 7f8b3d359640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b38156550 0x7f8b38158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.658+0000 7f8b3d359640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8b3806fb10 con 0x7f8b38070030 2024-04-22T07:20:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.658+0000 7f8b3d359640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8b3806f830 con 0x7f8b38156550 2024-04-22T07:20:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.658+0000 7f8b3d359640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f8b38070ea0 con 0x7f8b380ca080 2024-04-22T07:20:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.658+0000 7f8b36ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b38070030 0x7f8b381f2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.658+0000 7f8b36ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b38070030 0x7f8b381f2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54560/0 (socket says 172.21.15.40:54560) 2024-04-22T07:20:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.658+0000 7f8b36ffd640 1 -- 172.21.15.40:0/4138002917 learned_addr learned my addr 172.21.15.40:0/4138002917 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.658+0000 7f8b36ffd640 1 -- 172.21.15.40:0/4138002917 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b380ca080 msgr2=0x7f8b381e44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.658+0000 7f8b36ffd640 1 --2- 172.21.15.40:0/4138002917 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b380ca080 0x7f8b381e44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.658+0000 7f8b36ffd640 1 -- 172.21.15.40:0/4138002917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b38156550 msgr2=0x7f8b38158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.658+0000 7f8b36ffd640 1 --2- 172.21.15.40:0/4138002917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b38156550 0x7f8b38158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.658+0000 7f8b36ffd640 1 -- 172.21.15.40:0/4138002917 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b381f3140 con 0x7f8b38070030 2024-04-22T07:20:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.659+0000 7f8b36ffd640 1 --2- 172.21.15.40:0/4138002917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b38070030 0x7f8b381f2c00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8b30009890 tx=0x7f8b300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.659+0000 7f8b2f7fe640 1 -- 172.21.15.40:0/4138002917 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b30034040 con 0x7f8b38070030 2024-04-22T07:20:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.659+0000 7f8b2f7fe640 1 -- 172.21.15.40:0/4138002917 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b3003ace0 con 0x7f8b38070030 2024-04-22T07:20:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.659+0000 7f8b3d359640 1 -- 172.21.15.40:0/4138002917 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b381dfed0 con 0x7f8b38070030 2024-04-22T07:20:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.659+0000 7f8b2f7fe640 1 -- 172.21.15.40:0/4138002917 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b30044630 con 0x7f8b38070030 2024-04-22T07:20:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.659+0000 7f8b3d359640 1 -- 172.21.15.40:0/4138002917 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b381df110 con 0x7f8b38070030 2024-04-22T07:20:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.660+0000 7f8b3d359640 1 -- 172.21.15.40:0/4138002917 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b38069f50 con 0x7f8b38070030 2024-04-22T07:20:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.660+0000 7f8b2f7fe640 1 -- 172.21.15.40:0/4138002917 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8b30037070 con 0x7f8b38070030 2024-04-22T07:20:47.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.661+0000 7f8b2f7fe640 1 --2- 172.21.15.40:0/4138002917 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8b1806c8f0 0x7f8b1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:47.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.661+0000 7f8b2f7fe640 1 -- 172.21.15.40:0/4138002917 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f8b300ad7d0 con 0x7f8b38070030 2024-04-22T07:20:47.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.661+0000 7f8b367fc640 1 --2- 172.21.15.40:0/4138002917 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8b1806c8f0 0x7f8b1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:47.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.661+0000 7f8b367fc640 1 --2- 172.21.15.40:0/4138002917 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8b1806c8f0 0x7f8b1806edb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8b20006fd0 tx=0x7f8b20008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.665+0000 7f8b2f7fe640 1 -- 172.21.15.40:0/4138002917 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8b3003f070 con 0x7f8b38070030 2024-04-22T07:20:47.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.852+0000 7f8b3d359640 1 -- 172.21.15.40:0/4138002917 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8b3804fdc0 con 0x7f8b38070030 2024-04-22T07:20:47.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.852+0000 7f8b2f7fe640 1 -- 172.21.15.40:0/4138002917 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) ==== 93+0+10 (secure 0 0 0) 0x7f8b3007bf50 con 0x7f8b38070030 2024-04-22T07:20:47.850 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-04-22T07:20:47.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.854+0000 7f8b3d359640 1 -- 172.21.15.40:0/4138002917 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8b1806c8f0 msgr2=0x7f8b1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:47.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.854+0000 7f8b3d359640 1 --2- 172.21.15.40:0/4138002917 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8b1806c8f0 0x7f8b1806edb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8b20006fd0 tx=0x7f8b20008040 comp rx=0 tx=0).stop 2024-04-22T07:20:47.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.854+0000 7f8b3d359640 1 -- 172.21.15.40:0/4138002917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b38070030 msgr2=0x7f8b381f2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:47.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.854+0000 7f8b3d359640 1 --2- 172.21.15.40:0/4138002917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b38070030 0x7f8b381f2c00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8b30009890 tx=0x7f8b300046c0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.854+0000 7f8b3d359640 1 -- 172.21.15.40:0/4138002917 shutdown_connections 2024-04-22T07:20:47.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.854+0000 7f8b3d359640 1 --2- 172.21.15.40:0/4138002917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8b38156550 0x7f8b38158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.854+0000 7f8b3d359640 1 --2- 172.21.15.40:0/4138002917 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8b380ca080 0x7f8b381e44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.854+0000 7f8b3d359640 1 --2- 172.21.15.40:0/4138002917 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8b1806c8f0 0x7f8b1806edb0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.854+0000 7f8b3d359640 1 --2- 172.21.15.40:0/4138002917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b38070030 0x7f8b381f2c00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.854+0000 7f8b3d359640 1 -- 172.21.15.40:0/4138002917 >> 172.21.15.40:0/4138002917 conn(0x7f8b3806db30 msgr2=0x7f8b380c3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:47.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.854+0000 7f8b3d359640 1 -- 172.21.15.40:0/4138002917 shutdown_connections 2024-04-22T07:20:47.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.854+0000 7f8b3d359640 1 -- 172.21.15.40:0/4138002917 wait complete. 2024-04-22T07:20:47.863 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:20:47.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.966+0000 7fdbd2e26640 1 Processor -- start 2024-04-22T07:20:47.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.966+0000 7fdbd2e26640 1 -- start start 2024-04-22T07:20:47.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.967+0000 7fdbd2e26640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdbcc1551a0 0x7fdbcc0cd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:47.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.967+0000 7fdbd2e26640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdbcc0cbe00 0x7fdbcc0cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:47.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.967+0000 7fdbd2e26640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbcc15e410 con 0x7fdbcc15bae0 2024-04-22T07:20:47.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.967+0000 7fdbd2e26640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fdbcc155580 con 0x7fdbcc0cbe00 2024-04-22T07:20:47.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.967+0000 7fdbd2e26640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fdbcc15e6b0 con 0x7fdbcc1551a0 2024-04-22T07:20:47.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.967+0000 7fdbd13c3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdbcc0cbe00 0x7fdbcc0cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:47.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.967+0000 7fdbd13c3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdbcc0cbe00 0x7fdbcc0cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54572/0 (socket says 172.21.15.40:54572) 2024-04-22T07:20:47.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.967+0000 7fdbd13c3640 1 -- 172.21.15.40:0/1749816964 learned_addr learned my addr 172.21.15.40:0/1749816964 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:47.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.967+0000 7fdbd0bc2640 1 --2- 172.21.15.40:0/1749816964 >> v2:172.21.15.62:3300/0 conn(0x7fdbcc1551a0 0x7fdbcc0cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:47.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.967+0000 7fdbd13c3640 1 -- 172.21.15.40:0/1749816964 >> v2:172.21.15.62:3300/0 conn(0x7fdbcc1551a0 msgr2=0x7fdbcc0cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:47.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.967+0000 7fdbd13c3640 1 --2- 172.21.15.40:0/1749816964 >> v2:172.21.15.62:3300/0 conn(0x7fdbcc1551a0 0x7fdbcc0cd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.967+0000 7fdbd13c3640 1 -- 172.21.15.40:0/1749816964 >> v1:172.21.15.62:6789/0 conn(0x7fdbcc15bae0 legacy=0x7fdbcc0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:47.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.967+0000 7fdbd13c3640 1 -- 172.21.15.40:0/1749816964 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbcc15e990 con 0x7fdbcc0cbe00 2024-04-22T07:20:47.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.968+0000 7fdbd13c3640 1 --2- 172.21.15.40:0/1749816964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbcc0cbe00 0x7fdbcc0cd650 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc0d1740 tx=0x7fdbbc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d499c7b1a5a6f85f server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:47.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.968+0000 7fdbcb7fe640 1 -- 172.21.15.40:0/1749816964 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc034070 con 0x7fdbcc0cbe00 2024-04-22T07:20:47.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.968+0000 7fdbcb7fe640 1 -- 172.21.15.40:0/1749816964 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbbc030860 con 0x7fdbcc0cbe00 2024-04-22T07:20:47.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.968+0000 7fdbcb7fe640 1 -- 172.21.15.40:0/1749816964 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc030c30 con 0x7fdbcc0cbe00 2024-04-22T07:20:47.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.968+0000 7fdbd2e26640 1 -- 172.21.15.40:0/1749816964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbcc0cbe00 msgr2=0x7fdbcc0cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:47.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.968+0000 7fdbd2e26640 1 --2- 172.21.15.40:0/1749816964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbcc0cbe00 0x7fdbcc0cd650 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc0d1740 tx=0x7fdbbc02b9a0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.969+0000 7fdbd2e26640 1 -- 172.21.15.40:0/1749816964 shutdown_connections 2024-04-22T07:20:47.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.969+0000 7fdbd2e26640 1 --2- 172.21.15.40:0/1749816964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbcc0cbe00 0x7fdbcc0cd650 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.969+0000 7fdbd2e26640 1 --2- 172.21.15.40:0/1749816964 >> v2:172.21.15.62:3300/0 conn(0x7fdbcc1551a0 0x7fdbcc0cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.969+0000 7fdbd2e26640 1 -- 172.21.15.40:0/1749816964 >> 172.21.15.40:0/1749816964 conn(0x7fdbcc0678c0 msgr2=0x7fdbcc072860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:47.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.969+0000 7fdbd2e26640 1 -- 172.21.15.40:0/1749816964 shutdown_connections 2024-04-22T07:20:47.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.969+0000 7fdbd2e26640 1 -- 172.21.15.40:0/1749816964 wait complete. 2024-04-22T07:20:47.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.970+0000 7fdbd2e26640 1 Processor -- start 2024-04-22T07:20:47.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.970+0000 7fdbd2e26640 1 -- start start 2024-04-22T07:20:47.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.971+0000 7fdbd2e26640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbcc0cbe00 0x7fdbcc1f1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:47.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.971+0000 7fdbd2e26640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbcc1551a0 0x7fdbcc15d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:47.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.971+0000 7fdbd2e26640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdbcc15bae0 0x7fdbcc14f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:47.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.971+0000 7fdbd2e26640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc15f230 con 0x7fdbcc1551a0 2024-04-22T07:20:47.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.971+0000 7fdbd2e26640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc15ef50 con 0x7fdbcc0cbe00 2024-04-22T07:20:47.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.971+0000 7fdbd2e26640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fdbcc0b4ba0 con 0x7fdbcc15bae0 2024-04-22T07:20:47.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.971+0000 7fdbcbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbcc1551a0 0x7fdbcc15d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:47.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.971+0000 7fdbcbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbcc1551a0 0x7fdbcc15d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54578/0 (socket says 172.21.15.40:54578) 2024-04-22T07:20:47.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.971+0000 7fdbcbfff640 1 -- 172.21.15.40:0/760948404 learned_addr learned my addr 172.21.15.40:0/760948404 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:47.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.971+0000 7fdbd0bc2640 1 --2- 172.21.15.40:0/760948404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbcc0cbe00 0x7fdbcc1f1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:47.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.971+0000 7fdbd13c3640 1 --2- 172.21.15.40:0/760948404 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdbcc15bae0 0x7fdbcc14f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:47.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.971+0000 7fdbcbfff640 1 -- 172.21.15.40:0/760948404 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdbcc15bae0 msgr2=0x7fdbcc14f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:47.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.971+0000 7fdbcbfff640 1 --2- 172.21.15.40:0/760948404 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdbcc15bae0 0x7fdbcc14f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.971+0000 7fdbcbfff640 1 -- 172.21.15.40:0/760948404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbcc0cbe00 msgr2=0x7fdbcc1f1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:47.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.971+0000 7fdbcbfff640 1 --2- 172.21.15.40:0/760948404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbcc0cbe00 0x7fdbcc1f1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:47.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.971+0000 7fdbcbfff640 1 -- 172.21.15.40:0/760948404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbcc14df20 con 0x7fdbcc1551a0 2024-04-22T07:20:47.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.971+0000 7fdbcbfff640 1 --2- 172.21.15.40:0/760948404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbcc1551a0 0x7fdbcc15d520 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400c3f0 tx=0x7fdbb400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:47.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.971+0000 7fdbc97fa640 1 -- 172.21.15.40:0/760948404 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb40052d0 con 0x7fdbcc1551a0 2024-04-22T07:20:47.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.971+0000 7fdbc97fa640 1 -- 172.21.15.40:0/760948404 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbb4005490 con 0x7fdbcc1551a0 2024-04-22T07:20:47.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.971+0000 7fdbd2e26640 1 -- 172.21.15.40:0/760948404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbcc14e200 con 0x7fdbcc1551a0 2024-04-22T07:20:47.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.971+0000 7fdbc97fa640 1 -- 172.21.15.40:0/760948404 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4007260 con 0x7fdbcc1551a0 2024-04-22T07:20:47.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.971+0000 7fdbd2e26640 1 -- 172.21.15.40:0/760948404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbcc14e7c0 con 0x7fdbcc1551a0 2024-04-22T07:20:47.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.972+0000 7fdbd2e26640 1 -- 172.21.15.40:0/760948404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbcc0cb6f0 con 0x7fdbcc1551a0 2024-04-22T07:20:47.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.973+0000 7fdbc97fa640 1 -- 172.21.15.40:0/760948404 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdbb4007400 con 0x7fdbcc1551a0 2024-04-22T07:20:47.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.973+0000 7fdbc97fa640 1 --2- 172.21.15.40:0/760948404 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fdbac06c8f0 0x7fdbac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:47.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.973+0000 7fdbd0bc2640 1 --2- 172.21.15.40:0/760948404 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fdbac06c8f0 0x7fdbac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:47.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.973+0000 7fdbc97fa640 1 -- 172.21.15.40:0/760948404 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fdbb408ad20 con 0x7fdbcc1551a0 2024-04-22T07:20:47.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.974+0000 7fdbd0bc2640 1 --2- 172.21.15.40:0/760948404 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fdbac06c8f0 0x7fdbac06edb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40113e0 tx=0x7fdbc400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:47.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:47.978+0000 7fdbc97fa640 1 -- 172.21.15.40:0/760948404 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdbcc0cb6f0 con 0x7fdbcc1551a0 2024-04-22T07:20:48.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:48.199+0000 7fdbd2e26640 1 -- 172.21.15.40:0/760948404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdbcc069d40 con 0x7fdbcc1551a0 2024-04-22T07:20:48.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:48.200+0000 7fdbc97fa640 1 -- 172.21.15.40:0/760948404 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7fdbb4058d20 con 0x7fdbcc1551a0 2024-04-22T07:20:48.198 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:20:48.198 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2062933254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2062933254},{"type":"v1","addr":"172.21.15.40:6835","nonce":2062933254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-22T07:20:48.198 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 2 2024-04-22T07:20:48.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:48.201+0000 7fdbd2e26640 1 -- 172.21.15.40:0/760948404 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fdbac06c8f0 msgr2=0x7fdbac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:48.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:48.201+0000 7fdbd2e26640 1 --2- 172.21.15.40:0/760948404 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fdbac06c8f0 0x7fdbac06edb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40113e0 tx=0x7fdbc400b040 comp rx=0 tx=0).stop 2024-04-22T07:20:48.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:48.202+0000 7fdbd2e26640 1 -- 172.21.15.40:0/760948404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbcc1551a0 msgr2=0x7fdbcc15d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:48.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:48.202+0000 7fdbd2e26640 1 --2- 172.21.15.40:0/760948404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbcc1551a0 0x7fdbcc15d520 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400c3f0 tx=0x7fdbb400c8b0 comp rx=0 tx=0).stop 2024-04-22T07:20:48.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:48.202+0000 7fdbd2e26640 1 -- 172.21.15.40:0/760948404 shutdown_connections 2024-04-22T07:20:48.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:48.202+0000 7fdbd2e26640 1 --2- 172.21.15.40:0/760948404 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdbcc15bae0 0x7fdbcc14f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:48.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:48.202+0000 7fdbd2e26640 1 --2- 172.21.15.40:0/760948404 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fdbac06c8f0 0x7fdbac06edb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:48.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:48.202+0000 7fdbd2e26640 1 --2- 172.21.15.40:0/760948404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbcc1551a0 0x7fdbcc15d520 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:48.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:48.202+0000 7fdbd2e26640 1 --2- 172.21.15.40:0/760948404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbcc0cbe00 0x7fdbcc1f1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:48.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:48.202+0000 7fdbd2e26640 1 -- 172.21.15.40:0/760948404 >> 172.21.15.40:0/760948404 conn(0x7fdbcc0678c0 msgr2=0x7fdbcc152d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:48.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:48.202+0000 7fdbd2e26640 1 -- 172.21.15.40:0/760948404 shutdown_connections 2024-04-22T07:20:48.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:48.202+0000 7fdbd2e26640 1 -- 172.21.15.40:0/760948404 wait complete. 2024-04-22T07:20:50.211 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:20:50.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.327+0000 7f9acaf7e640 1 Processor -- start 2024-04-22T07:20:50.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.327+0000 7f9acaf7e640 1 -- start start 2024-04-22T07:20:50.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.328+0000 7f9acaf7e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9ac4155040 0x7f9ac40c9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:50.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.328+0000 7f9acaf7e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ac4155420 0x7f9ac40676b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:50.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.328+0000 7f9acaf7e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9ac406c050 0x7f9ac4067bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:50.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.328+0000 7f9acaf7e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f9ac406c5b0 con 0x7f9ac4155040 2024-04-22T07:20:50.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.328+0000 7f9acaf7e640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f9ac406d280 con 0x7f9ac406c050 2024-04-22T07:20:50.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.328+0000 7f9acaf7e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9ac406bac0 con 0x7f9ac4155420 2024-04-22T07:20:50.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.328+0000 7f9ac8d1a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9ac4155040 0x7f9ac40c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:50.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.328+0000 7f9ac8d1a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9ac4155040 0x7f9ac40c9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43462/0 (socket says 172.21.15.40:43462) 2024-04-22T07:20:50.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.328+0000 7f9ac8d1a640 1 -- 172.21.15.40:0/655637433 learned_addr learned my addr 172.21.15.40:0/655637433 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:50.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.328+0000 7f9ac951b640 1 --2- 172.21.15.40:0/655637433 >> v2:172.21.15.62:3300/0 conn(0x7f9ac406c050 0x7f9ac4067bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:50.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.328+0000 7f9ac3fff640 1 --2- 172.21.15.40:0/655637433 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ac4155420 0x7f9ac40676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:50.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.328+0000 7f9ac8d1a640 1 -- 172.21.15.40:0/655637433 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ac4155420 msgr2=0x7f9ac40676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:50.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.328+0000 7f9ac8d1a640 1 --2- 172.21.15.40:0/655637433 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ac4155420 0x7f9ac40676b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.328+0000 7f9ac8d1a640 1 -- 172.21.15.40:0/655637433 >> v2:172.21.15.62:3300/0 conn(0x7f9ac406c050 msgr2=0x7f9ac4067bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:50.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.328+0000 7f9ac8d1a640 1 --2- 172.21.15.40:0/655637433 >> v2:172.21.15.62:3300/0 conn(0x7f9ac406c050 0x7f9ac4067bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.328+0000 7f9ac8d1a640 1 -- 172.21.15.40:0/655637433 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac406bd60 con 0x7f9ac4155040 2024-04-22T07:20:50.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.329+0000 7f9ac8d1a640 1 --2- 172.21.15.40:0/655637433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac4155040 0x7f9ac40c9280 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9ac406c850 tx=0x7f9ab802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=522fc437b3387971 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:50.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.329+0000 7f9ac37fe640 1 -- 172.21.15.40:0/655637433 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8034070 con 0x7f9ac4155040 2024-04-22T07:20:50.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.329+0000 7f9ac37fe640 1 -- 172.21.15.40:0/655637433 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ab8030860 con 0x7f9ac4155040 2024-04-22T07:20:50.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.329+0000 7f9ac37fe640 1 -- 172.21.15.40:0/655637433 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8030c30 con 0x7f9ac4155040 2024-04-22T07:20:50.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.330+0000 7f9acaf7e640 1 -- 172.21.15.40:0/655637433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac4155040 msgr2=0x7f9ac40c9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:50.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.330+0000 7f9acaf7e640 1 --2- 172.21.15.40:0/655637433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac4155040 0x7f9ac40c9280 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9ac406c850 tx=0x7f9ab802b9a0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.330+0000 7f9acaf7e640 1 -- 172.21.15.40:0/655637433 shutdown_connections 2024-04-22T07:20:50.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.330+0000 7f9acaf7e640 1 --2- 172.21.15.40:0/655637433 >> v2:172.21.15.62:3300/0 conn(0x7f9ac406c050 0x7f9ac4067bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.330+0000 7f9acaf7e640 1 --2- 172.21.15.40:0/655637433 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ac4155420 0x7f9ac40676b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.330+0000 7f9acaf7e640 1 --2- 172.21.15.40:0/655637433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac4155040 0x7f9ac40c9280 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.330+0000 7f9acaf7e640 1 -- 172.21.15.40:0/655637433 >> 172.21.15.40:0/655637433 conn(0x7f9ac40cdb70 msgr2=0x7f9ac40c9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:50.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.330+0000 7f9acaf7e640 1 -- 172.21.15.40:0/655637433 shutdown_connections 2024-04-22T07:20:50.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.330+0000 7f9acaf7e640 1 -- 172.21.15.40:0/655637433 wait complete. 2024-04-22T07:20:50.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.331+0000 7f9acaf7e640 1 Processor -- start 2024-04-22T07:20:50.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.331+0000 7f9acaf7e640 1 -- start start 2024-04-22T07:20:50.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.332+0000 7f9acaf7e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ac406c050 0x7f9ac415c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:50.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.332+0000 7f9acaf7e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ac4155040 0x7f9ac40cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:50.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.332+0000 7f9acaf7e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac4155420 0x7f9ac4072b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:50.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.332+0000 7f9acaf7e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac40caa50 con 0x7f9ac4155420 2024-04-22T07:20:50.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.332+0000 7f9acaf7e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac406cf10 con 0x7f9ac4155040 2024-04-22T07:20:50.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.332+0000 7f9acaf7e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9ac40cabd0 con 0x7f9ac406c050 2024-04-22T07:20:50.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.332+0000 7f9ac951b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac4155420 0x7f9ac4072b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:50.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.332+0000 7f9ac951b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac4155420 0x7f9ac4072b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43478/0 (socket says 172.21.15.40:43478) 2024-04-22T07:20:50.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.332+0000 7f9ac951b640 1 -- 172.21.15.40:0/2682285007 learned_addr learned my addr 172.21.15.40:0/2682285007 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:50.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.332+0000 7f9ac3fff640 1 --2- 172.21.15.40:0/2682285007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ac4155040 0x7f9ac40cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:50.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.332+0000 7f9ac8d1a640 1 --2- 172.21.15.40:0/2682285007 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ac406c050 0x7f9ac415c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:50.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.332+0000 7f9ac951b640 1 -- 172.21.15.40:0/2682285007 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ac406c050 msgr2=0x7f9ac415c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:50.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.332+0000 7f9ac951b640 1 --2- 172.21.15.40:0/2682285007 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ac406c050 0x7f9ac415c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.332+0000 7f9ac951b640 1 -- 172.21.15.40:0/2682285007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ac4155040 msgr2=0x7f9ac40cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:50.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.332+0000 7f9ac951b640 1 --2- 172.21.15.40:0/2682285007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ac4155040 0x7f9ac40cb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.332+0000 7f9ac951b640 1 -- 172.21.15.40:0/2682285007 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac4150640 con 0x7f9ac4155420 2024-04-22T07:20:50.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.333+0000 7f9ac951b640 1 --2- 172.21.15.40:0/2682285007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac4155420 0x7f9ac4072b90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9abc007d40 tx=0x7f9abc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:50.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.333+0000 7f9ac17fa640 1 -- 172.21.15.40:0/2682285007 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc014420 con 0x7f9ac4155420 2024-04-22T07:20:50.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.333+0000 7f9ac17fa640 1 -- 172.21.15.40:0/2682285007 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9abc019070 con 0x7f9ac4155420 2024-04-22T07:20:50.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.333+0000 7f9acaf7e640 1 -- 172.21.15.40:0/2682285007 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ac415c730 con 0x7f9ac4155420 2024-04-22T07:20:50.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.333+0000 7f9ac17fa640 1 -- 172.21.15.40:0/2682285007 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc014800 con 0x7f9ac4155420 2024-04-22T07:20:50.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.333+0000 7f9acaf7e640 1 -- 172.21.15.40:0/2682285007 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ac41f4380 con 0x7f9ac4155420 2024-04-22T07:20:50.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.334+0000 7f9acaf7e640 1 -- 172.21.15.40:0/2682285007 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ac4069d40 con 0x7f9ac4155420 2024-04-22T07:20:50.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.334+0000 7f9ac17fa640 1 -- 172.21.15.40:0/2682285007 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9abc0149a0 con 0x7f9ac4155420 2024-04-22T07:20:50.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.335+0000 7f9ac17fa640 1 --2- 172.21.15.40:0/2682285007 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9aa806c920 0x7f9aa806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:50.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.335+0000 7f9ac17fa640 1 -- 172.21.15.40:0/2682285007 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f9abc08be90 con 0x7f9ac4155420 2024-04-22T07:20:50.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.335+0000 7f9ac8d1a640 1 --2- 172.21.15.40:0/2682285007 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9aa806c920 0x7f9aa806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:50.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.335+0000 7f9ac8d1a640 1 --2- 172.21.15.40:0/2682285007 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9aa806c920 0x7f9aa806ede0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8036000 tx=0x7f9ab8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:50.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.339+0000 7f9ac17fa640 1 -- 172.21.15.40:0/2682285007 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9abc059f20 con 0x7f9ac4155420 2024-04-22T07:20:50.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.563+0000 7f9acaf7e640 1 -- 172.21.15.40:0/2682285007 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ac406c970 con 0x7f9ac4155420 2024-04-22T07:20:50.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.564+0000 7f9ac17fa640 1 -- 172.21.15.40:0/2682285007 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5509 (secure 0 0 0) 0x7f9abc05e220 con 0x7f9ac4155420 2024-04-22T07:20:50.562 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:20:50.562 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1193926607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1193926607},{"type":"v1","addr":"172.21.15.62:6835","nonce":1193926607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/602167189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":602167189},{"type":"v1","addr":"172.21.15.62:6837","nonce":602167189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2062933254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2062933254},{"type":"v1","addr":"172.21.15.40:6835","nonce":2062933254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3873524978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3873524978},{"type":"v1","addr":"172.21.15.40:6837","nonce":3873524978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/1922761385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":1922761385},{"type":"v1","addr":"172.21.15.40:6839","nonce":1922761385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4305,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6836/2884673656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2884673656},{"type":"v1","addr":"172.21.15.62:6836","nonce":2884673656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-22T07:20:50.562 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 3 2024-04-22T07:20:50.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.565+0000 7f9acaf7e640 1 -- 172.21.15.40:0/2682285007 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9aa806c920 msgr2=0x7f9aa806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:50.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.565+0000 7f9acaf7e640 1 --2- 172.21.15.40:0/2682285007 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9aa806c920 0x7f9aa806ede0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8036000 tx=0x7f9ab8008030 comp rx=0 tx=0).stop 2024-04-22T07:20:50.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.565+0000 7f9acaf7e640 1 -- 172.21.15.40:0/2682285007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac4155420 msgr2=0x7f9ac4072b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:50.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.565+0000 7f9acaf7e640 1 --2- 172.21.15.40:0/2682285007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac4155420 0x7f9ac4072b90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9abc007d40 tx=0x7f9abc00e4b0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.565+0000 7f9acaf7e640 1 -- 172.21.15.40:0/2682285007 shutdown_connections 2024-04-22T07:20:50.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.565+0000 7f9acaf7e640 1 --2- 172.21.15.40:0/2682285007 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9aa806c920 0x7f9aa806ede0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.565+0000 7f9acaf7e640 1 --2- 172.21.15.40:0/2682285007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac4155420 0x7f9ac4072b90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.565+0000 7f9acaf7e640 1 --2- 172.21.15.40:0/2682285007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ac4155040 0x7f9ac40cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.565+0000 7f9acaf7e640 1 --2- 172.21.15.40:0/2682285007 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ac406c050 0x7f9ac415c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.565+0000 7f9acaf7e640 1 -- 172.21.15.40:0/2682285007 >> 172.21.15.40:0/2682285007 conn(0x7f9ac40cdb70 msgr2=0x7f9ac40c9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:50.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.566+0000 7f9acaf7e640 1 -- 172.21.15.40:0/2682285007 shutdown_connections 2024-04-22T07:20:50.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.566+0000 7f9acaf7e640 1 -- 172.21.15.40:0/2682285007 wait complete. 2024-04-22T07:20:50.574 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:20:50.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.677+0000 7f3cc75b2640 1 Processor -- start 2024-04-22T07:20:50.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.677+0000 7f3cc75b2640 1 -- start start 2024-04-22T07:20:50.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.678+0000 7f3cc75b2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3cc0154ed0 0x7f3cc00cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:50.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.678+0000 7f3cc75b2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cc00ccfd0 0x7f3cc00cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:50.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.678+0000 7f3cc75b2640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cc00c5960 con 0x7f3cc00cc650 2024-04-22T07:20:50.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.678+0000 7f3cc75b2640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f3cc015e260 con 0x7f3cc0154ed0 2024-04-22T07:20:50.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.678+0000 7f3cc75b2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f3cc015b7b0 con 0x7f3cc00ccfd0 2024-04-22T07:20:50.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.678+0000 7f3cc534e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3cc0154ed0 0x7f3cc00cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:50.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.678+0000 7f3cc4b4d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3cc00cc650 0x7f3cc015e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39818/0 (socket says 172.21.15.40:39818) 2024-04-22T07:20:50.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.678+0000 7f3cc4b4d640 1 -- 172.21.15.40:0/4048625466 learned_addr learned my addr 172.21.15.40:0/4048625466 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:20:50.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.678+0000 7f3cc534e640 1 -- 172.21.15.40:0/4048625466 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cc00ccfd0 msgr2=0x7f3cc00cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:50.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.678+0000 7f3cc534e640 1 --2- 172.21.15.40:0/4048625466 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cc00ccfd0 0x7f3cc00cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.678+0000 7f3cc534e640 1 -- 172.21.15.40:0/4048625466 >> v1:172.21.15.40:6789/0 conn(0x7f3cc00cc650 legacy=0x7f3cc015e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:50.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.678+0000 7f3cb7fff640 1 -- 172.21.15.40:0/4048625466 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 879255805 0 0) 0x7f3cb0001110 con 0x7f3cc00cc650 2024-04-22T07:20:50.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.678+0000 7f3cc534e640 1 -- 172.21.15.40:0/4048625466 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cc00cc0f0 con 0x7f3cc0154ed0 2024-04-22T07:20:50.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.679+0000 7f3cc534e640 1 --2- 172.21.15.40:0/4048625466 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cc0154ed0 0x7f3cc00cb490 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3cb80097a0 tx=0x7f3cb802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=479cdc7e782dc81f server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:50.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.679+0000 7f3cb7fff640 1 -- 172.21.15.40:0/4048625466 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8035020 con 0x7f3cc0154ed0 2024-04-22T07:20:50.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.679+0000 7f3cb7fff640 1 -- 172.21.15.40:0/4048625466 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cb8031830 con 0x7f3cc0154ed0 2024-04-22T07:20:50.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.679+0000 7f3cb7fff640 1 -- 172.21.15.40:0/4048625466 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8031c00 con 0x7f3cc0154ed0 2024-04-22T07:20:50.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.680+0000 7f3cc75b2640 1 -- 172.21.15.40:0/4048625466 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cc0154ed0 msgr2=0x7f3cc00cb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:50.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.680+0000 7f3cc75b2640 1 --2- 172.21.15.40:0/4048625466 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cc0154ed0 0x7f3cc00cb490 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3cb80097a0 tx=0x7f3cb802b8d0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.680+0000 7f3cc75b2640 1 -- 172.21.15.40:0/4048625466 shutdown_connections 2024-04-22T07:20:50.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.680+0000 7f3cc75b2640 1 --2- 172.21.15.40:0/4048625466 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cc00ccfd0 0x7f3cc00cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.680+0000 7f3cc75b2640 1 --2- 172.21.15.40:0/4048625466 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cc0154ed0 0x7f3cc00cb490 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.680+0000 7f3cc75b2640 1 -- 172.21.15.40:0/4048625466 >> 172.21.15.40:0/4048625466 conn(0x7f3cc0073d10 msgr2=0x7f3cc006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:50.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.680+0000 7f3cc75b2640 1 -- 172.21.15.40:0/4048625466 shutdown_connections 2024-04-22T07:20:50.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.680+0000 7f3cc75b2640 1 -- 172.21.15.40:0/4048625466 wait complete. 2024-04-22T07:20:50.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.681+0000 7f3cc75b2640 1 Processor -- start 2024-04-22T07:20:50.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.681+0000 7f3cc75b2640 1 -- start start 2024-04-22T07:20:50.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.682+0000 7f3cc75b2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cc00cc650 0x7f3cc015d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:50.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.682+0000 7f3cc75b2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cc00ccfd0 0x7f3cc0156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.682+0000 7f3cc75b2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cc0154ed0 0x7f3cc0145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.682+0000 7f3cc75b2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc00cc3b0 con 0x7f3cc0154ed0 2024-04-22T07:20:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.682+0000 7f3cc75b2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc015e4b0 con 0x7f3cc00ccfd0 2024-04-22T07:20:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.682+0000 7f3cc75b2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f3cc00cbb20 con 0x7f3cc00cc650 2024-04-22T07:20:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.682+0000 7f3cc5b4f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cc0154ed0 0x7f3cc0145e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.682+0000 7f3cc5b4f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cc0154ed0 0x7f3cc0145e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43494/0 (socket says 172.21.15.40:43494) 2024-04-22T07:20:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.682+0000 7f3cc5b4f640 1 -- 172.21.15.40:0/847631750 learned_addr learned my addr 172.21.15.40:0/847631750 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.682+0000 7f3cc534e640 1 --2- 172.21.15.40:0/847631750 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cc00cc650 0x7f3cc015d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.682+0000 7f3cc4b4d640 1 --2- 172.21.15.40:0/847631750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cc00ccfd0 0x7f3cc0156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.682+0000 7f3cc5b4f640 1 -- 172.21.15.40:0/847631750 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cc00cc650 msgr2=0x7f3cc015d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.682+0000 7f3cc5b4f640 1 --2- 172.21.15.40:0/847631750 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cc00cc650 0x7f3cc015d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.682+0000 7f3cc5b4f640 1 -- 172.21.15.40:0/847631750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cc00ccfd0 msgr2=0x7f3cc0156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:50.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.682+0000 7f3cc5b4f640 1 --2- 172.21.15.40:0/847631750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cc00ccfd0 0x7f3cc0156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.682+0000 7f3cc5b4f640 1 -- 172.21.15.40:0/847631750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cc015a160 con 0x7f3cc0154ed0 2024-04-22T07:20:50.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.682+0000 7f3cc5b4f640 1 --2- 172.21.15.40:0/847631750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cc0154ed0 0x7f3cc0145e40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc00b9a0 tx=0x7f3cbc00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:50.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.683+0000 7f3cb5ffb640 1 -- 172.21.15.40:0/847631750 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc019070 con 0x7f3cc0154ed0 2024-04-22T07:20:50.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.683+0000 7f3cb5ffb640 1 -- 172.21.15.40:0/847631750 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cbc00cbc0 con 0x7f3cc0154ed0 2024-04-22T07:20:50.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.683+0000 7f3cc75b2640 1 -- 172.21.15.40:0/847631750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cc01f4c30 con 0x7f3cc0154ed0 2024-04-22T07:20:50.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.683+0000 7f3cb5ffb640 1 -- 172.21.15.40:0/847631750 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc014440 con 0x7f3cc0154ed0 2024-04-22T07:20:50.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.683+0000 7f3cc75b2640 1 -- 172.21.15.40:0/847631750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cc0159e80 con 0x7f3cc0154ed0 2024-04-22T07:20:50.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.684+0000 7f3cc75b2640 1 -- 172.21.15.40:0/847631750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cc0069d40 con 0x7f3cc0154ed0 2024-04-22T07:20:50.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.684+0000 7f3cb5ffb640 1 -- 172.21.15.40:0/847631750 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3cbc01c070 con 0x7f3cc0154ed0 2024-04-22T07:20:50.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.685+0000 7f3cb5ffb640 1 --2- 172.21.15.40:0/847631750 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f3ca406c920 0x7f3ca406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:50.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.685+0000 7f3cb5ffb640 1 -- 172.21.15.40:0/847631750 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f3cbc08b510 con 0x7f3cc0154ed0 2024-04-22T07:20:50.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.685+0000 7f3cc534e640 1 --2- 172.21.15.40:0/847631750 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f3ca406c920 0x7f3ca406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:50.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.685+0000 7f3cc534e640 1 --2- 172.21.15.40:0/847631750 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f3ca406c920 0x7f3ca406ede0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8036000 tx=0x7f3cb803d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:50.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.689+0000 7f3cb5ffb640 1 -- 172.21.15.40:0/847631750 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3cbc0595a0 con 0x7f3cc0154ed0 2024-04-22T07:20:50.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.874+0000 7f3cc75b2640 1 -- 172.21.15.40:0/847631750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3cc00cbe30 con 0x7f3cc0154ed0 2024-04-22T07:20:50.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.875+0000 7f3cb5ffb640 1 -- 172.21.15.40:0/847631750 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12812 (secure 0 0 0) 0x7f3cbc05d8a0 con 0x7f3cc0154ed0 2024-04-22T07:20:50.873 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:20:50.873 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":19,"fsid":"dd5b16e4-89fe-4602-b37f-062846793158","created":"2024-04-22T07:20:29.488892+0000","modified":"2024-04-22T07:20:44.743795+0000","last_up_change":"2024-04-22T07:20:40.397383+0000","last_in_change":"2024-04-22T07:20:31.702551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:20:41.793179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32238b7e-228b-4a67-bfca-16e8f0020a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6801","nonce":1526385055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6803","nonce":1526385055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6807","nonce":1526385055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6805","nonce":1526385055}]},"public_addr":"172.21.15.40:6801/1526385055","cluster_addr":"172.21.15.40:6803/1526385055","heartbeat_back_addr":"172.21.15.40:6807/1526385055","heartbeat_front_addr":"172.21.15.40:6805/1526385055","state":["exists","up"]},{"osd":1,"uuid":"5ad8da43-39b1-4295-b4d1-0f1e1d06fc0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6809","nonce":623026645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6811","nonce":623026645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6815","nonce":623026645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6813","nonce":623026645}]},"public_addr":"172.21.15.40:6809/623026645","cluster_addr":"172.21.15.40:6811/623026645","heartbeat_back_addr":"172.21.15.40:6815/623026645","heartbeat_front_addr":"172.21.15.40:6813/623026645","state":["exists","up"]},{"osd":2,"uuid":"7d2c6d50-719d-4232-ad47-f04dcf1a8bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6820","nonce":1885686505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6824","nonce":1885686505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6831","nonce":1885686505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6828","nonce":1885686505}]},"public_addr":"172.21.15.40:6820/1885686505","cluster_addr":"172.21.15.40:6824/1885686505","heartbeat_back_addr":"172.21.15.40:6831/1885686505","heartbeat_front_addr":"172.21.15.40:6828/1885686505","state":["exists","up"]},{"osd":3,"uuid":"af42e7d6-a6bf-403e-92e7-162d7c4fbf0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6817","nonce":130276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6819","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6821","nonce":130276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6829","nonce":130276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6823","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6825","nonce":130276746}]},"public_addr":"172.21.15.40:6817/130276746","cluster_addr":"172.21.15.40:6821/130276746","heartbeat_back_addr":"172.21.15.40:6829/130276746","heartbeat_front_addr":"172.21.15.40:6825/130276746","state":["exists","up"]},{"osd":4,"uuid":"f8e89e0d-be96-4f19-88c0-69c408df7d98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6801","nonce":2251435758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6803","nonce":2251435758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6807","nonce":2251435758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6805","nonce":2251435758}]},"public_addr":"172.21.15.62:6801/2251435758","cluster_addr":"172.21.15.62:6803/2251435758","heartbeat_back_addr":"172.21.15.62:6807/2251435758","heartbeat_front_addr":"172.21.15.62:6805/2251435758","state":["exists","up"]},{"osd":5,"uuid":"ba6dc1bc-272b-4f80-b55f-40bc4a0c3ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6809","nonce":3509322231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6811","nonce":3509322231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6815","nonce":3509322231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6813","nonce":3509322231}]},"public_addr":"172.21.15.62:6809/3509322231","cluster_addr":"172.21.15.62:6811/3509322231","heartbeat_back_addr":"172.21.15.62:6815/3509322231","heartbeat_front_addr":"172.21.15.62:6813/3509322231","state":["exists","up"]},{"osd":6,"uuid":"834fcd74-14bf-45ec-a10a-0374f4ce9bf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6825","nonce":3094315954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6827","nonce":3094315954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6831","nonce":3094315954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6829","nonce":3094315954}]},"public_addr":"172.21.15.62:6825/3094315954","cluster_addr":"172.21.15.62:6827/3094315954","heartbeat_back_addr":"172.21.15.62:6831/3094315954","heartbeat_front_addr":"172.21.15.62:6829/3094315954","state":["exists","up"]},{"osd":7,"uuid":"831c9a73-960e-4d2e-b86a-33a6916be059","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6817","nonce":147453972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6819","nonce":147453972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6823","nonce":147453972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6821","nonce":147453972}]},"public_addr":"172.21.15.62:6817/147453972","cluster_addr":"172.21.15.62:6819/147453972","heartbeat_back_addr":"172.21.15.62:6823/147453972","heartbeat_front_addr":"172.21.15.62:6821/147453972","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.828738+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.873471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.908090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.894782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:37.686796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.801123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.852323+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.812139+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:20:50.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.877+0000 7f3cc75b2640 1 -- 172.21.15.40:0/847631750 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f3ca406c920 msgr2=0x7f3ca406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:50.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.877+0000 7f3cc75b2640 1 --2- 172.21.15.40:0/847631750 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f3ca406c920 0x7f3ca406ede0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8036000 tx=0x7f3cb803d040 comp rx=0 tx=0).stop 2024-04-22T07:20:50.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.877+0000 7f3cc75b2640 1 -- 172.21.15.40:0/847631750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cc0154ed0 msgr2=0x7f3cc0145e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:50.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.877+0000 7f3cc75b2640 1 --2- 172.21.15.40:0/847631750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cc0154ed0 0x7f3cc0145e40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc00b9a0 tx=0x7f3cbc00be60 comp rx=0 tx=0).stop 2024-04-22T07:20:50.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.877+0000 7f3cc75b2640 1 -- 172.21.15.40:0/847631750 shutdown_connections 2024-04-22T07:20:50.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.877+0000 7f3cc75b2640 1 --2- 172.21.15.40:0/847631750 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f3ca406c920 0x7f3ca406ede0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.877+0000 7f3cc75b2640 1 --2- 172.21.15.40:0/847631750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cc0154ed0 0x7f3cc0145e40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.877+0000 7f3cc75b2640 1 --2- 172.21.15.40:0/847631750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cc00ccfd0 0x7f3cc0156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.877+0000 7f3cc75b2640 1 --2- 172.21.15.40:0/847631750 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cc00cc650 0x7f3cc015d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.877+0000 7f3cc75b2640 1 -- 172.21.15.40:0/847631750 >> 172.21.15.40:0/847631750 conn(0x7f3cc0073d10 msgr2=0x7f3cc00c5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:50.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.877+0000 7f3cc75b2640 1 -- 172.21.15.40:0/847631750 shutdown_connections 2024-04-22T07:20:50.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.877+0000 7f3cc75b2640 1 -- 172.21.15.40:0/847631750 wait complete. 2024-04-22T07:20:50.886 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T07:20:41.793179+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-22T07:20:50.886 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T07:20:50.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.992+0000 7ff87b352640 1 Processor -- start 2024-04-22T07:20:50.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.992+0000 7ff87b352640 1 -- start start 2024-04-22T07:20:50.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.993+0000 7ff87b352640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff8741550f0 0x7ff87415ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:50.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.993+0000 7ff87b352640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8740cba00 0x7ff8740c5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:50.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.993+0000 7ff87b352640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff87415afd0 con 0x7ff8740cb5b0 2024-04-22T07:20:50.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.993+0000 7ff87b352640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7ff87415b290 con 0x7ff8740cba00 2024-04-22T07:20:50.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.993+0000 7ff87b352640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ff87415b570 con 0x7ff8741550f0 2024-04-22T07:20:50.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.993+0000 7ff8798ef640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8740cba00 0x7ff8740c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:50.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.993+0000 7ff8798ef640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8740cba00 0x7ff8740c5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43510/0 (socket says 172.21.15.40:43510) 2024-04-22T07:20:50.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.993+0000 7ff8788ed640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff8740cb5b0 0x7ff8740cd040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39826/0 (socket says 172.21.15.40:39826) 2024-04-22T07:20:50.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.993+0000 7ff8798ef640 1 -- 172.21.15.40:0/2629319178 learned_addr learned my addr 172.21.15.40:0/2629319178 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:50.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.993+0000 7ff8790ee640 1 --2- 172.21.15.40:0/2629319178 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff8741550f0 0x7ff87415ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:50.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.993+0000 7ff8798ef640 1 -- 172.21.15.40:0/2629319178 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff8741550f0 msgr2=0x7ff87415ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:50.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.993+0000 7ff8798ef640 1 --2- 172.21.15.40:0/2629319178 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff8741550f0 0x7ff87415ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.993+0000 7ff8798ef640 1 -- 172.21.15.40:0/2629319178 >> v1:172.21.15.40:6789/0 conn(0x7ff8740cb5b0 legacy=0x7ff8740cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:50.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.993+0000 7ff86bfff640 1 -- 172.21.15.40:0/2629319178 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1076262459 0 0) 0x7ff87415afd0 con 0x7ff8740cb5b0 2024-04-22T07:20:50.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.993+0000 7ff8798ef640 1 -- 172.21.15.40:0/2629319178 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff87415b850 con 0x7ff8740cba00 2024-04-22T07:20:50.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.993+0000 7ff8790ee640 1 --2- 172.21.15.40:0/2629319178 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff8741550f0 0x7ff87415ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:20:50.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.994+0000 7ff8798ef640 1 --2- 172.21.15.40:0/2629319178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8740cba00 0x7ff8740c5630 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff86c009e50 tx=0x7ff86c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499b59e6c5ea423a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:50.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.994+0000 7ff86bfff640 1 -- 172.21.15.40:0/2629319178 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86c02ca70 con 0x7ff8740cba00 2024-04-22T07:20:50.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.994+0000 7ff86bfff640 1 -- 172.21.15.40:0/2629319178 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff86c02cc10 con 0x7ff8740cba00 2024-04-22T07:20:50.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.994+0000 7ff86bfff640 1 -- 172.21.15.40:0/2629319178 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86c0343f0 con 0x7ff8740cba00 2024-04-22T07:20:50.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.995+0000 7ff87b352640 1 -- 172.21.15.40:0/2629319178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8740cba00 msgr2=0x7ff8740c5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:50.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.995+0000 7ff87b352640 1 --2- 172.21.15.40:0/2629319178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8740cba00 0x7ff8740c5630 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff86c009e50 tx=0x7ff86c02bed0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.995+0000 7ff87b352640 1 -- 172.21.15.40:0/2629319178 shutdown_connections 2024-04-22T07:20:50.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.995+0000 7ff87b352640 1 --2- 172.21.15.40:0/2629319178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8740cba00 0x7ff8740c5630 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.995+0000 7ff87b352640 1 --2- 172.21.15.40:0/2629319178 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff8741550f0 0x7ff87415ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.995+0000 7ff87b352640 1 -- 172.21.15.40:0/2629319178 >> 172.21.15.40:0/2629319178 conn(0x7ff87406b920 msgr2=0x7ff87406bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:50.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.995+0000 7ff87b352640 1 -- 172.21.15.40:0/2629319178 shutdown_connections 2024-04-22T07:20:50.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.995+0000 7ff87b352640 1 -- 172.21.15.40:0/2629319178 wait complete. 2024-04-22T07:20:50.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.996+0000 7ff87b352640 1 Processor -- start 2024-04-22T07:20:50.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.996+0000 7ff87b352640 1 -- start start 2024-04-22T07:20:50.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.997+0000 7ff87b352640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8740cb5b0 0x7ff8740c6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:50.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.997+0000 7ff87b352640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8740cba00 0x7ff874158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:50.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.997+0000 7ff87b352640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff8741550f0 0x7ff874159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:50.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.997+0000 7ff87b352640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff8740cd750 con 0x7ff8740cba00 2024-04-22T07:20:50.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.997+0000 7ff87b352640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff8741554d0 con 0x7ff8740cb5b0 2024-04-22T07:20:50.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.997+0000 7ff87b352640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ff8740cd8d0 con 0x7ff8741550f0 2024-04-22T07:20:50.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.997+0000 7ff8788ed640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8740cba00 0x7ff874158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:50.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.997+0000 7ff8788ed640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8740cba00 0x7ff874158b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43524/0 (socket says 172.21.15.40:43524) 2024-04-22T07:20:50.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.997+0000 7ff8788ed640 1 -- 172.21.15.40:0/2817906770 learned_addr learned my addr 172.21.15.40:0/2817906770 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:50.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.997+0000 7ff8790ee640 1 --2- 172.21.15.40:0/2817906770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8740cb5b0 0x7ff8740c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:50.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.997+0000 7ff8798ef640 1 --2- 172.21.15.40:0/2817906770 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff8741550f0 0x7ff874159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:50.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.997+0000 7ff8788ed640 1 -- 172.21.15.40:0/2817906770 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff8741550f0 msgr2=0x7ff874159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:50.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.997+0000 7ff8788ed640 1 --2- 172.21.15.40:0/2817906770 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff8741550f0 0x7ff874159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.997+0000 7ff8788ed640 1 -- 172.21.15.40:0/2817906770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8740cb5b0 msgr2=0x7ff8740c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:50.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.997+0000 7ff8788ed640 1 --2- 172.21.15.40:0/2817906770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8740cb5b0 0x7ff8740c6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:50.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.997+0000 7ff8788ed640 1 -- 172.21.15.40:0/2817906770 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8741f4630 con 0x7ff8740cba00 2024-04-22T07:20:50.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.997+0000 7ff8790ee640 1 --2- 172.21.15.40:0/2817906770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8740cb5b0 0x7ff8740c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:20:50.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.997+0000 7ff8788ed640 1 --2- 172.21.15.40:0/2817906770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8740cba00 0x7ff874158b40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff86400c430 tx=0x7ff86400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:50.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.997+0000 7ff869ffb640 1 -- 172.21.15.40:0/2817906770 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8640074e0 con 0x7ff8740cba00 2024-04-22T07:20:50.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.997+0000 7ff869ffb640 1 -- 172.21.15.40:0/2817906770 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8640047e0 con 0x7ff8740cba00 2024-04-22T07:20:50.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.997+0000 7ff87b352640 1 -- 172.21.15.40:0/2817906770 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8741f48f0 con 0x7ff8740cba00 2024-04-22T07:20:50.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.997+0000 7ff869ffb640 1 -- 172.21.15.40:0/2817906770 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff864004bd0 con 0x7ff8740cba00 2024-04-22T07:20:50.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.998+0000 7ff87b352640 1 -- 172.21.15.40:0/2817906770 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8741f4eb0 con 0x7ff8740cba00 2024-04-22T07:20:50.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.999+0000 7ff87b352640 1 -- 172.21.15.40:0/2817906770 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff874153db0 con 0x7ff8740cba00 2024-04-22T07:20:50.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.999+0000 7ff869ffb640 1 -- 172.21.15.40:0/2817906770 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff864011070 con 0x7ff8740cba00 2024-04-22T07:20:50.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.999+0000 7ff869ffb640 1 --2- 172.21.15.40:0/2817906770 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ff85806c8f0 0x7ff85806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:50.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.999+0000 7ff869ffb640 1 -- 172.21.15.40:0/2817906770 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7ff86408b350 con 0x7ff8740cba00 2024-04-22T07:20:50.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:50.999+0000 7ff8790ee640 1 --2- 172.21.15.40:0/2817906770 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ff85806c8f0 0x7ff85806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:51.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.000+0000 7ff8790ee640 1 --2- 172.21.15.40:0/2817906770 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ff85806c8f0 0x7ff85806edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff870006fd0 tx=0x7ff870008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:51.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.004+0000 7ff869ffb640 1 -- 172.21.15.40:0/2817906770 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff874153db0 con 0x7ff8740cba00 2024-04-22T07:20:51.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.186+0000 7ff87b352640 1 -- 172.21.15.40:0/2817906770 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff87404fdc0 con 0x7ff8740cba00 2024-04-22T07:20:51.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.186+0000 7ff869ffb640 1 -- 172.21.15.40:0/2817906770 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) ==== 93+0+10 (secure 0 0 0) 0x7ff864059ad0 con 0x7ff8740cba00 2024-04-22T07:20:51.184 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-04-22T07:20:51.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.188+0000 7ff87b352640 1 -- 172.21.15.40:0/2817906770 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ff85806c8f0 msgr2=0x7ff85806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:51.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.188+0000 7ff87b352640 1 --2- 172.21.15.40:0/2817906770 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ff85806c8f0 0x7ff85806edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff870006fd0 tx=0x7ff870008040 comp rx=0 tx=0).stop 2024-04-22T07:20:51.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.188+0000 7ff87b352640 1 -- 172.21.15.40:0/2817906770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8740cba00 msgr2=0x7ff874158b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:51.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.188+0000 7ff87b352640 1 --2- 172.21.15.40:0/2817906770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8740cba00 0x7ff874158b40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff86400c430 tx=0x7ff86400c8f0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.188+0000 7ff87b352640 1 -- 172.21.15.40:0/2817906770 shutdown_connections 2024-04-22T07:20:51.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.188+0000 7ff87b352640 1 --2- 172.21.15.40:0/2817906770 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff8741550f0 0x7ff874159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.188+0000 7ff87b352640 1 --2- 172.21.15.40:0/2817906770 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ff85806c8f0 0x7ff85806edb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.188+0000 7ff87b352640 1 --2- 172.21.15.40:0/2817906770 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8740cba00 0x7ff874158b40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.188+0000 7ff87b352640 1 --2- 172.21.15.40:0/2817906770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8740cb5b0 0x7ff8740c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.188+0000 7ff87b352640 1 -- 172.21.15.40:0/2817906770 >> 172.21.15.40:0/2817906770 conn(0x7ff87406b920 msgr2=0x7ff87414f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:51.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.188+0000 7ff87b352640 1 -- 172.21.15.40:0/2817906770 shutdown_connections 2024-04-22T07:20:51.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.188+0000 7ff87b352640 1 -- 172.21.15.40:0/2817906770 wait complete. 2024-04-22T07:20:51.197 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-22T07:20:51.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.300+0000 7effcffe0640 1 Processor -- start 2024-04-22T07:20:51.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.300+0000 7effcffe0640 1 -- start start 2024-04-22T07:20:51.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.301+0000 7effcffe0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7effc8155130 0x7effc80cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:51.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.301+0000 7effcffe0640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effc815f0c0 0x7effc80cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:51.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.301+0000 7effcffe0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7effc80cb710 0x7effc80cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:51.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.301+0000 7effcffe0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7effc815b1b0 con 0x7effc8155130 2024-04-22T07:20:51.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.301+0000 7effcffe0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7effc815b490 con 0x7effc80cb710 2024-04-22T07:20:51.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.301+0000 7effcffe0640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7effc815b770 con 0x7effc815f0c0 2024-04-22T07:20:51.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.301+0000 7effcdd7c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7effc8155130 0x7effc80cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:51.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.301+0000 7effcdd7c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7effc8155130 0x7effc80cd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43528/0 (socket says 172.21.15.40:43528) 2024-04-22T07:20:51.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.301+0000 7effcdd7c640 1 -- 172.21.15.40:0/803398231 learned_addr learned my addr 172.21.15.40:0/803398231 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:51.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.301+0000 7effce57d640 1 --2- 172.21.15.40:0/803398231 >> v2:172.21.15.62:3300/0 conn(0x7effc80cb710 0x7effc80cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:51.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.301+0000 7effcdd7c640 1 -- 172.21.15.40:0/803398231 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effc815f0c0 msgr2=0x7effc80cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:51.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.301+0000 7effcdd7c640 1 --2- 172.21.15.40:0/803398231 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effc815f0c0 0x7effc80cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.301+0000 7effcdd7c640 1 -- 172.21.15.40:0/803398231 >> v2:172.21.15.62:3300/0 conn(0x7effc80cb710 msgr2=0x7effc80cbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:51.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.301+0000 7effcdd7c640 1 --2- 172.21.15.40:0/803398231 >> v2:172.21.15.62:3300/0 conn(0x7effc80cb710 0x7effc80cbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.301+0000 7effcdd7c640 1 -- 172.21.15.40:0/803398231 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc815ba50 con 0x7effc8155130 2024-04-22T07:20:51.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.301+0000 7effce57d640 1 --2- 172.21.15.40:0/803398231 >> v2:172.21.15.62:3300/0 conn(0x7effc80cb710 0x7effc80cbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:20:51.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.302+0000 7effcdd7c640 1 --2- 172.21.15.40:0/803398231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effc8155130 0x7effc80cd130 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7effc80cc590 tx=0x7effc402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6357a79092170f6a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:51.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.302+0000 7effccd7a640 1 -- 172.21.15.40:0/803398231 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc4034070 con 0x7effc8155130 2024-04-22T07:20:51.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.302+0000 7effccd7a640 1 -- 172.21.15.40:0/803398231 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc4030860 con 0x7effc8155130 2024-04-22T07:20:51.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.302+0000 7effccd7a640 1 -- 172.21.15.40:0/803398231 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc4030c30 con 0x7effc8155130 2024-04-22T07:20:51.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.303+0000 7effcffe0640 1 -- 172.21.15.40:0/803398231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effc8155130 msgr2=0x7effc80cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:51.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.303+0000 7effcffe0640 1 --2- 172.21.15.40:0/803398231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effc8155130 0x7effc80cd130 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7effc80cc590 tx=0x7effc402b9a0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.303+0000 7effcffe0640 1 -- 172.21.15.40:0/803398231 shutdown_connections 2024-04-22T07:20:51.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.303+0000 7effcffe0640 1 --2- 172.21.15.40:0/803398231 >> v2:172.21.15.62:3300/0 conn(0x7effc80cb710 0x7effc80cbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.303+0000 7effcffe0640 1 --2- 172.21.15.40:0/803398231 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effc815f0c0 0x7effc80cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.303+0000 7effcffe0640 1 --2- 172.21.15.40:0/803398231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effc8155130 0x7effc80cd130 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.303+0000 7effcffe0640 1 -- 172.21.15.40:0/803398231 >> 172.21.15.40:0/803398231 conn(0x7effc8067890 msgr2=0x7effc8072860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:51.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.303+0000 7effcffe0640 1 -- 172.21.15.40:0/803398231 shutdown_connections 2024-04-22T07:20:51.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.303+0000 7effcffe0640 1 -- 172.21.15.40:0/803398231 wait complete. 2024-04-22T07:20:51.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.304+0000 7effcffe0640 1 Processor -- start 2024-04-22T07:20:51.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.304+0000 7effcffe0640 1 -- start start 2024-04-22T07:20:51.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.305+0000 7effcffe0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effc80cb710 0x7effc81f10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:51.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.305+0000 7effcffe0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effc8155130 0x7effc815c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:51.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.305+0000 7effcffe0640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effc815f0c0 0x7effc815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:51.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.305+0000 7effcffe0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7effc80b4bc0 con 0x7effc8155130 2024-04-22T07:20:51.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.305+0000 7effcffe0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7effc8155510 con 0x7effc80cb710 2024-04-22T07:20:51.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.305+0000 7effcffe0640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7effc80b4d40 con 0x7effc815f0c0 2024-04-22T07:20:51.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.305+0000 7effcd57b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effc8155130 0x7effc815c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:51.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.305+0000 7effcd57b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effc8155130 0x7effc815c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43530/0 (socket says 172.21.15.40:43530) 2024-04-22T07:20:51.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.305+0000 7effcd57b640 1 -- 172.21.15.40:0/172196434 learned_addr learned my addr 172.21.15.40:0/172196434 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:51.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.305+0000 7effcdd7c640 1 --2- 172.21.15.40:0/172196434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effc80cb710 0x7effc81f10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:51.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.305+0000 7effce57d640 1 --2- 172.21.15.40:0/172196434 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effc815f0c0 0x7effc815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:51.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.305+0000 7effcd57b640 1 -- 172.21.15.40:0/172196434 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effc815f0c0 msgr2=0x7effc815cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:51.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.305+0000 7effcd57b640 1 --2- 172.21.15.40:0/172196434 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effc815f0c0 0x7effc815cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.305+0000 7effcd57b640 1 -- 172.21.15.40:0/172196434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effc80cb710 msgr2=0x7effc81f10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:51.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.305+0000 7effcd57b640 1 --2- 172.21.15.40:0/172196434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effc80cb710 0x7effc81f10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.305+0000 7effcd57b640 1 -- 172.21.15.40:0/172196434 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc81f1610 con 0x7effc8155130 2024-04-22T07:20:51.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.305+0000 7effcd57b640 1 --2- 172.21.15.40:0/172196434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effc8155130 0x7effc815c580 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7effb800b440 tx=0x7effb800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:51.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.306+0000 7effbe7fc640 1 -- 172.21.15.40:0/172196434 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb8015020 con 0x7effc8155130 2024-04-22T07:20:51.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.306+0000 7effbe7fc640 1 -- 172.21.15.40:0/172196434 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effb8011890 con 0x7effc8155130 2024-04-22T07:20:51.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.306+0000 7effcffe0640 1 -- 172.21.15.40:0/172196434 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effc81558e0 con 0x7effc8155130 2024-04-22T07:20:51.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.306+0000 7effbe7fc640 1 -- 172.21.15.40:0/172196434 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb8011c80 con 0x7effc8155130 2024-04-22T07:20:51.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.306+0000 7effcffe0640 1 -- 172.21.15.40:0/172196434 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effc815e0f0 con 0x7effc8155130 2024-04-22T07:20:51.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.307+0000 7effcffe0640 1 -- 172.21.15.40:0/172196434 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effc8069d40 con 0x7effc8155130 2024-04-22T07:20:51.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.307+0000 7effbe7fc640 1 -- 172.21.15.40:0/172196434 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7effb8018020 con 0x7effc8155130 2024-04-22T07:20:51.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.308+0000 7effbe7fc640 1 --2- 172.21.15.40:0/172196434 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7effac06c920 0x7effac06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:51.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.308+0000 7effcdd7c640 1 --2- 172.21.15.40:0/172196434 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7effac06c920 0x7effac06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:51.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.308+0000 7effbe7fc640 1 -- 172.21.15.40:0/172196434 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7effb808b7a0 con 0x7effc8155130 2024-04-22T07:20:51.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.308+0000 7effcdd7c640 1 --2- 172.21.15.40:0/172196434 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7effac06c920 0x7effac06ede0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7effc4036000 tx=0x7effc4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:51.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.312+0000 7effbe7fc640 1 -- 172.21.15.40:0/172196434 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7effb801f020 con 0x7effc8155130 2024-04-22T07:20:51.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.499+0000 7effcffe0640 1 -- 172.21.15.40:0/172196434 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7effc80cc2e0 con 0x7effc8155130 2024-04-22T07:20:51.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.499+0000 7effbe7fc640 1 -- 172.21.15.40:0/172196434 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7effb800d040 con 0x7effc8155130 2024-04-22T07:20:51.497 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:20:51.497 INFO:teuthology.orchestra.run.smithi040.stdout:[ 2024-04-22T07:20:51.497 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-22T07:20:51.497 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 1, 2024-04-22T07:20:51.498 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": ".mgr" 2024-04-22T07:20:51.498 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:20:51.498 INFO:teuthology.orchestra.run.smithi040.stdout:] 2024-04-22T07:20:51.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.501+0000 7effcffe0640 1 -- 172.21.15.40:0/172196434 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7effac06c920 msgr2=0x7effac06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:51.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.501+0000 7effcffe0640 1 --2- 172.21.15.40:0/172196434 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7effac06c920 0x7effac06ede0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7effc4036000 tx=0x7effc4008030 comp rx=0 tx=0).stop 2024-04-22T07:20:51.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.501+0000 7effcffe0640 1 -- 172.21.15.40:0/172196434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effc8155130 msgr2=0x7effc815c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:51.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.501+0000 7effcffe0640 1 --2- 172.21.15.40:0/172196434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effc8155130 0x7effc815c580 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7effb800b440 tx=0x7effb800b900 comp rx=0 tx=0).stop 2024-04-22T07:20:51.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.501+0000 7effcffe0640 1 -- 172.21.15.40:0/172196434 shutdown_connections 2024-04-22T07:20:51.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.501+0000 7effcffe0640 1 --2- 172.21.15.40:0/172196434 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7effc815f0c0 0x7effc815cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.501+0000 7effcffe0640 1 --2- 172.21.15.40:0/172196434 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7effac06c920 0x7effac06ede0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.501+0000 7effcffe0640 1 --2- 172.21.15.40:0/172196434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effc8155130 0x7effc815c580 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.501+0000 7effcffe0640 1 --2- 172.21.15.40:0/172196434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7effc80cb710 0x7effc81f10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.501+0000 7effcffe0640 1 -- 172.21.15.40:0/172196434 >> 172.21.15.40:0/172196434 conn(0x7effc8067890 msgr2=0x7effc80cd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:51.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.501+0000 7effcffe0640 1 -- 172.21.15.40:0/172196434 shutdown_connections 2024-04-22T07:20:51.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.501+0000 7effcffe0640 1 -- 172.21.15.40:0/172196434 wait complete. 2024-04-22T07:20:51.509 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-22T07:20:51.510 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-22T07:20:51.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.616+0000 7f6636aa5640 1 Processor -- start 2024-04-22T07:20:51.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.616+0000 7f6636aa5640 1 -- start start 2024-04-22T07:20:51.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.617+0000 7f6636aa5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6630154f10 0x7f66300c5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:51.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.617+0000 7f6636aa5640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f663015eec0 0x7f66300cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:51.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.617+0000 7f6636aa5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f663015adc0 0x7f66300d05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:51.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.617+0000 7f6636aa5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f663015e450 con 0x7f6630154f10 2024-04-22T07:20:51.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.617+0000 7f6636aa5640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f663015f2e0 con 0x7f663015adc0 2024-04-22T07:20:51.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.617+0000 7f6636aa5640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f663015b6f0 con 0x7f663015eec0 2024-04-22T07:20:51.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.617+0000 7f6634841640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6630154f10 0x7f66300c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:51.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.617+0000 7f6634841640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6630154f10 0x7f66300c5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43546/0 (socket says 172.21.15.40:43546) 2024-04-22T07:20:51.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.617+0000 7f6634841640 1 -- 172.21.15.40:0/3601470419 learned_addr learned my addr 172.21.15.40:0/3601470419 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:51.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.618+0000 7f662ffff640 1 --2- 172.21.15.40:0/3601470419 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f663015eec0 0x7f66300cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:51.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.618+0000 7f6635042640 1 --2- 172.21.15.40:0/3601470419 >> v2:172.21.15.62:3300/0 conn(0x7f663015adc0 0x7f66300d05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:51.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.618+0000 7f6634841640 1 -- 172.21.15.40:0/3601470419 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f663015eec0 msgr2=0x7f66300cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:51.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.618+0000 7f6634841640 1 --2- 172.21.15.40:0/3601470419 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f663015eec0 0x7f66300cb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.618+0000 7f6634841640 1 -- 172.21.15.40:0/3601470419 >> v2:172.21.15.62:3300/0 conn(0x7f663015adc0 msgr2=0x7f66300d05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:51.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.618+0000 7f6634841640 1 --2- 172.21.15.40:0/3601470419 >> v2:172.21.15.62:3300/0 conn(0x7f663015adc0 0x7f66300d05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.618+0000 7f6634841640 1 -- 172.21.15.40:0/3601470419 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f663015b9d0 con 0x7f6630154f10 2024-04-22T07:20:51.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.618+0000 7f662ffff640 1 --2- 172.21.15.40:0/3601470419 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f663015eec0 0x7f66300cb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:20:51.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.618+0000 7f6634841640 1 --2- 172.21.15.40:0/3601470419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6630154f10 0x7f66300c5550 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6628009e50 tx=0x7f662802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b96d8b2ca91638 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:51.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.618+0000 7f662f7fe640 1 -- 172.21.15.40:0/3601470419 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662802ca70 con 0x7f6630154f10 2024-04-22T07:20:51.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.619+0000 7f662f7fe640 1 -- 172.21.15.40:0/3601470419 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f662802cc10 con 0x7f6630154f10 2024-04-22T07:20:51.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.619+0000 7f662f7fe640 1 -- 172.21.15.40:0/3601470419 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66280343f0 con 0x7f6630154f10 2024-04-22T07:20:51.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.619+0000 7f6636aa5640 1 -- 172.21.15.40:0/3601470419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6630154f10 msgr2=0x7f66300c5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:51.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.619+0000 7f6636aa5640 1 --2- 172.21.15.40:0/3601470419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6630154f10 0x7f66300c5550 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6628009e50 tx=0x7f662802bed0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.619+0000 7f6636aa5640 1 -- 172.21.15.40:0/3601470419 shutdown_connections 2024-04-22T07:20:51.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.619+0000 7f6636aa5640 1 --2- 172.21.15.40:0/3601470419 >> v2:172.21.15.62:3300/0 conn(0x7f663015adc0 0x7f66300d05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.619+0000 7f6636aa5640 1 --2- 172.21.15.40:0/3601470419 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f663015eec0 0x7f66300cb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.619+0000 7f6636aa5640 1 --2- 172.21.15.40:0/3601470419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6630154f10 0x7f66300c5550 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.619+0000 7f6636aa5640 1 -- 172.21.15.40:0/3601470419 >> 172.21.15.40:0/3601470419 conn(0x7f66300676b0 msgr2=0x7f6630067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:51.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.619+0000 7f6636aa5640 1 -- 172.21.15.40:0/3601470419 shutdown_connections 2024-04-22T07:20:51.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.619+0000 7f6636aa5640 1 -- 172.21.15.40:0/3601470419 wait complete. 2024-04-22T07:20:51.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.620+0000 7f6636aa5640 1 Processor -- start 2024-04-22T07:20:51.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.620+0000 7f6636aa5640 1 -- start start 2024-04-22T07:20:51.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.621+0000 7f6636aa5640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6630154f10 0x7f66301f1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:51.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.621+0000 7f6636aa5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f663015adc0 0x7f66300cf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:51.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.621+0000 7f6636aa5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f663015eec0 0x7f6630148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:51.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.621+0000 7f6636aa5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f663015bcb0 con 0x7f663015adc0 2024-04-22T07:20:51.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.621+0000 7f6636aa5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f66300cb930 con 0x7f663015eec0 2024-04-22T07:20:51.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.621+0000 7f6636aa5640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f66301552f0 con 0x7f6630154f10 2024-04-22T07:20:51.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.621+0000 7f662ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f663015adc0 0x7f66300cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:51.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.621+0000 7f662ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f663015adc0 0x7f66300cf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43550/0 (socket says 172.21.15.40:43550) 2024-04-22T07:20:51.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.621+0000 7f662ffff640 1 -- 172.21.15.40:0/2126645515 learned_addr learned my addr 172.21.15.40:0/2126645515 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:51.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.621+0000 7f6634841640 1 --2- 172.21.15.40:0/2126645515 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6630154f10 0x7f66301f1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:51.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.621+0000 7f6635042640 1 --2- 172.21.15.40:0/2126645515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f663015eec0 0x7f6630148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:51.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.621+0000 7f662ffff640 1 -- 172.21.15.40:0/2126645515 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6630154f10 msgr2=0x7f66301f1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:51.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.621+0000 7f662ffff640 1 --2- 172.21.15.40:0/2126645515 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6630154f10 0x7f66301f1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.621+0000 7f662ffff640 1 -- 172.21.15.40:0/2126645515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f663015eec0 msgr2=0x7f6630148f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:51.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.621+0000 7f662ffff640 1 --2- 172.21.15.40:0/2126645515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f663015eec0 0x7f6630148f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.621+0000 7f662ffff640 1 -- 172.21.15.40:0/2126645515 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66300d03e0 con 0x7f663015adc0 2024-04-22T07:20:51.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.621+0000 7f6634841640 1 --2- 172.21.15.40:0/2126645515 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6630154f10 0x7f66301f1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:20:51.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.621+0000 7f6635042640 1 --2- 172.21.15.40:0/2126645515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f663015eec0 0x7f6630148f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:20:51.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.622+0000 7f662ffff640 1 --2- 172.21.15.40:0/2126645515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f663015adc0 0x7f66300cf940 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f662000c820 tx=0x7f662000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:51.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.622+0000 7f662d7fa640 1 -- 172.21.15.40:0/2126645515 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6620015070 con 0x7f663015adc0 2024-04-22T07:20:51.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.622+0000 7f662d7fa640 1 -- 172.21.15.40:0/2126645515 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6620007a30 con 0x7f663015adc0 2024-04-22T07:20:51.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.622+0000 7f662d7fa640 1 -- 172.21.15.40:0/2126645515 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6620007e00 con 0x7f663015adc0 2024-04-22T07:20:51.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.622+0000 7f6636aa5640 1 -- 172.21.15.40:0/2126645515 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66301f2060 con 0x7f663015adc0 2024-04-22T07:20:51.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.622+0000 7f6636aa5640 1 -- 172.21.15.40:0/2126645515 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f663015e0d0 con 0x7f663015adc0 2024-04-22T07:20:51.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.623+0000 7f6636aa5640 1 -- 172.21.15.40:0/2126645515 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66300c6820 con 0x7f663015adc0 2024-04-22T07:20:51.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.623+0000 7f662d7fa640 1 -- 172.21.15.40:0/2126645515 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6620018070 con 0x7f663015adc0 2024-04-22T07:20:51.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.624+0000 7f662d7fa640 1 --2- 172.21.15.40:0/2126645515 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f661006c8f0 0x7f661006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:51.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.624+0000 7f662d7fa640 1 -- 172.21.15.40:0/2126645515 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f662008b800 con 0x7f663015adc0 2024-04-22T07:20:51.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.624+0000 7f6634841640 1 --2- 172.21.15.40:0/2126645515 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f661006c8f0 0x7f661006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:51.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.624+0000 7f6634841640 1 --2- 172.21.15.40:0/2126645515 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f661006c8f0 0x7f661006edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6628035000 tx=0x7f6628030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:51.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.628+0000 7f662d7fa640 1 -- 172.21.15.40:0/2126645515 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f66300c6820 con 0x7f663015adc0 2024-04-22T07:20:51.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.811+0000 7f6636aa5640 1 -- 172.21.15.40:0/2126645515 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f663015aad0 con 0x7f663015adc0 2024-04-22T07:20:51.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.835+0000 7f662d7fa640 1 -- 172.21.15.40:0/2126645515 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7f66300d03e0 con 0x7f663015adc0 2024-04-22T07:20:51.832 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' created 2024-04-22T07:20:51.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.837+0000 7f6636aa5640 1 -- 172.21.15.40:0/2126645515 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f661006c8f0 msgr2=0x7f661006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:51.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.837+0000 7f6636aa5640 1 --2- 172.21.15.40:0/2126645515 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f661006c8f0 0x7f661006edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6628035000 tx=0x7f6628030000 comp rx=0 tx=0).stop 2024-04-22T07:20:51.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.837+0000 7f6636aa5640 1 -- 172.21.15.40:0/2126645515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f663015adc0 msgr2=0x7f66300cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:51.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.837+0000 7f6636aa5640 1 --2- 172.21.15.40:0/2126645515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f663015adc0 0x7f66300cf940 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f662000c820 tx=0x7f662000cc20 comp rx=0 tx=0).stop 2024-04-22T07:20:51.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.837+0000 7f6636aa5640 1 -- 172.21.15.40:0/2126645515 shutdown_connections 2024-04-22T07:20:51.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.837+0000 7f6636aa5640 1 --2- 172.21.15.40:0/2126645515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f663015eec0 0x7f6630148f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.837+0000 7f6636aa5640 1 --2- 172.21.15.40:0/2126645515 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f661006c8f0 0x7f661006edb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.837+0000 7f6636aa5640 1 --2- 172.21.15.40:0/2126645515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f663015adc0 0x7f66300cf940 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.837+0000 7f6636aa5640 1 --2- 172.21.15.40:0/2126645515 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6630154f10 0x7f66301f1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.837+0000 7f6636aa5640 1 -- 172.21.15.40:0/2126645515 >> 172.21.15.40:0/2126645515 conn(0x7f66300676b0 msgr2=0x7f663014b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:51.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.837+0000 7f6636aa5640 1 -- 172.21.15.40:0/2126645515 shutdown_connections 2024-04-22T07:20:51.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.837+0000 7f6636aa5640 1 -- 172.21.15.40:0/2126645515 wait complete. 2024-04-22T07:20:51.849 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-22T07:20:51.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.959+0000 7f43580ce640 1 Processor -- start 2024-04-22T07:20:51.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.959+0000 7f43580ce640 1 -- start start 2024-04-22T07:20:51.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.960+0000 7f43580ce640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4350070290 0x7f43500c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:51.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.960+0000 7f43580ce640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f435015f1f0 con 0x7f435015ed20 2024-04-22T07:20:51.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.960+0000 7f43580ce640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f435015ada0 con 0x7f435006b920 2024-04-22T07:20:51.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.960+0000 7f43580ce640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f43500c90a0 con 0x7f4350070290 2024-04-22T07:20:51.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.960+0000 7f4355669640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f435015ed20 0x7f435006c330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39840/0 (socket says 172.21.15.40:39840) 2024-04-22T07:20:51.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.960+0000 7f4355669640 1 -- 172.21.15.40:0/110724846 learned_addr learned my addr 172.21.15.40:0/110724846 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:20:51.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.961+0000 7f4355e6a640 1 --2- 172.21.15.40:0/110724846 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4350070290 0x7f43500c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:51.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.961+0000 7f4354e68640 1 -- 172.21.15.40:0/110724846 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2634237348 0 0) 0x7f435015f1f0 con 0x7f435015ed20 2024-04-22T07:20:51.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.961+0000 7f4354e68640 1 -- 172.21.15.40:0/110724846 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4338003520 con 0x7f435015ed20 2024-04-22T07:20:51.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.961+0000 7f4354e68640 1 -- 172.21.15.40:0/110724846 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 538921236 0 0) 0x7f435015ada0 con 0x7f435006b920 2024-04-22T07:20:51.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.961+0000 7f4354e68640 1 -- 172.21.15.40:0/110724846 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f435015f1f0 con 0x7f435006b920 2024-04-22T07:20:51.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.961+0000 7f4354e68640 1 -- 172.21.15.40:0/110724846 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2365007913 0 0) 0x7f4338003520 con 0x7f435015ed20 2024-04-22T07:20:51.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.961+0000 7f4354e68640 1 -- 172.21.15.40:0/110724846 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4350070290 msgr2=0x7f43500c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:51.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.961+0000 7f4354e68640 1 --2- 172.21.15.40:0/110724846 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4350070290 0x7f43500c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.961+0000 7f4354e68640 1 -- 172.21.15.40:0/110724846 >> v1:172.21.15.62:6789/0 conn(0x7f435006b920 legacy=0x7f4350165640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:51.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.961+0000 7f4354e68640 1 -- 172.21.15.40:0/110724846 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43500c9380 con 0x7f435015ed20 2024-04-22T07:20:51.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.961+0000 7f4354e68640 1 -- 172.21.15.40:0/110724846 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7f4344001670 con 0x7f435015ed20 2024-04-22T07:20:51.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.961+0000 7f4354e68640 1 -- 172.21.15.40:0/110724846 >> v1:172.21.15.40:6789/0 conn(0x7f435015ed20 legacy=0x7f435006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:51.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.961+0000 7f4354e68640 1 --2- 172.21.15.40:0/110724846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4338003b70 0x7f4338003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:51.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.961+0000 7f4354e68640 1 --2- 172.21.15.40:0/110724846 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4350070290 0x7f4338004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:51.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.961+0000 7f4354e68640 1 --2- 172.21.15.40:0/110724846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4338004d40 0x7f43380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:51.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.961+0000 7f4354e68640 1 -- 172.21.15.40:0/110724846 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f43500c90a0 con 0x7f4338003b70 2024-04-22T07:20:51.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.961+0000 7f4354e68640 1 -- 172.21.15.40:0/110724846 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f433800bac0 con 0x7f4338004d40 2024-04-22T07:20:51.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.961+0000 7f4354e68640 1 -- 172.21.15.40:0/110724846 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f433800bcc0 con 0x7f4350070290 2024-04-22T07:20:51.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.961+0000 7f4355e6a640 1 --2- 172.21.15.40:0/110724846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4338003b70 0x7f4338003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:51.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.961+0000 7f435666b640 1 --2- 172.21.15.40:0/110724846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4338004d40 0x7f43380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:51.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.961+0000 7f4355669640 1 --2- 172.21.15.40:0/110724846 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4350070290 0x7f4338004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:51.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.961+0000 7f4355e6a640 1 -- 172.21.15.40:0/110724846 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4350070290 msgr2=0x7f4338004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:51.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.961+0000 7f4355e6a640 1 --2- 172.21.15.40:0/110724846 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4350070290 0x7f4338004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.961+0000 7f4355e6a640 1 -- 172.21.15.40:0/110724846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4338004d40 msgr2=0x7f43380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:51.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.961+0000 7f4355e6a640 1 --2- 172.21.15.40:0/110724846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4338004d40 0x7f43380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.961+0000 7f4355e6a640 1 -- 172.21.15.40:0/110724846 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4338003520 con 0x7f4338003b70 2024-04-22T07:20:51.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.961+0000 7f435666b640 1 --2- 172.21.15.40:0/110724846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4338004d40 0x7f43380051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:20:51.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.962+0000 7f4355e6a640 1 --2- 172.21.15.40:0/110724846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4338003b70 0x7f4338003f70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4348009ac0 tx=0x7f4338005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3bfe9e30a2b79c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:51.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.962+0000 7f4354e68640 1 -- 172.21.15.40:0/110724846 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4348039070 con 0x7f4338003b70 2024-04-22T07:20:51.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.962+0000 7f4354e68640 1 -- 172.21.15.40:0/110724846 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f434802c6b0 con 0x7f4338003b70 2024-04-22T07:20:51.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.962+0000 7f4354e68640 1 -- 172.21.15.40:0/110724846 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4348009690 con 0x7f4338003b70 2024-04-22T07:20:51.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.963+0000 7f43580ce640 1 -- 172.21.15.40:0/110724846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4338003b70 msgr2=0x7f4338003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:51.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.963+0000 7f43580ce640 1 --2- 172.21.15.40:0/110724846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4338003b70 0x7f4338003f70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4348009ac0 tx=0x7f4338005830 comp rx=0 tx=0).stop 2024-04-22T07:20:51.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.963+0000 7f435666b640 1 -- 172.21.15.40:0/110724846 reap_dead start 2024-04-22T07:20:51.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.963+0000 7f43580ce640 1 -- 172.21.15.40:0/110724846 shutdown_connections 2024-04-22T07:20:51.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.963+0000 7f43580ce640 1 -- 172.21.15.40:0/110724846 >> 172.21.15.40:0/110724846 conn(0x7f435006db30 msgr2=0x7f435006df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:51.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.963+0000 7f43580ce640 1 -- 172.21.15.40:0/110724846 shutdown_connections 2024-04-22T07:20:51.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.963+0000 7f43580ce640 1 -- 172.21.15.40:0/110724846 wait complete. 2024-04-22T07:20:51.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.964+0000 7f43580ce640 1 Processor -- start 2024-04-22T07:20:51.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.964+0000 7f43580ce640 1 -- start start 2024-04-22T07:20:51.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.965+0000 7f43580ce640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4338003b70 0x7f43501f0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:51.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.965+0000 7f43580ce640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f435015a570 0x7f435015d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:51.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.965+0000 7f43580ce640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43501f4430 0x7f435015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:51.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.965+0000 7f43580ce640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f435006ca40 con 0x7f43501f4430 2024-04-22T07:20:51.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.965+0000 7f43580ce640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f435015b340 con 0x7f435015a570 2024-04-22T07:20:51.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.965+0000 7f43580ce640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f435006cbc0 con 0x7f4338003b70 2024-04-22T07:20:51.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.965+0000 7f435666b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43501f4430 0x7f435015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.965+0000 7f435666b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43501f4430 0x7f435015d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43558/0 (socket says 172.21.15.40:43558) 2024-04-22T07:20:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.965+0000 7f435666b640 1 -- 172.21.15.40:0/292868530 learned_addr learned my addr 172.21.15.40:0/292868530 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.965+0000 7f4355669640 1 --2- 172.21.15.40:0/292868530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f435015a570 0x7f435015d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.965+0000 7f4355e6a640 1 --2- 172.21.15.40:0/292868530 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4338003b70 0x7f43501f0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.965+0000 7f435666b640 1 -- 172.21.15.40:0/292868530 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4338003b70 msgr2=0x7f43501f0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.965+0000 7f435666b640 1 --2- 172.21.15.40:0/292868530 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4338003b70 0x7f43501f0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.965+0000 7f435666b640 1 -- 172.21.15.40:0/292868530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f435015a570 msgr2=0x7f435015d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.965+0000 7f435666b640 1 --2- 172.21.15.40:0/292868530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f435015a570 0x7f435015d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.965+0000 7f435666b640 1 -- 172.21.15.40:0/292868530 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43501f4900 con 0x7f43501f4430 2024-04-22T07:20:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.965+0000 7f435666b640 1 --2- 172.21.15.40:0/292868530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43501f4430 0x7f435015d5c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4340001330 tx=0x7f434000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.965+0000 7f434e7fc640 1 -- 172.21.15.40:0/292868530 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434000ee50 con 0x7f43501f4430 2024-04-22T07:20:51.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.965+0000 7f434e7fc640 1 -- 172.21.15.40:0/292868530 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4340003b80 con 0x7f43501f4430 2024-04-22T07:20:51.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.965+0000 7f43580ce640 1 -- 172.21.15.40:0/292868530 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43501f4be0 con 0x7f43501f4430 2024-04-22T07:20:51.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.965+0000 7f434e7fc640 1 -- 172.21.15.40:0/292868530 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4340003d70 con 0x7f43501f4430 2024-04-22T07:20:51.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.966+0000 7f43580ce640 1 -- 172.21.15.40:0/292868530 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43501f51a0 con 0x7f43501f4430 2024-04-22T07:20:51.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.966+0000 7f43580ce640 1 -- 172.21.15.40:0/292868530 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4350069f50 con 0x7f43501f4430 2024-04-22T07:20:51.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.967+0000 7f434e7fc640 1 -- 172.21.15.40:0/292868530 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f434001a020 con 0x7f43501f4430 2024-04-22T07:20:51.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.968+0000 7f434e7fc640 1 --2- 172.21.15.40:0/292868530 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f433c06c8f0 0x7f433c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:51.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.968+0000 7f4355e6a640 1 --2- 172.21.15.40:0/292868530 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f433c06c8f0 0x7f433c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:51.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.968+0000 7f434e7fc640 1 -- 172.21.15.40:0/292868530 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7f434008aec0 con 0x7f43501f4430 2024-04-22T07:20:51.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.968+0000 7f4355e6a640 1 --2- 172.21.15.40:0/292868530 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f433c06c8f0 0x7f433c06edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4348036000 tx=0x7f4348030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:51.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:51.972+0000 7f434e7fc640 1 -- 172.21.15.40:0/292868530 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4340021020 con 0x7f43501f4430 2024-04-22T07:20:52.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.160+0000 7f43580ce640 1 -- 172.21.15.40:0/292868530 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f435015ac00 con 0x7f43501f4430 2024-04-22T07:20:52.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.837+0000 7f434e7fc640 1 -- 172.21.15.40:0/292868530 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) ==== 170+0+0 (secure 0 0 0) 0x7f4340059440 con 0x7f43501f4430 2024-04-22T07:20:52.835 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' created 2024-04-22T07:20:52.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.840+0000 7f43580ce640 1 -- 172.21.15.40:0/292868530 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f433c06c8f0 msgr2=0x7f433c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:52.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.840+0000 7f43580ce640 1 --2- 172.21.15.40:0/292868530 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f433c06c8f0 0x7f433c06edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4348036000 tx=0x7f4348030000 comp rx=0 tx=0).stop 2024-04-22T07:20:52.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.840+0000 7f43580ce640 1 -- 172.21.15.40:0/292868530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43501f4430 msgr2=0x7f435015d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:52.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.840+0000 7f43580ce640 1 --2- 172.21.15.40:0/292868530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43501f4430 0x7f435015d5c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4340001330 tx=0x7f434000ec00 comp rx=0 tx=0).stop 2024-04-22T07:20:52.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.840+0000 7f43580ce640 1 -- 172.21.15.40:0/292868530 shutdown_connections 2024-04-22T07:20:52.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.840+0000 7f43580ce640 1 --2- 172.21.15.40:0/292868530 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f433c06c8f0 0x7f433c06edb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:52.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.840+0000 7f43580ce640 1 --2- 172.21.15.40:0/292868530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43501f4430 0x7f435015d5c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:52.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.840+0000 7f43580ce640 1 --2- 172.21.15.40:0/292868530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f435015a570 0x7f435015d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:52.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.840+0000 7f43580ce640 1 --2- 172.21.15.40:0/292868530 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4338003b70 0x7f43501f0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:52.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.840+0000 7f43580ce640 1 -- 172.21.15.40:0/292868530 >> 172.21.15.40:0/292868530 conn(0x7f435006db30 msgr2=0x7f435006df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:52.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.840+0000 7f43580ce640 1 -- 172.21.15.40:0/292868530 shutdown_connections 2024-04-22T07:20:52.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.840+0000 7f43580ce640 1 -- 172.21.15.40:0/292868530 wait complete. 2024-04-22T07:20:52.866 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-22T07:20:52.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.976+0000 7f5e7c8d3640 1 Processor -- start 2024-04-22T07:20:52.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.976+0000 7f5e7c8d3640 1 -- start start 2024-04-22T07:20:52.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.977+0000 7f5e7c8d3640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e780c5010 0x7f5e7815ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:52.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.977+0000 7f5e7c8d3640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5e7806cca0 0x7f5e780c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:52.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.977+0000 7f5e7c8d3640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e7815aff0 con 0x7f5e7806b920 2024-04-22T07:20:52.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.977+0000 7f5e7c8d3640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f5e7815f4b0 con 0x7f5e7806cca0 2024-04-22T07:20:52.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.977+0000 7f5e7c8d3640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5e780c90f0 con 0x7f5e780c5010 2024-04-22T07:20:52.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.978+0000 7f5e7659c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e780c5010 0x7f5e7815ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:52.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.978+0000 7f5e7659c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e780c5010 0x7f5e7815ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.40:48958/0 (socket says 172.21.15.40:48958) 2024-04-22T07:20:52.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.978+0000 7f5e75d9b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5e7806cca0 0x7f5e780c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:52.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.978+0000 7f5e7659c640 1 -- 172.21.15.40:0/3254192324 learned_addr learned my addr 172.21.15.40:0/3254192324 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:52.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.978+0000 7f5e76d9d640 1 --1- 172.21.15.40:0/3254192324 >> v1:172.21.15.62:6789/0 conn(0x7f5e7806b920 0x7f5e7806c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.40:36368/0 (socket says 172.21.15.40:36368) 2024-04-22T07:20:52.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.978+0000 7f5e7659c640 1 -- 172.21.15.40:0/3254192324 >> v2:172.21.15.62:3300/0 conn(0x7f5e7806cca0 msgr2=0x7f5e780c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:52.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.978+0000 7f5e7659c640 1 --2- 172.21.15.40:0/3254192324 >> v2:172.21.15.62:3300/0 conn(0x7f5e7806cca0 0x7f5e780c3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:52.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.978+0000 7f5e7659c640 1 -- 172.21.15.40:0/3254192324 >> v1:172.21.15.62:6789/0 conn(0x7f5e7806b920 legacy=0x7f5e7806c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:52.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.978+0000 7f5e7659c640 1 -- 172.21.15.40:0/3254192324 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e780c93d0 con 0x7f5e780c5010 2024-04-22T07:20:52.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.978+0000 7f5e7559a640 1 -- 172.21.15.40:0/3254192324 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 873730791 0 0) 0x7f5e7815aff0 con 0x7f5e7806b920 2024-04-22T07:20:52.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.979+0000 7f5e7659c640 1 --2- 172.21.15.40:0/3254192324 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e780c5010 0x7f5e7815ef70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5e70009870 tx=0x7f5e7002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=191d66ed4e2ba491 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:52.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.979+0000 7f5e7559a640 1 -- 172.21.15.40:0/3254192324 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e70034070 con 0x7f5e780c5010 2024-04-22T07:20:52.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.979+0000 7f5e7559a640 1 -- 172.21.15.40:0/3254192324 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e70030840 con 0x7f5e780c5010 2024-04-22T07:20:52.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.979+0000 7f5e7559a640 1 -- 172.21.15.40:0/3254192324 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e70030c10 con 0x7f5e780c5010 2024-04-22T07:20:52.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.979+0000 7f5e7c8d3640 1 -- 172.21.15.40:0/3254192324 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e780c5010 msgr2=0x7f5e7815ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:52.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.979+0000 7f5e7c8d3640 1 --2- 172.21.15.40:0/3254192324 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e780c5010 0x7f5e7815ef70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5e70009870 tx=0x7f5e7002b980 comp rx=0 tx=0).stop 2024-04-22T07:20:52.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.980+0000 7f5e7c8d3640 1 -- 172.21.15.40:0/3254192324 shutdown_connections 2024-04-22T07:20:52.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.980+0000 7f5e7c8d3640 1 --2- 172.21.15.40:0/3254192324 >> v2:172.21.15.62:3300/0 conn(0x7f5e7806cca0 0x7f5e780c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:52.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.980+0000 7f5e7c8d3640 1 --2- 172.21.15.40:0/3254192324 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e780c5010 0x7f5e7815ef70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:52.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.980+0000 7f5e7c8d3640 1 -- 172.21.15.40:0/3254192324 >> 172.21.15.40:0/3254192324 conn(0x7f5e7806db30 msgr2=0x7f5e7806df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:52.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.980+0000 7f5e7c8d3640 1 -- 172.21.15.40:0/3254192324 shutdown_connections 2024-04-22T07:20:52.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.980+0000 7f5e7c8d3640 1 -- 172.21.15.40:0/3254192324 wait complete. 2024-04-22T07:20:52.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.981+0000 7f5e7c8d3640 1 Processor -- start 2024-04-22T07:20:52.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.981+0000 7f5e7c8d3640 1 -- start start 2024-04-22T07:20:52.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.982+0000 7f5e7c8d3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e7806b920 0x7f5e781522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:52.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.982+0000 7f5e7c8d3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e7806cca0 0x7f5e780af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:52.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.982+0000 7f5e7c8d3640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e780c5010 0x7f5e78150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:52.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.982+0000 7f5e7c8d3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5e780c53f0 con 0x7f5e7806cca0 2024-04-22T07:20:52.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.982+0000 7f5e7c8d3640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7815b590 con 0x7f5e7806b920 2024-04-22T07:20:52.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.982+0000 7f5e7c8d3640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5e780c43e0 con 0x7f5e780c5010 2024-04-22T07:20:52.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.982+0000 7f5e75d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e7806cca0 0x7f5e780af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:52.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.982+0000 7f5e75d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e7806cca0 0x7f5e780af140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43566/0 (socket says 172.21.15.40:43566) 2024-04-22T07:20:52.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.982+0000 7f5e75d9b640 1 -- 172.21.15.40:0/416199508 learned_addr learned my addr 172.21.15.40:0/416199508 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:52.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.982+0000 7f5e7659c640 1 --2- 172.21.15.40:0/416199508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e7806b920 0x7f5e781522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:52.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.982+0000 7f5e76d9d640 1 --2- 172.21.15.40:0/416199508 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e780c5010 0x7f5e78150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:52.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.982+0000 7f5e75d9b640 1 -- 172.21.15.40:0/416199508 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e780c5010 msgr2=0x7f5e78150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:52.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.982+0000 7f5e75d9b640 1 --2- 172.21.15.40:0/416199508 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e780c5010 0x7f5e78150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:52.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.982+0000 7f5e75d9b640 1 -- 172.21.15.40:0/416199508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e7806b920 msgr2=0x7f5e781522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:52.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.982+0000 7f5e75d9b640 1 --2- 172.21.15.40:0/416199508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e7806b920 0x7f5e781522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:52.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.982+0000 7f5e75d9b640 1 -- 172.21.15.40:0/416199508 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e780ae980 con 0x7f5e7806cca0 2024-04-22T07:20:52.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.982+0000 7f5e75d9b640 1 --2- 172.21.15.40:0/416199508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e7806cca0 0x7f5e780af140 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5e6000e9b0 tx=0x7f5e6000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:52.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.982+0000 7f5e6effd640 1 -- 172.21.15.40:0/416199508 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e60017070 con 0x7f5e7806cca0 2024-04-22T07:20:52.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.982+0000 7f5e6effd640 1 -- 172.21.15.40:0/416199508 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e6000c9a0 con 0x7f5e7806cca0 2024-04-22T07:20:52.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.982+0000 7f5e7c8d3640 1 -- 172.21.15.40:0/416199508 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e781f4c70 con 0x7f5e7806cca0 2024-04-22T07:20:52.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.982+0000 7f5e6effd640 1 -- 172.21.15.40:0/416199508 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6000cd90 con 0x7f5e7806cca0 2024-04-22T07:20:52.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.983+0000 7f5e7c8d3640 1 -- 172.21.15.40:0/416199508 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e781f5230 con 0x7f5e7806cca0 2024-04-22T07:20:52.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.984+0000 7f5e7c8d3640 1 -- 172.21.15.40:0/416199508 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e780cb940 con 0x7f5e7806cca0 2024-04-22T07:20:52.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.984+0000 7f5e6effd640 1 -- 172.21.15.40:0/416199508 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5e6001a070 con 0x7f5e7806cca0 2024-04-22T07:20:52.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.985+0000 7f5e6effd640 1 --2- 172.21.15.40:0/416199508 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5e5806c920 0x7f5e5806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:52.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.985+0000 7f5e7659c640 1 --2- 172.21.15.40:0/416199508 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5e5806c920 0x7f5e5806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:52.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.985+0000 7f5e6effd640 1 -- 172.21.15.40:0/416199508 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7f5e6008ba40 con 0x7f5e7806cca0 2024-04-22T07:20:52.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.985+0000 7f5e7659c640 1 --2- 172.21.15.40:0/416199508 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5e5806c920 0x7f5e5806ede0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5e70036000 tx=0x7f5e70008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:52.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:52.989+0000 7f5e6effd640 1 -- 172.21.15.40:0/416199508 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5e780cb940 con 0x7f5e7806cca0 2024-04-22T07:20:53.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.214+0000 7f5e7c8d3640 1 -- 172.21.15.40:0/416199508 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f5e780caec0 con 0x7f5e7806cca0 2024-04-22T07:20:53.435 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:20:53.438 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:20:53.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.862+0000 7f5e6effd640 1 -- 172.21.15.40:0/416199508 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f5e780caec0 con 0x7f5e7806cca0 2024-04-22T07:20:53.860 INFO:teuthology.orchestra.run.smithi040.stderr:new fs with metadata pool 2 and data pool 3 2024-04-22T07:20:53.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.870+0000 7f5e7c8d3640 1 -- 172.21.15.40:0/416199508 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5e5806c920 msgr2=0x7f5e5806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:53.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.870+0000 7f5e7c8d3640 1 --2- 172.21.15.40:0/416199508 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5e5806c920 0x7f5e5806ede0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5e70036000 tx=0x7f5e70008030 comp rx=0 tx=0).stop 2024-04-22T07:20:53.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.870+0000 7f5e7c8d3640 1 -- 172.21.15.40:0/416199508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e7806cca0 msgr2=0x7f5e780af140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:53.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.870+0000 7f5e7c8d3640 1 --2- 172.21.15.40:0/416199508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e7806cca0 0x7f5e780af140 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5e6000e9b0 tx=0x7f5e6000ee70 comp rx=0 tx=0).stop 2024-04-22T07:20:53.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.870+0000 7f5e7c8d3640 1 -- 172.21.15.40:0/416199508 shutdown_connections 2024-04-22T07:20:53.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.870+0000 7f5e7c8d3640 1 --2- 172.21.15.40:0/416199508 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e780c5010 0x7f5e78150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:53.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.870+0000 7f5e7c8d3640 1 --2- 172.21.15.40:0/416199508 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5e5806c920 0x7f5e5806ede0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:53.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.870+0000 7f5e7c8d3640 1 --2- 172.21.15.40:0/416199508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e7806cca0 0x7f5e780af140 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5e6000e9b0 tx=0x7f5e6000ee70 comp rx=0 tx=0).stop 2024-04-22T07:20:53.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.870+0000 7f5e7c8d3640 1 --2- 172.21.15.40:0/416199508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e7806b920 0x7f5e781522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:53.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.870+0000 7f5e7c8d3640 1 -- 172.21.15.40:0/416199508 >> 172.21.15.40:0/416199508 conn(0x7f5e7806db30 msgr2=0x7f5e780cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:53.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.872+0000 7f5e7c8d3640 1 -- 172.21.15.40:0/416199508 shutdown_connections 2024-04-22T07:20:53.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.873+0000 7f5e7c8d3640 1 -- 172.21.15.40:0/416199508 wait complete. 2024-04-22T07:20:53.887 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:20:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.991+0000 7f8f97f6d640 1 Processor -- start 2024-04-22T07:20:53.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.992+0000 7f8f97f6d640 1 -- start start 2024-04-22T07:20:53.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.992+0000 7f8f97f6d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8f900c8fe0 0x7f8f90166810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:53.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.992+0000 7f8f97f6d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f900ce610 con 0x7f8f900cbde0 2024-04-22T07:20:53.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.992+0000 7f8f97f6d640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f900ce8f0 con 0x7f8f901586e0 2024-04-22T07:20:53.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.992+0000 7f8f97f6d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f8f900cebd0 con 0x7f8f900c8fe0 2024-04-22T07:20:53.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.993+0000 7f8f95508640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8f900cbde0 0x7f8f9015e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39850/0 (socket says 172.21.15.40:39850) 2024-04-22T07:20:53.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.993+0000 7f8f95508640 1 -- 172.21.15.40:0/3909002354 learned_addr learned my addr 172.21.15.40:0/3909002354 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:20:53.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.993+0000 7f8f9650a640 1 --2- 172.21.15.40:0/3909002354 >> v2:172.21.15.62:3300/0 conn(0x7f8f900c8fe0 0x7f8f90166810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:53.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.993+0000 7f8f94d07640 1 -- 172.21.15.40:0/3909002354 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2760723492 0 0) 0x7f8f900ce610 con 0x7f8f900cbde0 2024-04-22T07:20:53.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.993+0000 7f8f94d07640 1 -- 172.21.15.40:0/3909002354 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f78003520 con 0x7f8f900cbde0 2024-04-22T07:20:53.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.993+0000 7f8f94d07640 1 -- 172.21.15.40:0/3909002354 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 386660601 0 0) 0x7f8f78003520 con 0x7f8f900cbde0 2024-04-22T07:20:53.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.993+0000 7f8f94d07640 1 -- 172.21.15.40:0/3909002354 >> v2:172.21.15.62:3300/0 conn(0x7f8f900c8fe0 msgr2=0x7f8f90166810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:53.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.993+0000 7f8f94d07640 1 --2- 172.21.15.40:0/3909002354 >> v2:172.21.15.62:3300/0 conn(0x7f8f900c8fe0 0x7f8f90166810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:53.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.993+0000 7f8f94d07640 1 -- 172.21.15.40:0/3909002354 >> v1:172.21.15.62:6789/0 conn(0x7f8f901586e0 legacy=0x7f8f9006f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:53.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.993+0000 7f8f94d07640 1 -- 172.21.15.40:0/3909002354 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f900ceeb0 con 0x7f8f900cbde0 2024-04-22T07:20:53.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.993+0000 7f8f94d07640 1 -- 172.21.15.40:0/3909002354 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7f8f84001670 con 0x7f8f900cbde0 2024-04-22T07:20:53.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.993+0000 7f8f94d07640 1 -- 172.21.15.40:0/3909002354 >> v1:172.21.15.40:6789/0 conn(0x7f8f900cbde0 legacy=0x7f8f9015e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:53.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.993+0000 7f8f94d07640 1 --2- 172.21.15.40:0/3909002354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f780039b0 0x7f8f78003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:53.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.993+0000 7f8f94d07640 1 --2- 172.21.15.40:0/3909002354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f78004800 0x7f8f78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:53.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.993+0000 7f8f94d07640 1 --2- 172.21.15.40:0/3909002354 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f780051c0 0x7f8f7800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:53.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.993+0000 7f8f94d07640 1 -- 172.21.15.40:0/3909002354 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8f900cebd0 con 0x7f8f78004800 2024-04-22T07:20:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.993+0000 7f8f94d07640 1 -- 172.21.15.40:0/3909002354 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7800c070 con 0x7f8f780039b0 2024-04-22T07:20:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.993+0000 7f8f94d07640 1 -- 172.21.15.40:0/3909002354 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f8f7800c270 con 0x7f8f780051c0 2024-04-22T07:20:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.993+0000 7f8f95508640 1 --2- 172.21.15.40:0/3909002354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f78004800 0x7f8f78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.993+0000 7f8f95d09640 1 --2- 172.21.15.40:0/3909002354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f780039b0 0x7f8f78003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.993+0000 7f8f9650a640 1 --2- 172.21.15.40:0/3909002354 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f780051c0 0x7f8f7800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.994+0000 7f8f95508640 1 -- 172.21.15.40:0/3909002354 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f780051c0 msgr2=0x7f8f7800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.994+0000 7f8f95508640 1 --2- 172.21.15.40:0/3909002354 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f780051c0 0x7f8f7800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.994+0000 7f8f95508640 1 -- 172.21.15.40:0/3909002354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f780039b0 msgr2=0x7f8f78003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.994+0000 7f8f95508640 1 --2- 172.21.15.40:0/3909002354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f780039b0 0x7f8f78003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.994+0000 7f8f9650a640 1 -- 172.21.15.40:0/3909002354 reap_dead start 2024-04-22T07:20:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.994+0000 7f8f95508640 1 -- 172.21.15.40:0/3909002354 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f78003520 con 0x7f8f78004800 2024-04-22T07:20:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.994+0000 7f8f95508640 1 --2- 172.21.15.40:0/3909002354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f78004800 0x7f8f78004c80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8f8400c210 tx=0x7f8f78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b40700439f3c0f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.994+0000 7f8f94d07640 1 -- 172.21.15.40:0/3909002354 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f84007d10 con 0x7f8f78004800 2024-04-22T07:20:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.995+0000 7f8f94d07640 1 -- 172.21.15.40:0/3909002354 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f84030070 con 0x7f8f78004800 2024-04-22T07:20:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.995+0000 7f8f94d07640 1 -- 172.21.15.40:0/3909002354 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f84005d90 con 0x7f8f78004800 2024-04-22T07:20:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.995+0000 7f8f97f6d640 1 -- 172.21.15.40:0/3909002354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f78004800 msgr2=0x7f8f78004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.995+0000 7f8f97f6d640 1 --2- 172.21.15.40:0/3909002354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f78004800 0x7f8f78004c80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8f8400c210 tx=0x7f8f78005830 comp rx=0 tx=0).stop 2024-04-22T07:20:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.995+0000 7f8f97f6d640 1 -- 172.21.15.40:0/3909002354 shutdown_connections 2024-04-22T07:20:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.995+0000 7f8f97f6d640 1 --2- 172.21.15.40:0/3909002354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f78004800 0x7f8f78004c80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.995+0000 7f8f97f6d640 1 -- 172.21.15.40:0/3909002354 >> 172.21.15.40:0/3909002354 conn(0x7f8f9006dd10 msgr2=0x7f8f9006e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.995+0000 7f8f97f6d640 1 -- 172.21.15.40:0/3909002354 shutdown_connections 2024-04-22T07:20:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.995+0000 7f8f97f6d640 1 -- 172.21.15.40:0/3909002354 wait complete. 2024-04-22T07:20:53.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.996+0000 7f8f97f6d640 1 Processor -- start 2024-04-22T07:20:53.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.996+0000 7f8f97f6d640 1 -- start start 2024-04-22T07:20:53.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.997+0000 7f8f97f6d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f78004800 0x7f8f9015bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:53.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.997+0000 7f8f97f6d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f900c4cd0 0x7f8f9014b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:53.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.997+0000 7f8f97f6d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f900cdd40 0x7f8f901f3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:53.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.997+0000 7f8f97f6d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8f900c9600 con 0x7f8f900c4cd0 2024-04-22T07:20:53.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.997+0000 7f8f97f6d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8f900c9480 con 0x7f8f78004800 2024-04-22T07:20:53.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.997+0000 7f8f97f6d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f8f9006b920 con 0x7f8f900cdd40 2024-04-22T07:20:53.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.997+0000 7f8f95508640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f900c4cd0 0x7f8f9014b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:54.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.997+0000 7f8f95508640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f900c4cd0 0x7f8f9014b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43578/0 (socket says 172.21.15.40:43578) 2024-04-22T07:20:54.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.997+0000 7f8f95508640 1 -- 172.21.15.40:0/1763585525 learned_addr learned my addr 172.21.15.40:0/1763585525 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:54.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.997+0000 7f8f95d09640 1 --2- 172.21.15.40:0/1763585525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f78004800 0x7f8f9015bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:54.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.997+0000 7f8f9650a640 1 --2- 172.21.15.40:0/1763585525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f900cdd40 0x7f8f901f3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:54.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.997+0000 7f8f95508640 1 -- 172.21.15.40:0/1763585525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f900cdd40 msgr2=0x7f8f901f3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:54.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.997+0000 7f8f95508640 1 --2- 172.21.15.40:0/1763585525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f900cdd40 0x7f8f901f3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:54.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.997+0000 7f8f95508640 1 -- 172.21.15.40:0/1763585525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f78004800 msgr2=0x7f8f9015bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:54.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.997+0000 7f8f95508640 1 --2- 172.21.15.40:0/1763585525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f78004800 0x7f8f9015bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:54.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.997+0000 7f8f95508640 1 -- 172.21.15.40:0/1763585525 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f90157ea0 con 0x7f8f900c4cd0 2024-04-22T07:20:54.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.997+0000 7f8f95d09640 1 --2- 172.21.15.40:0/1763585525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f78004800 0x7f8f9015bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:20:54.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.998+0000 7f8f95508640 1 --2- 172.21.15.40:0/1763585525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f900c4cd0 0x7f8f9014b1a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8f8400c330 tx=0x7f8f900cbb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:54.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.998+0000 7f8f8e7fc640 1 -- 172.21.15.40:0/1763585525 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f84045070 con 0x7f8f900c4cd0 2024-04-22T07:20:54.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.998+0000 7f8f8e7fc640 1 -- 172.21.15.40:0/1763585525 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f840049f0 con 0x7f8f900c4cd0 2024-04-22T07:20:54.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.998+0000 7f8f97f6d640 1 -- 172.21.15.40:0/1763585525 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f9014d810 con 0x7f8f900c4cd0 2024-04-22T07:20:54.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.998+0000 7f8f8e7fc640 1 -- 172.21.15.40:0/1763585525 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f84007d10 con 0x7f8f900c4cd0 2024-04-22T07:20:54.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.998+0000 7f8f97f6d640 1 -- 172.21.15.40:0/1763585525 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f90157bc0 con 0x7f8f900c4cd0 2024-04-22T07:20:54.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.999+0000 7f8f97f6d640 1 -- 172.21.15.40:0/1763585525 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f9006bf30 con 0x7f8f900c4cd0 2024-04-22T07:20:54.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.999+0000 7f8f8e7fc640 1 -- 172.21.15.40:0/1763585525 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8f84007070 con 0x7f8f900c4cd0 2024-04-22T07:20:54.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:53.999+0000 7f8f8e7fc640 1 --2- 172.21.15.40:0/1763585525 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8f7c06c920 0x7f8f7c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:54.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.000+0000 7f8f8e7fc640 1 -- 172.21.15.40:0/1763585525 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8f840ac680 con 0x7f8f900c4cd0 2024-04-22T07:20:54.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.000+0000 7f8f95d09640 1 --2- 172.21.15.40:0/1763585525 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8f7c06c920 0x7f8f7c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:54.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.000+0000 7f8f95d09640 1 --2- 172.21.15.40:0/1763585525 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8f7c06c920 0x7f8f7c06ede0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8f88000c00 tx=0x7f8f88009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:54.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.004+0000 7f8f8e7fc640 1 -- 172.21.15.40:0/1763585525 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8f9006bf30 con 0x7f8f900c4cd0 2024-04-22T07:20:54.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.193+0000 7f8f97f6d640 1 -- 172.21.15.40:0/1763585525 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8f90068b20 con 0x7f8f900c4cd0 2024-04-22T07:20:54.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.194+0000 7f8f8e7fc640 1 -- 172.21.15.40:0/1763585525 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16550 (secure 0 0 0) 0x7f8f8407ab40 con 0x7f8f900c4cd0 2024-04-22T07:20:54.192 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:20:54.192 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":22,"fsid":"dd5b16e4-89fe-4602-b37f-062846793158","created":"2024-04-22T07:20:29.488892+0000","modified":"2024-04-22T07:20:53.216242+0000","last_up_change":"2024-04-22T07:20:40.397383+0000","last_in_change":"2024-04-22T07:20:31.702551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:20:41.793179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:20:51.815779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:20:52.164265+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32238b7e-228b-4a67-bfca-16e8f0020a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6801","nonce":1526385055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6803","nonce":1526385055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6807","nonce":1526385055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6805","nonce":1526385055}]},"public_addr":"172.21.15.40:6801/1526385055","cluster_addr":"172.21.15.40:6803/1526385055","heartbeat_back_addr":"172.21.15.40:6807/1526385055","heartbeat_front_addr":"172.21.15.40:6805/1526385055","state":["exists","up"]},{"osd":1,"uuid":"5ad8da43-39b1-4295-b4d1-0f1e1d06fc0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6809","nonce":623026645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6811","nonce":623026645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6815","nonce":623026645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6813","nonce":623026645}]},"public_addr":"172.21.15.40:6809/623026645","cluster_addr":"172.21.15.40:6811/623026645","heartbeat_back_addr":"172.21.15.40:6815/623026645","heartbeat_front_addr":"172.21.15.40:6813/623026645","state":["exists","up"]},{"osd":2,"uuid":"7d2c6d50-719d-4232-ad47-f04dcf1a8bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6820","nonce":1885686505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6824","nonce":1885686505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6831","nonce":1885686505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6828","nonce":1885686505}]},"public_addr":"172.21.15.40:6820/1885686505","cluster_addr":"172.21.15.40:6824/1885686505","heartbeat_back_addr":"172.21.15.40:6831/1885686505","heartbeat_front_addr":"172.21.15.40:6828/1885686505","state":["exists","up"]},{"osd":3,"uuid":"af42e7d6-a6bf-403e-92e7-162d7c4fbf0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6817","nonce":130276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6819","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6821","nonce":130276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6829","nonce":130276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6823","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6825","nonce":130276746}]},"public_addr":"172.21.15.40:6817/130276746","cluster_addr":"172.21.15.40:6821/130276746","heartbeat_back_addr":"172.21.15.40:6829/130276746","heartbeat_front_addr":"172.21.15.40:6825/130276746","state":["exists","up"]},{"osd":4,"uuid":"f8e89e0d-be96-4f19-88c0-69c408df7d98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6801","nonce":2251435758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6803","nonce":2251435758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6807","nonce":2251435758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6805","nonce":2251435758}]},"public_addr":"172.21.15.62:6801/2251435758","cluster_addr":"172.21.15.62:6803/2251435758","heartbeat_back_addr":"172.21.15.62:6807/2251435758","heartbeat_front_addr":"172.21.15.62:6805/2251435758","state":["exists","up"]},{"osd":5,"uuid":"ba6dc1bc-272b-4f80-b55f-40bc4a0c3ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6809","nonce":3509322231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6811","nonce":3509322231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6815","nonce":3509322231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6813","nonce":3509322231}]},"public_addr":"172.21.15.62:6809/3509322231","cluster_addr":"172.21.15.62:6811/3509322231","heartbeat_back_addr":"172.21.15.62:6815/3509322231","heartbeat_front_addr":"172.21.15.62:6813/3509322231","state":["exists","up"]},{"osd":6,"uuid":"834fcd74-14bf-45ec-a10a-0374f4ce9bf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6825","nonce":3094315954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6827","nonce":3094315954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6831","nonce":3094315954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6829","nonce":3094315954}]},"public_addr":"172.21.15.62:6825/3094315954","cluster_addr":"172.21.15.62:6827/3094315954","heartbeat_back_addr":"172.21.15.62:6831/3094315954","heartbeat_front_addr":"172.21.15.62:6829/3094315954","state":["exists","up"]},{"osd":7,"uuid":"831c9a73-960e-4d2e-b86a-33a6916be059","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6817","nonce":147453972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6819","nonce":147453972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6823","nonce":147453972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6821","nonce":147453972}]},"public_addr":"172.21.15.62:6817/147453972","cluster_addr":"172.21.15.62:6819/147453972","heartbeat_back_addr":"172.21.15.62:6823/147453972","heartbeat_front_addr":"172.21.15.62:6821/147453972","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.828738+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.873471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.908090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.894782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:37.686796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.801123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.852323+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.812139+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:20:54.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.196+0000 7f8f97f6d640 1 -- 172.21.15.40:0/1763585525 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8f7c06c920 msgr2=0x7f8f7c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:54.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.196+0000 7f8f97f6d640 1 --2- 172.21.15.40:0/1763585525 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8f7c06c920 0x7f8f7c06ede0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8f88000c00 tx=0x7f8f88009040 comp rx=0 tx=0).stop 2024-04-22T07:20:54.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.196+0000 7f8f97f6d640 1 -- 172.21.15.40:0/1763585525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f900c4cd0 msgr2=0x7f8f9014b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:54.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.196+0000 7f8f97f6d640 1 --2- 172.21.15.40:0/1763585525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f900c4cd0 0x7f8f9014b1a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8f8400c330 tx=0x7f8f900cbb00 comp rx=0 tx=0).stop 2024-04-22T07:20:54.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.196+0000 7f8f97f6d640 1 -- 172.21.15.40:0/1763585525 shutdown_connections 2024-04-22T07:20:54.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.196+0000 7f8f97f6d640 1 --2- 172.21.15.40:0/1763585525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8f900cdd40 0x7f8f901f3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:54.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.196+0000 7f8f97f6d640 1 --2- 172.21.15.40:0/1763585525 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8f7c06c920 0x7f8f7c06ede0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:54.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.196+0000 7f8f97f6d640 1 --2- 172.21.15.40:0/1763585525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f900c4cd0 0x7f8f9014b1a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:54.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.196+0000 7f8f97f6d640 1 --2- 172.21.15.40:0/1763585525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f78004800 0x7f8f9015bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:54.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.196+0000 7f8f97f6d640 1 -- 172.21.15.40:0/1763585525 >> 172.21.15.40:0/1763585525 conn(0x7f8f9006dd10 msgr2=0x7f8f90150d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:54.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.196+0000 7f8f97f6d640 1 -- 172.21.15.40:0/1763585525 shutdown_connections 2024-04-22T07:20:54.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.196+0000 7f8f97f6d640 1 -- 172.21.15.40:0/1763585525 wait complete. 2024-04-22T07:20:54.206 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:20:54.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.308+0000 7f121d14b640 1 Processor -- start 2024-04-22T07:20:54.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.308+0000 7f121d14b640 1 -- start start 2024-04-22T07:20:54.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.309+0000 7f121d14b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1218154ed0 0x7f12180cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:54.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.309+0000 7f121d14b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f12180cc650 0x7f121815e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:54.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.309+0000 7f121d14b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f121815ef10 0x7f12180ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:54.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.309+0000 7f121d14b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f121815e260 con 0x7f1218154ed0 2024-04-22T07:20:54.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.309+0000 7f121d14b640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f12180c5960 con 0x7f12180cc650 2024-04-22T07:20:54.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.309+0000 7f121d14b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f121815b7b0 con 0x7f121815ef10 2024-04-22T07:20:54.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.309+0000 7f1216d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1218154ed0 0x7f12180cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:54.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.309+0000 7f1216d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1218154ed0 0x7f12180cb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43584/0 (socket says 172.21.15.40:43584) 2024-04-22T07:20:54.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.309+0000 7f1216d9d640 1 -- 172.21.15.40:0/1371044048 learned_addr learned my addr 172.21.15.40:0/1371044048 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:54.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.309+0000 7f121659c640 1 --2- 172.21.15.40:0/1371044048 >> v2:172.21.15.62:3300/0 conn(0x7f12180cc650 0x7f121815e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:54.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.309+0000 7f121759e640 1 --2- 172.21.15.40:0/1371044048 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f121815ef10 0x7f12180ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:54.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.309+0000 7f1216d9d640 1 -- 172.21.15.40:0/1371044048 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f121815ef10 msgr2=0x7f12180ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:54.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.309+0000 7f1216d9d640 1 --2- 172.21.15.40:0/1371044048 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f121815ef10 0x7f12180ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:54.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.309+0000 7f1216d9d640 1 -- 172.21.15.40:0/1371044048 >> v2:172.21.15.62:3300/0 conn(0x7f12180cc650 msgr2=0x7f121815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:54.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.309+0000 7f1216d9d640 1 --2- 172.21.15.40:0/1371044048 >> v2:172.21.15.62:3300/0 conn(0x7f12180cc650 0x7f121815e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:54.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.309+0000 7f1216d9d640 1 -- 172.21.15.40:0/1371044048 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12180cc0f0 con 0x7f1218154ed0 2024-04-22T07:20:54.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.309+0000 7f121659c640 1 --2- 172.21.15.40:0/1371044048 >> v2:172.21.15.62:3300/0 conn(0x7f12180cc650 0x7f121815e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:20:54.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.310+0000 7f1216d9d640 1 --2- 172.21.15.40:0/1371044048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1218154ed0 0x7f12180cb490 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1218073210 tx=0x7f120802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b2123442cb8241 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:54.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.310+0000 7f1215d9b640 1 -- 172.21.15.40:0/1371044048 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120802c9e0 con 0x7f1218154ed0 2024-04-22T07:20:54.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.310+0000 7f1215d9b640 1 -- 172.21.15.40:0/1371044048 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f120802cb80 con 0x7f1218154ed0 2024-04-22T07:20:54.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.310+0000 7f1215d9b640 1 -- 172.21.15.40:0/1371044048 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12080343f0 con 0x7f1218154ed0 2024-04-22T07:20:54.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.311+0000 7f121d14b640 1 -- 172.21.15.40:0/1371044048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1218154ed0 msgr2=0x7f12180cb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:54.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.311+0000 7f121d14b640 1 --2- 172.21.15.40:0/1371044048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1218154ed0 0x7f12180cb490 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1218073210 tx=0x7f120802be40 comp rx=0 tx=0).stop 2024-04-22T07:20:54.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.311+0000 7f121d14b640 1 -- 172.21.15.40:0/1371044048 shutdown_connections 2024-04-22T07:20:54.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.311+0000 7f121d14b640 1 --2- 172.21.15.40:0/1371044048 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f121815ef10 0x7f12180ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:54.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.311+0000 7f121d14b640 1 --2- 172.21.15.40:0/1371044048 >> v2:172.21.15.62:3300/0 conn(0x7f12180cc650 0x7f121815e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:54.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.311+0000 7f121d14b640 1 --2- 172.21.15.40:0/1371044048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1218154ed0 0x7f12180cb490 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:54.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.311+0000 7f121d14b640 1 -- 172.21.15.40:0/1371044048 >> 172.21.15.40:0/1371044048 conn(0x7f1218073d10 msgr2=0x7f121806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:54.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.311+0000 7f121d14b640 1 -- 172.21.15.40:0/1371044048 shutdown_connections 2024-04-22T07:20:54.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.311+0000 7f121d14b640 1 -- 172.21.15.40:0/1371044048 wait complete. 2024-04-22T07:20:54.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.312+0000 7f121d14b640 1 Processor -- start 2024-04-22T07:20:54.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.312+0000 7f121d14b640 1 -- start start 2024-04-22T07:20:54.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.313+0000 7f121d14b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12180cc650 0x7f12180c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:54.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.313+0000 7f121d14b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1218154ed0 0x7f12181f3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:54.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.313+0000 7f121d14b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f121815ef10 0x7f12180ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:54.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.313+0000 7f121d14b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f12180cc3b0 con 0x7f12180cc650 2024-04-22T07:20:54.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.313+0000 7f121d14b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f121815e4b0 con 0x7f1218154ed0 2024-04-22T07:20:54.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.313+0000 7f121d14b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f12180cbb20 con 0x7f121815ef10 2024-04-22T07:20:54.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.313+0000 7f1216d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12180cc650 0x7f12180c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:54.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.313+0000 7f1216d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12180cc650 0x7f12180c78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43588/0 (socket says 172.21.15.40:43588) 2024-04-22T07:20:54.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.313+0000 7f1216d9d640 1 -- 172.21.15.40:0/737414428 learned_addr learned my addr 172.21.15.40:0/737414428 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:54.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.313+0000 7f121659c640 1 --2- 172.21.15.40:0/737414428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1218154ed0 0x7f12181f3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:54.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.313+0000 7f1216d9d640 1 -- 172.21.15.40:0/737414428 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f121815ef10 msgr2=0x7f12180ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:54.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.313+0000 7f121759e640 1 --2- 172.21.15.40:0/737414428 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f121815ef10 0x7f12180ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:54.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.313+0000 7f1216d9d640 1 --2- 172.21.15.40:0/737414428 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f121815ef10 0x7f12180ceb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:54.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.313+0000 7f1216d9d640 1 -- 172.21.15.40:0/737414428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1218154ed0 msgr2=0x7f12181f3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:54.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.313+0000 7f1216d9d640 1 --2- 172.21.15.40:0/737414428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1218154ed0 0x7f12181f3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:54.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.313+0000 7f1216d9d640 1 -- 172.21.15.40:0/737414428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12181f4400 con 0x7f12180cc650 2024-04-22T07:20:54.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.314+0000 7f121659c640 1 --2- 172.21.15.40:0/737414428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1218154ed0 0x7f12181f3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:20:54.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.314+0000 7f121759e640 1 --2- 172.21.15.40:0/737414428 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f121815ef10 0x7f12180ceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:20:54.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.314+0000 7f1216d9d640 1 --2- 172.21.15.40:0/737414428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12180cc650 0x7f12180c78c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1208000f80 tx=0x7f1208004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:54.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.314+0000 7f120f7fe640 1 -- 172.21.15.40:0/737414428 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1208043020 con 0x7f12180cc650 2024-04-22T07:20:54.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.314+0000 7f120f7fe640 1 -- 172.21.15.40:0/737414428 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f120803e450 con 0x7f12180cc650 2024-04-22T07:20:54.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.314+0000 7f121d14b640 1 -- 172.21.15.40:0/737414428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12181f4120 con 0x7f12180cc650 2024-04-22T07:20:54.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.314+0000 7f120f7fe640 1 -- 172.21.15.40:0/737414428 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1208009510 con 0x7f12180cc650 2024-04-22T07:20:54.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.314+0000 7f121d14b640 1 -- 172.21.15.40:0/737414428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1218147f50 con 0x7f12180cc650 2024-04-22T07:20:54.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.315+0000 7f121d14b640 1 -- 172.21.15.40:0/737414428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1218069d40 con 0x7f12180cc650 2024-04-22T07:20:54.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.315+0000 7f120f7fe640 1 -- 172.21.15.40:0/737414428 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1208046020 con 0x7f12180cc650 2024-04-22T07:20:54.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.316+0000 7f120f7fe640 1 --2- 172.21.15.40:0/737414428 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f11f806c920 0x7f11f806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:54.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.316+0000 7f120f7fe640 1 -- 172.21.15.40:0/737414428 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f12080ae470 con 0x7f12180cc650 2024-04-22T07:20:54.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.316+0000 7f121659c640 1 --2- 172.21.15.40:0/737414428 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f11f806c920 0x7f11f806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:54.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.316+0000 7f121659c640 1 --2- 172.21.15.40:0/737414428 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f11f806c920 0x7f11f806ede0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1200006fd0 tx=0x7f1200008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:54.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.320+0000 7f120f7fe640 1 -- 172.21.15.40:0/737414428 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f120804d030 con 0x7f12180cc650 2024-04-22T07:20:54.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.506+0000 7f121d14b640 1 -- 172.21.15.40:0/737414428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12180cbe30 con 0x7f12180cc650 2024-04-22T07:20:54.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.507+0000 7f120f7fe640 1 -- 172.21.15.40:0/737414428 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16550 (secure 0 0 0) 0x7f120807c800 con 0x7f12180cc650 2024-04-22T07:20:54.505 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:20:54.505 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":22,"fsid":"dd5b16e4-89fe-4602-b37f-062846793158","created":"2024-04-22T07:20:29.488892+0000","modified":"2024-04-22T07:20:53.216242+0000","last_up_change":"2024-04-22T07:20:40.397383+0000","last_in_change":"2024-04-22T07:20:31.702551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:20:41.793179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:20:51.815779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:20:52.164265+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32238b7e-228b-4a67-bfca-16e8f0020a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6801","nonce":1526385055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6803","nonce":1526385055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6807","nonce":1526385055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6805","nonce":1526385055}]},"public_addr":"172.21.15.40:6801/1526385055","cluster_addr":"172.21.15.40:6803/1526385055","heartbeat_back_addr":"172.21.15.40:6807/1526385055","heartbeat_front_addr":"172.21.15.40:6805/1526385055","state":["exists","up"]},{"osd":1,"uuid":"5ad8da43-39b1-4295-b4d1-0f1e1d06fc0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6809","nonce":623026645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6811","nonce":623026645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6815","nonce":623026645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6813","nonce":623026645}]},"public_addr":"172.21.15.40:6809/623026645","cluster_addr":"172.21.15.40:6811/623026645","heartbeat_back_addr":"172.21.15.40:6815/623026645","heartbeat_front_addr":"172.21.15.40:6813/623026645","state":["exists","up"]},{"osd":2,"uuid":"7d2c6d50-719d-4232-ad47-f04dcf1a8bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6820","nonce":1885686505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6824","nonce":1885686505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6831","nonce":1885686505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6828","nonce":1885686505}]},"public_addr":"172.21.15.40:6820/1885686505","cluster_addr":"172.21.15.40:6824/1885686505","heartbeat_back_addr":"172.21.15.40:6831/1885686505","heartbeat_front_addr":"172.21.15.40:6828/1885686505","state":["exists","up"]},{"osd":3,"uuid":"af42e7d6-a6bf-403e-92e7-162d7c4fbf0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6817","nonce":130276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6819","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6821","nonce":130276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6829","nonce":130276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6823","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6825","nonce":130276746}]},"public_addr":"172.21.15.40:6817/130276746","cluster_addr":"172.21.15.40:6821/130276746","heartbeat_back_addr":"172.21.15.40:6829/130276746","heartbeat_front_addr":"172.21.15.40:6825/130276746","state":["exists","up"]},{"osd":4,"uuid":"f8e89e0d-be96-4f19-88c0-69c408df7d98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6801","nonce":2251435758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6803","nonce":2251435758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6807","nonce":2251435758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6805","nonce":2251435758}]},"public_addr":"172.21.15.62:6801/2251435758","cluster_addr":"172.21.15.62:6803/2251435758","heartbeat_back_addr":"172.21.15.62:6807/2251435758","heartbeat_front_addr":"172.21.15.62:6805/2251435758","state":["exists","up"]},{"osd":5,"uuid":"ba6dc1bc-272b-4f80-b55f-40bc4a0c3ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6809","nonce":3509322231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6811","nonce":3509322231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6815","nonce":3509322231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6813","nonce":3509322231}]},"public_addr":"172.21.15.62:6809/3509322231","cluster_addr":"172.21.15.62:6811/3509322231","heartbeat_back_addr":"172.21.15.62:6815/3509322231","heartbeat_front_addr":"172.21.15.62:6813/3509322231","state":["exists","up"]},{"osd":6,"uuid":"834fcd74-14bf-45ec-a10a-0374f4ce9bf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6825","nonce":3094315954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6827","nonce":3094315954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6831","nonce":3094315954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6829","nonce":3094315954}]},"public_addr":"172.21.15.62:6825/3094315954","cluster_addr":"172.21.15.62:6827/3094315954","heartbeat_back_addr":"172.21.15.62:6831/3094315954","heartbeat_front_addr":"172.21.15.62:6829/3094315954","state":["exists","up"]},{"osd":7,"uuid":"831c9a73-960e-4d2e-b86a-33a6916be059","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6817","nonce":147453972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6819","nonce":147453972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6823","nonce":147453972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6821","nonce":147453972}]},"public_addr":"172.21.15.62:6817/147453972","cluster_addr":"172.21.15.62:6819/147453972","heartbeat_back_addr":"172.21.15.62:6823/147453972","heartbeat_front_addr":"172.21.15.62:6821/147453972","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.828738+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.873471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.908090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.894782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:37.686796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.801123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.852323+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.812139+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:20:54.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.509+0000 7f121d14b640 1 -- 172.21.15.40:0/737414428 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f11f806c920 msgr2=0x7f11f806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:54.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.509+0000 7f121d14b640 1 --2- 172.21.15.40:0/737414428 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f11f806c920 0x7f11f806ede0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1200006fd0 tx=0x7f1200008040 comp rx=0 tx=0).stop 2024-04-22T07:20:54.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.509+0000 7f121d14b640 1 -- 172.21.15.40:0/737414428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12180cc650 msgr2=0x7f12180c78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:54.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.509+0000 7f121d14b640 1 --2- 172.21.15.40:0/737414428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12180cc650 0x7f12180c78c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1208000f80 tx=0x7f1208004a40 comp rx=0 tx=0).stop 2024-04-22T07:20:54.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.509+0000 7f121d14b640 1 -- 172.21.15.40:0/737414428 shutdown_connections 2024-04-22T07:20:54.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.509+0000 7f121d14b640 1 --2- 172.21.15.40:0/737414428 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f121815ef10 0x7f12180ceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:54.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.509+0000 7f121d14b640 1 --2- 172.21.15.40:0/737414428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1218154ed0 0x7f12181f3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:54.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.509+0000 7f121d14b640 1 --2- 172.21.15.40:0/737414428 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f11f806c920 0x7f11f806ede0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:54.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.509+0000 7f121d14b640 1 --2- 172.21.15.40:0/737414428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12180cc650 0x7f12180c78c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:54.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.509+0000 7f121d14b640 1 -- 172.21.15.40:0/737414428 >> 172.21.15.40:0/737414428 conn(0x7f1218073d10 msgr2=0x7f121815d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:54.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.509+0000 7f121d14b640 1 -- 172.21.15.40:0/737414428 shutdown_connections 2024-04-22T07:20:54.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.509+0000 7f121d14b640 1 -- 172.21.15.40:0/737414428 wait complete. 2024-04-22T07:20:54.518 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-22T07:20:54.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.624+0000 7f56119d0640 1 Processor -- start 2024-04-22T07:20:54.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.624+0000 7f56119d0640 1 -- start start 2024-04-22T07:20:54.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.625+0000 7f56119d0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f560c155130 0x7f560c0c5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:54.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.625+0000 7f56119d0640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f560c0cdbe0 0x7f560c0d0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:54.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.625+0000 7f56119d0640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f560c0cc860 con 0x7f560c0cb3f0 2024-04-22T07:20:54.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.625+0000 7f56119d0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f560c155510 con 0x7f560c155130 2024-04-22T07:20:54.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.625+0000 7f56119d0640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f560c0cc610 con 0x7f560c0cdbe0 2024-04-22T07:20:54.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.625+0000 7f560affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f560c155130 0x7f560c0c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:54.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.625+0000 7f560a7fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f560c0cb3f0 0x7f560c15b840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39860/0 (socket says 172.21.15.40:39860) 2024-04-22T07:20:54.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.625+0000 7f560a7fc640 1 -- 172.21.15.40:0/854940722 learned_addr learned my addr 172.21.15.40:0/854940722 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:20:54.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.625+0000 7f560b7fe640 1 --2- 172.21.15.40:0/854940722 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f560c0cdbe0 0x7f560c0d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:54.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.625+0000 7f5609ffb640 1 -- 172.21.15.40:0/854940722 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2541642372 0 0) 0x7f560c0cc860 con 0x7f560c0cb3f0 2024-04-22T07:20:54.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.625+0000 7f5609ffb640 1 -- 172.21.15.40:0/854940722 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55f8003520 con 0x7f560c0cb3f0 2024-04-22T07:20:54.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.625+0000 7f560affd640 1 -- 172.21.15.40:0/854940722 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f560c0cdbe0 msgr2=0x7f560c0d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:54.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.625+0000 7f560affd640 1 --2- 172.21.15.40:0/854940722 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f560c0cdbe0 0x7f560c0d0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:54.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.625+0000 7f560affd640 1 -- 172.21.15.40:0/854940722 >> v1:172.21.15.40:6789/0 conn(0x7f560c0cb3f0 legacy=0x7f560c15b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:54.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.625+0000 7f560affd640 1 -- 172.21.15.40:0/854940722 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f560c0ccb40 con 0x7f560c155130 2024-04-22T07:20:54.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.626+0000 7f560affd640 1 --2- 172.21.15.40:0/854940722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f560c155130 0x7f560c0c5550 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f55fc009d90 tx=0x7f55fc02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7800213cc144352 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:54.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.626+0000 7f5609ffb640 1 -- 172.21.15.40:0/854940722 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55fc039070 con 0x7f560c155130 2024-04-22T07:20:54.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.626+0000 7f5609ffb640 1 -- 172.21.15.40:0/854940722 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55fc02cc50 con 0x7f560c155130 2024-04-22T07:20:54.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.626+0000 7f5609ffb640 1 -- 172.21.15.40:0/854940722 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55fc034440 con 0x7f560c155130 2024-04-22T07:20:54.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.627+0000 7f56119d0640 1 -- 172.21.15.40:0/854940722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f560c155130 msgr2=0x7f560c0c5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:54.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.627+0000 7f56119d0640 1 --2- 172.21.15.40:0/854940722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f560c155130 0x7f560c0c5550 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f55fc009d90 tx=0x7f55fc02bea0 comp rx=0 tx=0).stop 2024-04-22T07:20:54.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.627+0000 7f56119d0640 1 -- 172.21.15.40:0/854940722 shutdown_connections 2024-04-22T07:20:54.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.627+0000 7f56119d0640 1 --2- 172.21.15.40:0/854940722 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f560c0cdbe0 0x7f560c0d0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:54.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.627+0000 7f56119d0640 1 --2- 172.21.15.40:0/854940722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f560c155130 0x7f560c0c5550 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:54.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.627+0000 7f56119d0640 1 -- 172.21.15.40:0/854940722 >> 172.21.15.40:0/854940722 conn(0x7f560c067890 msgr2=0x7f560c06ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:54.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.627+0000 7f56119d0640 1 -- 172.21.15.40:0/854940722 shutdown_connections 2024-04-22T07:20:54.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.627+0000 7f56119d0640 1 -- 172.21.15.40:0/854940722 wait complete. 2024-04-22T07:20:54.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.628+0000 7f56119d0640 1 Processor -- start 2024-04-22T07:20:54.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.628+0000 7f56119d0640 1 -- start start 2024-04-22T07:20:54.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.629+0000 7f56119d0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f560c0cb3f0 0x7f560c147760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:54.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.629+0000 7f56119d0640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f560c0cdbe0 0x7f560c0ce570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:54.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.629+0000 7f56119d0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f560c155130 0x7f560c150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:54.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.629+0000 7f56119d0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f560c0cd3e0 con 0x7f560c155130 2024-04-22T07:20:54.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.629+0000 7f56119d0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f560c0cd100 con 0x7f560c0cb3f0 2024-04-22T07:20:54.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.629+0000 7f56119d0640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f560c0cd6c0 con 0x7f560c0cdbe0 2024-04-22T07:20:54.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.629+0000 7f560b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f560c155130 0x7f560c150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:54.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.629+0000 7f560b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f560c155130 0x7f560c150550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43608/0 (socket says 172.21.15.40:43608) 2024-04-22T07:20:54.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.629+0000 7f560b7fe640 1 -- 172.21.15.40:0/2466194081 learned_addr learned my addr 172.21.15.40:0/2466194081 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:54.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.629+0000 7f560affd640 1 --2- 172.21.15.40:0/2466194081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f560c0cb3f0 0x7f560c147760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:54.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.629+0000 7f560a7fc640 1 --2- 172.21.15.40:0/2466194081 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f560c0cdbe0 0x7f560c0ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:54.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.629+0000 7f560b7fe640 1 -- 172.21.15.40:0/2466194081 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f560c0cdbe0 msgr2=0x7f560c0ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:54.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.629+0000 7f560b7fe640 1 --2- 172.21.15.40:0/2466194081 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f560c0cdbe0 0x7f560c0ce570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:54.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.629+0000 7f560b7fe640 1 -- 172.21.15.40:0/2466194081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f560c0cb3f0 msgr2=0x7f560c147760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:54.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.629+0000 7f560b7fe640 1 --2- 172.21.15.40:0/2466194081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f560c0cb3f0 0x7f560c147760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:54.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.629+0000 7f560b7fe640 1 -- 172.21.15.40:0/2466194081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f560c0d10f0 con 0x7f560c155130 2024-04-22T07:20:54.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.629+0000 7f560a7fc640 1 --2- 172.21.15.40:0/2466194081 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f560c0cdbe0 0x7f560c0ce570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:20:54.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.629+0000 7f560b7fe640 1 --2- 172.21.15.40:0/2466194081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f560c155130 0x7f560c150550 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f560400e930 tx=0x7f560400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:54.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.629+0000 7f5603fff640 1 -- 172.21.15.40:0/2466194081 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5604017070 con 0x7f560c155130 2024-04-22T07:20:54.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.629+0000 7f5603fff640 1 -- 172.21.15.40:0/2466194081 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f560400c980 con 0x7f560c155130 2024-04-22T07:20:54.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.629+0000 7f56119d0640 1 -- 172.21.15.40:0/2466194081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f560c14e360 con 0x7f560c155130 2024-04-22T07:20:54.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.629+0000 7f5603fff640 1 -- 172.21.15.40:0/2466194081 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560400cd70 con 0x7f560c155130 2024-04-22T07:20:54.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.629+0000 7f56119d0640 1 -- 172.21.15.40:0/2466194081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f560c15b820 con 0x7f560c155130 2024-04-22T07:20:54.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.631+0000 7f56119d0640 1 -- 172.21.15.40:0/2466194081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f560c15ba60 con 0x7f560c155130 2024-04-22T07:20:54.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.631+0000 7f5603fff640 1 -- 172.21.15.40:0/2466194081 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f560401a070 con 0x7f560c155130 2024-04-22T07:20:54.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.631+0000 7f5603fff640 1 --2- 172.21.15.40:0/2466194081 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f55ec06c8f0 0x7f55ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:54.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.631+0000 7f5603fff640 1 -- 172.21.15.40:0/2466194081 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f560408ba90 con 0x7f560c155130 2024-04-22T07:20:54.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.631+0000 7f560affd640 1 --2- 172.21.15.40:0/2466194081 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f55ec06c8f0 0x7f55ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:54.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.632+0000 7f560affd640 1 --2- 172.21.15.40:0/2466194081 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f55ec06c8f0 0x7f55ec06edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f55fc036000 tx=0x7f55fc030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:54.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.636+0000 7f5603fff640 1 -- 172.21.15.40:0/2466194081 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f560c15ba60 con 0x7f560c155130 2024-04-22T07:20:54.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:54.861+0000 7f56119d0640 1 -- 172.21.15.40:0/2466194081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f560c04fdc0 con 0x7f560c155130 2024-04-22T07:20:55.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.860+0000 7f5603fff640 1 -- 172.21.15.40:0/2466194081 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7f5604059930 con 0x7f560c155130 2024-04-22T07:20:55.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.863+0000 7f56119d0640 1 -- 172.21.15.40:0/2466194081 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f55ec06c8f0 msgr2=0x7f55ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:55.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.863+0000 7f56119d0640 1 --2- 172.21.15.40:0/2466194081 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f55ec06c8f0 0x7f55ec06edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f55fc036000 tx=0x7f55fc030000 comp rx=0 tx=0).stop 2024-04-22T07:20:55.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.863+0000 7f56119d0640 1 -- 172.21.15.40:0/2466194081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f560c155130 msgr2=0x7f560c150550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:55.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.863+0000 7f56119d0640 1 --2- 172.21.15.40:0/2466194081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f560c155130 0x7f560c150550 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f560400e930 tx=0x7f560400edf0 comp rx=0 tx=0).stop 2024-04-22T07:20:55.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.863+0000 7f56119d0640 1 -- 172.21.15.40:0/2466194081 shutdown_connections 2024-04-22T07:20:55.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.863+0000 7f56119d0640 1 --2- 172.21.15.40:0/2466194081 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f55ec06c8f0 0x7f55ec06edb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:55.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.863+0000 7f56119d0640 1 --2- 172.21.15.40:0/2466194081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f560c155130 0x7f560c150550 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:55.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.863+0000 7f56119d0640 1 --2- 172.21.15.40:0/2466194081 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f560c0cdbe0 0x7f560c0ce570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:55.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.863+0000 7f56119d0640 1 --2- 172.21.15.40:0/2466194081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f560c0cb3f0 0x7f560c147760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:55.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.863+0000 7f56119d0640 1 -- 172.21.15.40:0/2466194081 >> 172.21.15.40:0/2466194081 conn(0x7f560c067890 msgr2=0x7f560c14a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:55.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.863+0000 7f56119d0640 1 -- 172.21.15.40:0/2466194081 shutdown_connections 2024-04-22T07:20:55.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.863+0000 7f56119d0640 1 -- 172.21.15.40:0/2466194081 wait complete. 2024-04-22T07:20:55.875 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-04-22T07:20:55.875 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-22T07:20:55.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.987+0000 7f2759fa4640 1 Processor -- start 2024-04-22T07:20:55.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.987+0000 7f2759fa4640 1 -- start start 2024-04-22T07:20:55.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.988+0000 7f2759fa4640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2754072d40 0x7f27540caee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:55.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.988+0000 7f2759fa4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f27540d09f0 0x7f27540d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:55.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.988+0000 7f2759fa4640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27540ccd80 con 0x7f2754154fb0 2024-04-22T07:20:55.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.988+0000 7f2759fa4640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f27540c5c50 con 0x7f27540d09f0 2024-04-22T07:20:55.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.988+0000 7f2759fa4640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f2754073160 con 0x7f2754072d40 2024-04-22T07:20:55.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.988+0000 7f2753fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f27540d09f0 0x7f27540d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:55.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.988+0000 7f2753fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f27540d09f0 0x7f27540d0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43624/0 (socket says 172.21.15.40:43624) 2024-04-22T07:20:55.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.988+0000 7f2753fff640 1 -- 172.21.15.40:0/3294506366 learned_addr learned my addr 172.21.15.40:0/3294506366 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:55.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.988+0000 7f2753fff640 1 -- 172.21.15.40:0/3294506366 >> v2:172.21.15.62:3300/0 conn(0x7f2754072d40 msgr2=0x7f27540caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:55.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.988+0000 7f2752ffd640 1 --2- 172.21.15.40:0/3294506366 >> v2:172.21.15.62:3300/0 conn(0x7f2754072d40 0x7f27540caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:55.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.988+0000 7f2753fff640 1 --2- 172.21.15.40:0/3294506366 >> v2:172.21.15.62:3300/0 conn(0x7f2754072d40 0x7f27540caee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:55.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.988+0000 7f2753fff640 1 -- 172.21.15.40:0/3294506366 >> v1:172.21.15.62:6789/0 conn(0x7f2754154fb0 legacy=0x7f275415e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:55.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.988+0000 7f2753fff640 1 -- 172.21.15.40:0/3294506366 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27540cc7e0 con 0x7f27540d09f0 2024-04-22T07:20:55.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.989+0000 7f2753fff640 1 --2- 172.21.15.40:0/3294506366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27540d09f0 0x7f27540d0e80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f27540c7830 tx=0x7f274c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23643ffd07b99dbc server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:55.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.989+0000 7f27527fc640 1 -- 172.21.15.40:0/3294506366 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c02ca80 con 0x7f27540d09f0 2024-04-22T07:20:55.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.989+0000 7f27527fc640 1 -- 172.21.15.40:0/3294506366 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f274c02cc20 con 0x7f27540d09f0 2024-04-22T07:20:55.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.989+0000 7f27527fc640 1 -- 172.21.15.40:0/3294506366 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c0343f0 con 0x7f27540d09f0 2024-04-22T07:20:55.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.990+0000 7f2759fa4640 1 -- 172.21.15.40:0/3294506366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27540d09f0 msgr2=0x7f27540d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:55.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.990+0000 7f2759fa4640 1 --2- 172.21.15.40:0/3294506366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27540d09f0 0x7f27540d0e80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f27540c7830 tx=0x7f274c02bee0 comp rx=0 tx=0).stop 2024-04-22T07:20:55.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.990+0000 7f2759fa4640 1 -- 172.21.15.40:0/3294506366 shutdown_connections 2024-04-22T07:20:55.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.990+0000 7f2759fa4640 1 --2- 172.21.15.40:0/3294506366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27540d09f0 0x7f27540d0e80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:55.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.990+0000 7f2759fa4640 1 --2- 172.21.15.40:0/3294506366 >> v2:172.21.15.62:3300/0 conn(0x7f2754072d40 0x7f27540caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:55.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.990+0000 7f2759fa4640 1 -- 172.21.15.40:0/3294506366 >> 172.21.15.40:0/3294506366 conn(0x7f27540676b0 msgr2=0x7f2754067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:55.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.990+0000 7f2759fa4640 1 -- 172.21.15.40:0/3294506366 shutdown_connections 2024-04-22T07:20:55.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.990+0000 7f2759fa4640 1 -- 172.21.15.40:0/3294506366 wait complete. 2024-04-22T07:20:55.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.991+0000 7f2759fa4640 1 Processor -- start 2024-04-22T07:20:55.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.991+0000 7f2759fa4640 1 -- start start 2024-04-22T07:20:55.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.992+0000 7f2759fa4640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2754072d40 0x7f27541580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:55.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.992+0000 7f2759fa4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27540d09f0 0x7f275415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:55.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.992+0000 7f2759fa4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2754154fb0 0x7f2754155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:55.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.992+0000 7f2759fa4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f27540cbbb0 con 0x7f2754154fb0 2024-04-22T07:20:55.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.992+0000 7f2759fa4640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f27540cb8d0 con 0x7f27540d09f0 2024-04-22T07:20:55.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.992+0000 7f2759fa4640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f27540cbe90 con 0x7f2754072d40 2024-04-22T07:20:55.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.992+0000 7f2753fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2754154fb0 0x7f2754155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:55.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.992+0000 7f2753fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2754154fb0 0x7f2754155cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43636/0 (socket says 172.21.15.40:43636) 2024-04-22T07:20:55.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.992+0000 7f2753fff640 1 -- 172.21.15.40:0/4054883122 learned_addr learned my addr 172.21.15.40:0/4054883122 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:55.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.992+0000 7f2752ffd640 1 --2- 172.21.15.40:0/4054883122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27540d09f0 0x7f275415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:55.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.992+0000 7f27537fe640 1 --2- 172.21.15.40:0/4054883122 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2754072d40 0x7f27541580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:55.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.992+0000 7f2753fff640 1 -- 172.21.15.40:0/4054883122 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2754072d40 msgr2=0x7f27541580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:55.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.992+0000 7f2753fff640 1 --2- 172.21.15.40:0/4054883122 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2754072d40 0x7f27541580d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:55.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.992+0000 7f2753fff640 1 -- 172.21.15.40:0/4054883122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27540d09f0 msgr2=0x7f275415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:55.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.992+0000 7f2753fff640 1 --2- 172.21.15.40:0/4054883122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27540d09f0 0x7f275415a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:55.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.992+0000 7f2753fff640 1 -- 172.21.15.40:0/4054883122 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27541f1000 con 0x7f2754154fb0 2024-04-22T07:20:55.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.992+0000 7f2752ffd640 1 --2- 172.21.15.40:0/4054883122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27540d09f0 0x7f275415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:20:55.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.992+0000 7f2753fff640 1 --2- 172.21.15.40:0/4054883122 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2754154fb0 0x7f2754155cc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f274c009f70 tx=0x7f274c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:55.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.992+0000 7f273bfff640 1 -- 172.21.15.40:0/4054883122 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c043020 con 0x7f2754154fb0 2024-04-22T07:20:55.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.993+0000 7f273bfff640 1 -- 172.21.15.40:0/4054883122 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f274c03e450 con 0x7f2754154fb0 2024-04-22T07:20:55.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.993+0000 7f2759fa4640 1 -- 172.21.15.40:0/4054883122 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27541f12e0 con 0x7f2754154fb0 2024-04-22T07:20:55.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.993+0000 7f273bfff640 1 -- 172.21.15.40:0/4054883122 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c009510 con 0x7f2754154fb0 2024-04-22T07:20:55.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.993+0000 7f2759fa4640 1 -- 172.21.15.40:0/4054883122 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27541f18a0 con 0x7f2754154fb0 2024-04-22T07:20:55.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.993+0000 7f2759fa4640 1 -- 172.21.15.40:0/4054883122 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2754153bf0 con 0x7f2754154fb0 2024-04-22T07:20:55.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.994+0000 7f273bfff640 1 -- 172.21.15.40:0/4054883122 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f274c046020 con 0x7f2754154fb0 2024-04-22T07:20:55.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.994+0000 7f273bfff640 1 --2- 172.21.15.40:0/4054883122 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f274006c8f0 0x7f274006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:55.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.994+0000 7f273bfff640 1 -- 172.21.15.40:0/4054883122 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f274c0ae4d0 con 0x7f2754154fb0 2024-04-22T07:20:55.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.994+0000 7f27537fe640 1 --2- 172.21.15.40:0/4054883122 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f274006c8f0 0x7f274006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:55.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.995+0000 7f27537fe640 1 --2- 172.21.15.40:0/4054883122 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f274006c8f0 0x7f274006edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2744006fd0 tx=0x7f2744008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:55.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:55.999+0000 7f273bfff640 1 -- 172.21.15.40:0/4054883122 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f274c04d030 con 0x7f2754154fb0 2024-04-22T07:20:56.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.223+0000 7f2759fa4640 1 -- 172.21.15.40:0/4054883122 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f275404fdc0 con 0x7f2754154fb0 2024-04-22T07:20:56.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.869+0000 7f273bfff640 1 -- 172.21.15.40:0/4054883122 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7f274c0ace20 con 0x7f2754154fb0 2024-04-22T07:20:56.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.871+0000 7f2759fa4640 1 -- 172.21.15.40:0/4054883122 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f274006c8f0 msgr2=0x7f274006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:56.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.871+0000 7f2759fa4640 1 --2- 172.21.15.40:0/4054883122 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f274006c8f0 0x7f274006edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2744006fd0 tx=0x7f2744008040 comp rx=0 tx=0).stop 2024-04-22T07:20:56.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.871+0000 7f2759fa4640 1 -- 172.21.15.40:0/4054883122 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2754154fb0 msgr2=0x7f2754155cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:56.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.871+0000 7f2759fa4640 1 --2- 172.21.15.40:0/4054883122 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2754154fb0 0x7f2754155cc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f274c009f70 tx=0x7f274c004a40 comp rx=0 tx=0).stop 2024-04-22T07:20:56.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.872+0000 7f2759fa4640 1 -- 172.21.15.40:0/4054883122 shutdown_connections 2024-04-22T07:20:56.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.872+0000 7f2759fa4640 1 --2- 172.21.15.40:0/4054883122 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f274006c8f0 0x7f274006edb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:56.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.872+0000 7f2759fa4640 1 --2- 172.21.15.40:0/4054883122 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2754154fb0 0x7f2754155cc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:56.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.872+0000 7f2759fa4640 1 --2- 172.21.15.40:0/4054883122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27540d09f0 0x7f275415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:56.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.872+0000 7f2759fa4640 1 --2- 172.21.15.40:0/4054883122 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2754072d40 0x7f27541580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:56.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.872+0000 7f2759fa4640 1 -- 172.21.15.40:0/4054883122 >> 172.21.15.40:0/4054883122 conn(0x7f27540676b0 msgr2=0x7f27540b3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:56.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.872+0000 7f2759fa4640 1 -- 172.21.15.40:0/4054883122 shutdown_connections 2024-04-22T07:20:56.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.872+0000 7f2759fa4640 1 -- 172.21.15.40:0/4054883122 wait complete. 2024-04-22T07:20:56.883 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-22T07:20:56.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.996+0000 7f3177fb6640 1 Processor -- start 2024-04-22T07:20:56.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.996+0000 7f3177fb6640 1 -- start start 2024-04-22T07:20:56.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.997+0000 7f3177fb6640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f317015ed60 0x7f31700cd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:56.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.997+0000 7f3177fb6640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f317015afd0 con 0x7f31700cd580 2024-04-22T07:20:56.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.997+0000 7f3177fb6640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f317015b290 con 0x7f31701550f0 2024-04-22T07:20:56.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.997+0000 7f3177fb6640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f317015b570 con 0x7f317015ed60 2024-04-22T07:20:56.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.997+0000 7f3176553640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f31700cd580 0x7f31700c5630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39868/0 (socket says 172.21.15.40:39868) 2024-04-22T07:20:56.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.997+0000 7f3176553640 1 -- 172.21.15.40:0/3800662805 learned_addr learned my addr 172.21.15.40:0/3800662805 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:20:56.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.997+0000 7f3175551640 1 --2- 172.21.15.40:0/3800662805 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f317015ed60 0x7f31700cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:56.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.997+0000 7f3174d50640 1 -- 172.21.15.40:0/3800662805 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1846022116 0 0) 0x7f317015afd0 con 0x7f31700cd580 2024-04-22T07:20:56.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.997+0000 7f3174d50640 1 -- 172.21.15.40:0/3800662805 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f315c003520 con 0x7f31700cd580 2024-04-22T07:20:56.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.997+0000 7f3174d50640 1 -- 172.21.15.40:0/3800662805 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1485577482 0 0) 0x7f317015b290 con 0x7f31701550f0 2024-04-22T07:20:56.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.997+0000 7f3174d50640 1 -- 172.21.15.40:0/3800662805 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f317015afd0 con 0x7f31701550f0 2024-04-22T07:20:56.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.997+0000 7f3174d50640 1 -- 172.21.15.40:0/3800662805 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3919378898 0 0) 0x7f315c003520 con 0x7f31700cd580 2024-04-22T07:20:56.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.997+0000 7f3174d50640 1 -- 172.21.15.40:0/3800662805 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f317015ed60 msgr2=0x7f31700cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:56.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.997+0000 7f3174d50640 1 --2- 172.21.15.40:0/3800662805 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f317015ed60 0x7f31700cd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:56.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.997+0000 7f3174d50640 1 -- 172.21.15.40:0/3800662805 >> v1:172.21.15.62:6789/0 conn(0x7f31701550f0 legacy=0x7f31700cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:56.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.997+0000 7f3174d50640 1 -- 172.21.15.40:0/3800662805 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f317015b850 con 0x7f31700cd580 2024-04-22T07:20:56.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.997+0000 7f3174d50640 1 -- 172.21.15.40:0/3800662805 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7f31680019f0 con 0x7f31700cd580 2024-04-22T07:20:56.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.997+0000 7f3174d50640 1 -- 172.21.15.40:0/3800662805 >> v1:172.21.15.40:6789/0 conn(0x7f31700cd580 legacy=0x7f31700c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:56.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.997+0000 7f3174d50640 1 --2- 172.21.15.40:0/3800662805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f315c003b70 0x7f315c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:56.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.997+0000 7f3174d50640 1 --2- 172.21.15.40:0/3800662805 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f317015ed60 0x7f315c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:56.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.997+0000 7f3174d50640 1 --2- 172.21.15.40:0/3800662805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f315c004d40 0x7f315c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:56.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.997+0000 7f3174d50640 1 -- 172.21.15.40:0/3800662805 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f317015b570 con 0x7f315c004d40 2024-04-22T07:20:56.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.997+0000 7f3174d50640 1 -- 172.21.15.40:0/3800662805 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f315c00baf0 con 0x7f315c003b70 2024-04-22T07:20:56.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.997+0000 7f3174d50640 1 -- 172.21.15.40:0/3800662805 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f315c00bcf0 con 0x7f317015ed60 2024-04-22T07:20:56.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.998+0000 7f3176553640 1 --2- 172.21.15.40:0/3800662805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f315c004d40 0x7f315c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:56.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.998+0000 7f3175d52640 1 --2- 172.21.15.40:0/3800662805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f315c003b70 0x7f315c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:56.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.998+0000 7f3175551640 1 --2- 172.21.15.40:0/3800662805 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f317015ed60 0x7f315c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:56.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.998+0000 7f3176553640 1 -- 172.21.15.40:0/3800662805 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f317015ed60 msgr2=0x7f315c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:56.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.998+0000 7f3176553640 1 --2- 172.21.15.40:0/3800662805 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f317015ed60 0x7f315c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:56.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.998+0000 7f3176553640 1 -- 172.21.15.40:0/3800662805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f315c003b70 msgr2=0x7f315c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:56.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.998+0000 7f3176553640 1 --2- 172.21.15.40:0/3800662805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f315c003b70 0x7f315c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:57.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.998+0000 7f3176553640 1 -- 172.21.15.40:0/3800662805 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315c003520 con 0x7f315c004d40 2024-04-22T07:20:57.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.998+0000 7f3175551640 1 --2- 172.21.15.40:0/3800662805 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f317015ed60 0x7f315c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:20:57.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.999+0000 7f3176553640 1 --2- 172.21.15.40:0/3800662805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f315c004d40 0x7f315c0051c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f316800a7f0 tx=0x7f315c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4adb6c25ec0081 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:57.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.999+0000 7f3174d50640 1 -- 172.21.15.40:0/3800662805 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316800a410 con 0x7f315c004d40 2024-04-22T07:20:57.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.999+0000 7f3174d50640 1 -- 172.21.15.40:0/3800662805 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3168034630 con 0x7f315c004d40 2024-04-22T07:20:57.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.999+0000 7f3174d50640 1 -- 172.21.15.40:0/3800662805 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316802ce60 con 0x7f315c004d40 2024-04-22T07:20:57.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.999+0000 7f3177fb6640 1 -- 172.21.15.40:0/3800662805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f315c004d40 msgr2=0x7f315c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:57.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.999+0000 7f3177fb6640 1 --2- 172.21.15.40:0/3800662805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f315c004d40 0x7f315c0051c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f316800a7f0 tx=0x7f315c005830 comp rx=0 tx=0).stop 2024-04-22T07:20:57.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.999+0000 7f3176553640 1 -- 172.21.15.40:0/3800662805 reap_dead start 2024-04-22T07:20:57.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.999+0000 7f3177fb6640 1 -- 172.21.15.40:0/3800662805 shutdown_connections 2024-04-22T07:20:57.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.999+0000 7f3177fb6640 1 -- 172.21.15.40:0/3800662805 >> 172.21.15.40:0/3800662805 conn(0x7f317006b920 msgr2=0x7f317006bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:57.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.999+0000 7f3177fb6640 1 -- 172.21.15.40:0/3800662805 shutdown_connections 2024-04-22T07:20:57.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:56.999+0000 7f3177fb6640 1 -- 172.21.15.40:0/3800662805 wait complete. 2024-04-22T07:20:57.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.001+0000 7f3177fb6640 1 Processor -- start 2024-04-22T07:20:57.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.001+0000 7f3177fb6640 1 -- start start 2024-04-22T07:20:57.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.001+0000 7f3177fb6640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f315c004d40 0x7f317015cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:57.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.001+0000 7f3177fb6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31700b30e0 0x7f317015d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:57.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.001+0000 7f3177fb6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f317014f360 0x7f31701592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:57.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.001+0000 7f3177fb6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f31701554d0 con 0x7f31700b30e0 2024-04-22T07:20:57.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.001+0000 7f3177fb6640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f317015f1b0 con 0x7f317014f360 2024-04-22T07:20:57.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.001+0000 7f3177fb6640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f31700cbcc0 con 0x7f315c004d40 2024-04-22T07:20:57.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.001+0000 7f3175551640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31700b30e0 0x7f317015d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:57.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.001+0000 7f3175551640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31700b30e0 0x7f317015d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43656/0 (socket says 172.21.15.40:43656) 2024-04-22T07:20:57.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.001+0000 7f3175551640 1 -- 172.21.15.40:0/1751258098 learned_addr learned my addr 172.21.15.40:0/1751258098 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:57.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.002+0000 7f3175d52640 1 --2- 172.21.15.40:0/1751258098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f315c004d40 0x7f317015cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:57.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.002+0000 7f3176553640 1 --2- 172.21.15.40:0/1751258098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f317014f360 0x7f31701592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:57.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.002+0000 7f3175551640 1 -- 172.21.15.40:0/1751258098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f315c004d40 msgr2=0x7f317015cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:57.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.002+0000 7f3175551640 1 --2- 172.21.15.40:0/1751258098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f315c004d40 0x7f317015cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:57.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.002+0000 7f3175551640 1 -- 172.21.15.40:0/1751258098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f317014f360 msgr2=0x7f31701592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:57.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.002+0000 7f3175551640 1 --2- 172.21.15.40:0/1751258098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f317014f360 0x7f31701592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:57.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.002+0000 7f3175551640 1 -- 172.21.15.40:0/1751258098 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3170150420 con 0x7f31700b30e0 2024-04-22T07:20:57.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.002+0000 7f3175d52640 1 --2- 172.21.15.40:0/1751258098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f315c004d40 0x7f317015cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:20:57.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.002+0000 7f3175551640 1 --2- 172.21.15.40:0/1751258098 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31700b30e0 0x7f317015d140 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f31600116d0 tx=0x7f3160011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:57.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.002+0000 7f31667fc640 1 -- 172.21.15.40:0/1751258098 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316000f960 con 0x7f31700b30e0 2024-04-22T07:20:57.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.002+0000 7f31667fc640 1 -- 172.21.15.40:0/1751258098 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f316000fb00 con 0x7f31700b30e0 2024-04-22T07:20:57.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.002+0000 7f3177fb6640 1 -- 172.21.15.40:0/1751258098 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3170150700 con 0x7f31700b30e0 2024-04-22T07:20:57.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.002+0000 7f31667fc640 1 -- 172.21.15.40:0/1751258098 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3160015460 con 0x7f31700b30e0 2024-04-22T07:20:57.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.002+0000 7f3177fb6640 1 -- 172.21.15.40:0/1751258098 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3170150cc0 con 0x7f31700b30e0 2024-04-22T07:20:57.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.003+0000 7f3177fb6640 1 -- 172.21.15.40:0/1751258098 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31700cce50 con 0x7f31700b30e0 2024-04-22T07:20:57.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.004+0000 7f31667fc640 1 -- 172.21.15.40:0/1751258098 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3160015600 con 0x7f31700b30e0 2024-04-22T07:20:57.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.004+0000 7f31667fc640 1 --2- 172.21.15.40:0/1751258098 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f315406c920 0x7f315406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:57.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.004+0000 7f31667fc640 1 -- 172.21.15.40:0/1751258098 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f316008c500 con 0x7f31700b30e0 2024-04-22T07:20:57.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.004+0000 7f3175d52640 1 --2- 172.21.15.40:0/1751258098 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f315406c920 0x7f315406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:57.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.004+0000 7f3175d52640 1 --2- 172.21.15.40:0/1751258098 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f315406c920 0x7f315406ede0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f316c005570 tx=0x7f316c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:57.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.008+0000 7f31667fc640 1 -- 172.21.15.40:0/1751258098 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3160019030 con 0x7f31700b30e0 2024-04-22T07:20:57.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.232+0000 7f3177fb6640 1 -- 172.21.15.40:0/1751258098 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f3170151900 con 0x7f31700b30e0 2024-04-22T07:20:57.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.874+0000 7f31667fc640 1 -- 172.21.15.40:0/1751258098 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v7) ==== 115+0+0 (secure 0 0 0) 0x7f316005a8a0 con 0x7f31700b30e0 2024-04-22T07:20:57.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.877+0000 7f3177fb6640 1 -- 172.21.15.40:0/1751258098 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f315406c920 msgr2=0x7f315406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:57.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.877+0000 7f3177fb6640 1 --2- 172.21.15.40:0/1751258098 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f315406c920 0x7f315406ede0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f316c005570 tx=0x7f316c009040 comp rx=0 tx=0).stop 2024-04-22T07:20:57.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.877+0000 7f3177fb6640 1 -- 172.21.15.40:0/1751258098 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31700b30e0 msgr2=0x7f317015d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:57.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.877+0000 7f3177fb6640 1 --2- 172.21.15.40:0/1751258098 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31700b30e0 0x7f317015d140 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f31600116d0 tx=0x7f3160011b90 comp rx=0 tx=0).stop 2024-04-22T07:20:57.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.877+0000 7f3177fb6640 1 -- 172.21.15.40:0/1751258098 shutdown_connections 2024-04-22T07:20:57.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.877+0000 7f3177fb6640 1 --2- 172.21.15.40:0/1751258098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f317014f360 0x7f31701592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:57.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.877+0000 7f3177fb6640 1 --2- 172.21.15.40:0/1751258098 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f315406c920 0x7f315406ede0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:57.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.877+0000 7f3177fb6640 1 --2- 172.21.15.40:0/1751258098 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31700b30e0 0x7f317015d140 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:57.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.877+0000 7f3177fb6640 1 --2- 172.21.15.40:0/1751258098 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f315c004d40 0x7f317015cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:57.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.877+0000 7f3177fb6640 1 -- 172.21.15.40:0/1751258098 >> 172.21.15.40:0/1751258098 conn(0x7f317006b920 msgr2=0x7f31700cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:57.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.877+0000 7f3177fb6640 1 -- 172.21.15.40:0/1751258098 shutdown_connections 2024-04-22T07:20:57.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.877+0000 7f3177fb6640 1 -- 172.21.15.40:0/1751258098 wait complete. 2024-04-22T07:20:57.888 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-22T07:20:57.888 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:20:57.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.997+0000 7f762a22c640 1 Processor -- start 2024-04-22T07:20:57.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.997+0000 7f762a22c640 1 -- start start 2024-04-22T07:20:57.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.998+0000 7f762a22c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f76240d0590 0x7f76240d09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:57.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.998+0000 7f762a22c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f762415b3e0 0x7f762415b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:57.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.998+0000 7f762a22c640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f762415bd90 con 0x7f7624154f50 2024-04-22T07:20:57.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.998+0000 7f762a22c640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f762415af50 con 0x7f76240d0590 2024-04-22T07:20:57.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.998+0000 7f762a22c640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f762415e6e0 con 0x7f762415b3e0 2024-04-22T07:20:57.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.998+0000 7f7623fff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f762415b3e0 0x7f762415b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:57.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.998+0000 7f7622ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f76240d0590 0x7f76240d09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:57.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.998+0000 7f7623fff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f762415b3e0 0x7f762415b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.40:49042/0 (socket says 172.21.15.40:49042) 2024-04-22T07:20:57.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.998+0000 7f7623fff640 1 -- 172.21.15.40:0/3168503475 learned_addr learned my addr 172.21.15.40:0/3168503475 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:57.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.998+0000 7f76237fe640 1 --1- 172.21.15.40:0/3168503475 >> v1:172.21.15.62:6789/0 conn(0x7f7624154f50 0x7f76240cc060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.40:36402/0 (socket says 172.21.15.40:36402) 2024-04-22T07:20:57.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.999+0000 7f7623fff640 1 -- 172.21.15.40:0/3168503475 >> v2:172.21.15.62:3300/0 conn(0x7f76240d0590 msgr2=0x7f76240d09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:57.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.999+0000 7f7623fff640 1 --2- 172.21.15.40:0/3168503475 >> v2:172.21.15.62:3300/0 conn(0x7f76240d0590 0x7f76240d09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:57.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.999+0000 7f7623fff640 1 -- 172.21.15.40:0/3168503475 >> v1:172.21.15.62:6789/0 conn(0x7f7624154f50 legacy=0x7f76240cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:57.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.999+0000 7f7623fff640 1 -- 172.21.15.40:0/3168503475 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f762415e9c0 con 0x7f762415b3e0 2024-04-22T07:20:57.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.999+0000 7f76227fc640 1 -- 172.21.15.40:0/3168503475 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 55209010 0 0) 0x7f7614001110 con 0x7f7624154f50 2024-04-22T07:20:57.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:57.999+0000 7f7622ffd640 1 --2- 172.21.15.40:0/3168503475 >> v2:172.21.15.62:3300/0 conn(0x7f76240d0590 0x7f76240d09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:20:57.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.000+0000 7f7623fff640 1 --2- 172.21.15.40:0/3168503475 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f762415b3e0 0x7f762415b850 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f761c009e50 tx=0x7f761c02bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5c0a3b55d789eb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:57.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.000+0000 7f76227fc640 1 -- 172.21.15.40:0/3168503475 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c02cb90 con 0x7f762415b3e0 2024-04-22T07:20:57.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.000+0000 7f76227fc640 1 -- 172.21.15.40:0/3168503475 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f761c02cd30 con 0x7f762415b3e0 2024-04-22T07:20:57.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.000+0000 7f76227fc640 1 -- 172.21.15.40:0/3168503475 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c034610 con 0x7f762415b3e0 2024-04-22T07:20:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.000+0000 7f762a22c640 1 -- 172.21.15.40:0/3168503475 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f762415b3e0 msgr2=0x7f762415b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.000+0000 7f762a22c640 1 --2- 172.21.15.40:0/3168503475 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f762415b3e0 0x7f762415b850 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f761c009e50 tx=0x7f761c02bff0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.000+0000 7f762a22c640 1 -- 172.21.15.40:0/3168503475 shutdown_connections 2024-04-22T07:20:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.000+0000 7f762a22c640 1 --2- 172.21.15.40:0/3168503475 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f762415b3e0 0x7f762415b850 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.000+0000 7f762a22c640 1 --2- 172.21.15.40:0/3168503475 >> v2:172.21.15.62:3300/0 conn(0x7f76240d0590 0x7f76240d09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.000+0000 7f762a22c640 1 -- 172.21.15.40:0/3168503475 >> 172.21.15.40:0/3168503475 conn(0x7f76240676b0 msgr2=0x7f7624067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.000+0000 7f762a22c640 1 -- 172.21.15.40:0/3168503475 shutdown_connections 2024-04-22T07:20:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.000+0000 7f762a22c640 1 -- 172.21.15.40:0/3168503475 wait complete. 2024-04-22T07:20:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.001+0000 7f762a22c640 1 Processor -- start 2024-04-22T07:20:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.002+0000 7f762a22c640 1 -- start start 2024-04-22T07:20:58.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.002+0000 7f762a22c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76240d0590 0x7f7624144560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:58.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.002+0000 7f762a22c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7624154f50 0x7f762415c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:58.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.002+0000 7f762a22c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f762415b3e0 0x7f762415cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:58.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.002+0000 7f762a22c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f762415f260 con 0x7f76240d0590 2024-04-22T07:20:58.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.002+0000 7f762a22c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f762415ef80 con 0x7f762415b3e0 2024-04-22T07:20:58.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.002+0000 7f762a22c640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f762415e3a0 con 0x7f7624154f50 2024-04-22T07:20:58.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.002+0000 7f76237fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76240d0590 0x7f7624144560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:58.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.003+0000 7f76237fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76240d0590 0x7f7624144560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43662/0 (socket says 172.21.15.40:43662) 2024-04-22T07:20:58.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.003+0000 7f76237fe640 1 -- 172.21.15.40:0/77725045 learned_addr learned my addr 172.21.15.40:0/77725045 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:58.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.003+0000 7f7623fff640 1 --2- 172.21.15.40:0/77725045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f762415b3e0 0x7f762415cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:58.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.003+0000 7f7622ffd640 1 --2- 172.21.15.40:0/77725045 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7624154f50 0x7f762415c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:58.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.003+0000 7f76237fe640 1 -- 172.21.15.40:0/77725045 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7624154f50 msgr2=0x7f762415c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:58.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.003+0000 7f76237fe640 1 --2- 172.21.15.40:0/77725045 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7624154f50 0x7f762415c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.003+0000 7f76237fe640 1 -- 172.21.15.40:0/77725045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f762415b3e0 msgr2=0x7f762415cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:58.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.003+0000 7f76237fe640 1 --2- 172.21.15.40:0/77725045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f762415b3e0 0x7f762415cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.003+0000 7f76237fe640 1 -- 172.21.15.40:0/77725045 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76241539b0 con 0x7f76240d0590 2024-04-22T07:20:58.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.003+0000 7f76237fe640 1 --2- 172.21.15.40:0/77725045 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76240d0590 0x7f7624144560 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f761400c780 tx=0x7f761400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:58.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.003+0000 7f760bfff640 1 -- 172.21.15.40:0/77725045 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7614018070 con 0x7f76240d0590 2024-04-22T07:20:58.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.003+0000 7f760bfff640 1 -- 172.21.15.40:0/77725045 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76140072d0 con 0x7f76240d0590 2024-04-22T07:20:58.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.003+0000 7f762a22c640 1 -- 172.21.15.40:0/77725045 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7624153c50 con 0x7f76240d0590 2024-04-22T07:20:58.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.003+0000 7f760bfff640 1 -- 172.21.15.40:0/77725045 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76140047e0 con 0x7f76240d0590 2024-04-22T07:20:58.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.003+0000 7f762a22c640 1 -- 172.21.15.40:0/77725045 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76241527e0 con 0x7f76240d0590 2024-04-22T07:20:58.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.004+0000 7f762a22c640 1 -- 172.21.15.40:0/77725045 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7624069d40 con 0x7f76240d0590 2024-04-22T07:20:58.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.005+0000 7f760bfff640 1 -- 172.21.15.40:0/77725045 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f761401b070 con 0x7f76240d0590 2024-04-22T07:20:58.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.005+0000 7f760bfff640 1 --2- 172.21.15.40:0/77725045 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f761006c920 0x7f761006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:58.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.005+0000 7f760bfff640 1 -- 172.21.15.40:0/77725045 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f761408acd0 con 0x7f76240d0590 2024-04-22T07:20:58.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.005+0000 7f7622ffd640 1 --2- 172.21.15.40:0/77725045 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f761006c920 0x7f761006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:58.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.006+0000 7f7622ffd640 1 --2- 172.21.15.40:0/77725045 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f761006c920 0x7f761006ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f76241eb620 tx=0x7f7618009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:58.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.009+0000 7f760bfff640 1 -- 172.21.15.40:0/77725045 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f762415bd90 con 0x7f76240d0590 2024-04-22T07:20:58.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.233+0000 7f762a22c640 1 -- 172.21.15.40:0/77725045 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f76240cb470 con 0x7f76240d0590 2024-04-22T07:20:58.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.233+0000 7f760bfff640 1 -- 172.21.15.40:0/77725045 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6816 (secure 0 0 0) 0x7f7614058b40 con 0x7f76240d0590 2024-04-22T07:20:58.232 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:20:58.232 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1193926607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1193926607},{"type":"v1","addr":"172.21.15.62:6835","nonce":1193926607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/602167189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":602167189},{"type":"v1","addr":"172.21.15.62:6837","nonce":602167189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2062933254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2062933254},{"type":"v1","addr":"172.21.15.40:6835","nonce":2062933254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3873524978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3873524978},{"type":"v1","addr":"172.21.15.40:6837","nonce":3873524978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/1922761385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":1922761385},{"type":"v1","addr":"172.21.15.40:6839","nonce":1922761385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:20:53.216204+0000","modified":"2024-04-22T07:20:57.234176+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.62:6836/2884673656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2884673656},{"type":"v1","addr":"172.21.15.62:6836","nonce":2884673656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-22T07:20:58.232 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 7 2024-04-22T07:20:58.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.235+0000 7f762a22c640 1 -- 172.21.15.40:0/77725045 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f761006c920 msgr2=0x7f761006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:58.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.235+0000 7f762a22c640 1 --2- 172.21.15.40:0/77725045 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f761006c920 0x7f761006ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f76241eb620 tx=0x7f7618009190 comp rx=0 tx=0).stop 2024-04-22T07:20:58.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.235+0000 7f762a22c640 1 -- 172.21.15.40:0/77725045 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76240d0590 msgr2=0x7f7624144560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:58.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.235+0000 7f762a22c640 1 --2- 172.21.15.40:0/77725045 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76240d0590 0x7f7624144560 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f761400c780 tx=0x7f761400cc40 comp rx=0 tx=0).stop 2024-04-22T07:20:58.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.235+0000 7f762a22c640 1 -- 172.21.15.40:0/77725045 shutdown_connections 2024-04-22T07:20:58.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.235+0000 7f762a22c640 1 --2- 172.21.15.40:0/77725045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f762415b3e0 0x7f762415cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.235+0000 7f762a22c640 1 --2- 172.21.15.40:0/77725045 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7624154f50 0x7f762415c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.235+0000 7f762a22c640 1 --2- 172.21.15.40:0/77725045 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f761006c920 0x7f761006ede0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.235+0000 7f762a22c640 1 --2- 172.21.15.40:0/77725045 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76240d0590 0x7f7624144560 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.235+0000 7f762a22c640 1 -- 172.21.15.40:0/77725045 >> 172.21.15.40:0/77725045 conn(0x7f76240676b0 msgr2=0x7f76240b5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:58.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.235+0000 7f762a22c640 1 -- 172.21.15.40:0/77725045 shutdown_connections 2024-04-22T07:20:58.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.236+0000 7f762a22c640 1 -- 172.21.15.40:0/77725045 wait complete. 2024-04-22T07:20:58.244 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:20:58.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.347+0000 7f7f4e175640 1 Processor -- start 2024-04-22T07:20:58.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.347+0000 7f7f4e175640 1 -- start start 2024-04-22T07:20:58.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.347+0000 7f7f4e175640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7f48067920 0x7f7f48070c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:58.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.347+0000 7f7f4e175640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7f48067d00 0x7f7f4815ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:58.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.347+0000 7f7f4e175640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f4806b920 0x7f7f4815b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:58.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.347+0000 7f7f4e175640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f7f48071190 con 0x7f7f48067920 2024-04-22T07:20:58.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.347+0000 7f7f4e175640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f7f4806ce40 con 0x7f7f48067d00 2024-04-22T07:20:58.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.347+0000 7f7f4e175640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f7f4806d120 con 0x7f7f4806b920 2024-04-22T07:20:58.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.348+0000 7f7f477fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7f48067920 0x7f7f48070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:58.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.348+0000 7f7f477fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7f48067920 0x7f7f48070c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43676/0 (socket says 172.21.15.40:43676) 2024-04-22T07:20:58.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.348+0000 7f7f477fe640 1 -- 172.21.15.40:0/137225880 learned_addr learned my addr 172.21.15.40:0/137225880 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:58.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.348+0000 7f7f46ffd640 1 --2- 172.21.15.40:0/137225880 >> v2:172.21.15.62:3300/0 conn(0x7f7f48067d00 0x7f7f4815ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:58.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.348+0000 7f7f47fff640 1 --2- 172.21.15.40:0/137225880 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f4806b920 0x7f7f4815b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:58.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.348+0000 7f7f477fe640 1 -- 172.21.15.40:0/137225880 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f4806b920 msgr2=0x7f7f4815b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:58.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.348+0000 7f7f477fe640 1 --2- 172.21.15.40:0/137225880 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f4806b920 0x7f7f4815b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.348+0000 7f7f477fe640 1 -- 172.21.15.40:0/137225880 >> v2:172.21.15.62:3300/0 conn(0x7f7f48067d00 msgr2=0x7f7f4815ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:58.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.348+0000 7f7f477fe640 1 --2- 172.21.15.40:0/137225880 >> v2:172.21.15.62:3300/0 conn(0x7f7f48067d00 0x7f7f4815ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.348+0000 7f7f477fe640 1 -- 172.21.15.40:0/137225880 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f480c87f0 con 0x7f7f48067920 2024-04-22T07:20:58.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.348+0000 7f7f47fff640 1 --2- 172.21.15.40:0/137225880 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f4806b920 0x7f7f4815b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:20:58.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.349+0000 7f7f477fe640 1 --2- 172.21.15.40:0/137225880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f48067920 0x7f7f48070c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7f4806e560 tx=0x7f7f3c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6ef113bb7108ce server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:58.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.349+0000 7f7f467fc640 1 -- 172.21.15.40:0/137225880 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c034070 con 0x7f7f48067920 2024-04-22T07:20:58.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.349+0000 7f7f467fc640 1 -- 172.21.15.40:0/137225880 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f3c030860 con 0x7f7f48067920 2024-04-22T07:20:58.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.349+0000 7f7f467fc640 1 -- 172.21.15.40:0/137225880 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c030c30 con 0x7f7f48067920 2024-04-22T07:20:58.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.349+0000 7f7f4e175640 1 -- 172.21.15.40:0/137225880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f48067920 msgr2=0x7f7f48070c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:58.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.349+0000 7f7f4e175640 1 --2- 172.21.15.40:0/137225880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f48067920 0x7f7f48070c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7f4806e560 tx=0x7f7f3c02b9a0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.349+0000 7f7f4e175640 1 -- 172.21.15.40:0/137225880 shutdown_connections 2024-04-22T07:20:58.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.349+0000 7f7f4e175640 1 --2- 172.21.15.40:0/137225880 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f4806b920 0x7f7f4815b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.349+0000 7f7f4e175640 1 --2- 172.21.15.40:0/137225880 >> v2:172.21.15.62:3300/0 conn(0x7f7f48067d00 0x7f7f4815ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.349+0000 7f7f4e175640 1 --2- 172.21.15.40:0/137225880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f48067920 0x7f7f48070c50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.349+0000 7f7f4e175640 1 -- 172.21.15.40:0/137225880 >> 172.21.15.40:0/137225880 conn(0x7f7f480c9e40 msgr2=0x7f7f480ca220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:58.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.349+0000 7f7f4e175640 1 -- 172.21.15.40:0/137225880 shutdown_connections 2024-04-22T07:20:58.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.349+0000 7f7f4e175640 1 -- 172.21.15.40:0/137225880 wait complete. 2024-04-22T07:20:58.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.351+0000 7f7f4e175640 1 Processor -- start 2024-04-22T07:20:58.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.351+0000 7f7f4e175640 1 -- start start 2024-04-22T07:20:58.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.351+0000 7f7f4e175640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f48067920 0x7f7f48142990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:58.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.351+0000 7f7f4e175640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f48067d00 0x7f7f48149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:58.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.351+0000 7f7f4e175640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f4806b920 0x7f7f481f0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:58.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.351+0000 7f7f4e175640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7f480c9090 con 0x7f7f48067920 2024-04-22T07:20:58.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.351+0000 7f7f4e175640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7f480c8db0 con 0x7f7f4806b920 2024-04-22T07:20:58.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.351+0000 7f7f4e175640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f7f4806ca90 con 0x7f7f48067d00 2024-04-22T07:20:58.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.352+0000 7f7f477fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f48067920 0x7f7f48142990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:58.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.352+0000 7f7f477fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f48067920 0x7f7f48142990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43682/0 (socket says 172.21.15.40:43682) 2024-04-22T07:20:58.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.352+0000 7f7f477fe640 1 -- 172.21.15.40:0/3157765335 learned_addr learned my addr 172.21.15.40:0/3157765335 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:58.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.352+0000 7f7f47fff640 1 --2- 172.21.15.40:0/3157765335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f4806b920 0x7f7f481f0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:58.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.352+0000 7f7f46ffd640 1 --2- 172.21.15.40:0/3157765335 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f48067d00 0x7f7f48149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:58.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.352+0000 7f7f477fe640 1 -- 172.21.15.40:0/3157765335 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f48067d00 msgr2=0x7f7f48149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:58.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.352+0000 7f7f477fe640 1 --2- 172.21.15.40:0/3157765335 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f48067d00 0x7f7f48149dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.352+0000 7f7f477fe640 1 -- 172.21.15.40:0/3157765335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f4806b920 msgr2=0x7f7f481f0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:58.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.352+0000 7f7f477fe640 1 --2- 172.21.15.40:0/3157765335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f4806b920 0x7f7f481f0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.352+0000 7f7f477fe640 1 -- 172.21.15.40:0/3157765335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f48142ed0 con 0x7f7f48067920 2024-04-22T07:20:58.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.352+0000 7f7f477fe640 1 --2- 172.21.15.40:0/3157765335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f48067920 0x7f7f48142990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c000c00 tx=0x7f7f3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:58.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.352+0000 7f7f2ffff640 1 -- 172.21.15.40:0/3157765335 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c034040 con 0x7f7f48067920 2024-04-22T07:20:58.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.352+0000 7f7f2ffff640 1 -- 172.21.15.40:0/3157765335 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f3c039d90 con 0x7f7f48067920 2024-04-22T07:20:58.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.352+0000 7f7f4e175640 1 -- 172.21.15.40:0/3157765335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f48148760 con 0x7f7f48067920 2024-04-22T07:20:58.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.352+0000 7f7f2ffff640 1 -- 172.21.15.40:0/3157765335 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c043610 con 0x7f7f48067920 2024-04-22T07:20:58.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.352+0000 7f7f4e175640 1 -- 172.21.15.40:0/3157765335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f4814a9e0 con 0x7f7f48067920 2024-04-22T07:20:58.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.353+0000 7f7f4e175640 1 -- 172.21.15.40:0/3157765335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f48068b20 con 0x7f7f48067920 2024-04-22T07:20:58.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.354+0000 7f7f2ffff640 1 -- 172.21.15.40:0/3157765335 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7f3c037070 con 0x7f7f48067920 2024-04-22T07:20:58.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.354+0000 7f7f2ffff640 1 --2- 172.21.15.40:0/3157765335 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f7f3406c8f0 0x7f7f3406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:58.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.354+0000 7f7f2ffff640 1 -- 172.21.15.40:0/3157765335 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7f3c0adc40 con 0x7f7f48067920 2024-04-22T07:20:58.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.354+0000 7f7f46ffd640 1 --2- 172.21.15.40:0/3157765335 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f7f3406c8f0 0x7f7f3406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:58.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.355+0000 7f7f46ffd640 1 --2- 172.21.15.40:0/3157765335 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f7f3406c8f0 0x7f7f3406edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7f48146c80 tx=0x7f7f38008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:58.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.359+0000 7f7f2ffff640 1 -- 172.21.15.40:0/3157765335 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7f3c03e070 con 0x7f7f48067920 2024-04-22T07:20:58.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.542+0000 7f7f4e175640 1 -- 172.21.15.40:0/3157765335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7f480ce1b0 con 0x7f7f48067920 2024-04-22T07:20:58.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.543+0000 7f7f2ffff640 1 -- 172.21.15.40:0/3157765335 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16537 (secure 0 0 0) 0x7f7f3c07b990 con 0x7f7f48067920 2024-04-22T07:20:58.541 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:20:58.542 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":23,"fsid":"dd5b16e4-89fe-4602-b37f-062846793158","created":"2024-04-22T07:20:29.488892+0000","modified":"2024-04-22T07:20:54.858120+0000","last_up_change":"2024-04-22T07:20:40.397383+0000","last_in_change":"2024-04-22T07:20:31.702551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:20:41.793179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:20:51.815779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:20:52.164265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32238b7e-228b-4a67-bfca-16e8f0020a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6801","nonce":1526385055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6803","nonce":1526385055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6807","nonce":1526385055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6805","nonce":1526385055}]},"public_addr":"172.21.15.40:6801/1526385055","cluster_addr":"172.21.15.40:6803/1526385055","heartbeat_back_addr":"172.21.15.40:6807/1526385055","heartbeat_front_addr":"172.21.15.40:6805/1526385055","state":["exists","up"]},{"osd":1,"uuid":"5ad8da43-39b1-4295-b4d1-0f1e1d06fc0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6809","nonce":623026645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6811","nonce":623026645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6815","nonce":623026645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6813","nonce":623026645}]},"public_addr":"172.21.15.40:6809/623026645","cluster_addr":"172.21.15.40:6811/623026645","heartbeat_back_addr":"172.21.15.40:6815/623026645","heartbeat_front_addr":"172.21.15.40:6813/623026645","state":["exists","up"]},{"osd":2,"uuid":"7d2c6d50-719d-4232-ad47-f04dcf1a8bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6820","nonce":1885686505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6824","nonce":1885686505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6831","nonce":1885686505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6828","nonce":1885686505}]},"public_addr":"172.21.15.40:6820/1885686505","cluster_addr":"172.21.15.40:6824/1885686505","heartbeat_back_addr":"172.21.15.40:6831/1885686505","heartbeat_front_addr":"172.21.15.40:6828/1885686505","state":["exists","up"]},{"osd":3,"uuid":"af42e7d6-a6bf-403e-92e7-162d7c4fbf0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6817","nonce":130276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6819","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6821","nonce":130276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6829","nonce":130276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6823","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6825","nonce":130276746}]},"public_addr":"172.21.15.40:6817/130276746","cluster_addr":"172.21.15.40:6821/130276746","heartbeat_back_addr":"172.21.15.40:6829/130276746","heartbeat_front_addr":"172.21.15.40:6825/130276746","state":["exists","up"]},{"osd":4,"uuid":"f8e89e0d-be96-4f19-88c0-69c408df7d98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6801","nonce":2251435758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6803","nonce":2251435758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6807","nonce":2251435758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6805","nonce":2251435758}]},"public_addr":"172.21.15.62:6801/2251435758","cluster_addr":"172.21.15.62:6803/2251435758","heartbeat_back_addr":"172.21.15.62:6807/2251435758","heartbeat_front_addr":"172.21.15.62:6805/2251435758","state":["exists","up"]},{"osd":5,"uuid":"ba6dc1bc-272b-4f80-b55f-40bc4a0c3ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6809","nonce":3509322231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6811","nonce":3509322231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6815","nonce":3509322231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6813","nonce":3509322231}]},"public_addr":"172.21.15.62:6809/3509322231","cluster_addr":"172.21.15.62:6811/3509322231","heartbeat_back_addr":"172.21.15.62:6815/3509322231","heartbeat_front_addr":"172.21.15.62:6813/3509322231","state":["exists","up"]},{"osd":6,"uuid":"834fcd74-14bf-45ec-a10a-0374f4ce9bf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6825","nonce":3094315954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6827","nonce":3094315954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6831","nonce":3094315954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6829","nonce":3094315954}]},"public_addr":"172.21.15.62:6825/3094315954","cluster_addr":"172.21.15.62:6827/3094315954","heartbeat_back_addr":"172.21.15.62:6831/3094315954","heartbeat_front_addr":"172.21.15.62:6829/3094315954","state":["exists","up"]},{"osd":7,"uuid":"831c9a73-960e-4d2e-b86a-33a6916be059","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6817","nonce":147453972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6819","nonce":147453972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6823","nonce":147453972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6821","nonce":147453972}]},"public_addr":"172.21.15.62:6817/147453972","cluster_addr":"172.21.15.62:6819/147453972","heartbeat_back_addr":"172.21.15.62:6823/147453972","heartbeat_front_addr":"172.21.15.62:6821/147453972","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.828738+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.873471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.908090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.894782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:37.686796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.801123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.852323+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.812139+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:20:58.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.546+0000 7f7f4e175640 1 -- 172.21.15.40:0/3157765335 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f7f3406c8f0 msgr2=0x7f7f3406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:58.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.546+0000 7f7f4e175640 1 --2- 172.21.15.40:0/3157765335 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f7f3406c8f0 0x7f7f3406edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7f48146c80 tx=0x7f7f38008040 comp rx=0 tx=0).stop 2024-04-22T07:20:58.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.546+0000 7f7f4e175640 1 -- 172.21.15.40:0/3157765335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f48067920 msgr2=0x7f7f48142990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:58.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.546+0000 7f7f4e175640 1 --2- 172.21.15.40:0/3157765335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f48067920 0x7f7f48142990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c000c00 tx=0x7f7f3c0046c0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.546+0000 7f7f4e175640 1 -- 172.21.15.40:0/3157765335 shutdown_connections 2024-04-22T07:20:58.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.546+0000 7f7f4e175640 1 --2- 172.21.15.40:0/3157765335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f4806b920 0x7f7f481f0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.546+0000 7f7f4e175640 1 --2- 172.21.15.40:0/3157765335 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7f48067d00 0x7f7f48149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.546+0000 7f7f4e175640 1 --2- 172.21.15.40:0/3157765335 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f7f3406c8f0 0x7f7f3406edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.546+0000 7f7f4e175640 1 --2- 172.21.15.40:0/3157765335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f48067920 0x7f7f48142990 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.546+0000 7f7f4e175640 1 -- 172.21.15.40:0/3157765335 >> 172.21.15.40:0/3157765335 conn(0x7f7f480c9e40 msgr2=0x7f7f480c7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:58.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.546+0000 7f7f4e175640 1 -- 172.21.15.40:0/3157765335 shutdown_connections 2024-04-22T07:20:58.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.546+0000 7f7f4e175640 1 -- 172.21.15.40:0/3157765335 wait complete. 2024-04-22T07:20:58.555 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-22T07:20:58.555 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T07:20:58.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.658+0000 7fa62b64e640 1 Processor -- start 2024-04-22T07:20:58.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.658+0000 7fa62b64e640 1 -- start start 2024-04-22T07:20:58.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.659+0000 7fa62b64e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa624151c00 0x7fa624158470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:58.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.659+0000 7fa62b64e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6240c5650 con 0x7fa6240c7d30 2024-04-22T07:20:58.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.659+0000 7fa62b64e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6240c3970 con 0x7fa62406ea90 2024-04-22T07:20:58.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.659+0000 7fa62b64e640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fa6240c3720 con 0x7fa624151c00 2024-04-22T07:20:58.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.659+0000 7fa629beb640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa6240c7d30 0x7fa6240c81e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39884/0 (socket says 172.21.15.40:39884) 2024-04-22T07:20:58.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.659+0000 7fa629beb640 1 -- 172.21.15.40:0/3822403615 learned_addr learned my addr 172.21.15.40:0/3822403615 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:20:58.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.659+0000 7fa6293ea640 1 --2- 172.21.15.40:0/3822403615 >> v2:172.21.15.62:3300/0 conn(0x7fa624151c00 0x7fa624158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:58.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.659+0000 7fa61bfff640 1 -- 172.21.15.40:0/3822403615 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1940029930 0 0) 0x7fa6240c5650 con 0x7fa6240c7d30 2024-04-22T07:20:58.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.659+0000 7fa61bfff640 1 -- 172.21.15.40:0/3822403615 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa610003520 con 0x7fa6240c7d30 2024-04-22T07:20:58.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.659+0000 7fa61bfff640 1 -- 172.21.15.40:0/3822403615 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4250430419 0 0) 0x7fa610003520 con 0x7fa6240c7d30 2024-04-22T07:20:58.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.659+0000 7fa61bfff640 1 -- 172.21.15.40:0/3822403615 >> v2:172.21.15.62:3300/0 conn(0x7fa624151c00 msgr2=0x7fa624158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:58.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.659+0000 7fa61bfff640 1 --2- 172.21.15.40:0/3822403615 >> v2:172.21.15.62:3300/0 conn(0x7fa624151c00 0x7fa624158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.659+0000 7fa61bfff640 1 -- 172.21.15.40:0/3822403615 >> v1:172.21.15.62:6789/0 conn(0x7fa62406ea90 legacy=0x7fa6240c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:58.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.659+0000 7fa61bfff640 1 -- 172.21.15.40:0/3822403615 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6240c3c50 con 0x7fa6240c7d30 2024-04-22T07:20:58.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.659+0000 7fa61bfff640 1 -- 172.21.15.40:0/3822403615 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7fa61c0019f0 con 0x7fa6240c7d30 2024-04-22T07:20:58.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.659+0000 7fa6293ea640 1 --2- 172.21.15.40:0/3822403615 >> v2:172.21.15.62:3300/0 conn(0x7fa624151c00 0x7fa624158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:20:58.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.659+0000 7fa61bfff640 1 -- 172.21.15.40:0/3822403615 >> v1:172.21.15.40:6789/0 conn(0x7fa6240c7d30 legacy=0x7fa6240c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:58.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.659+0000 7fa61bfff640 1 --2- 172.21.15.40:0/3822403615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6100039b0 0x7fa610003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:58.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.659+0000 7fa61bfff640 1 --2- 172.21.15.40:0/3822403615 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa610004800 0x7fa610004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:58.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.659+0000 7fa61bfff640 1 --2- 172.21.15.40:0/3822403615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6100051c0 0x7fa61000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:58.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.659+0000 7fa61bfff640 1 -- 172.21.15.40:0/3822403615 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa6240c3720 con 0x7fa6100051c0 2024-04-22T07:20:58.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.659+0000 7fa61bfff640 1 -- 172.21.15.40:0/3822403615 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa61000c040 con 0x7fa6100039b0 2024-04-22T07:20:58.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.659+0000 7fa61bfff640 1 -- 172.21.15.40:0/3822403615 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa61000e450 con 0x7fa610004800 2024-04-22T07:20:58.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.659+0000 7fa629beb640 1 --2- 172.21.15.40:0/3822403615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6100051c0 0x7fa61000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:58.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.660+0000 7fa6293ea640 1 --2- 172.21.15.40:0/3822403615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6100039b0 0x7fa610003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:58.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.660+0000 7fa628be9640 1 --2- 172.21.15.40:0/3822403615 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa610004800 0x7fa610004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:58.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.660+0000 7fa629beb640 1 -- 172.21.15.40:0/3822403615 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa610004800 msgr2=0x7fa610004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:58.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.660+0000 7fa629beb640 1 --2- 172.21.15.40:0/3822403615 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa610004800 0x7fa610004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.660+0000 7fa629beb640 1 -- 172.21.15.40:0/3822403615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6100039b0 msgr2=0x7fa610003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:58.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.660+0000 7fa629beb640 1 --2- 172.21.15.40:0/3822403615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa6100039b0 0x7fa610003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.660+0000 7fa629beb640 1 -- 172.21.15.40:0/3822403615 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa610003520 con 0x7fa6100051c0 2024-04-22T07:20:58.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.660+0000 7fa628be9640 1 --2- 172.21.15.40:0/3822403615 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa610004800 0x7fa610004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:20:58.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.660+0000 7fa629beb640 1 -- 172.21.15.40:0/3822403615 reap_dead start 2024-04-22T07:20:58.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.660+0000 7fa629beb640 1 --2- 172.21.15.40:0/3822403615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6100051c0 0x7fa61000b9c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa61c00a7b0 tx=0x7fa610005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d75cc87abb7cbb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:58.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.661+0000 7fa61bfff640 1 -- 172.21.15.40:0/3822403615 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61c00a3d0 con 0x7fa6100051c0 2024-04-22T07:20:58.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.661+0000 7fa61bfff640 1 -- 172.21.15.40:0/3822403615 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa61c034670 con 0x7fa6100051c0 2024-04-22T07:20:58.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.661+0000 7fa61bfff640 1 -- 172.21.15.40:0/3822403615 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61c034a60 con 0x7fa6100051c0 2024-04-22T07:20:58.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.661+0000 7fa62b64e640 1 -- 172.21.15.40:0/3822403615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6100051c0 msgr2=0x7fa61000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:58.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.661+0000 7fa62b64e640 1 --2- 172.21.15.40:0/3822403615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6100051c0 0x7fa61000b9c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa61c00a7b0 tx=0x7fa610005830 comp rx=0 tx=0).stop 2024-04-22T07:20:58.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.661+0000 7fa62b64e640 1 -- 172.21.15.40:0/3822403615 shutdown_connections 2024-04-22T07:20:58.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.661+0000 7fa62b64e640 1 --2- 172.21.15.40:0/3822403615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6100051c0 0x7fa61000b9c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.661+0000 7fa62b64e640 1 -- 172.21.15.40:0/3822403615 >> 172.21.15.40:0/3822403615 conn(0x7fa6240cc220 msgr2=0x7fa6240cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:58.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.661+0000 7fa62b64e640 1 -- 172.21.15.40:0/3822403615 shutdown_connections 2024-04-22T07:20:58.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.661+0000 7fa62b64e640 1 -- 172.21.15.40:0/3822403615 wait complete. 2024-04-22T07:20:58.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.662+0000 7fa62b64e640 1 Processor -- start 2024-04-22T07:20:58.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.662+0000 7fa62b64e640 1 -- start start 2024-04-22T07:20:58.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.663+0000 7fa62b64e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6100051c0 0x7fa6241e44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:58.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.663+0000 7fa62b64e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa624150a50 0x7fa6241e3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:58.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.663+0000 7fa62b64e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa62414fc40 0x7fa6240cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:58.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.663+0000 7fa62b64e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa6240ccfb0 con 0x7fa6100051c0 2024-04-22T07:20:58.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.663+0000 7fa62b64e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa6240c5bd0 con 0x7fa62414fc40 2024-04-22T07:20:58.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.663+0000 7fa62b64e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa6240c3f30 con 0x7fa624150a50 2024-04-22T07:20:58.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.663+0000 7fa6293ea640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6100051c0 0x7fa6241e44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:58.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.663+0000 7fa6293ea640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6100051c0 0x7fa6241e44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43706/0 (socket says 172.21.15.40:43706) 2024-04-22T07:20:58.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.663+0000 7fa6293ea640 1 -- 172.21.15.40:0/3875604063 learned_addr learned my addr 172.21.15.40:0/3875604063 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:58.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.663+0000 7fa6293ea640 1 -- 172.21.15.40:0/3875604063 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa624150a50 msgr2=0x7fa6241e3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:58.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.663+0000 7fa6293ea640 1 --2- 172.21.15.40:0/3875604063 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa624150a50 0x7fa6241e3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.663+0000 7fa6293ea640 1 -- 172.21.15.40:0/3875604063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa62414fc40 msgr2=0x7fa6240cb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:58.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.663+0000 7fa6293ea640 1 --2- 172.21.15.40:0/3875604063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa62414fc40 0x7fa6240cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.663+0000 7fa6293ea640 1 -- 172.21.15.40:0/3875604063 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6241f1400 con 0x7fa6100051c0 2024-04-22T07:20:58.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.664+0000 7fa6293ea640 1 --2- 172.21.15.40:0/3875604063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6100051c0 0x7fa6241e44b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa620011af0 tx=0x7fa62000f240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:58.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.664+0000 7fa619ffb640 1 -- 172.21.15.40:0/3875604063 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa62000fc80 con 0x7fa6100051c0 2024-04-22T07:20:58.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.664+0000 7fa619ffb640 1 -- 172.21.15.40:0/3875604063 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa62000fe20 con 0x7fa6100051c0 2024-04-22T07:20:58.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.664+0000 7fa62b64e640 1 -- 172.21.15.40:0/3875604063 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6241f16a0 con 0x7fa6100051c0 2024-04-22T07:20:58.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.664+0000 7fa619ffb640 1 -- 172.21.15.40:0/3875604063 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa620004260 con 0x7fa6100051c0 2024-04-22T07:20:58.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.664+0000 7fa62b64e640 1 -- 172.21.15.40:0/3875604063 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa62414f440 con 0x7fa6100051c0 2024-04-22T07:20:58.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.665+0000 7fa62b64e640 1 -- 172.21.15.40:0/3875604063 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa624069d40 con 0x7fa6100051c0 2024-04-22T07:20:58.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.665+0000 7fa619ffb640 1 -- 172.21.15.40:0/3875604063 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa620012040 con 0x7fa6100051c0 2024-04-22T07:20:58.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.666+0000 7fa619ffb640 1 --2- 172.21.15.40:0/3875604063 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fa60806c8f0 0x7fa60806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:58.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.666+0000 7fa619ffb640 1 -- 172.21.15.40:0/3875604063 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa62008bff0 con 0x7fa6100051c0 2024-04-22T07:20:58.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.666+0000 7fa628be9640 1 --2- 172.21.15.40:0/3875604063 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fa60806c8f0 0x7fa60806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:58.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.666+0000 7fa628be9640 1 --2- 172.21.15.40:0/3875604063 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fa60806c8f0 0x7fa60806edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa614007980 tx=0x7fa614009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:58.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.670+0000 7fa619ffb640 1 -- 172.21.15.40:0/3875604063 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa620019030 con 0x7fa6100051c0 2024-04-22T07:20:58.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.851+0000 7fa62b64e640 1 -- 172.21.15.40:0/3875604063 --> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa62414bc80 con 0x7fa60806c8f0 2024-04-22T07:20:58.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.857+0000 7fa619ffb640 1 -- 172.21.15.40:0/3875604063 <== mgr.4107 v2:172.21.15.40:6832/91163869 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250408 (secure 0 0 0) 0x7fa62414bc80 con 0x7fa60806c8f0 2024-04-22T07:20:58.859 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:20:58.860 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-22T07:20:58.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.860+0000 7fa62b64e640 1 -- 172.21.15.40:0/3875604063 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fa60806c8f0 msgr2=0x7fa60806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:58.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.860+0000 7fa62b64e640 1 --2- 172.21.15.40:0/3875604063 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fa60806c8f0 0x7fa60806edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa614007980 tx=0x7fa614009040 comp rx=0 tx=0).stop 2024-04-22T07:20:58.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.860+0000 7fa62b64e640 1 -- 172.21.15.40:0/3875604063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6100051c0 msgr2=0x7fa6241e44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:58.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.860+0000 7fa62b64e640 1 --2- 172.21.15.40:0/3875604063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6100051c0 0x7fa6241e44b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa620011af0 tx=0x7fa62000f240 comp rx=0 tx=0).stop 2024-04-22T07:20:58.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.860+0000 7fa62b64e640 1 -- 172.21.15.40:0/3875604063 shutdown_connections 2024-04-22T07:20:58.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.860+0000 7fa62b64e640 1 --2- 172.21.15.40:0/3875604063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa62414fc40 0x7fa6240cb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.860+0000 7fa62b64e640 1 --2- 172.21.15.40:0/3875604063 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa624150a50 0x7fa6241e3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.860+0000 7fa62b64e640 1 --2- 172.21.15.40:0/3875604063 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fa60806c8f0 0x7fa60806edb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.860+0000 7fa62b64e640 1 --2- 172.21.15.40:0/3875604063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6100051c0 0x7fa6241e44b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:58.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.860+0000 7fa62b64e640 1 -- 172.21.15.40:0/3875604063 >> 172.21.15.40:0/3875604063 conn(0x7fa6240cc220 msgr2=0x7fa6240c68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:58.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.861+0000 7fa62b64e640 1 -- 172.21.15.40:0/3875604063 shutdown_connections 2024-04-22T07:20:58.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:58.861+0000 7fa62b64e640 1 -- 172.21.15.40:0/3875604063 wait complete. 2024-04-22T07:20:58.871 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-04-22T07:20:57.777573+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219060,"kb_used_data":2876,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755660,"statfs":{"total":773094113280,"available":772869795840,"internally_reserved":0,"allocated":2945024,"data_stored":1773949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.941312"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977886+0000","last_change":"2024-04-22T07:20:53.873662+0000","last_active":"2024-04-22T07:20:54.977886+0000","last_peered":"2024-04-22T07:20:54.977886+0000","last_clean":"2024-04-22T07:20:54.977886+0000","last_became_active":"2024-04-22T07:20:53.873384+0000","last_became_peered":"2024-04-22T07:20:53.873384+0000","last_unstale":"2024-04-22T07:20:54.977886+0000","last_undegraded":"2024-04-22T07:20:54.977886+0000","last_fullsized":"2024-04-22T07:20:54.977886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980006+0000","last_change":"2024-04-22T07:20:53.870454+0000","last_active":"2024-04-22T07:20:54.980006+0000","last_peered":"2024-04-22T07:20:54.980006+0000","last_clean":"2024-04-22T07:20:54.980006+0000","last_became_active":"2024-04-22T07:20:53.869964+0000","last_became_peered":"2024-04-22T07:20:53.869964+0000","last_unstale":"2024-04-22T07:20:54.980006+0000","last_undegraded":"2024-04-22T07:20:54.980006+0000","last_fullsized":"2024-04-22T07:20:54.980006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979125+0000","last_change":"2024-04-22T07:20:53.871145+0000","last_active":"2024-04-22T07:20:54.979125+0000","last_peered":"2024-04-22T07:20:54.979125+0000","last_clean":"2024-04-22T07:20:54.979125+0000","last_became_active":"2024-04-22T07:20:53.870819+0000","last_became_peered":"2024-04-22T07:20:53.870819+0000","last_unstale":"2024-04-22T07:20:54.979125+0000","last_undegraded":"2024-04-22T07:20:54.979125+0000","last_fullsized":"2024-04-22T07:20:54.979125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:02:16.373202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861622+0000","last_change":"2024-04-22T07:20:53.870458+0000","last_active":"2024-04-22T07:20:54.861622+0000","last_peered":"2024-04-22T07:20:54.861622+0000","last_clean":"2024-04-22T07:20:54.861622+0000","last_became_active":"2024-04-22T07:20:53.870125+0000","last_became_peered":"2024-04-22T07:20:53.870125+0000","last_unstale":"2024-04-22T07:20:54.861622+0000","last_undegraded":"2024-04-22T07:20:54.861622+0000","last_fullsized":"2024-04-22T07:20:54.861622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977801+0000","last_change":"2024-04-22T07:20:53.877301+0000","last_active":"2024-04-22T07:20:54.977801+0000","last_peered":"2024-04-22T07:20:54.977801+0000","last_clean":"2024-04-22T07:20:54.977801+0000","last_became_active":"2024-04-22T07:20:53.874941+0000","last_became_peered":"2024-04-22T07:20:53.874941+0000","last_unstale":"2024-04-22T07:20:54.977801+0000","last_undegraded":"2024-04-22T07:20:54.977801+0000","last_fullsized":"2024-04-22T07:20:54.977801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:52.686229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861484+0000","last_change":"2024-04-22T07:20:53.869735+0000","last_active":"2024-04-22T07:20:54.861484+0000","last_peered":"2024-04-22T07:20:54.861484+0000","last_clean":"2024-04-22T07:20:54.861484+0000","last_became_active":"2024-04-22T07:20:53.869369+0000","last_became_peered":"2024-04-22T07:20:53.869369+0000","last_unstale":"2024-04-22T07:20:54.861484+0000","last_undegraded":"2024-04-22T07:20:54.861484+0000","last_fullsized":"2024-04-22T07:20:54.861484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:27.624819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977494+0000","last_change":"2024-04-22T07:20:53.873492+0000","last_active":"2024-04-22T07:20:54.977494+0000","last_peered":"2024-04-22T07:20:54.977494+0000","last_clean":"2024-04-22T07:20:54.977494+0000","last_became_active":"2024-04-22T07:20:53.873220+0000","last_became_peered":"2024-04-22T07:20:53.873220+0000","last_unstale":"2024-04-22T07:20:54.977494+0000","last_undegraded":"2024-04-22T07:20:54.977494+0000","last_fullsized":"2024-04-22T07:20:54.977494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:35:26.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979018+0000","last_change":"2024-04-22T07:20:53.875847+0000","last_active":"2024-04-22T07:20:54.979018+0000","last_peered":"2024-04-22T07:20:54.979018+0000","last_clean":"2024-04-22T07:20:54.979018+0000","last_became_active":"2024-04-22T07:20:53.875017+0000","last_became_peered":"2024-04-22T07:20:53.875017+0000","last_unstale":"2024-04-22T07:20:54.979018+0000","last_undegraded":"2024-04-22T07:20:54.979018+0000","last_fullsized":"2024-04-22T07:20:54.979018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:07.080135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863086+0000","last_change":"2024-04-22T07:20:53.869174+0000","last_active":"2024-04-22T07:20:54.863086+0000","last_peered":"2024-04-22T07:20:54.863086+0000","last_clean":"2024-04-22T07:20:54.863086+0000","last_became_active":"2024-04-22T07:20:53.868906+0000","last_became_peered":"2024-04-22T07:20:53.868906+0000","last_unstale":"2024-04-22T07:20:54.863086+0000","last_undegraded":"2024-04-22T07:20:54.863086+0000","last_fullsized":"2024-04-22T07:20:54.863086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977893+0000","last_change":"2024-04-22T07:20:53.874933+0000","last_active":"2024-04-22T07:20:54.977893+0000","last_peered":"2024-04-22T07:20:54.977893+0000","last_clean":"2024-04-22T07:20:54.977893+0000","last_became_active":"2024-04-22T07:20:53.874673+0000","last_became_peered":"2024-04-22T07:20:53.874673+0000","last_unstale":"2024-04-22T07:20:54.977893+0000","last_undegraded":"2024-04-22T07:20:54.977893+0000","last_fullsized":"2024-04-22T07:20:54.977893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977684+0000","last_change":"2024-04-22T07:20:53.874909+0000","last_active":"2024-04-22T07:20:54.977684+0000","last_peered":"2024-04-22T07:20:54.977684+0000","last_clean":"2024-04-22T07:20:54.977684+0000","last_became_active":"2024-04-22T07:20:53.873945+0000","last_became_peered":"2024-04-22T07:20:53.873945+0000","last_unstale":"2024-04-22T07:20:54.977684+0000","last_undegraded":"2024-04-22T07:20:54.977684+0000","last_fullsized":"2024-04-22T07:20:54.977684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:53.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977652+0000","last_change":"2024-04-22T07:20:53.878344+0000","last_active":"2024-04-22T07:20:54.977652+0000","last_peered":"2024-04-22T07:20:54.977652+0000","last_clean":"2024-04-22T07:20:54.977652+0000","last_became_active":"2024-04-22T07:20:53.877192+0000","last_became_peered":"2024-04-22T07:20:53.877192+0000","last_unstale":"2024-04-22T07:20:54.977652+0000","last_undegraded":"2024-04-22T07:20:54.977652+0000","last_fullsized":"2024-04-22T07:20:54.977652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:42:03.637655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979583+0000","last_change":"2024-04-22T07:20:53.879419+0000","last_active":"2024-04-22T07:20:54.979583+0000","last_peered":"2024-04-22T07:20:54.979583+0000","last_clean":"2024-04-22T07:20:54.979583+0000","last_became_active":"2024-04-22T07:20:53.879070+0000","last_became_peered":"2024-04-22T07:20:53.879070+0000","last_unstale":"2024-04-22T07:20:54.979583+0000","last_undegraded":"2024-04-22T07:20:54.979583+0000","last_fullsized":"2024-04-22T07:20:54.979583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979592+0000","last_change":"2024-04-22T07:20:53.877395+0000","last_active":"2024-04-22T07:20:54.979592+0000","last_peered":"2024-04-22T07:20:54.979592+0000","last_clean":"2024-04-22T07:20:54.979592+0000","last_became_active":"2024-04-22T07:20:53.877116+0000","last_became_peered":"2024-04-22T07:20:53.877116+0000","last_unstale":"2024-04-22T07:20:54.979592+0000","last_undegraded":"2024-04-22T07:20:54.979592+0000","last_fullsized":"2024-04-22T07:20:54.979592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:21:25.001413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979310+0000","last_change":"2024-04-22T07:20:53.875156+0000","last_active":"2024-04-22T07:20:54.979310+0000","last_peered":"2024-04-22T07:20:54.979310+0000","last_clean":"2024-04-22T07:20:54.979310+0000","last_became_active":"2024-04-22T07:20:53.874468+0000","last_became_peered":"2024-04-22T07:20:53.874468+0000","last_unstale":"2024-04-22T07:20:54.979310+0000","last_undegraded":"2024-04-22T07:20:54.979310+0000","last_fullsized":"2024-04-22T07:20:54.979310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:42:03.637655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862585+0000","last_change":"2024-04-22T07:20:53.867178+0000","last_active":"2024-04-22T07:20:54.862585+0000","last_peered":"2024-04-22T07:20:54.862585+0000","last_clean":"2024-04-22T07:20:54.862585+0000","last_became_active":"2024-04-22T07:20:53.865491+0000","last_became_peered":"2024-04-22T07:20:53.865491+0000","last_unstale":"2024-04-22T07:20:54.862585+0000","last_undegraded":"2024-04-22T07:20:54.862585+0000","last_fullsized":"2024-04-22T07:20:54.862585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863583+0000","last_change":"2024-04-22T07:20:53.876797+0000","last_active":"2024-04-22T07:20:54.863583+0000","last_peered":"2024-04-22T07:20:54.863583+0000","last_clean":"2024-04-22T07:20:54.863583+0000","last_became_active":"2024-04-22T07:20:53.876321+0000","last_became_peered":"2024-04-22T07:20:53.876321+0000","last_unstale":"2024-04-22T07:20:54.863583+0000","last_undegraded":"2024-04-22T07:20:54.863583+0000","last_fullsized":"2024-04-22T07:20:54.863583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:22:45.699676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980360+0000","last_change":"2024-04-22T07:20:53.868760+0000","last_active":"2024-04-22T07:20:54.980360+0000","last_peered":"2024-04-22T07:20:54.980360+0000","last_clean":"2024-04-22T07:20:54.980360+0000","last_became_active":"2024-04-22T07:20:53.868441+0000","last_became_peered":"2024-04-22T07:20:53.868441+0000","last_unstale":"2024-04-22T07:20:54.980360+0000","last_undegraded":"2024-04-22T07:20:54.980360+0000","last_fullsized":"2024-04-22T07:20:54.980360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863503+0000","last_change":"2024-04-22T07:20:53.864806+0000","last_active":"2024-04-22T07:20:54.863503+0000","last_peered":"2024-04-22T07:20:54.863503+0000","last_clean":"2024-04-22T07:20:54.863503+0000","last_became_active":"2024-04-22T07:20:53.864535+0000","last_became_peered":"2024-04-22T07:20:53.864535+0000","last_unstale":"2024-04-22T07:20:54.863503+0000","last_undegraded":"2024-04-22T07:20:54.863503+0000","last_fullsized":"2024-04-22T07:20:54.863503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:22:07.227993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977721+0000","last_change":"2024-04-22T07:20:53.878013+0000","last_active":"2024-04-22T07:20:54.977721+0000","last_peered":"2024-04-22T07:20:54.977721+0000","last_clean":"2024-04-22T07:20:54.977721+0000","last_became_active":"2024-04-22T07:20:53.876641+0000","last_became_peered":"2024-04-22T07:20:53.876641+0000","last_unstale":"2024-04-22T07:20:54.977721+0000","last_undegraded":"2024-04-22T07:20:54.977721+0000","last_fullsized":"2024-04-22T07:20:54.977721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:45:15.519469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-22T07:20:52.835850+0000","last_change":"2024-04-22T07:20:52.835850+0000","last_active":"2024-04-22T07:20:52.835850+0000","last_peered":"2024-04-22T07:20:52.835850+0000","last_clean":"2024-04-22T07:20:52.835850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:52.835850+0000","last_undegraded":"2024-04-22T07:20:52.835850+0000","last_fullsized":"2024-04-22T07:20:52.835850+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862823+0000","last_change":"2024-04-22T07:20:53.867684+0000","last_active":"2024-04-22T07:20:54.862823+0000","last_peered":"2024-04-22T07:20:54.862823+0000","last_clean":"2024-04-22T07:20:54.862823+0000","last_became_active":"2024-04-22T07:20:53.867403+0000","last_became_peered":"2024-04-22T07:20:53.867403+0000","last_unstale":"2024-04-22T07:20:54.862823+0000","last_undegraded":"2024-04-22T07:20:54.862823+0000","last_fullsized":"2024-04-22T07:20:54.862823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979253+0000","last_change":"2024-04-22T07:20:53.869595+0000","last_active":"2024-04-22T07:20:54.979253+0000","last_peered":"2024-04-22T07:20:54.979253+0000","last_clean":"2024-04-22T07:20:54.979253+0000","last_became_active":"2024-04-22T07:20:53.868519+0000","last_became_peered":"2024-04-22T07:20:53.868519+0000","last_unstale":"2024-04-22T07:20:54.979253+0000","last_undegraded":"2024-04-22T07:20:54.979253+0000","last_fullsized":"2024-04-22T07:20:54.979253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:35:26.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862610+0000","last_change":"2024-04-22T07:20:53.865275+0000","last_active":"2024-04-22T07:20:54.862610+0000","last_peered":"2024-04-22T07:20:54.862610+0000","last_clean":"2024-04-22T07:20:54.862610+0000","last_became_active":"2024-04-22T07:20:53.865026+0000","last_became_peered":"2024-04-22T07:20:53.865026+0000","last_unstale":"2024-04-22T07:20:54.862610+0000","last_undegraded":"2024-04-22T07:20:54.862610+0000","last_fullsized":"2024-04-22T07:20:54.862610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:48:40.630407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979451+0000","last_change":"2024-04-22T07:20:53.873457+0000","last_active":"2024-04-22T07:20:54.979451+0000","last_peered":"2024-04-22T07:20:54.979451+0000","last_clean":"2024-04-22T07:20:54.979451+0000","last_became_active":"2024-04-22T07:20:53.873147+0000","last_became_peered":"2024-04-22T07:20:53.873147+0000","last_unstale":"2024-04-22T07:20:54.979451+0000","last_undegraded":"2024-04-22T07:20:54.979451+0000","last_fullsized":"2024-04-22T07:20:54.979451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:53.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861933+0000","last_change":"2024-04-22T07:20:53.865327+0000","last_active":"2024-04-22T07:20:54.861933+0000","last_peered":"2024-04-22T07:20:54.861933+0000","last_clean":"2024-04-22T07:20:54.861933+0000","last_became_active":"2024-04-22T07:20:53.865030+0000","last_became_peered":"2024-04-22T07:20:53.865030+0000","last_unstale":"2024-04-22T07:20:54.861933+0000","last_undegraded":"2024-04-22T07:20:54.861933+0000","last_fullsized":"2024-04-22T07:20:54.861933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979550+0000","last_change":"2024-04-22T07:20:53.876792+0000","last_active":"2024-04-22T07:20:54.979550+0000","last_peered":"2024-04-22T07:20:54.979550+0000","last_clean":"2024-04-22T07:20:54.979550+0000","last_became_active":"2024-04-22T07:20:53.876446+0000","last_became_peered":"2024-04-22T07:20:53.876446+0000","last_unstale":"2024-04-22T07:20:54.979550+0000","last_undegraded":"2024-04-22T07:20:54.979550+0000","last_fullsized":"2024-04-22T07:20:54.979550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:34.943561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979292+0000","last_change":"2024-04-22T07:20:53.878147+0000","last_active":"2024-04-22T07:20:54.979292+0000","last_peered":"2024-04-22T07:20:54.979292+0000","last_clean":"2024-04-22T07:20:54.979292+0000","last_became_active":"2024-04-22T07:20:53.877867+0000","last_became_peered":"2024-04-22T07:20:53.877867+0000","last_unstale":"2024-04-22T07:20:54.979292+0000","last_undegraded":"2024-04-22T07:20:54.979292+0000","last_fullsized":"2024-04-22T07:20:54.979292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979201+0000","last_change":"2024-04-22T07:20:53.872447+0000","last_active":"2024-04-22T07:20:54.979201+0000","last_peered":"2024-04-22T07:20:54.979201+0000","last_clean":"2024-04-22T07:20:54.979201+0000","last_became_active":"2024-04-22T07:20:53.871862+0000","last_became_peered":"2024-04-22T07:20:53.871862+0000","last_unstale":"2024-04-22T07:20:54.979201+0000","last_undegraded":"2024-04-22T07:20:54.979201+0000","last_fullsized":"2024-04-22T07:20:54.979201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:08:33.063318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862747+0000","last_change":"2024-04-22T07:20:53.862483+0000","last_active":"2024-04-22T07:20:54.862747+0000","last_peered":"2024-04-22T07:20:54.862747+0000","last_clean":"2024-04-22T07:20:54.862747+0000","last_became_active":"2024-04-22T07:20:53.862199+0000","last_became_peered":"2024-04-22T07:20:53.862199+0000","last_unstale":"2024-04-22T07:20:54.862747+0000","last_undegraded":"2024-04-22T07:20:54.862747+0000","last_fullsized":"2024-04-22T07:20:54.862747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:10:12.276510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979743+0000","last_change":"2024-04-22T07:20:53.872507+0000","last_active":"2024-04-22T07:20:54.979743+0000","last_peered":"2024-04-22T07:20:54.979743+0000","last_clean":"2024-04-22T07:20:54.979743+0000","last_became_active":"2024-04-22T07:20:53.872199+0000","last_became_peered":"2024-04-22T07:20:53.872199+0000","last_unstale":"2024-04-22T07:20:54.979743+0000","last_undegraded":"2024-04-22T07:20:54.979743+0000","last_fullsized":"2024-04-22T07:20:54.979743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:09.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861399+0000","last_change":"2024-04-22T07:20:53.863946+0000","last_active":"2024-04-22T07:20:54.861399+0000","last_peered":"2024-04-22T07:20:54.861399+0000","last_clean":"2024-04-22T07:20:54.861399+0000","last_became_active":"2024-04-22T07:20:53.863688+0000","last_became_peered":"2024-04-22T07:20:53.863688+0000","last_unstale":"2024-04-22T07:20:54.861399+0000","last_undegraded":"2024-04-22T07:20:54.861399+0000","last_fullsized":"2024-04-22T07:20:54.861399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862947+0000","last_change":"2024-04-22T07:20:53.874785+0000","last_active":"2024-04-22T07:20:54.862947+0000","last_peered":"2024-04-22T07:20:54.862947+0000","last_clean":"2024-04-22T07:20:54.862947+0000","last_became_active":"2024-04-22T07:20:53.874524+0000","last_became_peered":"2024-04-22T07:20:53.874524+0000","last_unstale":"2024-04-22T07:20:54.862947+0000","last_undegraded":"2024-04-22T07:20:54.862947+0000","last_fullsized":"2024-04-22T07:20:54.862947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978859+0000","last_change":"2024-04-22T07:20:52.860712+0000","last_active":"2024-04-22T07:20:54.978859+0000","last_peered":"2024-04-22T07:20:54.978859+0000","last_clean":"2024-04-22T07:20:54.978859+0000","last_became_active":"2024-04-22T07:20:52.860015+0000","last_became_peered":"2024-04-22T07:20:52.860015+0000","last_unstale":"2024-04-22T07:20:54.978859+0000","last_undegraded":"2024-04-22T07:20:54.978859+0000","last_fullsized":"2024-04-22T07:20:54.978859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:59:32.487127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-22T07:20:52.835850+0000","last_change":"2024-04-22T07:20:52.835850+0000","last_active":"2024-04-22T07:20:52.835850+0000","last_peered":"2024-04-22T07:20:52.835850+0000","last_clean":"2024-04-22T07:20:52.835850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:52.835850+0000","last_undegraded":"2024-04-22T07:20:52.835850+0000","last_fullsized":"2024-04-22T07:20:52.835850+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863066+0000","last_change":"2024-04-22T07:20:52.862510+0000","last_active":"2024-04-22T07:20:54.863066+0000","last_peered":"2024-04-22T07:20:54.863066+0000","last_clean":"2024-04-22T07:20:54.863066+0000","last_became_active":"2024-04-22T07:20:52.862228+0000","last_became_peered":"2024-04-22T07:20:52.862228+0000","last_unstale":"2024-04-22T07:20:54.863066+0000","last_undegraded":"2024-04-22T07:20:54.863066+0000","last_fullsized":"2024-04-22T07:20:54.863066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:51.683021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979012+0000","last_change":"2024-04-22T07:20:52.856651+0000","last_active":"2024-04-22T07:20:54.979012+0000","last_peered":"2024-04-22T07:20:54.979012+0000","last_clean":"2024-04-22T07:20:54.979012+0000","last_became_active":"2024-04-22T07:20:52.856096+0000","last_became_peered":"2024-04-22T07:20:52.856096+0000","last_unstale":"2024-04-22T07:20:54.979012+0000","last_undegraded":"2024-04-22T07:20:54.979012+0000","last_fullsized":"2024-04-22T07:20:54.979012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:04.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979658+0000","last_change":"2024-04-22T07:20:53.873708+0000","last_active":"2024-04-22T07:20:54.979658+0000","last_peered":"2024-04-22T07:20:54.979658+0000","last_clean":"2024-04-22T07:20:54.979658+0000","last_became_active":"2024-04-22T07:20:53.872793+0000","last_became_peered":"2024-04-22T07:20:53.872793+0000","last_unstale":"2024-04-22T07:20:54.979658+0000","last_undegraded":"2024-04-22T07:20:54.979658+0000","last_fullsized":"2024-04-22T07:20:54.979658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:52.686229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862729+0000","last_change":"2024-04-22T07:20:52.861133+0000","last_active":"2024-04-22T07:20:54.862729+0000","last_peered":"2024-04-22T07:20:54.862729+0000","last_clean":"2024-04-22T07:20:54.862729+0000","last_became_active":"2024-04-22T07:20:52.860736+0000","last_became_peered":"2024-04-22T07:20:52.860736+0000","last_unstale":"2024-04-22T07:20:54.862729+0000","last_undegraded":"2024-04-22T07:20:54.862729+0000","last_fullsized":"2024-04-22T07:20:54.862729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:06.123308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-22T07:20:52.835850+0000","last_change":"2024-04-22T07:20:52.835850+0000","last_active":"2024-04-22T07:20:52.835850+0000","last_peered":"2024-04-22T07:20:52.835850+0000","last_clean":"2024-04-22T07:20:52.835850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:52.835850+0000","last_undegraded":"2024-04-22T07:20:52.835850+0000","last_fullsized":"2024-04-22T07:20:52.835850+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863067+0000","last_change":"2024-04-22T07:20:52.863567+0000","last_active":"2024-04-22T07:20:54.863067+0000","last_peered":"2024-04-22T07:20:54.863067+0000","last_clean":"2024-04-22T07:20:54.863067+0000","last_became_active":"2024-04-22T07:20:52.863285+0000","last_became_peered":"2024-04-22T07:20:52.863285+0000","last_unstale":"2024-04-22T07:20:54.863067+0000","last_undegraded":"2024-04-22T07:20:54.863067+0000","last_fullsized":"2024-04-22T07:20:54.863067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861976+0000","last_change":"2024-04-22T07:20:53.864955+0000","last_active":"2024-04-22T07:20:54.861976+0000","last_peered":"2024-04-22T07:20:54.861976+0000","last_clean":"2024-04-22T07:20:54.861976+0000","last_became_active":"2024-04-22T07:20:53.864694+0000","last_became_peered":"2024-04-22T07:20:53.864694+0000","last_unstale":"2024-04-22T07:20:54.861976+0000","last_undegraded":"2024-04-22T07:20:54.861976+0000","last_fullsized":"2024-04-22T07:20:54.861976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977898+0000","last_change":"2024-04-22T07:20:52.858761+0000","last_active":"2024-04-22T07:20:54.977898+0000","last_peered":"2024-04-22T07:20:54.977898+0000","last_clean":"2024-04-22T07:20:54.977898+0000","last_became_active":"2024-04-22T07:20:52.856815+0000","last_became_peered":"2024-04-22T07:20:52.856815+0000","last_unstale":"2024-04-22T07:20:54.977898+0000","last_undegraded":"2024-04-22T07:20:54.977898+0000","last_fullsized":"2024-04-22T07:20:54.977898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:06.123308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979798+0000","last_change":"2024-04-22T07:20:53.867290+0000","last_active":"2024-04-22T07:20:54.979798+0000","last_peered":"2024-04-22T07:20:54.979798+0000","last_clean":"2024-04-22T07:20:54.979798+0000","last_became_active":"2024-04-22T07:20:53.866955+0000","last_became_peered":"2024-04-22T07:20:53.866955+0000","last_unstale":"2024-04-22T07:20:54.979798+0000","last_undegraded":"2024-04-22T07:20:54.979798+0000","last_fullsized":"2024-04-22T07:20:54.979798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:43.442316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980048+0000","last_change":"2024-04-22T07:20:52.863670+0000","last_active":"2024-04-22T07:20:54.980048+0000","last_peered":"2024-04-22T07:20:54.980048+0000","last_clean":"2024-04-22T07:20:54.980048+0000","last_became_active":"2024-04-22T07:20:52.863320+0000","last_became_peered":"2024-04-22T07:20:52.863320+0000","last_unstale":"2024-04-22T07:20:54.980048+0000","last_undegraded":"2024-04-22T07:20:54.980048+0000","last_fullsized":"2024-04-22T07:20:54.980048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:04.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862589+0000","last_change":"2024-04-22T07:20:53.868286+0000","last_active":"2024-04-22T07:20:54.862589+0000","last_peered":"2024-04-22T07:20:54.862589+0000","last_clean":"2024-04-22T07:20:54.862589+0000","last_became_active":"2024-04-22T07:20:53.862811+0000","last_became_peered":"2024-04-22T07:20:53.862811+0000","last_unstale":"2024-04-22T07:20:54.862589+0000","last_undegraded":"2024-04-22T07:20:54.862589+0000","last_fullsized":"2024-04-22T07:20:54.862589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861603+0000","last_change":"2024-04-22T07:20:52.863638+0000","last_active":"2024-04-22T07:20:54.861603+0000","last_peered":"2024-04-22T07:20:54.861603+0000","last_clean":"2024-04-22T07:20:54.861603+0000","last_became_active":"2024-04-22T07:20:52.863244+0000","last_became_peered":"2024-04-22T07:20:52.863244+0000","last_unstale":"2024-04-22T07:20:54.861603+0000","last_undegraded":"2024-04-22T07:20:54.861603+0000","last_fullsized":"2024-04-22T07:20:54.861603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:36:49.017537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977713+0000","last_change":"2024-04-22T07:20:53.875162+0000","last_active":"2024-04-22T07:20:54.977713+0000","last_peered":"2024-04-22T07:20:54.977713+0000","last_clean":"2024-04-22T07:20:54.977713+0000","last_became_active":"2024-04-22T07:20:53.874612+0000","last_became_peered":"2024-04-22T07:20:53.874612+0000","last_unstale":"2024-04-22T07:20:54.977713+0000","last_undegraded":"2024-04-22T07:20:54.977713+0000","last_fullsized":"2024-04-22T07:20:54.977713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:13:12.303505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979428+0000","last_change":"2024-04-22T07:20:52.855194+0000","last_active":"2024-04-22T07:20:54.979428+0000","last_peered":"2024-04-22T07:20:54.979428+0000","last_clean":"2024-04-22T07:20:54.979428+0000","last_became_active":"2024-04-22T07:20:52.854915+0000","last_became_peered":"2024-04-22T07:20:52.854915+0000","last_unstale":"2024-04-22T07:20:54.979428+0000","last_undegraded":"2024-04-22T07:20:54.979428+0000","last_fullsized":"2024-04-22T07:20:54.979428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979725+0000","last_change":"2024-04-22T07:20:53.868695+0000","last_active":"2024-04-22T07:20:54.979725+0000","last_peered":"2024-04-22T07:20:54.979725+0000","last_clean":"2024-04-22T07:20:54.979725+0000","last_became_active":"2024-04-22T07:20:53.868400+0000","last_became_peered":"2024-04-22T07:20:53.868400+0000","last_unstale":"2024-04-22T07:20:54.979725+0000","last_undegraded":"2024-04-22T07:20:54.979725+0000","last_fullsized":"2024-04-22T07:20:54.979725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:30:23.352871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863163+0000","last_change":"2024-04-22T07:20:52.861884+0000","last_active":"2024-04-22T07:20:54.863163+0000","last_peered":"2024-04-22T07:20:54.863163+0000","last_clean":"2024-04-22T07:20:54.863163+0000","last_became_active":"2024-04-22T07:20:52.861546+0000","last_became_peered":"2024-04-22T07:20:52.861546+0000","last_unstale":"2024-04-22T07:20:54.863163+0000","last_undegraded":"2024-04-22T07:20:54.863163+0000","last_fullsized":"2024-04-22T07:20:54.863163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:37.283262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862882+0000","last_change":"2024-04-22T07:20:53.863071+0000","last_active":"2024-04-22T07:20:54.862882+0000","last_peered":"2024-04-22T07:20:54.862882+0000","last_clean":"2024-04-22T07:20:54.862882+0000","last_became_active":"2024-04-22T07:20:53.862763+0000","last_became_peered":"2024-04-22T07:20:53.862763+0000","last_unstale":"2024-04-22T07:20:54.862882+0000","last_undegraded":"2024-04-22T07:20:54.862882+0000","last_fullsized":"2024-04-22T07:20:54.862882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:19:57.432323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977415+0000","last_change":"2024-04-22T07:20:52.865285+0000","last_active":"2024-04-22T07:20:54.977415+0000","last_peered":"2024-04-22T07:20:54.977415+0000","last_clean":"2024-04-22T07:20:54.977415+0000","last_became_active":"2024-04-22T07:20:52.864725+0000","last_became_peered":"2024-04-22T07:20:52.864725+0000","last_unstale":"2024-04-22T07:20:54.977415+0000","last_undegraded":"2024-04-22T07:20:54.977415+0000","last_fullsized":"2024-04-22T07:20:54.977415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:23:28.850031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862533+0000","last_change":"2024-04-22T07:20:53.875479+0000","last_active":"2024-04-22T07:20:54.862533+0000","last_peered":"2024-04-22T07:20:54.862533+0000","last_clean":"2024-04-22T07:20:54.862533+0000","last_became_active":"2024-04-22T07:20:53.874567+0000","last_became_peered":"2024-04-22T07:20:53.874567+0000","last_unstale":"2024-04-22T07:20:54.862533+0000","last_undegraded":"2024-04-22T07:20:54.862533+0000","last_fullsized":"2024-04-22T07:20:54.862533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-22T07:20:51.842535+0000","last_change":"2024-04-22T07:20:51.842535+0000","last_active":"2024-04-22T07:20:51.829465+0000","last_peered":"2024-04-22T07:20:51.829465+0000","last_clean":"2024-04-22T07:20:51.829465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:51.842535+0000","last_undegraded":"2024-04-22T07:20:51.842535+0000","last_fullsized":"2024-04-22T07:20:51.842535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862635+0000","last_change":"2024-04-22T07:20:53.859641+0000","last_active":"2024-04-22T07:20:54.862635+0000","last_peered":"2024-04-22T07:20:54.862635+0000","last_clean":"2024-04-22T07:20:54.862635+0000","last_became_active":"2024-04-22T07:20:53.859365+0000","last_became_peered":"2024-04-22T07:20:53.859365+0000","last_unstale":"2024-04-22T07:20:54.862635+0000","last_undegraded":"2024-04-22T07:20:54.862635+0000","last_fullsized":"2024-04-22T07:20:54.862635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:46:50.322722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977979+0000","last_change":"2024-04-22T07:20:52.866960+0000","last_active":"2024-04-22T07:20:54.977979+0000","last_peered":"2024-04-22T07:20:54.977979+0000","last_clean":"2024-04-22T07:20:54.977979+0000","last_became_active":"2024-04-22T07:20:52.866654+0000","last_became_peered":"2024-04-22T07:20:52.866654+0000","last_unstale":"2024-04-22T07:20:54.977979+0000","last_undegraded":"2024-04-22T07:20:54.977979+0000","last_fullsized":"2024-04-22T07:20:54.977979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:51.683021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862087+0000","last_change":"2024-04-22T07:20:53.874775+0000","last_active":"2024-04-22T07:20:54.862087+0000","last_peered":"2024-04-22T07:20:54.862087+0000","last_clean":"2024-04-22T07:20:54.862087+0000","last_became_active":"2024-04-22T07:20:53.874499+0000","last_became_peered":"2024-04-22T07:20:53.874499+0000","last_unstale":"2024-04-22T07:20:54.862087+0000","last_undegraded":"2024-04-22T07:20:54.862087+0000","last_fullsized":"2024-04-22T07:20:54.862087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:23.268067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-22T07:20:51.844556+0000","last_change":"2024-04-22T07:20:51.844556+0000","last_active":"2024-04-22T07:20:51.829465+0000","last_peered":"2024-04-22T07:20:51.829465+0000","last_clean":"2024-04-22T07:20:51.829465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:51.844556+0000","last_undegraded":"2024-04-22T07:20:51.844556+0000","last_fullsized":"2024-04-22T07:20:51.844556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977901+0000","last_change":"2024-04-22T07:20:53.871645+0000","last_active":"2024-04-22T07:20:54.977901+0000","last_peered":"2024-04-22T07:20:54.977901+0000","last_clean":"2024-04-22T07:20:54.977901+0000","last_became_active":"2024-04-22T07:20:53.871353+0000","last_became_peered":"2024-04-22T07:20:53.871353+0000","last_unstale":"2024-04-22T07:20:54.977901+0000","last_undegraded":"2024-04-22T07:20:54.977901+0000","last_fullsized":"2024-04-22T07:20:54.977901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:48:40.630407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980304+0000","last_change":"2024-04-22T07:20:52.866996+0000","last_active":"2024-04-22T07:20:54.980304+0000","last_peered":"2024-04-22T07:20:54.980304+0000","last_clean":"2024-04-22T07:20:54.980304+0000","last_became_active":"2024-04-22T07:20:52.866677+0000","last_became_peered":"2024-04-22T07:20:52.866677+0000","last_unstale":"2024-04-22T07:20:54.980304+0000","last_undegraded":"2024-04-22T07:20:54.980304+0000","last_fullsized":"2024-04-22T07:20:54.980304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977832+0000","last_change":"2024-04-22T07:20:53.871064+0000","last_active":"2024-04-22T07:20:54.977832+0000","last_peered":"2024-04-22T07:20:54.977832+0000","last_clean":"2024-04-22T07:20:54.977832+0000","last_became_active":"2024-04-22T07:20:53.866968+0000","last_became_peered":"2024-04-22T07:20:53.866968+0000","last_unstale":"2024-04-22T07:20:54.977832+0000","last_undegraded":"2024-04-22T07:20:54.977832+0000","last_fullsized":"2024-04-22T07:20:54.977832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:43.442316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979659+0000","last_change":"2024-04-22T07:20:52.856958+0000","last_active":"2024-04-22T07:20:54.979659+0000","last_peered":"2024-04-22T07:20:54.979659+0000","last_clean":"2024-04-22T07:20:54.979659+0000","last_became_active":"2024-04-22T07:20:52.856289+0000","last_became_peered":"2024-04-22T07:20:52.856289+0000","last_unstale":"2024-04-22T07:20:54.979659+0000","last_undegraded":"2024-04-22T07:20:54.979659+0000","last_fullsized":"2024-04-22T07:20:54.979659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863352+0000","last_change":"2024-04-22T07:20:53.872915+0000","last_active":"2024-04-22T07:20:54.863352+0000","last_peered":"2024-04-22T07:20:54.863352+0000","last_clean":"2024-04-22T07:20:54.863352+0000","last_became_active":"2024-04-22T07:20:53.872005+0000","last_became_peered":"2024-04-22T07:20:53.872005+0000","last_unstale":"2024-04-22T07:20:54.863352+0000","last_undegraded":"2024-04-22T07:20:54.863352+0000","last_fullsized":"2024-04-22T07:20:54.863352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:53:29.242632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862549+0000","last_change":"2024-04-22T07:20:43.747396+0000","last_active":"2024-04-22T07:20:54.862549+0000","last_peered":"2024-04-22T07:20:54.862549+0000","last_clean":"2024-04-22T07:20:54.862549+0000","last_became_active":"2024-04-22T07:20:43.746332+0000","last_became_peered":"2024-04-22T07:20:43.746332+0000","last_unstale":"2024-04-22T07:20:54.862549+0000","last_undegraded":"2024-04-22T07:20:54.862549+0000","last_fullsized":"2024-04-22T07:20:54.862549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:42.732916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:42.732916+0000","last_clean_scrub_stamp":"2024-04-22T07:20:42.732916+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:02:55.086445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863049+0000","last_change":"2024-04-22T07:20:52.862492+0000","last_active":"2024-04-22T07:20:54.863049+0000","last_peered":"2024-04-22T07:20:54.863049+0000","last_clean":"2024-04-22T07:20:54.863049+0000","last_became_active":"2024-04-22T07:20:52.862201+0000","last_became_peered":"2024-04-22T07:20:52.862201+0000","last_unstale":"2024-04-22T07:20:54.863049+0000","last_undegraded":"2024-04-22T07:20:54.863049+0000","last_fullsized":"2024-04-22T07:20:54.863049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:52.015227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-22T07:20:52.835850+0000","last_change":"2024-04-22T07:20:52.835850+0000","last_active":"2024-04-22T07:20:52.835850+0000","last_peered":"2024-04-22T07:20:52.835850+0000","last_clean":"2024-04-22T07:20:52.835850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:52.835850+0000","last_undegraded":"2024-04-22T07:20:52.835850+0000","last_fullsized":"2024-04-22T07:20:52.835850+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862731+0000","last_change":"2024-04-22T07:20:52.867622+0000","last_active":"2024-04-22T07:20:54.862731+0000","last_peered":"2024-04-22T07:20:54.862731+0000","last_clean":"2024-04-22T07:20:54.862731+0000","last_became_active":"2024-04-22T07:20:52.866996+0000","last_became_peered":"2024-04-22T07:20:52.866996+0000","last_unstale":"2024-04-22T07:20:54.862731+0000","last_undegraded":"2024-04-22T07:20:54.862731+0000","last_fullsized":"2024-04-22T07:20:54.862731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:08.286530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978392+0000","last_change":"2024-04-22T07:20:53.871576+0000","last_active":"2024-04-22T07:20:54.978392+0000","last_peered":"2024-04-22T07:20:54.978392+0000","last_clean":"2024-04-22T07:20:54.978392+0000","last_became_active":"2024-04-22T07:20:53.871239+0000","last_became_peered":"2024-04-22T07:20:53.871239+0000","last_unstale":"2024-04-22T07:20:54.978392+0000","last_undegraded":"2024-04-22T07:20:54.978392+0000","last_fullsized":"2024-04-22T07:20:54.978392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979845+0000","last_change":"2024-04-22T07:20:52.866974+0000","last_active":"2024-04-22T07:20:54.979845+0000","last_peered":"2024-04-22T07:20:54.979845+0000","last_clean":"2024-04-22T07:20:54.979845+0000","last_became_active":"2024-04-22T07:20:52.866581+0000","last_became_peered":"2024-04-22T07:20:52.866581+0000","last_unstale":"2024-04-22T07:20:54.979845+0000","last_undegraded":"2024-04-22T07:20:54.979845+0000","last_fullsized":"2024-04-22T07:20:54.979845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979503+0000","last_change":"2024-04-22T07:20:53.865035+0000","last_active":"2024-04-22T07:20:54.979503+0000","last_peered":"2024-04-22T07:20:54.979503+0000","last_clean":"2024-04-22T07:20:54.979503+0000","last_became_active":"2024-04-22T07:20:53.864523+0000","last_became_peered":"2024-04-22T07:20:53.864523+0000","last_unstale":"2024-04-22T07:20:54.979503+0000","last_undegraded":"2024-04-22T07:20:54.979503+0000","last_fullsized":"2024-04-22T07:20:54.979503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:13:12.303505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863169+0000","last_change":"2024-04-22T07:20:52.858498+0000","last_active":"2024-04-22T07:20:54.863169+0000","last_peered":"2024-04-22T07:20:54.863169+0000","last_clean":"2024-04-22T07:20:54.863169+0000","last_became_active":"2024-04-22T07:20:52.858139+0000","last_became_peered":"2024-04-22T07:20:52.858139+0000","last_unstale":"2024-04-22T07:20:54.863169+0000","last_undegraded":"2024-04-22T07:20:54.863169+0000","last_fullsized":"2024-04-22T07:20:54.863169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:45.382709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977943+0000","last_change":"2024-04-22T07:20:53.877595+0000","last_active":"2024-04-22T07:20:54.977943+0000","last_peered":"2024-04-22T07:20:54.977943+0000","last_clean":"2024-04-22T07:20:54.977943+0000","last_became_active":"2024-04-22T07:20:53.877208+0000","last_became_peered":"2024-04-22T07:20:53.877208+0000","last_unstale":"2024-04-22T07:20:54.977943+0000","last_undegraded":"2024-04-22T07:20:54.977943+0000","last_fullsized":"2024-04-22T07:20:54.977943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:46:50.322722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979001+0000","last_change":"2024-04-22T07:20:52.866224+0000","last_active":"2024-04-22T07:20:54.979001+0000","last_peered":"2024-04-22T07:20:54.979001+0000","last_clean":"2024-04-22T07:20:54.979001+0000","last_became_active":"2024-04-22T07:20:52.865903+0000","last_became_peered":"2024-04-22T07:20:52.865903+0000","last_unstale":"2024-04-22T07:20:54.979001+0000","last_undegraded":"2024-04-22T07:20:54.979001+0000","last_fullsized":"2024-04-22T07:20:54.979001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861395+0000","last_change":"2024-04-22T07:20:53.873266+0000","last_active":"2024-04-22T07:20:54.861395+0000","last_peered":"2024-04-22T07:20:54.861395+0000","last_clean":"2024-04-22T07:20:54.861395+0000","last_became_active":"2024-04-22T07:20:53.872915+0000","last_became_peered":"2024-04-22T07:20:53.872915+0000","last_unstale":"2024-04-22T07:20:54.861395+0000","last_undegraded":"2024-04-22T07:20:54.861395+0000","last_fullsized":"2024-04-22T07:20:54.861395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:09.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863471+0000","last_change":"2024-04-22T07:20:52.863593+0000","last_active":"2024-04-22T07:20:54.863471+0000","last_peered":"2024-04-22T07:20:54.863471+0000","last_clean":"2024-04-22T07:20:54.863471+0000","last_became_active":"2024-04-22T07:20:52.863296+0000","last_became_peered":"2024-04-22T07:20:52.863296+0000","last_unstale":"2024-04-22T07:20:54.863471+0000","last_undegraded":"2024-04-22T07:20:54.863471+0000","last_fullsized":"2024-04-22T07:20:54.863471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:22.261683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979540+0000","last_change":"2024-04-22T07:20:53.874491+0000","last_active":"2024-04-22T07:20:54.979540+0000","last_peered":"2024-04-22T07:20:54.979540+0000","last_clean":"2024-04-22T07:20:54.979540+0000","last_became_active":"2024-04-22T07:20:53.874202+0000","last_became_peered":"2024-04-22T07:20:53.874202+0000","last_unstale":"2024-04-22T07:20:54.979540+0000","last_undegraded":"2024-04-22T07:20:54.979540+0000","last_fullsized":"2024-04-22T07:20:54.979540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:23.268067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-22T07:20:51.842526+0000","last_change":"2024-04-22T07:20:51.842526+0000","last_active":"2024-04-22T07:20:51.829465+0000","last_peered":"2024-04-22T07:20:51.829465+0000","last_clean":"2024-04-22T07:20:51.829465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:51.842526+0000","last_undegraded":"2024-04-22T07:20:51.842526+0000","last_fullsized":"2024-04-22T07:20:51.842526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-22T07:20:52.835850+0000","last_change":"2024-04-22T07:20:52.835850+0000","last_active":"2024-04-22T07:20:52.835850+0000","last_peered":"2024-04-22T07:20:52.835850+0000","last_clean":"2024-04-22T07:20:52.835850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:52.835850+0000","last_undegraded":"2024-04-22T07:20:52.835850+0000","last_fullsized":"2024-04-22T07:20:52.835850+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863610+0000","last_change":"2024-04-22T07:20:52.864740+0000","last_active":"2024-04-22T07:20:54.863610+0000","last_peered":"2024-04-22T07:20:54.863610+0000","last_clean":"2024-04-22T07:20:54.863610+0000","last_became_active":"2024-04-22T07:20:52.864434+0000","last_became_peered":"2024-04-22T07:20:52.864434+0000","last_unstale":"2024-04-22T07:20:54.863610+0000","last_undegraded":"2024-04-22T07:20:54.863610+0000","last_fullsized":"2024-04-22T07:20:54.863610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:33.937176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-22T07:20:52.835850+0000","last_change":"2024-04-22T07:20:52.835850+0000","last_active":"2024-04-22T07:20:52.835850+0000","last_peered":"2024-04-22T07:20:52.835850+0000","last_clean":"2024-04-22T07:20:52.835850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:52.835850+0000","last_undegraded":"2024-04-22T07:20:52.835850+0000","last_fullsized":"2024-04-22T07:20:52.835850+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977319+0000","last_change":"2024-04-22T07:20:52.854668+0000","last_active":"2024-04-22T07:20:54.977319+0000","last_peered":"2024-04-22T07:20:54.977319+0000","last_clean":"2024-04-22T07:20:54.977319+0000","last_became_active":"2024-04-22T07:20:52.854395+0000","last_became_peered":"2024-04-22T07:20:52.854395+0000","last_unstale":"2024-04-22T07:20:54.977319+0000","last_undegraded":"2024-04-22T07:20:54.977319+0000","last_fullsized":"2024-04-22T07:20:54.977319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:59:32.487127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862797+0000","last_change":"2024-04-22T07:20:53.870972+0000","last_active":"2024-04-22T07:20:54.862797+0000","last_peered":"2024-04-22T07:20:54.862797+0000","last_clean":"2024-04-22T07:20:54.862797+0000","last_became_active":"2024-04-22T07:20:53.870674+0000","last_became_peered":"2024-04-22T07:20:53.870674+0000","last_unstale":"2024-04-22T07:20:54.862797+0000","last_undegraded":"2024-04-22T07:20:54.862797+0000","last_fullsized":"2024-04-22T07:20:54.862797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:10.431906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-22T07:20:51.843148+0000","last_change":"2024-04-22T07:20:51.843148+0000","last_active":"2024-04-22T07:20:51.829465+0000","last_peered":"2024-04-22T07:20:51.829465+0000","last_clean":"2024-04-22T07:20:51.829465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:51.843148+0000","last_undegraded":"2024-04-22T07:20:51.843148+0000","last_fullsized":"2024-04-22T07:20:51.843148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-22T07:20:52.835850+0000","last_change":"2024-04-22T07:20:52.835850+0000","last_active":"2024-04-22T07:20:52.835850+0000","last_peered":"2024-04-22T07:20:52.835850+0000","last_clean":"2024-04-22T07:20:52.835850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:52.835850+0000","last_undegraded":"2024-04-22T07:20:52.835850+0000","last_fullsized":"2024-04-22T07:20:52.835850+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979784+0000","last_change":"2024-04-22T07:20:52.861048+0000","last_active":"2024-04-22T07:20:54.979784+0000","last_peered":"2024-04-22T07:20:54.979784+0000","last_clean":"2024-04-22T07:20:54.979784+0000","last_became_active":"2024-04-22T07:20:52.860702+0000","last_became_peered":"2024-04-22T07:20:52.860702+0000","last_unstale":"2024-04-22T07:20:54.979784+0000","last_undegraded":"2024-04-22T07:20:54.979784+0000","last_fullsized":"2024-04-22T07:20:54.979784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979324+0000","last_change":"2024-04-22T07:20:53.868782+0000","last_active":"2024-04-22T07:20:54.979324+0000","last_peered":"2024-04-22T07:20:54.979324+0000","last_clean":"2024-04-22T07:20:54.979324+0000","last_became_active":"2024-04-22T07:20:53.868509+0000","last_became_peered":"2024-04-22T07:20:53.868509+0000","last_unstale":"2024-04-22T07:20:54.979324+0000","last_undegraded":"2024-04-22T07:20:54.979324+0000","last_fullsized":"2024-04-22T07:20:54.979324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:07.129692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862970+0000","last_change":"2024-04-22T07:20:52.858508+0000","last_active":"2024-04-22T07:20:54.862970+0000","last_peered":"2024-04-22T07:20:54.862970+0000","last_clean":"2024-04-22T07:20:54.862970+0000","last_became_active":"2024-04-22T07:20:52.858215+0000","last_became_peered":"2024-04-22T07:20:52.858215+0000","last_unstale":"2024-04-22T07:20:54.862970+0000","last_undegraded":"2024-04-22T07:20:54.862970+0000","last_fullsized":"2024-04-22T07:20:54.862970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:26.618434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862971+0000","last_change":"2024-04-22T07:20:53.867977+0000","last_active":"2024-04-22T07:20:54.862971+0000","last_peered":"2024-04-22T07:20:54.862971+0000","last_clean":"2024-04-22T07:20:54.862971+0000","last_became_active":"2024-04-22T07:20:53.867447+0000","last_became_peered":"2024-04-22T07:20:53.867447+0000","last_unstale":"2024-04-22T07:20:54.862971+0000","last_undegraded":"2024-04-22T07:20:54.862971+0000","last_fullsized":"2024-04-22T07:20:54.862971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:48:52.934171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863377+0000","last_change":"2024-04-22T07:20:53.875681+0000","last_active":"2024-04-22T07:20:54.863377+0000","last_peered":"2024-04-22T07:20:54.863377+0000","last_clean":"2024-04-22T07:20:54.863377+0000","last_became_active":"2024-04-22T07:20:53.875305+0000","last_became_peered":"2024-04-22T07:20:53.875305+0000","last_unstale":"2024-04-22T07:20:54.863377+0000","last_undegraded":"2024-04-22T07:20:54.863377+0000","last_fullsized":"2024-04-22T07:20:54.863377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:22:34.452869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977916+0000","last_change":"2024-04-22T07:20:52.857445+0000","last_active":"2024-04-22T07:20:54.977916+0000","last_peered":"2024-04-22T07:20:54.977916+0000","last_clean":"2024-04-22T07:20:54.977916+0000","last_became_active":"2024-04-22T07:20:52.856293+0000","last_became_peered":"2024-04-22T07:20:52.856293+0000","last_unstale":"2024-04-22T07:20:54.977916+0000","last_undegraded":"2024-04-22T07:20:54.977916+0000","last_fullsized":"2024-04-22T07:20:54.977916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:10.640191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862780+0000","last_change":"2024-04-22T07:20:53.870827+0000","last_active":"2024-04-22T07:20:54.862780+0000","last_peered":"2024-04-22T07:20:54.862780+0000","last_clean":"2024-04-22T07:20:54.862780+0000","last_became_active":"2024-04-22T07:20:53.870548+0000","last_became_peered":"2024-04-22T07:20:53.870548+0000","last_unstale":"2024-04-22T07:20:54.862780+0000","last_undegraded":"2024-04-22T07:20:54.862780+0000","last_fullsized":"2024-04-22T07:20:54.862780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:27.624819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977785+0000","last_change":"2024-04-22T07:20:52.856933+0000","last_active":"2024-04-22T07:20:54.977785+0000","last_peered":"2024-04-22T07:20:54.977785+0000","last_clean":"2024-04-22T07:20:54.977785+0000","last_became_active":"2024-04-22T07:20:52.856617+0000","last_became_peered":"2024-04-22T07:20:52.856617+0000","last_unstale":"2024-04-22T07:20:54.977785+0000","last_undegraded":"2024-04-22T07:20:54.977785+0000","last_fullsized":"2024-04-22T07:20:54.977785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:08.286530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979619+0000","last_change":"2024-04-22T07:20:53.866552+0000","last_active":"2024-04-22T07:20:54.979619+0000","last_peered":"2024-04-22T07:20:54.979619+0000","last_clean":"2024-04-22T07:20:54.979619+0000","last_became_active":"2024-04-22T07:20:53.866286+0000","last_became_peered":"2024-04-22T07:20:53.866286+0000","last_unstale":"2024-04-22T07:20:54.979619+0000","last_undegraded":"2024-04-22T07:20:54.979619+0000","last_fullsized":"2024-04-22T07:20:54.979619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:45:15.519469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980248+0000","last_change":"2024-04-22T07:20:52.863291+0000","last_active":"2024-04-22T07:20:54.980248+0000","last_peered":"2024-04-22T07:20:54.980248+0000","last_clean":"2024-04-22T07:20:54.980248+0000","last_became_active":"2024-04-22T07:20:52.862967+0000","last_became_peered":"2024-04-22T07:20:52.862967+0000","last_unstale":"2024-04-22T07:20:54.980248+0000","last_undegraded":"2024-04-22T07:20:54.980248+0000","last_fullsized":"2024-04-22T07:20:54.980248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:10.640191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980150+0000","last_change":"2024-04-22T07:20:53.871045+0000","last_active":"2024-04-22T07:20:54.980150+0000","last_peered":"2024-04-22T07:20:54.980150+0000","last_clean":"2024-04-22T07:20:54.980150+0000","last_became_active":"2024-04-22T07:20:53.870715+0000","last_became_peered":"2024-04-22T07:20:53.870715+0000","last_unstale":"2024-04-22T07:20:54.980150+0000","last_undegraded":"2024-04-22T07:20:54.980150+0000","last_fullsized":"2024-04-22T07:20:54.980150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-22T07:20:51.842558+0000","last_change":"2024-04-22T07:20:51.842558+0000","last_active":"2024-04-22T07:20:51.829465+0000","last_peered":"2024-04-22T07:20:51.829465+0000","last_clean":"2024-04-22T07:20:51.829465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:51.842558+0000","last_undegraded":"2024-04-22T07:20:51.842558+0000","last_fullsized":"2024-04-22T07:20:51.842558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":815104,"data_stored":665303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":671603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T07:20:58.876 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T07:20:59.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.014+0000 7ffb8aa8c640 1 Processor -- start 2024-04-22T07:20:59.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.014+0000 7ffb8aa8c640 1 -- start start 2024-04-22T07:20:59.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.015+0000 7ffb8aa8c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffb84154ed0 0x7ffb840cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:59.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.015+0000 7ffb8aa8c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffb840cc650 0x7ffb8415e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:59.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.015+0000 7ffb8aa8c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ffb8415ef10 0x7ffb840ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:59.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.015+0000 7ffb8aa8c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7ffb8415e260 con 0x7ffb84154ed0 2024-04-22T07:20:59.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.015+0000 7ffb8aa8c640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7ffb840c5960 con 0x7ffb8415ef10 2024-04-22T07:20:59.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.015+0000 7ffb8aa8c640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ffb8415b7b0 con 0x7ffb840cc650 2024-04-22T07:20:59.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.015+0000 7ffb88828640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffb84154ed0 0x7ffb840cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:59.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.015+0000 7ffb88828640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffb84154ed0 0x7ffb840cb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43712/0 (socket says 172.21.15.40:43712) 2024-04-22T07:20:59.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.015+0000 7ffb88828640 1 -- 172.21.15.40:0/4085083229 learned_addr learned my addr 172.21.15.40:0/4085083229 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:59.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.015+0000 7ffb89029640 1 --2- 172.21.15.40:0/4085083229 >> v2:172.21.15.62:3300/0 conn(0x7ffb8415ef10 0x7ffb840ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:59.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.015+0000 7ffb83fff640 1 --2- 172.21.15.40:0/4085083229 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffb840cc650 0x7ffb8415e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:59.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.015+0000 7ffb88828640 1 -- 172.21.15.40:0/4085083229 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffb840cc650 msgr2=0x7ffb8415e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:59.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.015+0000 7ffb88828640 1 --2- 172.21.15.40:0/4085083229 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffb840cc650 0x7ffb8415e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.015+0000 7ffb88828640 1 -- 172.21.15.40:0/4085083229 >> v2:172.21.15.62:3300/0 conn(0x7ffb8415ef10 msgr2=0x7ffb840ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:59.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.015+0000 7ffb88828640 1 --2- 172.21.15.40:0/4085083229 >> v2:172.21.15.62:3300/0 conn(0x7ffb8415ef10 0x7ffb840ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.015+0000 7ffb88828640 1 -- 172.21.15.40:0/4085083229 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb840cc0f0 con 0x7ffb84154ed0 2024-04-22T07:20:59.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.016+0000 7ffb88828640 1 --2- 172.21.15.40:0/4085083229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb84154ed0 0x7ffb840cb490 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffb840b45b0 tx=0x7ffb7c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd43afae587ae9dd server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:59.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.016+0000 7ffb837fe640 1 -- 172.21.15.40:0/4085083229 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c02c9e0 con 0x7ffb84154ed0 2024-04-22T07:20:59.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.016+0000 7ffb837fe640 1 -- 172.21.15.40:0/4085083229 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb7c02cb80 con 0x7ffb84154ed0 2024-04-22T07:20:59.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.016+0000 7ffb837fe640 1 -- 172.21.15.40:0/4085083229 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c0343f0 con 0x7ffb84154ed0 2024-04-22T07:20:59.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.017+0000 7ffb8aa8c640 1 -- 172.21.15.40:0/4085083229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb84154ed0 msgr2=0x7ffb840cb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:59.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.017+0000 7ffb8aa8c640 1 --2- 172.21.15.40:0/4085083229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb84154ed0 0x7ffb840cb490 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffb840b45b0 tx=0x7ffb7c02be40 comp rx=0 tx=0).stop 2024-04-22T07:20:59.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.017+0000 7ffb8aa8c640 1 -- 172.21.15.40:0/4085083229 shutdown_connections 2024-04-22T07:20:59.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.017+0000 7ffb8aa8c640 1 --2- 172.21.15.40:0/4085083229 >> v2:172.21.15.62:3300/0 conn(0x7ffb8415ef10 0x7ffb840ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.017+0000 7ffb8aa8c640 1 --2- 172.21.15.40:0/4085083229 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffb840cc650 0x7ffb8415e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.017+0000 7ffb8aa8c640 1 --2- 172.21.15.40:0/4085083229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb84154ed0 0x7ffb840cb490 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.017+0000 7ffb8aa8c640 1 -- 172.21.15.40:0/4085083229 >> 172.21.15.40:0/4085083229 conn(0x7ffb84073d10 msgr2=0x7ffb8406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:59.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.017+0000 7ffb8aa8c640 1 -- 172.21.15.40:0/4085083229 shutdown_connections 2024-04-22T07:20:59.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.017+0000 7ffb8aa8c640 1 -- 172.21.15.40:0/4085083229 wait complete. 2024-04-22T07:20:59.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.018+0000 7ffb8aa8c640 1 Processor -- start 2024-04-22T07:20:59.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.018+0000 7ffb8aa8c640 1 -- start start 2024-04-22T07:20:59.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.019+0000 7ffb8aa8c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb840cc650 0x7ffb8414fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:59.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.019+0000 7ffb8aa8c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffb84154ed0 0x7ffb841f0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:59.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.019+0000 7ffb8aa8c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb8415ef10 0x7ffb8414af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:59.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.019+0000 7ffb8aa8c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ffb840cc3b0 con 0x7ffb8415ef10 2024-04-22T07:20:59.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.019+0000 7ffb8aa8c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8415e4b0 con 0x7ffb840cc650 2024-04-22T07:20:59.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.019+0000 7ffb8aa8c640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ffb840cbb20 con 0x7ffb84154ed0 2024-04-22T07:20:59.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.019+0000 7ffb89029640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb8415ef10 0x7ffb8414af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:59.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.019+0000 7ffb89029640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb8415ef10 0x7ffb8414af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43728/0 (socket says 172.21.15.40:43728) 2024-04-22T07:20:59.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.019+0000 7ffb89029640 1 -- 172.21.15.40:0/3549090901 learned_addr learned my addr 172.21.15.40:0/3549090901 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:59.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.019+0000 7ffb88828640 1 --2- 172.21.15.40:0/3549090901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb840cc650 0x7ffb8414fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:59.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.019+0000 7ffb83fff640 1 --2- 172.21.15.40:0/3549090901 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffb84154ed0 0x7ffb841f0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.019+0000 7ffb89029640 1 -- 172.21.15.40:0/3549090901 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffb84154ed0 msgr2=0x7ffb841f0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.019+0000 7ffb89029640 1 --2- 172.21.15.40:0/3549090901 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffb84154ed0 0x7ffb841f0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.019+0000 7ffb89029640 1 -- 172.21.15.40:0/3549090901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb840cc650 msgr2=0x7ffb8414fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.019+0000 7ffb89029640 1 --2- 172.21.15.40:0/3549090901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb840cc650 0x7ffb8414fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.019+0000 7ffb89029640 1 -- 172.21.15.40:0/3549090901 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb840b5930 con 0x7ffb8415ef10 2024-04-22T07:20:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.019+0000 7ffb89029640 1 --2- 172.21.15.40:0/3549090901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb8415ef10 0x7ffb8414af00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c00d600 tx=0x7ffb6c00dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.020+0000 7ffb817fa640 1 -- 172.21.15.40:0/3549090901 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c0125f0 con 0x7ffb8415ef10 2024-04-22T07:20:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.020+0000 7ffb817fa640 1 -- 172.21.15.40:0/3549090901 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb6c019070 con 0x7ffb8415ef10 2024-04-22T07:20:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.020+0000 7ffb8aa8c640 1 -- 172.21.15.40:0/3549090901 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb841f4110 con 0x7ffb8415ef10 2024-04-22T07:20:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.020+0000 7ffb817fa640 1 -- 172.21.15.40:0/3549090901 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c0129f0 con 0x7ffb8415ef10 2024-04-22T07:20:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.020+0000 7ffb8aa8c640 1 -- 172.21.15.40:0/3549090901 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb841f46d0 con 0x7ffb8415ef10 2024-04-22T07:20:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.021+0000 7ffb8aa8c640 1 -- 172.21.15.40:0/3549090901 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb840cac10 con 0x7ffb8415ef10 2024-04-22T07:20:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.021+0000 7ffb817fa640 1 -- 172.21.15.40:0/3549090901 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffb6c012b90 con 0x7ffb8415ef10 2024-04-22T07:20:59.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.021+0000 7ffb817fa640 1 --2- 172.21.15.40:0/3549090901 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ffb6406c920 0x7ffb6406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:59.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.022+0000 7ffb817fa640 1 -- 172.21.15.40:0/3549090901 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ffb6c08bc10 con 0x7ffb8415ef10 2024-04-22T07:20:59.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.022+0000 7ffb88828640 1 --2- 172.21.15.40:0/3549090901 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ffb6406c920 0x7ffb6406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:59.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.022+0000 7ffb88828640 1 --2- 172.21.15.40:0/3549090901 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ffb6406c920 0x7ffb6406ede0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c035000 tx=0x7ffb7c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:59.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.026+0000 7ffb817fa640 1 -- 172.21.15.40:0/3549090901 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffb840cac10 con 0x7ffb8415ef10 2024-04-22T07:20:59.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.207+0000 7ffb8aa8c640 1 -- 172.21.15.40:0/3549090901 --> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffb840c54a0 con 0x7ffb6406c920 2024-04-22T07:20:59.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.213+0000 7ffb817fa640 1 -- 172.21.15.40:0/3549090901 <== mgr.4107 v2:172.21.15.40:6832/91163869 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250408 (secure 0 0 0) 0x7ffb840c54a0 con 0x7ffb6406c920 2024-04-22T07:20:59.214 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:20:59.215 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-22T07:20:59.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.216+0000 7ffb8aa8c640 1 -- 172.21.15.40:0/3549090901 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ffb6406c920 msgr2=0x7ffb6406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:59.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.216+0000 7ffb8aa8c640 1 --2- 172.21.15.40:0/3549090901 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ffb6406c920 0x7ffb6406ede0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c035000 tx=0x7ffb7c030000 comp rx=0 tx=0).stop 2024-04-22T07:20:59.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.216+0000 7ffb8aa8c640 1 -- 172.21.15.40:0/3549090901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb8415ef10 msgr2=0x7ffb8414af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:59.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.216+0000 7ffb8aa8c640 1 --2- 172.21.15.40:0/3549090901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb8415ef10 0x7ffb8414af00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c00d600 tx=0x7ffb6c00dac0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.216+0000 7ffb8aa8c640 1 -- 172.21.15.40:0/3549090901 shutdown_connections 2024-04-22T07:20:59.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.216+0000 7ffb8aa8c640 1 --2- 172.21.15.40:0/3549090901 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ffb6406c920 0x7ffb6406ede0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.216+0000 7ffb8aa8c640 1 --2- 172.21.15.40:0/3549090901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffb8415ef10 0x7ffb8414af00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.216+0000 7ffb8aa8c640 1 --2- 172.21.15.40:0/3549090901 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffb84154ed0 0x7ffb841f0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.216+0000 7ffb8aa8c640 1 --2- 172.21.15.40:0/3549090901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffb840cc650 0x7ffb8414fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.216+0000 7ffb8aa8c640 1 -- 172.21.15.40:0/3549090901 >> 172.21.15.40:0/3549090901 conn(0x7ffb84073d10 msgr2=0x7ffb840c5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:59.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.216+0000 7ffb8aa8c640 1 -- 172.21.15.40:0/3549090901 shutdown_connections 2024-04-22T07:20:59.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.217+0000 7ffb8aa8c640 1 -- 172.21.15.40:0/3549090901 wait complete. 2024-04-22T07:20:59.225 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-04-22T07:20:57.777573+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219060,"kb_used_data":2876,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755660,"statfs":{"total":773094113280,"available":772869795840,"internally_reserved":0,"allocated":2945024,"data_stored":1773949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.941312"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977886+0000","last_change":"2024-04-22T07:20:53.873662+0000","last_active":"2024-04-22T07:20:54.977886+0000","last_peered":"2024-04-22T07:20:54.977886+0000","last_clean":"2024-04-22T07:20:54.977886+0000","last_became_active":"2024-04-22T07:20:53.873384+0000","last_became_peered":"2024-04-22T07:20:53.873384+0000","last_unstale":"2024-04-22T07:20:54.977886+0000","last_undegraded":"2024-04-22T07:20:54.977886+0000","last_fullsized":"2024-04-22T07:20:54.977886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980006+0000","last_change":"2024-04-22T07:20:53.870454+0000","last_active":"2024-04-22T07:20:54.980006+0000","last_peered":"2024-04-22T07:20:54.980006+0000","last_clean":"2024-04-22T07:20:54.980006+0000","last_became_active":"2024-04-22T07:20:53.869964+0000","last_became_peered":"2024-04-22T07:20:53.869964+0000","last_unstale":"2024-04-22T07:20:54.980006+0000","last_undegraded":"2024-04-22T07:20:54.980006+0000","last_fullsized":"2024-04-22T07:20:54.980006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979125+0000","last_change":"2024-04-22T07:20:53.871145+0000","last_active":"2024-04-22T07:20:54.979125+0000","last_peered":"2024-04-22T07:20:54.979125+0000","last_clean":"2024-04-22T07:20:54.979125+0000","last_became_active":"2024-04-22T07:20:53.870819+0000","last_became_peered":"2024-04-22T07:20:53.870819+0000","last_unstale":"2024-04-22T07:20:54.979125+0000","last_undegraded":"2024-04-22T07:20:54.979125+0000","last_fullsized":"2024-04-22T07:20:54.979125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:02:16.373202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861622+0000","last_change":"2024-04-22T07:20:53.870458+0000","last_active":"2024-04-22T07:20:54.861622+0000","last_peered":"2024-04-22T07:20:54.861622+0000","last_clean":"2024-04-22T07:20:54.861622+0000","last_became_active":"2024-04-22T07:20:53.870125+0000","last_became_peered":"2024-04-22T07:20:53.870125+0000","last_unstale":"2024-04-22T07:20:54.861622+0000","last_undegraded":"2024-04-22T07:20:54.861622+0000","last_fullsized":"2024-04-22T07:20:54.861622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977801+0000","last_change":"2024-04-22T07:20:53.877301+0000","last_active":"2024-04-22T07:20:54.977801+0000","last_peered":"2024-04-22T07:20:54.977801+0000","last_clean":"2024-04-22T07:20:54.977801+0000","last_became_active":"2024-04-22T07:20:53.874941+0000","last_became_peered":"2024-04-22T07:20:53.874941+0000","last_unstale":"2024-04-22T07:20:54.977801+0000","last_undegraded":"2024-04-22T07:20:54.977801+0000","last_fullsized":"2024-04-22T07:20:54.977801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:52.686229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861484+0000","last_change":"2024-04-22T07:20:53.869735+0000","last_active":"2024-04-22T07:20:54.861484+0000","last_peered":"2024-04-22T07:20:54.861484+0000","last_clean":"2024-04-22T07:20:54.861484+0000","last_became_active":"2024-04-22T07:20:53.869369+0000","last_became_peered":"2024-04-22T07:20:53.869369+0000","last_unstale":"2024-04-22T07:20:54.861484+0000","last_undegraded":"2024-04-22T07:20:54.861484+0000","last_fullsized":"2024-04-22T07:20:54.861484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:27.624819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977494+0000","last_change":"2024-04-22T07:20:53.873492+0000","last_active":"2024-04-22T07:20:54.977494+0000","last_peered":"2024-04-22T07:20:54.977494+0000","last_clean":"2024-04-22T07:20:54.977494+0000","last_became_active":"2024-04-22T07:20:53.873220+0000","last_became_peered":"2024-04-22T07:20:53.873220+0000","last_unstale":"2024-04-22T07:20:54.977494+0000","last_undegraded":"2024-04-22T07:20:54.977494+0000","last_fullsized":"2024-04-22T07:20:54.977494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:35:26.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979018+0000","last_change":"2024-04-22T07:20:53.875847+0000","last_active":"2024-04-22T07:20:54.979018+0000","last_peered":"2024-04-22T07:20:54.979018+0000","last_clean":"2024-04-22T07:20:54.979018+0000","last_became_active":"2024-04-22T07:20:53.875017+0000","last_became_peered":"2024-04-22T07:20:53.875017+0000","last_unstale":"2024-04-22T07:20:54.979018+0000","last_undegraded":"2024-04-22T07:20:54.979018+0000","last_fullsized":"2024-04-22T07:20:54.979018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:07.080135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863086+0000","last_change":"2024-04-22T07:20:53.869174+0000","last_active":"2024-04-22T07:20:54.863086+0000","last_peered":"2024-04-22T07:20:54.863086+0000","last_clean":"2024-04-22T07:20:54.863086+0000","last_became_active":"2024-04-22T07:20:53.868906+0000","last_became_peered":"2024-04-22T07:20:53.868906+0000","last_unstale":"2024-04-22T07:20:54.863086+0000","last_undegraded":"2024-04-22T07:20:54.863086+0000","last_fullsized":"2024-04-22T07:20:54.863086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977893+0000","last_change":"2024-04-22T07:20:53.874933+0000","last_active":"2024-04-22T07:20:54.977893+0000","last_peered":"2024-04-22T07:20:54.977893+0000","last_clean":"2024-04-22T07:20:54.977893+0000","last_became_active":"2024-04-22T07:20:53.874673+0000","last_became_peered":"2024-04-22T07:20:53.874673+0000","last_unstale":"2024-04-22T07:20:54.977893+0000","last_undegraded":"2024-04-22T07:20:54.977893+0000","last_fullsized":"2024-04-22T07:20:54.977893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977684+0000","last_change":"2024-04-22T07:20:53.874909+0000","last_active":"2024-04-22T07:20:54.977684+0000","last_peered":"2024-04-22T07:20:54.977684+0000","last_clean":"2024-04-22T07:20:54.977684+0000","last_became_active":"2024-04-22T07:20:53.873945+0000","last_became_peered":"2024-04-22T07:20:53.873945+0000","last_unstale":"2024-04-22T07:20:54.977684+0000","last_undegraded":"2024-04-22T07:20:54.977684+0000","last_fullsized":"2024-04-22T07:20:54.977684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:53.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977652+0000","last_change":"2024-04-22T07:20:53.878344+0000","last_active":"2024-04-22T07:20:54.977652+0000","last_peered":"2024-04-22T07:20:54.977652+0000","last_clean":"2024-04-22T07:20:54.977652+0000","last_became_active":"2024-04-22T07:20:53.877192+0000","last_became_peered":"2024-04-22T07:20:53.877192+0000","last_unstale":"2024-04-22T07:20:54.977652+0000","last_undegraded":"2024-04-22T07:20:54.977652+0000","last_fullsized":"2024-04-22T07:20:54.977652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:42:03.637655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979583+0000","last_change":"2024-04-22T07:20:53.879419+0000","last_active":"2024-04-22T07:20:54.979583+0000","last_peered":"2024-04-22T07:20:54.979583+0000","last_clean":"2024-04-22T07:20:54.979583+0000","last_became_active":"2024-04-22T07:20:53.879070+0000","last_became_peered":"2024-04-22T07:20:53.879070+0000","last_unstale":"2024-04-22T07:20:54.979583+0000","last_undegraded":"2024-04-22T07:20:54.979583+0000","last_fullsized":"2024-04-22T07:20:54.979583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979592+0000","last_change":"2024-04-22T07:20:53.877395+0000","last_active":"2024-04-22T07:20:54.979592+0000","last_peered":"2024-04-22T07:20:54.979592+0000","last_clean":"2024-04-22T07:20:54.979592+0000","last_became_active":"2024-04-22T07:20:53.877116+0000","last_became_peered":"2024-04-22T07:20:53.877116+0000","last_unstale":"2024-04-22T07:20:54.979592+0000","last_undegraded":"2024-04-22T07:20:54.979592+0000","last_fullsized":"2024-04-22T07:20:54.979592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:21:25.001413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979310+0000","last_change":"2024-04-22T07:20:53.875156+0000","last_active":"2024-04-22T07:20:54.979310+0000","last_peered":"2024-04-22T07:20:54.979310+0000","last_clean":"2024-04-22T07:20:54.979310+0000","last_became_active":"2024-04-22T07:20:53.874468+0000","last_became_peered":"2024-04-22T07:20:53.874468+0000","last_unstale":"2024-04-22T07:20:54.979310+0000","last_undegraded":"2024-04-22T07:20:54.979310+0000","last_fullsized":"2024-04-22T07:20:54.979310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:42:03.637655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862585+0000","last_change":"2024-04-22T07:20:53.867178+0000","last_active":"2024-04-22T07:20:54.862585+0000","last_peered":"2024-04-22T07:20:54.862585+0000","last_clean":"2024-04-22T07:20:54.862585+0000","last_became_active":"2024-04-22T07:20:53.865491+0000","last_became_peered":"2024-04-22T07:20:53.865491+0000","last_unstale":"2024-04-22T07:20:54.862585+0000","last_undegraded":"2024-04-22T07:20:54.862585+0000","last_fullsized":"2024-04-22T07:20:54.862585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863583+0000","last_change":"2024-04-22T07:20:53.876797+0000","last_active":"2024-04-22T07:20:54.863583+0000","last_peered":"2024-04-22T07:20:54.863583+0000","last_clean":"2024-04-22T07:20:54.863583+0000","last_became_active":"2024-04-22T07:20:53.876321+0000","last_became_peered":"2024-04-22T07:20:53.876321+0000","last_unstale":"2024-04-22T07:20:54.863583+0000","last_undegraded":"2024-04-22T07:20:54.863583+0000","last_fullsized":"2024-04-22T07:20:54.863583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:22:45.699676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980360+0000","last_change":"2024-04-22T07:20:53.868760+0000","last_active":"2024-04-22T07:20:54.980360+0000","last_peered":"2024-04-22T07:20:54.980360+0000","last_clean":"2024-04-22T07:20:54.980360+0000","last_became_active":"2024-04-22T07:20:53.868441+0000","last_became_peered":"2024-04-22T07:20:53.868441+0000","last_unstale":"2024-04-22T07:20:54.980360+0000","last_undegraded":"2024-04-22T07:20:54.980360+0000","last_fullsized":"2024-04-22T07:20:54.980360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863503+0000","last_change":"2024-04-22T07:20:53.864806+0000","last_active":"2024-04-22T07:20:54.863503+0000","last_peered":"2024-04-22T07:20:54.863503+0000","last_clean":"2024-04-22T07:20:54.863503+0000","last_became_active":"2024-04-22T07:20:53.864535+0000","last_became_peered":"2024-04-22T07:20:53.864535+0000","last_unstale":"2024-04-22T07:20:54.863503+0000","last_undegraded":"2024-04-22T07:20:54.863503+0000","last_fullsized":"2024-04-22T07:20:54.863503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:22:07.227993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977721+0000","last_change":"2024-04-22T07:20:53.878013+0000","last_active":"2024-04-22T07:20:54.977721+0000","last_peered":"2024-04-22T07:20:54.977721+0000","last_clean":"2024-04-22T07:20:54.977721+0000","last_became_active":"2024-04-22T07:20:53.876641+0000","last_became_peered":"2024-04-22T07:20:53.876641+0000","last_unstale":"2024-04-22T07:20:54.977721+0000","last_undegraded":"2024-04-22T07:20:54.977721+0000","last_fullsized":"2024-04-22T07:20:54.977721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:45:15.519469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-22T07:20:52.835850+0000","last_change":"2024-04-22T07:20:52.835850+0000","last_active":"2024-04-22T07:20:52.835850+0000","last_peered":"2024-04-22T07:20:52.835850+0000","last_clean":"2024-04-22T07:20:52.835850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:52.835850+0000","last_undegraded":"2024-04-22T07:20:52.835850+0000","last_fullsized":"2024-04-22T07:20:52.835850+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862823+0000","last_change":"2024-04-22T07:20:53.867684+0000","last_active":"2024-04-22T07:20:54.862823+0000","last_peered":"2024-04-22T07:20:54.862823+0000","last_clean":"2024-04-22T07:20:54.862823+0000","last_became_active":"2024-04-22T07:20:53.867403+0000","last_became_peered":"2024-04-22T07:20:53.867403+0000","last_unstale":"2024-04-22T07:20:54.862823+0000","last_undegraded":"2024-04-22T07:20:54.862823+0000","last_fullsized":"2024-04-22T07:20:54.862823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979253+0000","last_change":"2024-04-22T07:20:53.869595+0000","last_active":"2024-04-22T07:20:54.979253+0000","last_peered":"2024-04-22T07:20:54.979253+0000","last_clean":"2024-04-22T07:20:54.979253+0000","last_became_active":"2024-04-22T07:20:53.868519+0000","last_became_peered":"2024-04-22T07:20:53.868519+0000","last_unstale":"2024-04-22T07:20:54.979253+0000","last_undegraded":"2024-04-22T07:20:54.979253+0000","last_fullsized":"2024-04-22T07:20:54.979253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:35:26.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862610+0000","last_change":"2024-04-22T07:20:53.865275+0000","last_active":"2024-04-22T07:20:54.862610+0000","last_peered":"2024-04-22T07:20:54.862610+0000","last_clean":"2024-04-22T07:20:54.862610+0000","last_became_active":"2024-04-22T07:20:53.865026+0000","last_became_peered":"2024-04-22T07:20:53.865026+0000","last_unstale":"2024-04-22T07:20:54.862610+0000","last_undegraded":"2024-04-22T07:20:54.862610+0000","last_fullsized":"2024-04-22T07:20:54.862610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:48:40.630407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979451+0000","last_change":"2024-04-22T07:20:53.873457+0000","last_active":"2024-04-22T07:20:54.979451+0000","last_peered":"2024-04-22T07:20:54.979451+0000","last_clean":"2024-04-22T07:20:54.979451+0000","last_became_active":"2024-04-22T07:20:53.873147+0000","last_became_peered":"2024-04-22T07:20:53.873147+0000","last_unstale":"2024-04-22T07:20:54.979451+0000","last_undegraded":"2024-04-22T07:20:54.979451+0000","last_fullsized":"2024-04-22T07:20:54.979451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:53.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861933+0000","last_change":"2024-04-22T07:20:53.865327+0000","last_active":"2024-04-22T07:20:54.861933+0000","last_peered":"2024-04-22T07:20:54.861933+0000","last_clean":"2024-04-22T07:20:54.861933+0000","last_became_active":"2024-04-22T07:20:53.865030+0000","last_became_peered":"2024-04-22T07:20:53.865030+0000","last_unstale":"2024-04-22T07:20:54.861933+0000","last_undegraded":"2024-04-22T07:20:54.861933+0000","last_fullsized":"2024-04-22T07:20:54.861933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979550+0000","last_change":"2024-04-22T07:20:53.876792+0000","last_active":"2024-04-22T07:20:54.979550+0000","last_peered":"2024-04-22T07:20:54.979550+0000","last_clean":"2024-04-22T07:20:54.979550+0000","last_became_active":"2024-04-22T07:20:53.876446+0000","last_became_peered":"2024-04-22T07:20:53.876446+0000","last_unstale":"2024-04-22T07:20:54.979550+0000","last_undegraded":"2024-04-22T07:20:54.979550+0000","last_fullsized":"2024-04-22T07:20:54.979550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:34.943561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979292+0000","last_change":"2024-04-22T07:20:53.878147+0000","last_active":"2024-04-22T07:20:54.979292+0000","last_peered":"2024-04-22T07:20:54.979292+0000","last_clean":"2024-04-22T07:20:54.979292+0000","last_became_active":"2024-04-22T07:20:53.877867+0000","last_became_peered":"2024-04-22T07:20:53.877867+0000","last_unstale":"2024-04-22T07:20:54.979292+0000","last_undegraded":"2024-04-22T07:20:54.979292+0000","last_fullsized":"2024-04-22T07:20:54.979292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979201+0000","last_change":"2024-04-22T07:20:53.872447+0000","last_active":"2024-04-22T07:20:54.979201+0000","last_peered":"2024-04-22T07:20:54.979201+0000","last_clean":"2024-04-22T07:20:54.979201+0000","last_became_active":"2024-04-22T07:20:53.871862+0000","last_became_peered":"2024-04-22T07:20:53.871862+0000","last_unstale":"2024-04-22T07:20:54.979201+0000","last_undegraded":"2024-04-22T07:20:54.979201+0000","last_fullsized":"2024-04-22T07:20:54.979201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:08:33.063318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862747+0000","last_change":"2024-04-22T07:20:53.862483+0000","last_active":"2024-04-22T07:20:54.862747+0000","last_peered":"2024-04-22T07:20:54.862747+0000","last_clean":"2024-04-22T07:20:54.862747+0000","last_became_active":"2024-04-22T07:20:53.862199+0000","last_became_peered":"2024-04-22T07:20:53.862199+0000","last_unstale":"2024-04-22T07:20:54.862747+0000","last_undegraded":"2024-04-22T07:20:54.862747+0000","last_fullsized":"2024-04-22T07:20:54.862747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:10:12.276510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979743+0000","last_change":"2024-04-22T07:20:53.872507+0000","last_active":"2024-04-22T07:20:54.979743+0000","last_peered":"2024-04-22T07:20:54.979743+0000","last_clean":"2024-04-22T07:20:54.979743+0000","last_became_active":"2024-04-22T07:20:53.872199+0000","last_became_peered":"2024-04-22T07:20:53.872199+0000","last_unstale":"2024-04-22T07:20:54.979743+0000","last_undegraded":"2024-04-22T07:20:54.979743+0000","last_fullsized":"2024-04-22T07:20:54.979743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:09.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861399+0000","last_change":"2024-04-22T07:20:53.863946+0000","last_active":"2024-04-22T07:20:54.861399+0000","last_peered":"2024-04-22T07:20:54.861399+0000","last_clean":"2024-04-22T07:20:54.861399+0000","last_became_active":"2024-04-22T07:20:53.863688+0000","last_became_peered":"2024-04-22T07:20:53.863688+0000","last_unstale":"2024-04-22T07:20:54.861399+0000","last_undegraded":"2024-04-22T07:20:54.861399+0000","last_fullsized":"2024-04-22T07:20:54.861399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862947+0000","last_change":"2024-04-22T07:20:53.874785+0000","last_active":"2024-04-22T07:20:54.862947+0000","last_peered":"2024-04-22T07:20:54.862947+0000","last_clean":"2024-04-22T07:20:54.862947+0000","last_became_active":"2024-04-22T07:20:53.874524+0000","last_became_peered":"2024-04-22T07:20:53.874524+0000","last_unstale":"2024-04-22T07:20:54.862947+0000","last_undegraded":"2024-04-22T07:20:54.862947+0000","last_fullsized":"2024-04-22T07:20:54.862947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978859+0000","last_change":"2024-04-22T07:20:52.860712+0000","last_active":"2024-04-22T07:20:54.978859+0000","last_peered":"2024-04-22T07:20:54.978859+0000","last_clean":"2024-04-22T07:20:54.978859+0000","last_became_active":"2024-04-22T07:20:52.860015+0000","last_became_peered":"2024-04-22T07:20:52.860015+0000","last_unstale":"2024-04-22T07:20:54.978859+0000","last_undegraded":"2024-04-22T07:20:54.978859+0000","last_fullsized":"2024-04-22T07:20:54.978859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:59:32.487127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-22T07:20:52.835850+0000","last_change":"2024-04-22T07:20:52.835850+0000","last_active":"2024-04-22T07:20:52.835850+0000","last_peered":"2024-04-22T07:20:52.835850+0000","last_clean":"2024-04-22T07:20:52.835850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:52.835850+0000","last_undegraded":"2024-04-22T07:20:52.835850+0000","last_fullsized":"2024-04-22T07:20:52.835850+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863066+0000","last_change":"2024-04-22T07:20:52.862510+0000","last_active":"2024-04-22T07:20:54.863066+0000","last_peered":"2024-04-22T07:20:54.863066+0000","last_clean":"2024-04-22T07:20:54.863066+0000","last_became_active":"2024-04-22T07:20:52.862228+0000","last_became_peered":"2024-04-22T07:20:52.862228+0000","last_unstale":"2024-04-22T07:20:54.863066+0000","last_undegraded":"2024-04-22T07:20:54.863066+0000","last_fullsized":"2024-04-22T07:20:54.863066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:51.683021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979012+0000","last_change":"2024-04-22T07:20:52.856651+0000","last_active":"2024-04-22T07:20:54.979012+0000","last_peered":"2024-04-22T07:20:54.979012+0000","last_clean":"2024-04-22T07:20:54.979012+0000","last_became_active":"2024-04-22T07:20:52.856096+0000","last_became_peered":"2024-04-22T07:20:52.856096+0000","last_unstale":"2024-04-22T07:20:54.979012+0000","last_undegraded":"2024-04-22T07:20:54.979012+0000","last_fullsized":"2024-04-22T07:20:54.979012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:04.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979658+0000","last_change":"2024-04-22T07:20:53.873708+0000","last_active":"2024-04-22T07:20:54.979658+0000","last_peered":"2024-04-22T07:20:54.979658+0000","last_clean":"2024-04-22T07:20:54.979658+0000","last_became_active":"2024-04-22T07:20:53.872793+0000","last_became_peered":"2024-04-22T07:20:53.872793+0000","last_unstale":"2024-04-22T07:20:54.979658+0000","last_undegraded":"2024-04-22T07:20:54.979658+0000","last_fullsized":"2024-04-22T07:20:54.979658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:52.686229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862729+0000","last_change":"2024-04-22T07:20:52.861133+0000","last_active":"2024-04-22T07:20:54.862729+0000","last_peered":"2024-04-22T07:20:54.862729+0000","last_clean":"2024-04-22T07:20:54.862729+0000","last_became_active":"2024-04-22T07:20:52.860736+0000","last_became_peered":"2024-04-22T07:20:52.860736+0000","last_unstale":"2024-04-22T07:20:54.862729+0000","last_undegraded":"2024-04-22T07:20:54.862729+0000","last_fullsized":"2024-04-22T07:20:54.862729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:06.123308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-22T07:20:52.835850+0000","last_change":"2024-04-22T07:20:52.835850+0000","last_active":"2024-04-22T07:20:52.835850+0000","last_peered":"2024-04-22T07:20:52.835850+0000","last_clean":"2024-04-22T07:20:52.835850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:52.835850+0000","last_undegraded":"2024-04-22T07:20:52.835850+0000","last_fullsized":"2024-04-22T07:20:52.835850+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863067+0000","last_change":"2024-04-22T07:20:52.863567+0000","last_active":"2024-04-22T07:20:54.863067+0000","last_peered":"2024-04-22T07:20:54.863067+0000","last_clean":"2024-04-22T07:20:54.863067+0000","last_became_active":"2024-04-22T07:20:52.863285+0000","last_became_peered":"2024-04-22T07:20:52.863285+0000","last_unstale":"2024-04-22T07:20:54.863067+0000","last_undegraded":"2024-04-22T07:20:54.863067+0000","last_fullsized":"2024-04-22T07:20:54.863067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861976+0000","last_change":"2024-04-22T07:20:53.864955+0000","last_active":"2024-04-22T07:20:54.861976+0000","last_peered":"2024-04-22T07:20:54.861976+0000","last_clean":"2024-04-22T07:20:54.861976+0000","last_became_active":"2024-04-22T07:20:53.864694+0000","last_became_peered":"2024-04-22T07:20:53.864694+0000","last_unstale":"2024-04-22T07:20:54.861976+0000","last_undegraded":"2024-04-22T07:20:54.861976+0000","last_fullsized":"2024-04-22T07:20:54.861976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977898+0000","last_change":"2024-04-22T07:20:52.858761+0000","last_active":"2024-04-22T07:20:54.977898+0000","last_peered":"2024-04-22T07:20:54.977898+0000","last_clean":"2024-04-22T07:20:54.977898+0000","last_became_active":"2024-04-22T07:20:52.856815+0000","last_became_peered":"2024-04-22T07:20:52.856815+0000","last_unstale":"2024-04-22T07:20:54.977898+0000","last_undegraded":"2024-04-22T07:20:54.977898+0000","last_fullsized":"2024-04-22T07:20:54.977898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:06.123308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979798+0000","last_change":"2024-04-22T07:20:53.867290+0000","last_active":"2024-04-22T07:20:54.979798+0000","last_peered":"2024-04-22T07:20:54.979798+0000","last_clean":"2024-04-22T07:20:54.979798+0000","last_became_active":"2024-04-22T07:20:53.866955+0000","last_became_peered":"2024-04-22T07:20:53.866955+0000","last_unstale":"2024-04-22T07:20:54.979798+0000","last_undegraded":"2024-04-22T07:20:54.979798+0000","last_fullsized":"2024-04-22T07:20:54.979798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:43.442316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980048+0000","last_change":"2024-04-22T07:20:52.863670+0000","last_active":"2024-04-22T07:20:54.980048+0000","last_peered":"2024-04-22T07:20:54.980048+0000","last_clean":"2024-04-22T07:20:54.980048+0000","last_became_active":"2024-04-22T07:20:52.863320+0000","last_became_peered":"2024-04-22T07:20:52.863320+0000","last_unstale":"2024-04-22T07:20:54.980048+0000","last_undegraded":"2024-04-22T07:20:54.980048+0000","last_fullsized":"2024-04-22T07:20:54.980048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:04.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862589+0000","last_change":"2024-04-22T07:20:53.868286+0000","last_active":"2024-04-22T07:20:54.862589+0000","last_peered":"2024-04-22T07:20:54.862589+0000","last_clean":"2024-04-22T07:20:54.862589+0000","last_became_active":"2024-04-22T07:20:53.862811+0000","last_became_peered":"2024-04-22T07:20:53.862811+0000","last_unstale":"2024-04-22T07:20:54.862589+0000","last_undegraded":"2024-04-22T07:20:54.862589+0000","last_fullsized":"2024-04-22T07:20:54.862589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861603+0000","last_change":"2024-04-22T07:20:52.863638+0000","last_active":"2024-04-22T07:20:54.861603+0000","last_peered":"2024-04-22T07:20:54.861603+0000","last_clean":"2024-04-22T07:20:54.861603+0000","last_became_active":"2024-04-22T07:20:52.863244+0000","last_became_peered":"2024-04-22T07:20:52.863244+0000","last_unstale":"2024-04-22T07:20:54.861603+0000","last_undegraded":"2024-04-22T07:20:54.861603+0000","last_fullsized":"2024-04-22T07:20:54.861603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:36:49.017537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977713+0000","last_change":"2024-04-22T07:20:53.875162+0000","last_active":"2024-04-22T07:20:54.977713+0000","last_peered":"2024-04-22T07:20:54.977713+0000","last_clean":"2024-04-22T07:20:54.977713+0000","last_became_active":"2024-04-22T07:20:53.874612+0000","last_became_peered":"2024-04-22T07:20:53.874612+0000","last_unstale":"2024-04-22T07:20:54.977713+0000","last_undegraded":"2024-04-22T07:20:54.977713+0000","last_fullsized":"2024-04-22T07:20:54.977713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:13:12.303505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979428+0000","last_change":"2024-04-22T07:20:52.855194+0000","last_active":"2024-04-22T07:20:54.979428+0000","last_peered":"2024-04-22T07:20:54.979428+0000","last_clean":"2024-04-22T07:20:54.979428+0000","last_became_active":"2024-04-22T07:20:52.854915+0000","last_became_peered":"2024-04-22T07:20:52.854915+0000","last_unstale":"2024-04-22T07:20:54.979428+0000","last_undegraded":"2024-04-22T07:20:54.979428+0000","last_fullsized":"2024-04-22T07:20:54.979428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979725+0000","last_change":"2024-04-22T07:20:53.868695+0000","last_active":"2024-04-22T07:20:54.979725+0000","last_peered":"2024-04-22T07:20:54.979725+0000","last_clean":"2024-04-22T07:20:54.979725+0000","last_became_active":"2024-04-22T07:20:53.868400+0000","last_became_peered":"2024-04-22T07:20:53.868400+0000","last_unstale":"2024-04-22T07:20:54.979725+0000","last_undegraded":"2024-04-22T07:20:54.979725+0000","last_fullsized":"2024-04-22T07:20:54.979725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:30:23.352871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863163+0000","last_change":"2024-04-22T07:20:52.861884+0000","last_active":"2024-04-22T07:20:54.863163+0000","last_peered":"2024-04-22T07:20:54.863163+0000","last_clean":"2024-04-22T07:20:54.863163+0000","last_became_active":"2024-04-22T07:20:52.861546+0000","last_became_peered":"2024-04-22T07:20:52.861546+0000","last_unstale":"2024-04-22T07:20:54.863163+0000","last_undegraded":"2024-04-22T07:20:54.863163+0000","last_fullsized":"2024-04-22T07:20:54.863163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:37.283262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862882+0000","last_change":"2024-04-22T07:20:53.863071+0000","last_active":"2024-04-22T07:20:54.862882+0000","last_peered":"2024-04-22T07:20:54.862882+0000","last_clean":"2024-04-22T07:20:54.862882+0000","last_became_active":"2024-04-22T07:20:53.862763+0000","last_became_peered":"2024-04-22T07:20:53.862763+0000","last_unstale":"2024-04-22T07:20:54.862882+0000","last_undegraded":"2024-04-22T07:20:54.862882+0000","last_fullsized":"2024-04-22T07:20:54.862882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:19:57.432323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977415+0000","last_change":"2024-04-22T07:20:52.865285+0000","last_active":"2024-04-22T07:20:54.977415+0000","last_peered":"2024-04-22T07:20:54.977415+0000","last_clean":"2024-04-22T07:20:54.977415+0000","last_became_active":"2024-04-22T07:20:52.864725+0000","last_became_peered":"2024-04-22T07:20:52.864725+0000","last_unstale":"2024-04-22T07:20:54.977415+0000","last_undegraded":"2024-04-22T07:20:54.977415+0000","last_fullsized":"2024-04-22T07:20:54.977415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:23:28.850031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862533+0000","last_change":"2024-04-22T07:20:53.875479+0000","last_active":"2024-04-22T07:20:54.862533+0000","last_peered":"2024-04-22T07:20:54.862533+0000","last_clean":"2024-04-22T07:20:54.862533+0000","last_became_active":"2024-04-22T07:20:53.874567+0000","last_became_peered":"2024-04-22T07:20:53.874567+0000","last_unstale":"2024-04-22T07:20:54.862533+0000","last_undegraded":"2024-04-22T07:20:54.862533+0000","last_fullsized":"2024-04-22T07:20:54.862533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-22T07:20:51.842535+0000","last_change":"2024-04-22T07:20:51.842535+0000","last_active":"2024-04-22T07:20:51.829465+0000","last_peered":"2024-04-22T07:20:51.829465+0000","last_clean":"2024-04-22T07:20:51.829465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:51.842535+0000","last_undegraded":"2024-04-22T07:20:51.842535+0000","last_fullsized":"2024-04-22T07:20:51.842535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862635+0000","last_change":"2024-04-22T07:20:53.859641+0000","last_active":"2024-04-22T07:20:54.862635+0000","last_peered":"2024-04-22T07:20:54.862635+0000","last_clean":"2024-04-22T07:20:54.862635+0000","last_became_active":"2024-04-22T07:20:53.859365+0000","last_became_peered":"2024-04-22T07:20:53.859365+0000","last_unstale":"2024-04-22T07:20:54.862635+0000","last_undegraded":"2024-04-22T07:20:54.862635+0000","last_fullsized":"2024-04-22T07:20:54.862635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:46:50.322722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977979+0000","last_change":"2024-04-22T07:20:52.866960+0000","last_active":"2024-04-22T07:20:54.977979+0000","last_peered":"2024-04-22T07:20:54.977979+0000","last_clean":"2024-04-22T07:20:54.977979+0000","last_became_active":"2024-04-22T07:20:52.866654+0000","last_became_peered":"2024-04-22T07:20:52.866654+0000","last_unstale":"2024-04-22T07:20:54.977979+0000","last_undegraded":"2024-04-22T07:20:54.977979+0000","last_fullsized":"2024-04-22T07:20:54.977979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:51.683021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862087+0000","last_change":"2024-04-22T07:20:53.874775+0000","last_active":"2024-04-22T07:20:54.862087+0000","last_peered":"2024-04-22T07:20:54.862087+0000","last_clean":"2024-04-22T07:20:54.862087+0000","last_became_active":"2024-04-22T07:20:53.874499+0000","last_became_peered":"2024-04-22T07:20:53.874499+0000","last_unstale":"2024-04-22T07:20:54.862087+0000","last_undegraded":"2024-04-22T07:20:54.862087+0000","last_fullsized":"2024-04-22T07:20:54.862087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:23.268067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-22T07:20:51.844556+0000","last_change":"2024-04-22T07:20:51.844556+0000","last_active":"2024-04-22T07:20:51.829465+0000","last_peered":"2024-04-22T07:20:51.829465+0000","last_clean":"2024-04-22T07:20:51.829465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:51.844556+0000","last_undegraded":"2024-04-22T07:20:51.844556+0000","last_fullsized":"2024-04-22T07:20:51.844556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977901+0000","last_change":"2024-04-22T07:20:53.871645+0000","last_active":"2024-04-22T07:20:54.977901+0000","last_peered":"2024-04-22T07:20:54.977901+0000","last_clean":"2024-04-22T07:20:54.977901+0000","last_became_active":"2024-04-22T07:20:53.871353+0000","last_became_peered":"2024-04-22T07:20:53.871353+0000","last_unstale":"2024-04-22T07:20:54.977901+0000","last_undegraded":"2024-04-22T07:20:54.977901+0000","last_fullsized":"2024-04-22T07:20:54.977901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:48:40.630407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980304+0000","last_change":"2024-04-22T07:20:52.866996+0000","last_active":"2024-04-22T07:20:54.980304+0000","last_peered":"2024-04-22T07:20:54.980304+0000","last_clean":"2024-04-22T07:20:54.980304+0000","last_became_active":"2024-04-22T07:20:52.866677+0000","last_became_peered":"2024-04-22T07:20:52.866677+0000","last_unstale":"2024-04-22T07:20:54.980304+0000","last_undegraded":"2024-04-22T07:20:54.980304+0000","last_fullsized":"2024-04-22T07:20:54.980304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977832+0000","last_change":"2024-04-22T07:20:53.871064+0000","last_active":"2024-04-22T07:20:54.977832+0000","last_peered":"2024-04-22T07:20:54.977832+0000","last_clean":"2024-04-22T07:20:54.977832+0000","last_became_active":"2024-04-22T07:20:53.866968+0000","last_became_peered":"2024-04-22T07:20:53.866968+0000","last_unstale":"2024-04-22T07:20:54.977832+0000","last_undegraded":"2024-04-22T07:20:54.977832+0000","last_fullsized":"2024-04-22T07:20:54.977832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:43.442316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979659+0000","last_change":"2024-04-22T07:20:52.856958+0000","last_active":"2024-04-22T07:20:54.979659+0000","last_peered":"2024-04-22T07:20:54.979659+0000","last_clean":"2024-04-22T07:20:54.979659+0000","last_became_active":"2024-04-22T07:20:52.856289+0000","last_became_peered":"2024-04-22T07:20:52.856289+0000","last_unstale":"2024-04-22T07:20:54.979659+0000","last_undegraded":"2024-04-22T07:20:54.979659+0000","last_fullsized":"2024-04-22T07:20:54.979659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863352+0000","last_change":"2024-04-22T07:20:53.872915+0000","last_active":"2024-04-22T07:20:54.863352+0000","last_peered":"2024-04-22T07:20:54.863352+0000","last_clean":"2024-04-22T07:20:54.863352+0000","last_became_active":"2024-04-22T07:20:53.872005+0000","last_became_peered":"2024-04-22T07:20:53.872005+0000","last_unstale":"2024-04-22T07:20:54.863352+0000","last_undegraded":"2024-04-22T07:20:54.863352+0000","last_fullsized":"2024-04-22T07:20:54.863352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:53:29.242632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862549+0000","last_change":"2024-04-22T07:20:43.747396+0000","last_active":"2024-04-22T07:20:54.862549+0000","last_peered":"2024-04-22T07:20:54.862549+0000","last_clean":"2024-04-22T07:20:54.862549+0000","last_became_active":"2024-04-22T07:20:43.746332+0000","last_became_peered":"2024-04-22T07:20:43.746332+0000","last_unstale":"2024-04-22T07:20:54.862549+0000","last_undegraded":"2024-04-22T07:20:54.862549+0000","last_fullsized":"2024-04-22T07:20:54.862549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:42.732916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:42.732916+0000","last_clean_scrub_stamp":"2024-04-22T07:20:42.732916+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:02:55.086445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863049+0000","last_change":"2024-04-22T07:20:52.862492+0000","last_active":"2024-04-22T07:20:54.863049+0000","last_peered":"2024-04-22T07:20:54.863049+0000","last_clean":"2024-04-22T07:20:54.863049+0000","last_became_active":"2024-04-22T07:20:52.862201+0000","last_became_peered":"2024-04-22T07:20:52.862201+0000","last_unstale":"2024-04-22T07:20:54.863049+0000","last_undegraded":"2024-04-22T07:20:54.863049+0000","last_fullsized":"2024-04-22T07:20:54.863049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:52.015227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-22T07:20:52.835850+0000","last_change":"2024-04-22T07:20:52.835850+0000","last_active":"2024-04-22T07:20:52.835850+0000","last_peered":"2024-04-22T07:20:52.835850+0000","last_clean":"2024-04-22T07:20:52.835850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:52.835850+0000","last_undegraded":"2024-04-22T07:20:52.835850+0000","last_fullsized":"2024-04-22T07:20:52.835850+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862731+0000","last_change":"2024-04-22T07:20:52.867622+0000","last_active":"2024-04-22T07:20:54.862731+0000","last_peered":"2024-04-22T07:20:54.862731+0000","last_clean":"2024-04-22T07:20:54.862731+0000","last_became_active":"2024-04-22T07:20:52.866996+0000","last_became_peered":"2024-04-22T07:20:52.866996+0000","last_unstale":"2024-04-22T07:20:54.862731+0000","last_undegraded":"2024-04-22T07:20:54.862731+0000","last_fullsized":"2024-04-22T07:20:54.862731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:08.286530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978392+0000","last_change":"2024-04-22T07:20:53.871576+0000","last_active":"2024-04-22T07:20:54.978392+0000","last_peered":"2024-04-22T07:20:54.978392+0000","last_clean":"2024-04-22T07:20:54.978392+0000","last_became_active":"2024-04-22T07:20:53.871239+0000","last_became_peered":"2024-04-22T07:20:53.871239+0000","last_unstale":"2024-04-22T07:20:54.978392+0000","last_undegraded":"2024-04-22T07:20:54.978392+0000","last_fullsized":"2024-04-22T07:20:54.978392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979845+0000","last_change":"2024-04-22T07:20:52.866974+0000","last_active":"2024-04-22T07:20:54.979845+0000","last_peered":"2024-04-22T07:20:54.979845+0000","last_clean":"2024-04-22T07:20:54.979845+0000","last_became_active":"2024-04-22T07:20:52.866581+0000","last_became_peered":"2024-04-22T07:20:52.866581+0000","last_unstale":"2024-04-22T07:20:54.979845+0000","last_undegraded":"2024-04-22T07:20:54.979845+0000","last_fullsized":"2024-04-22T07:20:54.979845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979503+0000","last_change":"2024-04-22T07:20:53.865035+0000","last_active":"2024-04-22T07:20:54.979503+0000","last_peered":"2024-04-22T07:20:54.979503+0000","last_clean":"2024-04-22T07:20:54.979503+0000","last_became_active":"2024-04-22T07:20:53.864523+0000","last_became_peered":"2024-04-22T07:20:53.864523+0000","last_unstale":"2024-04-22T07:20:54.979503+0000","last_undegraded":"2024-04-22T07:20:54.979503+0000","last_fullsized":"2024-04-22T07:20:54.979503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:13:12.303505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863169+0000","last_change":"2024-04-22T07:20:52.858498+0000","last_active":"2024-04-22T07:20:54.863169+0000","last_peered":"2024-04-22T07:20:54.863169+0000","last_clean":"2024-04-22T07:20:54.863169+0000","last_became_active":"2024-04-22T07:20:52.858139+0000","last_became_peered":"2024-04-22T07:20:52.858139+0000","last_unstale":"2024-04-22T07:20:54.863169+0000","last_undegraded":"2024-04-22T07:20:54.863169+0000","last_fullsized":"2024-04-22T07:20:54.863169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:45.382709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977943+0000","last_change":"2024-04-22T07:20:53.877595+0000","last_active":"2024-04-22T07:20:54.977943+0000","last_peered":"2024-04-22T07:20:54.977943+0000","last_clean":"2024-04-22T07:20:54.977943+0000","last_became_active":"2024-04-22T07:20:53.877208+0000","last_became_peered":"2024-04-22T07:20:53.877208+0000","last_unstale":"2024-04-22T07:20:54.977943+0000","last_undegraded":"2024-04-22T07:20:54.977943+0000","last_fullsized":"2024-04-22T07:20:54.977943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:46:50.322722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979001+0000","last_change":"2024-04-22T07:20:52.866224+0000","last_active":"2024-04-22T07:20:54.979001+0000","last_peered":"2024-04-22T07:20:54.979001+0000","last_clean":"2024-04-22T07:20:54.979001+0000","last_became_active":"2024-04-22T07:20:52.865903+0000","last_became_peered":"2024-04-22T07:20:52.865903+0000","last_unstale":"2024-04-22T07:20:54.979001+0000","last_undegraded":"2024-04-22T07:20:54.979001+0000","last_fullsized":"2024-04-22T07:20:54.979001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861395+0000","last_change":"2024-04-22T07:20:53.873266+0000","last_active":"2024-04-22T07:20:54.861395+0000","last_peered":"2024-04-22T07:20:54.861395+0000","last_clean":"2024-04-22T07:20:54.861395+0000","last_became_active":"2024-04-22T07:20:53.872915+0000","last_became_peered":"2024-04-22T07:20:53.872915+0000","last_unstale":"2024-04-22T07:20:54.861395+0000","last_undegraded":"2024-04-22T07:20:54.861395+0000","last_fullsized":"2024-04-22T07:20:54.861395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:09.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863471+0000","last_change":"2024-04-22T07:20:52.863593+0000","last_active":"2024-04-22T07:20:54.863471+0000","last_peered":"2024-04-22T07:20:54.863471+0000","last_clean":"2024-04-22T07:20:54.863471+0000","last_became_active":"2024-04-22T07:20:52.863296+0000","last_became_peered":"2024-04-22T07:20:52.863296+0000","last_unstale":"2024-04-22T07:20:54.863471+0000","last_undegraded":"2024-04-22T07:20:54.863471+0000","last_fullsized":"2024-04-22T07:20:54.863471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:22.261683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979540+0000","last_change":"2024-04-22T07:20:53.874491+0000","last_active":"2024-04-22T07:20:54.979540+0000","last_peered":"2024-04-22T07:20:54.979540+0000","last_clean":"2024-04-22T07:20:54.979540+0000","last_became_active":"2024-04-22T07:20:53.874202+0000","last_became_peered":"2024-04-22T07:20:53.874202+0000","last_unstale":"2024-04-22T07:20:54.979540+0000","last_undegraded":"2024-04-22T07:20:54.979540+0000","last_fullsized":"2024-04-22T07:20:54.979540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:23.268067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-22T07:20:51.842526+0000","last_change":"2024-04-22T07:20:51.842526+0000","last_active":"2024-04-22T07:20:51.829465+0000","last_peered":"2024-04-22T07:20:51.829465+0000","last_clean":"2024-04-22T07:20:51.829465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:51.842526+0000","last_undegraded":"2024-04-22T07:20:51.842526+0000","last_fullsized":"2024-04-22T07:20:51.842526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-22T07:20:52.835850+0000","last_change":"2024-04-22T07:20:52.835850+0000","last_active":"2024-04-22T07:20:52.835850+0000","last_peered":"2024-04-22T07:20:52.835850+0000","last_clean":"2024-04-22T07:20:52.835850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:52.835850+0000","last_undegraded":"2024-04-22T07:20:52.835850+0000","last_fullsized":"2024-04-22T07:20:52.835850+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863610+0000","last_change":"2024-04-22T07:20:52.864740+0000","last_active":"2024-04-22T07:20:54.863610+0000","last_peered":"2024-04-22T07:20:54.863610+0000","last_clean":"2024-04-22T07:20:54.863610+0000","last_became_active":"2024-04-22T07:20:52.864434+0000","last_became_peered":"2024-04-22T07:20:52.864434+0000","last_unstale":"2024-04-22T07:20:54.863610+0000","last_undegraded":"2024-04-22T07:20:54.863610+0000","last_fullsized":"2024-04-22T07:20:54.863610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:33.937176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-22T07:20:52.835850+0000","last_change":"2024-04-22T07:20:52.835850+0000","last_active":"2024-04-22T07:20:52.835850+0000","last_peered":"2024-04-22T07:20:52.835850+0000","last_clean":"2024-04-22T07:20:52.835850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:52.835850+0000","last_undegraded":"2024-04-22T07:20:52.835850+0000","last_fullsized":"2024-04-22T07:20:52.835850+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977319+0000","last_change":"2024-04-22T07:20:52.854668+0000","last_active":"2024-04-22T07:20:54.977319+0000","last_peered":"2024-04-22T07:20:54.977319+0000","last_clean":"2024-04-22T07:20:54.977319+0000","last_became_active":"2024-04-22T07:20:52.854395+0000","last_became_peered":"2024-04-22T07:20:52.854395+0000","last_unstale":"2024-04-22T07:20:54.977319+0000","last_undegraded":"2024-04-22T07:20:54.977319+0000","last_fullsized":"2024-04-22T07:20:54.977319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:59:32.487127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862797+0000","last_change":"2024-04-22T07:20:53.870972+0000","last_active":"2024-04-22T07:20:54.862797+0000","last_peered":"2024-04-22T07:20:54.862797+0000","last_clean":"2024-04-22T07:20:54.862797+0000","last_became_active":"2024-04-22T07:20:53.870674+0000","last_became_peered":"2024-04-22T07:20:53.870674+0000","last_unstale":"2024-04-22T07:20:54.862797+0000","last_undegraded":"2024-04-22T07:20:54.862797+0000","last_fullsized":"2024-04-22T07:20:54.862797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:10.431906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-22T07:20:51.843148+0000","last_change":"2024-04-22T07:20:51.843148+0000","last_active":"2024-04-22T07:20:51.829465+0000","last_peered":"2024-04-22T07:20:51.829465+0000","last_clean":"2024-04-22T07:20:51.829465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:51.843148+0000","last_undegraded":"2024-04-22T07:20:51.843148+0000","last_fullsized":"2024-04-22T07:20:51.843148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-22T07:20:52.835850+0000","last_change":"2024-04-22T07:20:52.835850+0000","last_active":"2024-04-22T07:20:52.835850+0000","last_peered":"2024-04-22T07:20:52.835850+0000","last_clean":"2024-04-22T07:20:52.835850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:52.835850+0000","last_undegraded":"2024-04-22T07:20:52.835850+0000","last_fullsized":"2024-04-22T07:20:52.835850+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979784+0000","last_change":"2024-04-22T07:20:52.861048+0000","last_active":"2024-04-22T07:20:54.979784+0000","last_peered":"2024-04-22T07:20:54.979784+0000","last_clean":"2024-04-22T07:20:54.979784+0000","last_became_active":"2024-04-22T07:20:52.860702+0000","last_became_peered":"2024-04-22T07:20:52.860702+0000","last_unstale":"2024-04-22T07:20:54.979784+0000","last_undegraded":"2024-04-22T07:20:54.979784+0000","last_fullsized":"2024-04-22T07:20:54.979784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979324+0000","last_change":"2024-04-22T07:20:53.868782+0000","last_active":"2024-04-22T07:20:54.979324+0000","last_peered":"2024-04-22T07:20:54.979324+0000","last_clean":"2024-04-22T07:20:54.979324+0000","last_became_active":"2024-04-22T07:20:53.868509+0000","last_became_peered":"2024-04-22T07:20:53.868509+0000","last_unstale":"2024-04-22T07:20:54.979324+0000","last_undegraded":"2024-04-22T07:20:54.979324+0000","last_fullsized":"2024-04-22T07:20:54.979324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:07.129692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862970+0000","last_change":"2024-04-22T07:20:52.858508+0000","last_active":"2024-04-22T07:20:54.862970+0000","last_peered":"2024-04-22T07:20:54.862970+0000","last_clean":"2024-04-22T07:20:54.862970+0000","last_became_active":"2024-04-22T07:20:52.858215+0000","last_became_peered":"2024-04-22T07:20:52.858215+0000","last_unstale":"2024-04-22T07:20:54.862970+0000","last_undegraded":"2024-04-22T07:20:54.862970+0000","last_fullsized":"2024-04-22T07:20:54.862970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:26.618434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862971+0000","last_change":"2024-04-22T07:20:53.867977+0000","last_active":"2024-04-22T07:20:54.862971+0000","last_peered":"2024-04-22T07:20:54.862971+0000","last_clean":"2024-04-22T07:20:54.862971+0000","last_became_active":"2024-04-22T07:20:53.867447+0000","last_became_peered":"2024-04-22T07:20:53.867447+0000","last_unstale":"2024-04-22T07:20:54.862971+0000","last_undegraded":"2024-04-22T07:20:54.862971+0000","last_fullsized":"2024-04-22T07:20:54.862971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:48:52.934171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863377+0000","last_change":"2024-04-22T07:20:53.875681+0000","last_active":"2024-04-22T07:20:54.863377+0000","last_peered":"2024-04-22T07:20:54.863377+0000","last_clean":"2024-04-22T07:20:54.863377+0000","last_became_active":"2024-04-22T07:20:53.875305+0000","last_became_peered":"2024-04-22T07:20:53.875305+0000","last_unstale":"2024-04-22T07:20:54.863377+0000","last_undegraded":"2024-04-22T07:20:54.863377+0000","last_fullsized":"2024-04-22T07:20:54.863377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:22:34.452869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977916+0000","last_change":"2024-04-22T07:20:52.857445+0000","last_active":"2024-04-22T07:20:54.977916+0000","last_peered":"2024-04-22T07:20:54.977916+0000","last_clean":"2024-04-22T07:20:54.977916+0000","last_became_active":"2024-04-22T07:20:52.856293+0000","last_became_peered":"2024-04-22T07:20:52.856293+0000","last_unstale":"2024-04-22T07:20:54.977916+0000","last_undegraded":"2024-04-22T07:20:54.977916+0000","last_fullsized":"2024-04-22T07:20:54.977916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:10.640191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862780+0000","last_change":"2024-04-22T07:20:53.870827+0000","last_active":"2024-04-22T07:20:54.862780+0000","last_peered":"2024-04-22T07:20:54.862780+0000","last_clean":"2024-04-22T07:20:54.862780+0000","last_became_active":"2024-04-22T07:20:53.870548+0000","last_became_peered":"2024-04-22T07:20:53.870548+0000","last_unstale":"2024-04-22T07:20:54.862780+0000","last_undegraded":"2024-04-22T07:20:54.862780+0000","last_fullsized":"2024-04-22T07:20:54.862780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:27.624819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977785+0000","last_change":"2024-04-22T07:20:52.856933+0000","last_active":"2024-04-22T07:20:54.977785+0000","last_peered":"2024-04-22T07:20:54.977785+0000","last_clean":"2024-04-22T07:20:54.977785+0000","last_became_active":"2024-04-22T07:20:52.856617+0000","last_became_peered":"2024-04-22T07:20:52.856617+0000","last_unstale":"2024-04-22T07:20:54.977785+0000","last_undegraded":"2024-04-22T07:20:54.977785+0000","last_fullsized":"2024-04-22T07:20:54.977785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:08.286530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979619+0000","last_change":"2024-04-22T07:20:53.866552+0000","last_active":"2024-04-22T07:20:54.979619+0000","last_peered":"2024-04-22T07:20:54.979619+0000","last_clean":"2024-04-22T07:20:54.979619+0000","last_became_active":"2024-04-22T07:20:53.866286+0000","last_became_peered":"2024-04-22T07:20:53.866286+0000","last_unstale":"2024-04-22T07:20:54.979619+0000","last_undegraded":"2024-04-22T07:20:54.979619+0000","last_fullsized":"2024-04-22T07:20:54.979619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:45:15.519469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980248+0000","last_change":"2024-04-22T07:20:52.863291+0000","last_active":"2024-04-22T07:20:54.980248+0000","last_peered":"2024-04-22T07:20:54.980248+0000","last_clean":"2024-04-22T07:20:54.980248+0000","last_became_active":"2024-04-22T07:20:52.862967+0000","last_became_peered":"2024-04-22T07:20:52.862967+0000","last_unstale":"2024-04-22T07:20:54.980248+0000","last_undegraded":"2024-04-22T07:20:54.980248+0000","last_fullsized":"2024-04-22T07:20:54.980248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:10.640191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980150+0000","last_change":"2024-04-22T07:20:53.871045+0000","last_active":"2024-04-22T07:20:54.980150+0000","last_peered":"2024-04-22T07:20:54.980150+0000","last_clean":"2024-04-22T07:20:54.980150+0000","last_became_active":"2024-04-22T07:20:53.870715+0000","last_became_peered":"2024-04-22T07:20:53.870715+0000","last_unstale":"2024-04-22T07:20:54.980150+0000","last_undegraded":"2024-04-22T07:20:54.980150+0000","last_fullsized":"2024-04-22T07:20:54.980150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-22T07:20:51.842558+0000","last_change":"2024-04-22T07:20:51.842558+0000","last_active":"2024-04-22T07:20:51.829465+0000","last_peered":"2024-04-22T07:20:51.829465+0000","last_clean":"2024-04-22T07:20:51.829465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:51.842558+0000","last_undegraded":"2024-04-22T07:20:51.842558+0000","last_fullsized":"2024-04-22T07:20:51.842558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":815104,"data_stored":665303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":671603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T07:20:59.229 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T07:20:59.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.369+0000 7feb4bc06640 1 Processor -- start 2024-04-22T07:20:59.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.369+0000 7feb4bc06640 1 -- start start 2024-04-22T07:20:59.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.370+0000 7feb4bc06640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7feb4406ea90 0x7feb44158470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:59.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.370+0000 7feb4bc06640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7feb440c7d30 0x7feb440c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:59.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.370+0000 7feb4bc06640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb440c5650 con 0x7feb44151c00 2024-04-22T07:20:59.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.370+0000 7feb4bc06640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7feb440c3720 con 0x7feb4406ea90 2024-04-22T07:20:59.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.370+0000 7feb4bc06640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7feb440c3970 con 0x7feb440c7d30 2024-04-22T07:20:59.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.370+0000 7feb491a1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7feb4406ea90 0x7feb44158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:59.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.370+0000 7feb499a2640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7feb44151c00 0x7feb440c60f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39888/0 (socket says 172.21.15.40:39888) 2024-04-22T07:20:59.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.370+0000 7feb499a2640 1 -- 172.21.15.40:0/150908145 learned_addr learned my addr 172.21.15.40:0/150908145 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:20:59.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.370+0000 7feb4a1a3640 1 --2- 172.21.15.40:0/150908145 >> v2:172.21.15.62:3300/0 conn(0x7feb440c7d30 0x7feb440c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:59.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.370+0000 7feb491a1640 1 -- 172.21.15.40:0/150908145 >> v2:172.21.15.62:3300/0 conn(0x7feb440c7d30 msgr2=0x7feb440c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:20:59.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.370+0000 7feb491a1640 1 --2- 172.21.15.40:0/150908145 >> v2:172.21.15.62:3300/0 conn(0x7feb440c7d30 0x7feb440c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.370+0000 7feb491a1640 1 -- 172.21.15.40:0/150908145 >> v1:172.21.15.40:6789/0 conn(0x7feb44151c00 legacy=0x7feb440c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:59.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.370+0000 7feb491a1640 1 -- 172.21.15.40:0/150908145 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb440c3c50 con 0x7feb4406ea90 2024-04-22T07:20:59.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.370+0000 7feb489a0640 1 -- 172.21.15.40:0/150908145 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1369201069 0 0) 0x7feb440c5650 con 0x7feb44151c00 2024-04-22T07:20:59.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.371+0000 7feb491a1640 1 --2- 172.21.15.40:0/150908145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb4406ea90 0x7feb44158470 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7feb440723e0 tx=0x7feb3402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b89a9680796083 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:59.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.371+0000 7feb489a0640 1 -- 172.21.15.40:0/150908145 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb34035020 con 0x7feb4406ea90 2024-04-22T07:20:59.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.371+0000 7feb489a0640 1 -- 172.21.15.40:0/150908145 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb34031830 con 0x7feb4406ea90 2024-04-22T07:20:59.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.371+0000 7feb489a0640 1 -- 172.21.15.40:0/150908145 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb34031c00 con 0x7feb4406ea90 2024-04-22T07:20:59.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.372+0000 7feb4bc06640 1 -- 172.21.15.40:0/150908145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb4406ea90 msgr2=0x7feb44158470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:59.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.372+0000 7feb4bc06640 1 --2- 172.21.15.40:0/150908145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb4406ea90 0x7feb44158470 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7feb440723e0 tx=0x7feb3402b8d0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.372+0000 7feb4bc06640 1 -- 172.21.15.40:0/150908145 shutdown_connections 2024-04-22T07:20:59.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.372+0000 7feb4bc06640 1 --2- 172.21.15.40:0/150908145 >> v2:172.21.15.62:3300/0 conn(0x7feb440c7d30 0x7feb440c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.372+0000 7feb4bc06640 1 --2- 172.21.15.40:0/150908145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb4406ea90 0x7feb44158470 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.372+0000 7feb4bc06640 1 -- 172.21.15.40:0/150908145 >> 172.21.15.40:0/150908145 conn(0x7feb440cc220 msgr2=0x7feb440cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:59.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.372+0000 7feb4bc06640 1 -- 172.21.15.40:0/150908145 shutdown_connections 2024-04-22T07:20:59.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.372+0000 7feb4bc06640 1 -- 172.21.15.40:0/150908145 wait complete. 2024-04-22T07:20:59.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.373+0000 7feb4bc06640 1 Processor -- start 2024-04-22T07:20:59.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.373+0000 7feb4bc06640 1 -- start start 2024-04-22T07:20:59.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.374+0000 7feb4bc06640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb4406ea90 0x7feb441467e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:59.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.374+0000 7feb4bc06640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feb440c7d30 0x7feb44146d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:59.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.374+0000 7feb4bc06640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb44151c00 0x7feb4414cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:59.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.374+0000 7feb4bc06640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7feb440ccfb0 con 0x7feb4406ea90 2024-04-22T07:20:59.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.374+0000 7feb4bc06640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7feb440c5bd0 con 0x7feb44151c00 2024-04-22T07:20:59.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.374+0000 7feb4bc06640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7feb440c3f30 con 0x7feb440c7d30 2024-04-22T07:20:59.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.374+0000 7feb499a2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb4406ea90 0x7feb441467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:59.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.374+0000 7feb499a2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb4406ea90 0x7feb441467e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43742/0 (socket says 172.21.15.40:43742) 2024-04-22T07:20:59.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.374+0000 7feb499a2640 1 -- 172.21.15.40:0/3693113361 learned_addr learned my addr 172.21.15.40:0/3693113361 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:59.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.374+0000 7feb4a1a3640 1 --2- 172.21.15.40:0/3693113361 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb44151c00 0x7feb4414cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:59.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.374+0000 7feb491a1640 1 --2- 172.21.15.40:0/3693113361 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feb440c7d30 0x7feb44146d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:59.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.374+0000 7feb499a2640 1 -- 172.21.15.40:0/3693113361 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feb440c7d30 msgr2=0x7feb44146d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:59.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.374+0000 7feb499a2640 1 --2- 172.21.15.40:0/3693113361 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feb440c7d30 0x7feb44146d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.374+0000 7feb499a2640 1 -- 172.21.15.40:0/3693113361 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb44151c00 msgr2=0x7feb4414cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:59.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.374+0000 7feb499a2640 1 --2- 172.21.15.40:0/3693113361 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb44151c00 0x7feb4414cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.374+0000 7feb499a2640 1 -- 172.21.15.40:0/3693113361 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb4414a620 con 0x7feb4406ea90 2024-04-22T07:20:59.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.374+0000 7feb491a1640 1 --2- 172.21.15.40:0/3693113361 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feb440c7d30 0x7feb44146d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:20:59.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.374+0000 7feb499a2640 1 --2- 172.21.15.40:0/3693113361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb4406ea90 0x7feb441467e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feb4000e760 tx=0x7feb4000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:59.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.374+0000 7feb3a7fc640 1 -- 172.21.15.40:0/3693113361 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb400072e0 con 0x7feb4406ea90 2024-04-22T07:20:59.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.374+0000 7feb3a7fc640 1 -- 172.21.15.40:0/3693113361 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb40016020 con 0x7feb4406ea90 2024-04-22T07:20:59.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.374+0000 7feb4bc06640 1 -- 172.21.15.40:0/3693113361 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb441575d0 con 0x7feb4406ea90 2024-04-22T07:20:59.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.374+0000 7feb3a7fc640 1 -- 172.21.15.40:0/3693113361 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb400016d0 con 0x7feb4406ea90 2024-04-22T07:20:59.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.374+0000 7feb4bc06640 1 -- 172.21.15.40:0/3693113361 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb4414ef60 con 0x7feb4406ea90 2024-04-22T07:20:59.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.375+0000 7feb4bc06640 1 -- 172.21.15.40:0/3693113361 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb44069d40 con 0x7feb4406ea90 2024-04-22T07:20:59.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.376+0000 7feb3a7fc640 1 -- 172.21.15.40:0/3693113361 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feb40001870 con 0x7feb4406ea90 2024-04-22T07:20:59.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.376+0000 7feb3a7fc640 1 --2- 172.21.15.40:0/3693113361 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7feb2806c8f0 0x7feb2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:59.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.376+0000 7feb3a7fc640 1 -- 172.21.15.40:0/3693113361 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7feb4008e150 con 0x7feb4406ea90 2024-04-22T07:20:59.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.376+0000 7feb491a1640 1 --2- 172.21.15.40:0/3693113361 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7feb2806c8f0 0x7feb2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:59.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.377+0000 7feb491a1640 1 --2- 172.21.15.40:0/3693113361 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7feb2806c8f0 0x7feb2806edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feb34036000 tx=0x7feb34008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:59.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.380+0000 7feb3a7fc640 1 -- 172.21.15.40:0/3693113361 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feb40020020 con 0x7feb4406ea90 2024-04-22T07:20:59.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.561+0000 7feb4bc06640 1 -- 172.21.15.40:0/3693113361 --> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feb4414e5d0 con 0x7feb2806c8f0 2024-04-22T07:20:59.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.566+0000 7feb3a7fc640 1 -- 172.21.15.40:0/3693113361 <== mgr.4107 v2:172.21.15.40:6832/91163869 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250408 (secure 0 0 0) 0x7feb4414e5d0 con 0x7feb2806c8f0 2024-04-22T07:20:59.567 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:20:59.568 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-22T07:20:59.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.569+0000 7feb4bc06640 1 -- 172.21.15.40:0/3693113361 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7feb2806c8f0 msgr2=0x7feb2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:59.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.569+0000 7feb4bc06640 1 --2- 172.21.15.40:0/3693113361 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7feb2806c8f0 0x7feb2806edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feb34036000 tx=0x7feb34008030 comp rx=0 tx=0).stop 2024-04-22T07:20:59.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.569+0000 7feb4bc06640 1 -- 172.21.15.40:0/3693113361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb4406ea90 msgr2=0x7feb441467e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:59.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.569+0000 7feb4bc06640 1 --2- 172.21.15.40:0/3693113361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb4406ea90 0x7feb441467e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feb4000e760 tx=0x7feb4000ec20 comp rx=0 tx=0).stop 2024-04-22T07:20:59.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.570+0000 7feb4bc06640 1 -- 172.21.15.40:0/3693113361 shutdown_connections 2024-04-22T07:20:59.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.570+0000 7feb4bc06640 1 --2- 172.21.15.40:0/3693113361 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb44151c00 0x7feb4414cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.570+0000 7feb4bc06640 1 --2- 172.21.15.40:0/3693113361 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feb440c7d30 0x7feb44146d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.570+0000 7feb4bc06640 1 --2- 172.21.15.40:0/3693113361 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7feb2806c8f0 0x7feb2806edb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.570+0000 7feb4bc06640 1 --2- 172.21.15.40:0/3693113361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb4406ea90 0x7feb441467e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.570+0000 7feb4bc06640 1 -- 172.21.15.40:0/3693113361 >> 172.21.15.40:0/3693113361 conn(0x7feb440cc220 msgr2=0x7feb440c81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:59.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.570+0000 7feb4bc06640 1 -- 172.21.15.40:0/3693113361 shutdown_connections 2024-04-22T07:20:59.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.570+0000 7feb4bc06640 1 -- 172.21.15.40:0/3693113361 wait complete. 2024-04-22T07:20:59.578 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-04-22T07:20:57.777573+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219060,"kb_used_data":2876,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755660,"statfs":{"total":773094113280,"available":772869795840,"internally_reserved":0,"allocated":2945024,"data_stored":1773949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.941312"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977886+0000","last_change":"2024-04-22T07:20:53.873662+0000","last_active":"2024-04-22T07:20:54.977886+0000","last_peered":"2024-04-22T07:20:54.977886+0000","last_clean":"2024-04-22T07:20:54.977886+0000","last_became_active":"2024-04-22T07:20:53.873384+0000","last_became_peered":"2024-04-22T07:20:53.873384+0000","last_unstale":"2024-04-22T07:20:54.977886+0000","last_undegraded":"2024-04-22T07:20:54.977886+0000","last_fullsized":"2024-04-22T07:20:54.977886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980006+0000","last_change":"2024-04-22T07:20:53.870454+0000","last_active":"2024-04-22T07:20:54.980006+0000","last_peered":"2024-04-22T07:20:54.980006+0000","last_clean":"2024-04-22T07:20:54.980006+0000","last_became_active":"2024-04-22T07:20:53.869964+0000","last_became_peered":"2024-04-22T07:20:53.869964+0000","last_unstale":"2024-04-22T07:20:54.980006+0000","last_undegraded":"2024-04-22T07:20:54.980006+0000","last_fullsized":"2024-04-22T07:20:54.980006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979125+0000","last_change":"2024-04-22T07:20:53.871145+0000","last_active":"2024-04-22T07:20:54.979125+0000","last_peered":"2024-04-22T07:20:54.979125+0000","last_clean":"2024-04-22T07:20:54.979125+0000","last_became_active":"2024-04-22T07:20:53.870819+0000","last_became_peered":"2024-04-22T07:20:53.870819+0000","last_unstale":"2024-04-22T07:20:54.979125+0000","last_undegraded":"2024-04-22T07:20:54.979125+0000","last_fullsized":"2024-04-22T07:20:54.979125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:02:16.373202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861622+0000","last_change":"2024-04-22T07:20:53.870458+0000","last_active":"2024-04-22T07:20:54.861622+0000","last_peered":"2024-04-22T07:20:54.861622+0000","last_clean":"2024-04-22T07:20:54.861622+0000","last_became_active":"2024-04-22T07:20:53.870125+0000","last_became_peered":"2024-04-22T07:20:53.870125+0000","last_unstale":"2024-04-22T07:20:54.861622+0000","last_undegraded":"2024-04-22T07:20:54.861622+0000","last_fullsized":"2024-04-22T07:20:54.861622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977801+0000","last_change":"2024-04-22T07:20:53.877301+0000","last_active":"2024-04-22T07:20:54.977801+0000","last_peered":"2024-04-22T07:20:54.977801+0000","last_clean":"2024-04-22T07:20:54.977801+0000","last_became_active":"2024-04-22T07:20:53.874941+0000","last_became_peered":"2024-04-22T07:20:53.874941+0000","last_unstale":"2024-04-22T07:20:54.977801+0000","last_undegraded":"2024-04-22T07:20:54.977801+0000","last_fullsized":"2024-04-22T07:20:54.977801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:52.686229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861484+0000","last_change":"2024-04-22T07:20:53.869735+0000","last_active":"2024-04-22T07:20:54.861484+0000","last_peered":"2024-04-22T07:20:54.861484+0000","last_clean":"2024-04-22T07:20:54.861484+0000","last_became_active":"2024-04-22T07:20:53.869369+0000","last_became_peered":"2024-04-22T07:20:53.869369+0000","last_unstale":"2024-04-22T07:20:54.861484+0000","last_undegraded":"2024-04-22T07:20:54.861484+0000","last_fullsized":"2024-04-22T07:20:54.861484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:27.624819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977494+0000","last_change":"2024-04-22T07:20:53.873492+0000","last_active":"2024-04-22T07:20:54.977494+0000","last_peered":"2024-04-22T07:20:54.977494+0000","last_clean":"2024-04-22T07:20:54.977494+0000","last_became_active":"2024-04-22T07:20:53.873220+0000","last_became_peered":"2024-04-22T07:20:53.873220+0000","last_unstale":"2024-04-22T07:20:54.977494+0000","last_undegraded":"2024-04-22T07:20:54.977494+0000","last_fullsized":"2024-04-22T07:20:54.977494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:35:26.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979018+0000","last_change":"2024-04-22T07:20:53.875847+0000","last_active":"2024-04-22T07:20:54.979018+0000","last_peered":"2024-04-22T07:20:54.979018+0000","last_clean":"2024-04-22T07:20:54.979018+0000","last_became_active":"2024-04-22T07:20:53.875017+0000","last_became_peered":"2024-04-22T07:20:53.875017+0000","last_unstale":"2024-04-22T07:20:54.979018+0000","last_undegraded":"2024-04-22T07:20:54.979018+0000","last_fullsized":"2024-04-22T07:20:54.979018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:07.080135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863086+0000","last_change":"2024-04-22T07:20:53.869174+0000","last_active":"2024-04-22T07:20:54.863086+0000","last_peered":"2024-04-22T07:20:54.863086+0000","last_clean":"2024-04-22T07:20:54.863086+0000","last_became_active":"2024-04-22T07:20:53.868906+0000","last_became_peered":"2024-04-22T07:20:53.868906+0000","last_unstale":"2024-04-22T07:20:54.863086+0000","last_undegraded":"2024-04-22T07:20:54.863086+0000","last_fullsized":"2024-04-22T07:20:54.863086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977893+0000","last_change":"2024-04-22T07:20:53.874933+0000","last_active":"2024-04-22T07:20:54.977893+0000","last_peered":"2024-04-22T07:20:54.977893+0000","last_clean":"2024-04-22T07:20:54.977893+0000","last_became_active":"2024-04-22T07:20:53.874673+0000","last_became_peered":"2024-04-22T07:20:53.874673+0000","last_unstale":"2024-04-22T07:20:54.977893+0000","last_undegraded":"2024-04-22T07:20:54.977893+0000","last_fullsized":"2024-04-22T07:20:54.977893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977684+0000","last_change":"2024-04-22T07:20:53.874909+0000","last_active":"2024-04-22T07:20:54.977684+0000","last_peered":"2024-04-22T07:20:54.977684+0000","last_clean":"2024-04-22T07:20:54.977684+0000","last_became_active":"2024-04-22T07:20:53.873945+0000","last_became_peered":"2024-04-22T07:20:53.873945+0000","last_unstale":"2024-04-22T07:20:54.977684+0000","last_undegraded":"2024-04-22T07:20:54.977684+0000","last_fullsized":"2024-04-22T07:20:54.977684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:53.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977652+0000","last_change":"2024-04-22T07:20:53.878344+0000","last_active":"2024-04-22T07:20:54.977652+0000","last_peered":"2024-04-22T07:20:54.977652+0000","last_clean":"2024-04-22T07:20:54.977652+0000","last_became_active":"2024-04-22T07:20:53.877192+0000","last_became_peered":"2024-04-22T07:20:53.877192+0000","last_unstale":"2024-04-22T07:20:54.977652+0000","last_undegraded":"2024-04-22T07:20:54.977652+0000","last_fullsized":"2024-04-22T07:20:54.977652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:42:03.637655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979583+0000","last_change":"2024-04-22T07:20:53.879419+0000","last_active":"2024-04-22T07:20:54.979583+0000","last_peered":"2024-04-22T07:20:54.979583+0000","last_clean":"2024-04-22T07:20:54.979583+0000","last_became_active":"2024-04-22T07:20:53.879070+0000","last_became_peered":"2024-04-22T07:20:53.879070+0000","last_unstale":"2024-04-22T07:20:54.979583+0000","last_undegraded":"2024-04-22T07:20:54.979583+0000","last_fullsized":"2024-04-22T07:20:54.979583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979592+0000","last_change":"2024-04-22T07:20:53.877395+0000","last_active":"2024-04-22T07:20:54.979592+0000","last_peered":"2024-04-22T07:20:54.979592+0000","last_clean":"2024-04-22T07:20:54.979592+0000","last_became_active":"2024-04-22T07:20:53.877116+0000","last_became_peered":"2024-04-22T07:20:53.877116+0000","last_unstale":"2024-04-22T07:20:54.979592+0000","last_undegraded":"2024-04-22T07:20:54.979592+0000","last_fullsized":"2024-04-22T07:20:54.979592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:21:25.001413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979310+0000","last_change":"2024-04-22T07:20:53.875156+0000","last_active":"2024-04-22T07:20:54.979310+0000","last_peered":"2024-04-22T07:20:54.979310+0000","last_clean":"2024-04-22T07:20:54.979310+0000","last_became_active":"2024-04-22T07:20:53.874468+0000","last_became_peered":"2024-04-22T07:20:53.874468+0000","last_unstale":"2024-04-22T07:20:54.979310+0000","last_undegraded":"2024-04-22T07:20:54.979310+0000","last_fullsized":"2024-04-22T07:20:54.979310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:42:03.637655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862585+0000","last_change":"2024-04-22T07:20:53.867178+0000","last_active":"2024-04-22T07:20:54.862585+0000","last_peered":"2024-04-22T07:20:54.862585+0000","last_clean":"2024-04-22T07:20:54.862585+0000","last_became_active":"2024-04-22T07:20:53.865491+0000","last_became_peered":"2024-04-22T07:20:53.865491+0000","last_unstale":"2024-04-22T07:20:54.862585+0000","last_undegraded":"2024-04-22T07:20:54.862585+0000","last_fullsized":"2024-04-22T07:20:54.862585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863583+0000","last_change":"2024-04-22T07:20:53.876797+0000","last_active":"2024-04-22T07:20:54.863583+0000","last_peered":"2024-04-22T07:20:54.863583+0000","last_clean":"2024-04-22T07:20:54.863583+0000","last_became_active":"2024-04-22T07:20:53.876321+0000","last_became_peered":"2024-04-22T07:20:53.876321+0000","last_unstale":"2024-04-22T07:20:54.863583+0000","last_undegraded":"2024-04-22T07:20:54.863583+0000","last_fullsized":"2024-04-22T07:20:54.863583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:22:45.699676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980360+0000","last_change":"2024-04-22T07:20:53.868760+0000","last_active":"2024-04-22T07:20:54.980360+0000","last_peered":"2024-04-22T07:20:54.980360+0000","last_clean":"2024-04-22T07:20:54.980360+0000","last_became_active":"2024-04-22T07:20:53.868441+0000","last_became_peered":"2024-04-22T07:20:53.868441+0000","last_unstale":"2024-04-22T07:20:54.980360+0000","last_undegraded":"2024-04-22T07:20:54.980360+0000","last_fullsized":"2024-04-22T07:20:54.980360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863503+0000","last_change":"2024-04-22T07:20:53.864806+0000","last_active":"2024-04-22T07:20:54.863503+0000","last_peered":"2024-04-22T07:20:54.863503+0000","last_clean":"2024-04-22T07:20:54.863503+0000","last_became_active":"2024-04-22T07:20:53.864535+0000","last_became_peered":"2024-04-22T07:20:53.864535+0000","last_unstale":"2024-04-22T07:20:54.863503+0000","last_undegraded":"2024-04-22T07:20:54.863503+0000","last_fullsized":"2024-04-22T07:20:54.863503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:22:07.227993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977721+0000","last_change":"2024-04-22T07:20:53.878013+0000","last_active":"2024-04-22T07:20:54.977721+0000","last_peered":"2024-04-22T07:20:54.977721+0000","last_clean":"2024-04-22T07:20:54.977721+0000","last_became_active":"2024-04-22T07:20:53.876641+0000","last_became_peered":"2024-04-22T07:20:53.876641+0000","last_unstale":"2024-04-22T07:20:54.977721+0000","last_undegraded":"2024-04-22T07:20:54.977721+0000","last_fullsized":"2024-04-22T07:20:54.977721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:45:15.519469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-22T07:20:52.835850+0000","last_change":"2024-04-22T07:20:52.835850+0000","last_active":"2024-04-22T07:20:52.835850+0000","last_peered":"2024-04-22T07:20:52.835850+0000","last_clean":"2024-04-22T07:20:52.835850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:52.835850+0000","last_undegraded":"2024-04-22T07:20:52.835850+0000","last_fullsized":"2024-04-22T07:20:52.835850+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862823+0000","last_change":"2024-04-22T07:20:53.867684+0000","last_active":"2024-04-22T07:20:54.862823+0000","last_peered":"2024-04-22T07:20:54.862823+0000","last_clean":"2024-04-22T07:20:54.862823+0000","last_became_active":"2024-04-22T07:20:53.867403+0000","last_became_peered":"2024-04-22T07:20:53.867403+0000","last_unstale":"2024-04-22T07:20:54.862823+0000","last_undegraded":"2024-04-22T07:20:54.862823+0000","last_fullsized":"2024-04-22T07:20:54.862823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979253+0000","last_change":"2024-04-22T07:20:53.869595+0000","last_active":"2024-04-22T07:20:54.979253+0000","last_peered":"2024-04-22T07:20:54.979253+0000","last_clean":"2024-04-22T07:20:54.979253+0000","last_became_active":"2024-04-22T07:20:53.868519+0000","last_became_peered":"2024-04-22T07:20:53.868519+0000","last_unstale":"2024-04-22T07:20:54.979253+0000","last_undegraded":"2024-04-22T07:20:54.979253+0000","last_fullsized":"2024-04-22T07:20:54.979253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:35:26.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862610+0000","last_change":"2024-04-22T07:20:53.865275+0000","last_active":"2024-04-22T07:20:54.862610+0000","last_peered":"2024-04-22T07:20:54.862610+0000","last_clean":"2024-04-22T07:20:54.862610+0000","last_became_active":"2024-04-22T07:20:53.865026+0000","last_became_peered":"2024-04-22T07:20:53.865026+0000","last_unstale":"2024-04-22T07:20:54.862610+0000","last_undegraded":"2024-04-22T07:20:54.862610+0000","last_fullsized":"2024-04-22T07:20:54.862610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:48:40.630407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979451+0000","last_change":"2024-04-22T07:20:53.873457+0000","last_active":"2024-04-22T07:20:54.979451+0000","last_peered":"2024-04-22T07:20:54.979451+0000","last_clean":"2024-04-22T07:20:54.979451+0000","last_became_active":"2024-04-22T07:20:53.873147+0000","last_became_peered":"2024-04-22T07:20:53.873147+0000","last_unstale":"2024-04-22T07:20:54.979451+0000","last_undegraded":"2024-04-22T07:20:54.979451+0000","last_fullsized":"2024-04-22T07:20:54.979451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:53.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861933+0000","last_change":"2024-04-22T07:20:53.865327+0000","last_active":"2024-04-22T07:20:54.861933+0000","last_peered":"2024-04-22T07:20:54.861933+0000","last_clean":"2024-04-22T07:20:54.861933+0000","last_became_active":"2024-04-22T07:20:53.865030+0000","last_became_peered":"2024-04-22T07:20:53.865030+0000","last_unstale":"2024-04-22T07:20:54.861933+0000","last_undegraded":"2024-04-22T07:20:54.861933+0000","last_fullsized":"2024-04-22T07:20:54.861933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979550+0000","last_change":"2024-04-22T07:20:53.876792+0000","last_active":"2024-04-22T07:20:54.979550+0000","last_peered":"2024-04-22T07:20:54.979550+0000","last_clean":"2024-04-22T07:20:54.979550+0000","last_became_active":"2024-04-22T07:20:53.876446+0000","last_became_peered":"2024-04-22T07:20:53.876446+0000","last_unstale":"2024-04-22T07:20:54.979550+0000","last_undegraded":"2024-04-22T07:20:54.979550+0000","last_fullsized":"2024-04-22T07:20:54.979550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:34.943561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979292+0000","last_change":"2024-04-22T07:20:53.878147+0000","last_active":"2024-04-22T07:20:54.979292+0000","last_peered":"2024-04-22T07:20:54.979292+0000","last_clean":"2024-04-22T07:20:54.979292+0000","last_became_active":"2024-04-22T07:20:53.877867+0000","last_became_peered":"2024-04-22T07:20:53.877867+0000","last_unstale":"2024-04-22T07:20:54.979292+0000","last_undegraded":"2024-04-22T07:20:54.979292+0000","last_fullsized":"2024-04-22T07:20:54.979292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979201+0000","last_change":"2024-04-22T07:20:53.872447+0000","last_active":"2024-04-22T07:20:54.979201+0000","last_peered":"2024-04-22T07:20:54.979201+0000","last_clean":"2024-04-22T07:20:54.979201+0000","last_became_active":"2024-04-22T07:20:53.871862+0000","last_became_peered":"2024-04-22T07:20:53.871862+0000","last_unstale":"2024-04-22T07:20:54.979201+0000","last_undegraded":"2024-04-22T07:20:54.979201+0000","last_fullsized":"2024-04-22T07:20:54.979201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:08:33.063318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862747+0000","last_change":"2024-04-22T07:20:53.862483+0000","last_active":"2024-04-22T07:20:54.862747+0000","last_peered":"2024-04-22T07:20:54.862747+0000","last_clean":"2024-04-22T07:20:54.862747+0000","last_became_active":"2024-04-22T07:20:53.862199+0000","last_became_peered":"2024-04-22T07:20:53.862199+0000","last_unstale":"2024-04-22T07:20:54.862747+0000","last_undegraded":"2024-04-22T07:20:54.862747+0000","last_fullsized":"2024-04-22T07:20:54.862747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:10:12.276510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979743+0000","last_change":"2024-04-22T07:20:53.872507+0000","last_active":"2024-04-22T07:20:54.979743+0000","last_peered":"2024-04-22T07:20:54.979743+0000","last_clean":"2024-04-22T07:20:54.979743+0000","last_became_active":"2024-04-22T07:20:53.872199+0000","last_became_peered":"2024-04-22T07:20:53.872199+0000","last_unstale":"2024-04-22T07:20:54.979743+0000","last_undegraded":"2024-04-22T07:20:54.979743+0000","last_fullsized":"2024-04-22T07:20:54.979743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:09.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861399+0000","last_change":"2024-04-22T07:20:53.863946+0000","last_active":"2024-04-22T07:20:54.861399+0000","last_peered":"2024-04-22T07:20:54.861399+0000","last_clean":"2024-04-22T07:20:54.861399+0000","last_became_active":"2024-04-22T07:20:53.863688+0000","last_became_peered":"2024-04-22T07:20:53.863688+0000","last_unstale":"2024-04-22T07:20:54.861399+0000","last_undegraded":"2024-04-22T07:20:54.861399+0000","last_fullsized":"2024-04-22T07:20:54.861399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862947+0000","last_change":"2024-04-22T07:20:53.874785+0000","last_active":"2024-04-22T07:20:54.862947+0000","last_peered":"2024-04-22T07:20:54.862947+0000","last_clean":"2024-04-22T07:20:54.862947+0000","last_became_active":"2024-04-22T07:20:53.874524+0000","last_became_peered":"2024-04-22T07:20:53.874524+0000","last_unstale":"2024-04-22T07:20:54.862947+0000","last_undegraded":"2024-04-22T07:20:54.862947+0000","last_fullsized":"2024-04-22T07:20:54.862947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978859+0000","last_change":"2024-04-22T07:20:52.860712+0000","last_active":"2024-04-22T07:20:54.978859+0000","last_peered":"2024-04-22T07:20:54.978859+0000","last_clean":"2024-04-22T07:20:54.978859+0000","last_became_active":"2024-04-22T07:20:52.860015+0000","last_became_peered":"2024-04-22T07:20:52.860015+0000","last_unstale":"2024-04-22T07:20:54.978859+0000","last_undegraded":"2024-04-22T07:20:54.978859+0000","last_fullsized":"2024-04-22T07:20:54.978859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:59:32.487127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-22T07:20:52.835850+0000","last_change":"2024-04-22T07:20:52.835850+0000","last_active":"2024-04-22T07:20:52.835850+0000","last_peered":"2024-04-22T07:20:52.835850+0000","last_clean":"2024-04-22T07:20:52.835850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:52.835850+0000","last_undegraded":"2024-04-22T07:20:52.835850+0000","last_fullsized":"2024-04-22T07:20:52.835850+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863066+0000","last_change":"2024-04-22T07:20:52.862510+0000","last_active":"2024-04-22T07:20:54.863066+0000","last_peered":"2024-04-22T07:20:54.863066+0000","last_clean":"2024-04-22T07:20:54.863066+0000","last_became_active":"2024-04-22T07:20:52.862228+0000","last_became_peered":"2024-04-22T07:20:52.862228+0000","last_unstale":"2024-04-22T07:20:54.863066+0000","last_undegraded":"2024-04-22T07:20:54.863066+0000","last_fullsized":"2024-04-22T07:20:54.863066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:51.683021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979012+0000","last_change":"2024-04-22T07:20:52.856651+0000","last_active":"2024-04-22T07:20:54.979012+0000","last_peered":"2024-04-22T07:20:54.979012+0000","last_clean":"2024-04-22T07:20:54.979012+0000","last_became_active":"2024-04-22T07:20:52.856096+0000","last_became_peered":"2024-04-22T07:20:52.856096+0000","last_unstale":"2024-04-22T07:20:54.979012+0000","last_undegraded":"2024-04-22T07:20:54.979012+0000","last_fullsized":"2024-04-22T07:20:54.979012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:04.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979658+0000","last_change":"2024-04-22T07:20:53.873708+0000","last_active":"2024-04-22T07:20:54.979658+0000","last_peered":"2024-04-22T07:20:54.979658+0000","last_clean":"2024-04-22T07:20:54.979658+0000","last_became_active":"2024-04-22T07:20:53.872793+0000","last_became_peered":"2024-04-22T07:20:53.872793+0000","last_unstale":"2024-04-22T07:20:54.979658+0000","last_undegraded":"2024-04-22T07:20:54.979658+0000","last_fullsized":"2024-04-22T07:20:54.979658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:52.686229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862729+0000","last_change":"2024-04-22T07:20:52.861133+0000","last_active":"2024-04-22T07:20:54.862729+0000","last_peered":"2024-04-22T07:20:54.862729+0000","last_clean":"2024-04-22T07:20:54.862729+0000","last_became_active":"2024-04-22T07:20:52.860736+0000","last_became_peered":"2024-04-22T07:20:52.860736+0000","last_unstale":"2024-04-22T07:20:54.862729+0000","last_undegraded":"2024-04-22T07:20:54.862729+0000","last_fullsized":"2024-04-22T07:20:54.862729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:06.123308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-22T07:20:52.835850+0000","last_change":"2024-04-22T07:20:52.835850+0000","last_active":"2024-04-22T07:20:52.835850+0000","last_peered":"2024-04-22T07:20:52.835850+0000","last_clean":"2024-04-22T07:20:52.835850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:52.835850+0000","last_undegraded":"2024-04-22T07:20:52.835850+0000","last_fullsized":"2024-04-22T07:20:52.835850+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863067+0000","last_change":"2024-04-22T07:20:52.863567+0000","last_active":"2024-04-22T07:20:54.863067+0000","last_peered":"2024-04-22T07:20:54.863067+0000","last_clean":"2024-04-22T07:20:54.863067+0000","last_became_active":"2024-04-22T07:20:52.863285+0000","last_became_peered":"2024-04-22T07:20:52.863285+0000","last_unstale":"2024-04-22T07:20:54.863067+0000","last_undegraded":"2024-04-22T07:20:54.863067+0000","last_fullsized":"2024-04-22T07:20:54.863067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861976+0000","last_change":"2024-04-22T07:20:53.864955+0000","last_active":"2024-04-22T07:20:54.861976+0000","last_peered":"2024-04-22T07:20:54.861976+0000","last_clean":"2024-04-22T07:20:54.861976+0000","last_became_active":"2024-04-22T07:20:53.864694+0000","last_became_peered":"2024-04-22T07:20:53.864694+0000","last_unstale":"2024-04-22T07:20:54.861976+0000","last_undegraded":"2024-04-22T07:20:54.861976+0000","last_fullsized":"2024-04-22T07:20:54.861976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977898+0000","last_change":"2024-04-22T07:20:52.858761+0000","last_active":"2024-04-22T07:20:54.977898+0000","last_peered":"2024-04-22T07:20:54.977898+0000","last_clean":"2024-04-22T07:20:54.977898+0000","last_became_active":"2024-04-22T07:20:52.856815+0000","last_became_peered":"2024-04-22T07:20:52.856815+0000","last_unstale":"2024-04-22T07:20:54.977898+0000","last_undegraded":"2024-04-22T07:20:54.977898+0000","last_fullsized":"2024-04-22T07:20:54.977898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:06.123308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979798+0000","last_change":"2024-04-22T07:20:53.867290+0000","last_active":"2024-04-22T07:20:54.979798+0000","last_peered":"2024-04-22T07:20:54.979798+0000","last_clean":"2024-04-22T07:20:54.979798+0000","last_became_active":"2024-04-22T07:20:53.866955+0000","last_became_peered":"2024-04-22T07:20:53.866955+0000","last_unstale":"2024-04-22T07:20:54.979798+0000","last_undegraded":"2024-04-22T07:20:54.979798+0000","last_fullsized":"2024-04-22T07:20:54.979798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:43.442316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980048+0000","last_change":"2024-04-22T07:20:52.863670+0000","last_active":"2024-04-22T07:20:54.980048+0000","last_peered":"2024-04-22T07:20:54.980048+0000","last_clean":"2024-04-22T07:20:54.980048+0000","last_became_active":"2024-04-22T07:20:52.863320+0000","last_became_peered":"2024-04-22T07:20:52.863320+0000","last_unstale":"2024-04-22T07:20:54.980048+0000","last_undegraded":"2024-04-22T07:20:54.980048+0000","last_fullsized":"2024-04-22T07:20:54.980048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:04.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862589+0000","last_change":"2024-04-22T07:20:53.868286+0000","last_active":"2024-04-22T07:20:54.862589+0000","last_peered":"2024-04-22T07:20:54.862589+0000","last_clean":"2024-04-22T07:20:54.862589+0000","last_became_active":"2024-04-22T07:20:53.862811+0000","last_became_peered":"2024-04-22T07:20:53.862811+0000","last_unstale":"2024-04-22T07:20:54.862589+0000","last_undegraded":"2024-04-22T07:20:54.862589+0000","last_fullsized":"2024-04-22T07:20:54.862589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861603+0000","last_change":"2024-04-22T07:20:52.863638+0000","last_active":"2024-04-22T07:20:54.861603+0000","last_peered":"2024-04-22T07:20:54.861603+0000","last_clean":"2024-04-22T07:20:54.861603+0000","last_became_active":"2024-04-22T07:20:52.863244+0000","last_became_peered":"2024-04-22T07:20:52.863244+0000","last_unstale":"2024-04-22T07:20:54.861603+0000","last_undegraded":"2024-04-22T07:20:54.861603+0000","last_fullsized":"2024-04-22T07:20:54.861603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:36:49.017537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977713+0000","last_change":"2024-04-22T07:20:53.875162+0000","last_active":"2024-04-22T07:20:54.977713+0000","last_peered":"2024-04-22T07:20:54.977713+0000","last_clean":"2024-04-22T07:20:54.977713+0000","last_became_active":"2024-04-22T07:20:53.874612+0000","last_became_peered":"2024-04-22T07:20:53.874612+0000","last_unstale":"2024-04-22T07:20:54.977713+0000","last_undegraded":"2024-04-22T07:20:54.977713+0000","last_fullsized":"2024-04-22T07:20:54.977713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:13:12.303505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979428+0000","last_change":"2024-04-22T07:20:52.855194+0000","last_active":"2024-04-22T07:20:54.979428+0000","last_peered":"2024-04-22T07:20:54.979428+0000","last_clean":"2024-04-22T07:20:54.979428+0000","last_became_active":"2024-04-22T07:20:52.854915+0000","last_became_peered":"2024-04-22T07:20:52.854915+0000","last_unstale":"2024-04-22T07:20:54.979428+0000","last_undegraded":"2024-04-22T07:20:54.979428+0000","last_fullsized":"2024-04-22T07:20:54.979428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979725+0000","last_change":"2024-04-22T07:20:53.868695+0000","last_active":"2024-04-22T07:20:54.979725+0000","last_peered":"2024-04-22T07:20:54.979725+0000","last_clean":"2024-04-22T07:20:54.979725+0000","last_became_active":"2024-04-22T07:20:53.868400+0000","last_became_peered":"2024-04-22T07:20:53.868400+0000","last_unstale":"2024-04-22T07:20:54.979725+0000","last_undegraded":"2024-04-22T07:20:54.979725+0000","last_fullsized":"2024-04-22T07:20:54.979725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:30:23.352871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863163+0000","last_change":"2024-04-22T07:20:52.861884+0000","last_active":"2024-04-22T07:20:54.863163+0000","last_peered":"2024-04-22T07:20:54.863163+0000","last_clean":"2024-04-22T07:20:54.863163+0000","last_became_active":"2024-04-22T07:20:52.861546+0000","last_became_peered":"2024-04-22T07:20:52.861546+0000","last_unstale":"2024-04-22T07:20:54.863163+0000","last_undegraded":"2024-04-22T07:20:54.863163+0000","last_fullsized":"2024-04-22T07:20:54.863163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:37.283262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862882+0000","last_change":"2024-04-22T07:20:53.863071+0000","last_active":"2024-04-22T07:20:54.862882+0000","last_peered":"2024-04-22T07:20:54.862882+0000","last_clean":"2024-04-22T07:20:54.862882+0000","last_became_active":"2024-04-22T07:20:53.862763+0000","last_became_peered":"2024-04-22T07:20:53.862763+0000","last_unstale":"2024-04-22T07:20:54.862882+0000","last_undegraded":"2024-04-22T07:20:54.862882+0000","last_fullsized":"2024-04-22T07:20:54.862882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:19:57.432323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977415+0000","last_change":"2024-04-22T07:20:52.865285+0000","last_active":"2024-04-22T07:20:54.977415+0000","last_peered":"2024-04-22T07:20:54.977415+0000","last_clean":"2024-04-22T07:20:54.977415+0000","last_became_active":"2024-04-22T07:20:52.864725+0000","last_became_peered":"2024-04-22T07:20:52.864725+0000","last_unstale":"2024-04-22T07:20:54.977415+0000","last_undegraded":"2024-04-22T07:20:54.977415+0000","last_fullsized":"2024-04-22T07:20:54.977415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:23:28.850031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862533+0000","last_change":"2024-04-22T07:20:53.875479+0000","last_active":"2024-04-22T07:20:54.862533+0000","last_peered":"2024-04-22T07:20:54.862533+0000","last_clean":"2024-04-22T07:20:54.862533+0000","last_became_active":"2024-04-22T07:20:53.874567+0000","last_became_peered":"2024-04-22T07:20:53.874567+0000","last_unstale":"2024-04-22T07:20:54.862533+0000","last_undegraded":"2024-04-22T07:20:54.862533+0000","last_fullsized":"2024-04-22T07:20:54.862533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-22T07:20:51.842535+0000","last_change":"2024-04-22T07:20:51.842535+0000","last_active":"2024-04-22T07:20:51.829465+0000","last_peered":"2024-04-22T07:20:51.829465+0000","last_clean":"2024-04-22T07:20:51.829465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:51.842535+0000","last_undegraded":"2024-04-22T07:20:51.842535+0000","last_fullsized":"2024-04-22T07:20:51.842535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862635+0000","last_change":"2024-04-22T07:20:53.859641+0000","last_active":"2024-04-22T07:20:54.862635+0000","last_peered":"2024-04-22T07:20:54.862635+0000","last_clean":"2024-04-22T07:20:54.862635+0000","last_became_active":"2024-04-22T07:20:53.859365+0000","last_became_peered":"2024-04-22T07:20:53.859365+0000","last_unstale":"2024-04-22T07:20:54.862635+0000","last_undegraded":"2024-04-22T07:20:54.862635+0000","last_fullsized":"2024-04-22T07:20:54.862635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:46:50.322722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977979+0000","last_change":"2024-04-22T07:20:52.866960+0000","last_active":"2024-04-22T07:20:54.977979+0000","last_peered":"2024-04-22T07:20:54.977979+0000","last_clean":"2024-04-22T07:20:54.977979+0000","last_became_active":"2024-04-22T07:20:52.866654+0000","last_became_peered":"2024-04-22T07:20:52.866654+0000","last_unstale":"2024-04-22T07:20:54.977979+0000","last_undegraded":"2024-04-22T07:20:54.977979+0000","last_fullsized":"2024-04-22T07:20:54.977979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:51.683021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862087+0000","last_change":"2024-04-22T07:20:53.874775+0000","last_active":"2024-04-22T07:20:54.862087+0000","last_peered":"2024-04-22T07:20:54.862087+0000","last_clean":"2024-04-22T07:20:54.862087+0000","last_became_active":"2024-04-22T07:20:53.874499+0000","last_became_peered":"2024-04-22T07:20:53.874499+0000","last_unstale":"2024-04-22T07:20:54.862087+0000","last_undegraded":"2024-04-22T07:20:54.862087+0000","last_fullsized":"2024-04-22T07:20:54.862087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:23.268067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-22T07:20:51.844556+0000","last_change":"2024-04-22T07:20:51.844556+0000","last_active":"2024-04-22T07:20:51.829465+0000","last_peered":"2024-04-22T07:20:51.829465+0000","last_clean":"2024-04-22T07:20:51.829465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:51.844556+0000","last_undegraded":"2024-04-22T07:20:51.844556+0000","last_fullsized":"2024-04-22T07:20:51.844556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977901+0000","last_change":"2024-04-22T07:20:53.871645+0000","last_active":"2024-04-22T07:20:54.977901+0000","last_peered":"2024-04-22T07:20:54.977901+0000","last_clean":"2024-04-22T07:20:54.977901+0000","last_became_active":"2024-04-22T07:20:53.871353+0000","last_became_peered":"2024-04-22T07:20:53.871353+0000","last_unstale":"2024-04-22T07:20:54.977901+0000","last_undegraded":"2024-04-22T07:20:54.977901+0000","last_fullsized":"2024-04-22T07:20:54.977901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:48:40.630407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980304+0000","last_change":"2024-04-22T07:20:52.866996+0000","last_active":"2024-04-22T07:20:54.980304+0000","last_peered":"2024-04-22T07:20:54.980304+0000","last_clean":"2024-04-22T07:20:54.980304+0000","last_became_active":"2024-04-22T07:20:52.866677+0000","last_became_peered":"2024-04-22T07:20:52.866677+0000","last_unstale":"2024-04-22T07:20:54.980304+0000","last_undegraded":"2024-04-22T07:20:54.980304+0000","last_fullsized":"2024-04-22T07:20:54.980304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977832+0000","last_change":"2024-04-22T07:20:53.871064+0000","last_active":"2024-04-22T07:20:54.977832+0000","last_peered":"2024-04-22T07:20:54.977832+0000","last_clean":"2024-04-22T07:20:54.977832+0000","last_became_active":"2024-04-22T07:20:53.866968+0000","last_became_peered":"2024-04-22T07:20:53.866968+0000","last_unstale":"2024-04-22T07:20:54.977832+0000","last_undegraded":"2024-04-22T07:20:54.977832+0000","last_fullsized":"2024-04-22T07:20:54.977832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:43.442316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979659+0000","last_change":"2024-04-22T07:20:52.856958+0000","last_active":"2024-04-22T07:20:54.979659+0000","last_peered":"2024-04-22T07:20:54.979659+0000","last_clean":"2024-04-22T07:20:54.979659+0000","last_became_active":"2024-04-22T07:20:52.856289+0000","last_became_peered":"2024-04-22T07:20:52.856289+0000","last_unstale":"2024-04-22T07:20:54.979659+0000","last_undegraded":"2024-04-22T07:20:54.979659+0000","last_fullsized":"2024-04-22T07:20:54.979659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863352+0000","last_change":"2024-04-22T07:20:53.872915+0000","last_active":"2024-04-22T07:20:54.863352+0000","last_peered":"2024-04-22T07:20:54.863352+0000","last_clean":"2024-04-22T07:20:54.863352+0000","last_became_active":"2024-04-22T07:20:53.872005+0000","last_became_peered":"2024-04-22T07:20:53.872005+0000","last_unstale":"2024-04-22T07:20:54.863352+0000","last_undegraded":"2024-04-22T07:20:54.863352+0000","last_fullsized":"2024-04-22T07:20:54.863352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:53:29.242632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862549+0000","last_change":"2024-04-22T07:20:43.747396+0000","last_active":"2024-04-22T07:20:54.862549+0000","last_peered":"2024-04-22T07:20:54.862549+0000","last_clean":"2024-04-22T07:20:54.862549+0000","last_became_active":"2024-04-22T07:20:43.746332+0000","last_became_peered":"2024-04-22T07:20:43.746332+0000","last_unstale":"2024-04-22T07:20:54.862549+0000","last_undegraded":"2024-04-22T07:20:54.862549+0000","last_fullsized":"2024-04-22T07:20:54.862549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:42.732916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:42.732916+0000","last_clean_scrub_stamp":"2024-04-22T07:20:42.732916+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:02:55.086445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863049+0000","last_change":"2024-04-22T07:20:52.862492+0000","last_active":"2024-04-22T07:20:54.863049+0000","last_peered":"2024-04-22T07:20:54.863049+0000","last_clean":"2024-04-22T07:20:54.863049+0000","last_became_active":"2024-04-22T07:20:52.862201+0000","last_became_peered":"2024-04-22T07:20:52.862201+0000","last_unstale":"2024-04-22T07:20:54.863049+0000","last_undegraded":"2024-04-22T07:20:54.863049+0000","last_fullsized":"2024-04-22T07:20:54.863049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:52.015227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-22T07:20:52.835850+0000","last_change":"2024-04-22T07:20:52.835850+0000","last_active":"2024-04-22T07:20:52.835850+0000","last_peered":"2024-04-22T07:20:52.835850+0000","last_clean":"2024-04-22T07:20:52.835850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:52.835850+0000","last_undegraded":"2024-04-22T07:20:52.835850+0000","last_fullsized":"2024-04-22T07:20:52.835850+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862731+0000","last_change":"2024-04-22T07:20:52.867622+0000","last_active":"2024-04-22T07:20:54.862731+0000","last_peered":"2024-04-22T07:20:54.862731+0000","last_clean":"2024-04-22T07:20:54.862731+0000","last_became_active":"2024-04-22T07:20:52.866996+0000","last_became_peered":"2024-04-22T07:20:52.866996+0000","last_unstale":"2024-04-22T07:20:54.862731+0000","last_undegraded":"2024-04-22T07:20:54.862731+0000","last_fullsized":"2024-04-22T07:20:54.862731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:08.286530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978392+0000","last_change":"2024-04-22T07:20:53.871576+0000","last_active":"2024-04-22T07:20:54.978392+0000","last_peered":"2024-04-22T07:20:54.978392+0000","last_clean":"2024-04-22T07:20:54.978392+0000","last_became_active":"2024-04-22T07:20:53.871239+0000","last_became_peered":"2024-04-22T07:20:53.871239+0000","last_unstale":"2024-04-22T07:20:54.978392+0000","last_undegraded":"2024-04-22T07:20:54.978392+0000","last_fullsized":"2024-04-22T07:20:54.978392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979845+0000","last_change":"2024-04-22T07:20:52.866974+0000","last_active":"2024-04-22T07:20:54.979845+0000","last_peered":"2024-04-22T07:20:54.979845+0000","last_clean":"2024-04-22T07:20:54.979845+0000","last_became_active":"2024-04-22T07:20:52.866581+0000","last_became_peered":"2024-04-22T07:20:52.866581+0000","last_unstale":"2024-04-22T07:20:54.979845+0000","last_undegraded":"2024-04-22T07:20:54.979845+0000","last_fullsized":"2024-04-22T07:20:54.979845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979503+0000","last_change":"2024-04-22T07:20:53.865035+0000","last_active":"2024-04-22T07:20:54.979503+0000","last_peered":"2024-04-22T07:20:54.979503+0000","last_clean":"2024-04-22T07:20:54.979503+0000","last_became_active":"2024-04-22T07:20:53.864523+0000","last_became_peered":"2024-04-22T07:20:53.864523+0000","last_unstale":"2024-04-22T07:20:54.979503+0000","last_undegraded":"2024-04-22T07:20:54.979503+0000","last_fullsized":"2024-04-22T07:20:54.979503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:13:12.303505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863169+0000","last_change":"2024-04-22T07:20:52.858498+0000","last_active":"2024-04-22T07:20:54.863169+0000","last_peered":"2024-04-22T07:20:54.863169+0000","last_clean":"2024-04-22T07:20:54.863169+0000","last_became_active":"2024-04-22T07:20:52.858139+0000","last_became_peered":"2024-04-22T07:20:52.858139+0000","last_unstale":"2024-04-22T07:20:54.863169+0000","last_undegraded":"2024-04-22T07:20:54.863169+0000","last_fullsized":"2024-04-22T07:20:54.863169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:45.382709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977943+0000","last_change":"2024-04-22T07:20:53.877595+0000","last_active":"2024-04-22T07:20:54.977943+0000","last_peered":"2024-04-22T07:20:54.977943+0000","last_clean":"2024-04-22T07:20:54.977943+0000","last_became_active":"2024-04-22T07:20:53.877208+0000","last_became_peered":"2024-04-22T07:20:53.877208+0000","last_unstale":"2024-04-22T07:20:54.977943+0000","last_undegraded":"2024-04-22T07:20:54.977943+0000","last_fullsized":"2024-04-22T07:20:54.977943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:46:50.322722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979001+0000","last_change":"2024-04-22T07:20:52.866224+0000","last_active":"2024-04-22T07:20:54.979001+0000","last_peered":"2024-04-22T07:20:54.979001+0000","last_clean":"2024-04-22T07:20:54.979001+0000","last_became_active":"2024-04-22T07:20:52.865903+0000","last_became_peered":"2024-04-22T07:20:52.865903+0000","last_unstale":"2024-04-22T07:20:54.979001+0000","last_undegraded":"2024-04-22T07:20:54.979001+0000","last_fullsized":"2024-04-22T07:20:54.979001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861395+0000","last_change":"2024-04-22T07:20:53.873266+0000","last_active":"2024-04-22T07:20:54.861395+0000","last_peered":"2024-04-22T07:20:54.861395+0000","last_clean":"2024-04-22T07:20:54.861395+0000","last_became_active":"2024-04-22T07:20:53.872915+0000","last_became_peered":"2024-04-22T07:20:53.872915+0000","last_unstale":"2024-04-22T07:20:54.861395+0000","last_undegraded":"2024-04-22T07:20:54.861395+0000","last_fullsized":"2024-04-22T07:20:54.861395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:09.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863471+0000","last_change":"2024-04-22T07:20:52.863593+0000","last_active":"2024-04-22T07:20:54.863471+0000","last_peered":"2024-04-22T07:20:54.863471+0000","last_clean":"2024-04-22T07:20:54.863471+0000","last_became_active":"2024-04-22T07:20:52.863296+0000","last_became_peered":"2024-04-22T07:20:52.863296+0000","last_unstale":"2024-04-22T07:20:54.863471+0000","last_undegraded":"2024-04-22T07:20:54.863471+0000","last_fullsized":"2024-04-22T07:20:54.863471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:22.261683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979540+0000","last_change":"2024-04-22T07:20:53.874491+0000","last_active":"2024-04-22T07:20:54.979540+0000","last_peered":"2024-04-22T07:20:54.979540+0000","last_clean":"2024-04-22T07:20:54.979540+0000","last_became_active":"2024-04-22T07:20:53.874202+0000","last_became_peered":"2024-04-22T07:20:53.874202+0000","last_unstale":"2024-04-22T07:20:54.979540+0000","last_undegraded":"2024-04-22T07:20:54.979540+0000","last_fullsized":"2024-04-22T07:20:54.979540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:23.268067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-22T07:20:51.842526+0000","last_change":"2024-04-22T07:20:51.842526+0000","last_active":"2024-04-22T07:20:51.829465+0000","last_peered":"2024-04-22T07:20:51.829465+0000","last_clean":"2024-04-22T07:20:51.829465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:51.842526+0000","last_undegraded":"2024-04-22T07:20:51.842526+0000","last_fullsized":"2024-04-22T07:20:51.842526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-22T07:20:52.835850+0000","last_change":"2024-04-22T07:20:52.835850+0000","last_active":"2024-04-22T07:20:52.835850+0000","last_peered":"2024-04-22T07:20:52.835850+0000","last_clean":"2024-04-22T07:20:52.835850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:52.835850+0000","last_undegraded":"2024-04-22T07:20:52.835850+0000","last_fullsized":"2024-04-22T07:20:52.835850+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863610+0000","last_change":"2024-04-22T07:20:52.864740+0000","last_active":"2024-04-22T07:20:54.863610+0000","last_peered":"2024-04-22T07:20:54.863610+0000","last_clean":"2024-04-22T07:20:54.863610+0000","last_became_active":"2024-04-22T07:20:52.864434+0000","last_became_peered":"2024-04-22T07:20:52.864434+0000","last_unstale":"2024-04-22T07:20:54.863610+0000","last_undegraded":"2024-04-22T07:20:54.863610+0000","last_fullsized":"2024-04-22T07:20:54.863610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:33.937176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-22T07:20:52.835850+0000","last_change":"2024-04-22T07:20:52.835850+0000","last_active":"2024-04-22T07:20:52.835850+0000","last_peered":"2024-04-22T07:20:52.835850+0000","last_clean":"2024-04-22T07:20:52.835850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:52.835850+0000","last_undegraded":"2024-04-22T07:20:52.835850+0000","last_fullsized":"2024-04-22T07:20:52.835850+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977319+0000","last_change":"2024-04-22T07:20:52.854668+0000","last_active":"2024-04-22T07:20:54.977319+0000","last_peered":"2024-04-22T07:20:54.977319+0000","last_clean":"2024-04-22T07:20:54.977319+0000","last_became_active":"2024-04-22T07:20:52.854395+0000","last_became_peered":"2024-04-22T07:20:52.854395+0000","last_unstale":"2024-04-22T07:20:54.977319+0000","last_undegraded":"2024-04-22T07:20:54.977319+0000","last_fullsized":"2024-04-22T07:20:54.977319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:59:32.487127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862797+0000","last_change":"2024-04-22T07:20:53.870972+0000","last_active":"2024-04-22T07:20:54.862797+0000","last_peered":"2024-04-22T07:20:54.862797+0000","last_clean":"2024-04-22T07:20:54.862797+0000","last_became_active":"2024-04-22T07:20:53.870674+0000","last_became_peered":"2024-04-22T07:20:53.870674+0000","last_unstale":"2024-04-22T07:20:54.862797+0000","last_undegraded":"2024-04-22T07:20:54.862797+0000","last_fullsized":"2024-04-22T07:20:54.862797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:10.431906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-22T07:20:51.843148+0000","last_change":"2024-04-22T07:20:51.843148+0000","last_active":"2024-04-22T07:20:51.829465+0000","last_peered":"2024-04-22T07:20:51.829465+0000","last_clean":"2024-04-22T07:20:51.829465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:51.843148+0000","last_undegraded":"2024-04-22T07:20:51.843148+0000","last_fullsized":"2024-04-22T07:20:51.843148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-22T07:20:52.835850+0000","last_change":"2024-04-22T07:20:52.835850+0000","last_active":"2024-04-22T07:20:52.835850+0000","last_peered":"2024-04-22T07:20:52.835850+0000","last_clean":"2024-04-22T07:20:52.835850+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:52.835850+0000","last_undegraded":"2024-04-22T07:20:52.835850+0000","last_fullsized":"2024-04-22T07:20:52.835850+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979784+0000","last_change":"2024-04-22T07:20:52.861048+0000","last_active":"2024-04-22T07:20:54.979784+0000","last_peered":"2024-04-22T07:20:54.979784+0000","last_clean":"2024-04-22T07:20:54.979784+0000","last_became_active":"2024-04-22T07:20:52.860702+0000","last_became_peered":"2024-04-22T07:20:52.860702+0000","last_unstale":"2024-04-22T07:20:54.979784+0000","last_undegraded":"2024-04-22T07:20:54.979784+0000","last_fullsized":"2024-04-22T07:20:54.979784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979324+0000","last_change":"2024-04-22T07:20:53.868782+0000","last_active":"2024-04-22T07:20:54.979324+0000","last_peered":"2024-04-22T07:20:54.979324+0000","last_clean":"2024-04-22T07:20:54.979324+0000","last_became_active":"2024-04-22T07:20:53.868509+0000","last_became_peered":"2024-04-22T07:20:53.868509+0000","last_unstale":"2024-04-22T07:20:54.979324+0000","last_undegraded":"2024-04-22T07:20:54.979324+0000","last_fullsized":"2024-04-22T07:20:54.979324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:07.129692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862970+0000","last_change":"2024-04-22T07:20:52.858508+0000","last_active":"2024-04-22T07:20:54.862970+0000","last_peered":"2024-04-22T07:20:54.862970+0000","last_clean":"2024-04-22T07:20:54.862970+0000","last_became_active":"2024-04-22T07:20:52.858215+0000","last_became_peered":"2024-04-22T07:20:52.858215+0000","last_unstale":"2024-04-22T07:20:54.862970+0000","last_undegraded":"2024-04-22T07:20:54.862970+0000","last_fullsized":"2024-04-22T07:20:54.862970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:26.618434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862971+0000","last_change":"2024-04-22T07:20:53.867977+0000","last_active":"2024-04-22T07:20:54.862971+0000","last_peered":"2024-04-22T07:20:54.862971+0000","last_clean":"2024-04-22T07:20:54.862971+0000","last_became_active":"2024-04-22T07:20:53.867447+0000","last_became_peered":"2024-04-22T07:20:53.867447+0000","last_unstale":"2024-04-22T07:20:54.862971+0000","last_undegraded":"2024-04-22T07:20:54.862971+0000","last_fullsized":"2024-04-22T07:20:54.862971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:48:52.934171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863377+0000","last_change":"2024-04-22T07:20:53.875681+0000","last_active":"2024-04-22T07:20:54.863377+0000","last_peered":"2024-04-22T07:20:54.863377+0000","last_clean":"2024-04-22T07:20:54.863377+0000","last_became_active":"2024-04-22T07:20:53.875305+0000","last_became_peered":"2024-04-22T07:20:53.875305+0000","last_unstale":"2024-04-22T07:20:54.863377+0000","last_undegraded":"2024-04-22T07:20:54.863377+0000","last_fullsized":"2024-04-22T07:20:54.863377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:22:34.452869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977916+0000","last_change":"2024-04-22T07:20:52.857445+0000","last_active":"2024-04-22T07:20:54.977916+0000","last_peered":"2024-04-22T07:20:54.977916+0000","last_clean":"2024-04-22T07:20:54.977916+0000","last_became_active":"2024-04-22T07:20:52.856293+0000","last_became_peered":"2024-04-22T07:20:52.856293+0000","last_unstale":"2024-04-22T07:20:54.977916+0000","last_undegraded":"2024-04-22T07:20:54.977916+0000","last_fullsized":"2024-04-22T07:20:54.977916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:10.640191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862780+0000","last_change":"2024-04-22T07:20:53.870827+0000","last_active":"2024-04-22T07:20:54.862780+0000","last_peered":"2024-04-22T07:20:54.862780+0000","last_clean":"2024-04-22T07:20:54.862780+0000","last_became_active":"2024-04-22T07:20:53.870548+0000","last_became_peered":"2024-04-22T07:20:53.870548+0000","last_unstale":"2024-04-22T07:20:54.862780+0000","last_undegraded":"2024-04-22T07:20:54.862780+0000","last_fullsized":"2024-04-22T07:20:54.862780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:27.624819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977785+0000","last_change":"2024-04-22T07:20:52.856933+0000","last_active":"2024-04-22T07:20:54.977785+0000","last_peered":"2024-04-22T07:20:54.977785+0000","last_clean":"2024-04-22T07:20:54.977785+0000","last_became_active":"2024-04-22T07:20:52.856617+0000","last_became_peered":"2024-04-22T07:20:52.856617+0000","last_unstale":"2024-04-22T07:20:54.977785+0000","last_undegraded":"2024-04-22T07:20:54.977785+0000","last_fullsized":"2024-04-22T07:20:54.977785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:08.286530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979619+0000","last_change":"2024-04-22T07:20:53.866552+0000","last_active":"2024-04-22T07:20:54.979619+0000","last_peered":"2024-04-22T07:20:54.979619+0000","last_clean":"2024-04-22T07:20:54.979619+0000","last_became_active":"2024-04-22T07:20:53.866286+0000","last_became_peered":"2024-04-22T07:20:53.866286+0000","last_unstale":"2024-04-22T07:20:54.979619+0000","last_undegraded":"2024-04-22T07:20:54.979619+0000","last_fullsized":"2024-04-22T07:20:54.979619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:45:15.519469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980248+0000","last_change":"2024-04-22T07:20:52.863291+0000","last_active":"2024-04-22T07:20:54.980248+0000","last_peered":"2024-04-22T07:20:54.980248+0000","last_clean":"2024-04-22T07:20:54.980248+0000","last_became_active":"2024-04-22T07:20:52.862967+0000","last_became_peered":"2024-04-22T07:20:52.862967+0000","last_unstale":"2024-04-22T07:20:54.980248+0000","last_undegraded":"2024-04-22T07:20:54.980248+0000","last_fullsized":"2024-04-22T07:20:54.980248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:10.640191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980150+0000","last_change":"2024-04-22T07:20:53.871045+0000","last_active":"2024-04-22T07:20:54.980150+0000","last_peered":"2024-04-22T07:20:54.980150+0000","last_clean":"2024-04-22T07:20:54.980150+0000","last_became_active":"2024-04-22T07:20:53.870715+0000","last_became_peered":"2024-04-22T07:20:53.870715+0000","last_unstale":"2024-04-22T07:20:54.980150+0000","last_undegraded":"2024-04-22T07:20:54.980150+0000","last_fullsized":"2024-04-22T07:20:54.980150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-04-22T07:20:51.842558+0000","last_change":"2024-04-22T07:20:51.842558+0000","last_active":"2024-04-22T07:20:51.829465+0000","last_peered":"2024-04-22T07:20:51.829465+0000","last_clean":"2024-04-22T07:20:51.829465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-22T07:20:51.842558+0000","last_undegraded":"2024-04-22T07:20:51.842558+0000","last_fullsized":"2024-04-22T07:20:51.842558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":815104,"data_stored":665303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":671603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T07:20:59.582 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2024-04-22T07:20:59.582 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-22T07:20:52.835850+0000', 'last_change': '2024-04-22T07:20:52.835850+0000', 'last_active': '2024-04-22T07:20:52.835850+0000', 'last_peered': '2024-04-22T07:20:52.835850+0000', 'last_clean': '2024-04-22T07:20:52.835850+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-22T07:20:52.835850+0000', 'last_undegraded': '2024-04-22T07:20:52.835850+0000', 'last_fullsized': '2024-04-22T07:20:52.835850+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-22T07:20:52.835850+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-22T07:20:52.835850+0000', 'last_clean_scrub_stamp': '2024-04-22T07:20:52.835850+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-22T07:20:59.582 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-04-22T07:20:59.582 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-22T07:20:52.835850+0000', 'last_change': '2024-04-22T07:20:52.835850+0000', 'last_active': '2024-04-22T07:20:52.835850+0000', 'last_peered': '2024-04-22T07:20:52.835850+0000', 'last_clean': '2024-04-22T07:20:52.835850+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-22T07:20:52.835850+0000', 'last_undegraded': '2024-04-22T07:20:52.835850+0000', 'last_fullsized': '2024-04-22T07:20:52.835850+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-22T07:20:52.835850+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-22T07:20:52.835850+0000', 'last_clean_scrub_stamp': '2024-04-22T07:20:52.835850+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-22T07:20:59.582 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-04-22T07:20:59.582 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-22T07:20:52.835850+0000', 'last_change': '2024-04-22T07:20:52.835850+0000', 'last_active': '2024-04-22T07:20:52.835850+0000', 'last_peered': '2024-04-22T07:20:52.835850+0000', 'last_clean': '2024-04-22T07:20:52.835850+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-22T07:20:52.835850+0000', 'last_undegraded': '2024-04-22T07:20:52.835850+0000', 'last_fullsized': '2024-04-22T07:20:52.835850+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-22T07:20:52.835850+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-22T07:20:52.835850+0000', 'last_clean_scrub_stamp': '2024-04-22T07:20:52.835850+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-22T07:20:59.583 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.10 is not active+clean 2024-04-22T07:20:59.583 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-04-22T07:20:51.842535+0000', 'last_change': '2024-04-22T07:20:51.842535+0000', 'last_active': '2024-04-22T07:20:51.829465+0000', 'last_peered': '2024-04-22T07:20:51.829465+0000', 'last_clean': '2024-04-22T07:20:51.829465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-22T07:20:51.842535+0000', 'last_undegraded': '2024-04-22T07:20:51.842535+0000', 'last_fullsized': '2024-04-22T07:20:51.842535+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-22T07:20:51.829465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-22T07:20:51.829465+0000', 'last_clean_scrub_stamp': '2024-04-22T07:20:51.829465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-22T07:20:59.583 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.e is not active+clean 2024-04-22T07:20:59.583 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-04-22T07:20:51.844556+0000', 'last_change': '2024-04-22T07:20:51.844556+0000', 'last_active': '2024-04-22T07:20:51.829465+0000', 'last_peered': '2024-04-22T07:20:51.829465+0000', 'last_clean': '2024-04-22T07:20:51.829465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-22T07:20:51.844556+0000', 'last_undegraded': '2024-04-22T07:20:51.844556+0000', 'last_fullsized': '2024-04-22T07:20:51.844556+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-22T07:20:51.829465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-22T07:20:51.829465+0000', 'last_clean_scrub_stamp': '2024-04-22T07:20:51.829465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-22T07:20:59.583 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-04-22T07:20:59.583 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-22T07:20:52.835850+0000', 'last_change': '2024-04-22T07:20:52.835850+0000', 'last_active': '2024-04-22T07:20:52.835850+0000', 'last_peered': '2024-04-22T07:20:52.835850+0000', 'last_clean': '2024-04-22T07:20:52.835850+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-22T07:20:52.835850+0000', 'last_undegraded': '2024-04-22T07:20:52.835850+0000', 'last_fullsized': '2024-04-22T07:20:52.835850+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-22T07:20:52.835850+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-22T07:20:52.835850+0000', 'last_clean_scrub_stamp': '2024-04-22T07:20:52.835850+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-22T07:20:59.583 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.6 is not active+clean 2024-04-22T07:20:59.583 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-04-22T07:20:51.842526+0000', 'last_change': '2024-04-22T07:20:51.842526+0000', 'last_active': '2024-04-22T07:20:51.829465+0000', 'last_peered': '2024-04-22T07:20:51.829465+0000', 'last_clean': '2024-04-22T07:20:51.829465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-22T07:20:51.842526+0000', 'last_undegraded': '2024-04-22T07:20:51.842526+0000', 'last_fullsized': '2024-04-22T07:20:51.842526+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-22T07:20:51.829465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-22T07:20:51.829465+0000', 'last_clean_scrub_stamp': '2024-04-22T07:20:51.829465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-22T07:20:59.583 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-04-22T07:20:59.583 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-22T07:20:52.835850+0000', 'last_change': '2024-04-22T07:20:52.835850+0000', 'last_active': '2024-04-22T07:20:52.835850+0000', 'last_peered': '2024-04-22T07:20:52.835850+0000', 'last_clean': '2024-04-22T07:20:52.835850+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-22T07:20:52.835850+0000', 'last_undegraded': '2024-04-22T07:20:52.835850+0000', 'last_fullsized': '2024-04-22T07:20:52.835850+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-22T07:20:52.835850+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-22T07:20:52.835850+0000', 'last_clean_scrub_stamp': '2024-04-22T07:20:52.835850+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-22T07:20:59.583 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-04-22T07:20:59.583 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-22T07:20:52.835850+0000', 'last_change': '2024-04-22T07:20:52.835850+0000', 'last_active': '2024-04-22T07:20:52.835850+0000', 'last_peered': '2024-04-22T07:20:52.835850+0000', 'last_clean': '2024-04-22T07:20:52.835850+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-22T07:20:52.835850+0000', 'last_undegraded': '2024-04-22T07:20:52.835850+0000', 'last_fullsized': '2024-04-22T07:20:52.835850+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-22T07:20:52.835850+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-22T07:20:52.835850+0000', 'last_clean_scrub_stamp': '2024-04-22T07:20:52.835850+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-22T07:20:59.584 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.9 is not active+clean 2024-04-22T07:20:59.584 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-04-22T07:20:51.843148+0000', 'last_change': '2024-04-22T07:20:51.843148+0000', 'last_active': '2024-04-22T07:20:51.829465+0000', 'last_peered': '2024-04-22T07:20:51.829465+0000', 'last_clean': '2024-04-22T07:20:51.829465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-22T07:20:51.843148+0000', 'last_undegraded': '2024-04-22T07:20:51.843148+0000', 'last_fullsized': '2024-04-22T07:20:51.843148+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-22T07:20:51.829465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-22T07:20:51.829465+0000', 'last_clean_scrub_stamp': '2024-04-22T07:20:51.829465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-22T07:20:59.584 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-04-22T07:20:59.584 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-22T07:20:52.835850+0000', 'last_change': '2024-04-22T07:20:52.835850+0000', 'last_active': '2024-04-22T07:20:52.835850+0000', 'last_peered': '2024-04-22T07:20:52.835850+0000', 'last_clean': '2024-04-22T07:20:52.835850+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-22T07:20:52.835850+0000', 'last_undegraded': '2024-04-22T07:20:52.835850+0000', 'last_fullsized': '2024-04-22T07:20:52.835850+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-22T07:20:52.835850+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-22T07:20:52.835850+0000', 'last_clean_scrub_stamp': '2024-04-22T07:20:52.835850+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-22T07:20:59.584 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1f is not active+clean 2024-04-22T07:20:59.584 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-04-22T07:20:51.842558+0000', 'last_change': '2024-04-22T07:20:51.842558+0000', 'last_active': '2024-04-22T07:20:51.829465+0000', 'last_peered': '2024-04-22T07:20:51.829465+0000', 'last_clean': '2024-04-22T07:20:51.829465+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-22T07:20:51.842558+0000', 'last_undegraded': '2024-04-22T07:20:51.842558+0000', 'last_fullsized': '2024-04-22T07:20:51.842558+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-22T07:20:51.829465+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-22T07:20:51.829465+0000', 'last_clean_scrub_stamp': '2024-04-22T07:20:51.829465+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-22T07:20:59.585 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-22T07:20:59.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.720+0000 7f573b05c640 1 Processor -- start 2024-04-22T07:20:59.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.720+0000 7f573b05c640 1 -- start start 2024-04-22T07:20:59.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.721+0000 7f573b05c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5734072cc0 0x7f57340cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:59.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.721+0000 7f573b05c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f573415e7c0 con 0x7f57340d09a0 2024-04-22T07:20:59.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.721+0000 7f573b05c640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f573415eaa0 con 0x7f5734155320 2024-04-22T07:20:59.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.721+0000 7f573b05c640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f57340cc400 con 0x7f5734072cc0 2024-04-22T07:20:59.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.721+0000 7f57395f9640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f57340d09a0 0x7f5734165710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33790/0 (socket says 172.21.15.40:33790) 2024-04-22T07:20:59.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.721+0000 7f57395f9640 1 -- 172.21.15.40:0/3587686671 learned_addr learned my addr 172.21.15.40:0/3587686671 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:20:59.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.722+0000 7f5733fff640 1 --2- 172.21.15.40:0/3587686671 >> v2:172.21.15.62:3300/0 conn(0x7f5734072cc0 0x7f57340cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:59.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.722+0000 7f57337fe640 1 -- 172.21.15.40:0/3587686671 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 886897716 0 0) 0x7f573415e7c0 con 0x7f57340d09a0 2024-04-22T07:20:59.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.722+0000 7f57337fe640 1 -- 172.21.15.40:0/3587686671 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5724003520 con 0x7f57340d09a0 2024-04-22T07:20:59.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.722+0000 7f5733fff640 1 -- 172.21.15.40:0/3587686671 >> v1:172.21.15.62:6789/0 conn(0x7f5734155320 legacy=0x7f573415b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:59.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.722+0000 7f5733fff640 1 -- 172.21.15.40:0/3587686671 >> v1:172.21.15.40:6789/0 conn(0x7f57340d09a0 legacy=0x7f5734165710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:59.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.722+0000 7f5733fff640 1 -- 172.21.15.40:0/3587686671 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f573415ed80 con 0x7f5734072cc0 2024-04-22T07:20:59.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.723+0000 7f5733fff640 1 --2- 172.21.15.40:0/3587686671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5734072cc0 0x7f57340cbec0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f57200097a0 tx=0x7f572002b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c54c84c0b0103c03 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:59.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.723+0000 7f57337fe640 1 -- 172.21.15.40:0/3587686671 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572002f810 con 0x7f5734072cc0 2024-04-22T07:20:59.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.723+0000 7f57337fe640 1 -- 172.21.15.40:0/3587686671 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f572002f9b0 con 0x7f5734072cc0 2024-04-22T07:20:59.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.723+0000 7f57337fe640 1 -- 172.21.15.40:0/3587686671 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572002fd60 con 0x7f5734072cc0 2024-04-22T07:20:59.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.723+0000 7f573b05c640 1 -- 172.21.15.40:0/3587686671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5734072cc0 msgr2=0x7f57340cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:59.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.723+0000 7f573b05c640 1 --2- 172.21.15.40:0/3587686671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5734072cc0 0x7f57340cbec0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f57200097a0 tx=0x7f572002b9f0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.723+0000 7f573b05c640 1 -- 172.21.15.40:0/3587686671 shutdown_connections 2024-04-22T07:20:59.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.723+0000 7f573b05c640 1 --2- 172.21.15.40:0/3587686671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5734072cc0 0x7f57340cbec0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.723+0000 7f573b05c640 1 -- 172.21.15.40:0/3587686671 >> 172.21.15.40:0/3587686671 conn(0x7f57340676b0 msgr2=0x7f5734067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:59.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.723+0000 7f573b05c640 1 -- 172.21.15.40:0/3587686671 shutdown_connections 2024-04-22T07:20:59.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.723+0000 7f573b05c640 1 -- 172.21.15.40:0/3587686671 wait complete. 2024-04-22T07:20:59.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.725+0000 7f573b05c640 1 Processor -- start 2024-04-22T07:20:59.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.725+0000 7f573b05c640 1 -- start start 2024-04-22T07:20:59.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.725+0000 7f573b05c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5734072cc0 0x7f57340ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:59.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.725+0000 7f573b05c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57340d09a0 0x7f5734155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:59.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.725+0000 7f573b05c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5734155320 0x7f57341f0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:59.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.725+0000 7f573b05c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f573415bbd0 con 0x7f5734072cc0 2024-04-22T07:20:59.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.725+0000 7f573b05c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f573415afa0 con 0x7f57340d09a0 2024-04-22T07:20:59.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.725+0000 7f573b05c640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f573415bd50 con 0x7f5734155320 2024-04-22T07:20:59.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.725+0000 7f5738df8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5734072cc0 0x7f57340ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:59.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.725+0000 7f5738df8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5734072cc0 0x7f57340ca2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42030/0 (socket says 172.21.15.40:42030) 2024-04-22T07:20:59.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.726+0000 7f5738df8640 1 -- 172.21.15.40:0/1178308036 learned_addr learned my addr 172.21.15.40:0/1178308036 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:20:59.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.726+0000 7f5733fff640 1 --2- 172.21.15.40:0/1178308036 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57340d09a0 0x7f5734155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:59.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.726+0000 7f57395f9640 1 --2- 172.21.15.40:0/1178308036 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5734155320 0x7f57341f0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:59.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.726+0000 7f5738df8640 1 -- 172.21.15.40:0/1178308036 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5734155320 msgr2=0x7f57341f0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:59.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.726+0000 7f5738df8640 1 --2- 172.21.15.40:0/1178308036 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5734155320 0x7f57341f0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.726+0000 7f5738df8640 1 -- 172.21.15.40:0/1178308036 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57340d09a0 msgr2=0x7f5734155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:59.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.726+0000 7f5738df8640 1 --2- 172.21.15.40:0/1178308036 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57340d09a0 0x7f5734155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.726+0000 7f5738df8640 1 -- 172.21.15.40:0/1178308036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5734156f50 con 0x7f5734072cc0 2024-04-22T07:20:59.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.726+0000 7f57395f9640 1 --2- 172.21.15.40:0/1178308036 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5734155320 0x7f57341f0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:20:59.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.726+0000 7f5738df8640 1 --2- 172.21.15.40:0/1178308036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5734072cc0 0x7f57340ca2b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f572800c3f0 tx=0x7f572800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:59.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.726+0000 7f57317fa640 1 -- 172.21.15.40:0/1178308036 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57280052d0 con 0x7f5734072cc0 2024-04-22T07:20:59.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.726+0000 7f57317fa640 1 -- 172.21.15.40:0/1178308036 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5728005490 con 0x7f5734072cc0 2024-04-22T07:20:59.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.726+0000 7f573b05c640 1 -- 172.21.15.40:0/1178308036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57340c8800 con 0x7f5734072cc0 2024-04-22T07:20:59.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.726+0000 7f57317fa640 1 -- 172.21.15.40:0/1178308036 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5728007260 con 0x7f5734072cc0 2024-04-22T07:20:59.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.726+0000 7f573b05c640 1 -- 172.21.15.40:0/1178308036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57340c7f60 con 0x7f5734072cc0 2024-04-22T07:20:59.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.727+0000 7f573b05c640 1 -- 172.21.15.40:0/1178308036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5734072770 con 0x7f5734072cc0 2024-04-22T07:20:59.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.728+0000 7f57317fa640 1 -- 172.21.15.40:0/1178308036 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5728007400 con 0x7f5734072cc0 2024-04-22T07:20:59.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.728+0000 7f57317fa640 1 --2- 172.21.15.40:0/1178308036 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f571806c920 0x7f571806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:20:59.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.728+0000 7f57317fa640 1 -- 172.21.15.40:0/1178308036 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f572808af40 con 0x7f5734072cc0 2024-04-22T07:20:59.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.728+0000 7f5733fff640 1 --2- 172.21.15.40:0/1178308036 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f571806c920 0x7f571806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:20:59.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.728+0000 7f5733fff640 1 --2- 172.21.15.40:0/1178308036 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f571806c920 0x7f571806ede0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5720036000 tx=0x7f5720008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:20:59.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.732+0000 7f57317fa640 1 -- 172.21.15.40:0/1178308036 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5734072770 con 0x7f5734072cc0 2024-04-22T07:20:59.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.987+0000 7f573b05c640 1 -- 172.21.15.40:0/1178308036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f5734068b20 con 0x7f5734072cc0 2024-04-22T07:20:59.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.987+0000 7f57317fa640 1 -- 172.21.15.40:0/1178308036 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+946 (secure 0 0 0) 0x7f572805f030 con 0x7f5734072cc0 2024-04-22T07:20:59.985 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:20:59.985 INFO:teuthology.orchestra.run.smithi040.stdout:{"fsid":"dd5b16e4-89fe-4602-b37f-062846793158","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":30,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":23,"num_osds":8,"num_up_osds":8,"osd_up_since":1713770440,"num_in_osds":8,"osd_in_since":1713770431,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":224370688,"bytes_avail":772869742592,"bytes_total":773094113280},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4305}],"up:standby":5},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-04-22T07:20:29.489979+0000","services":{}},"progress_events":{}} 2024-04-22T07:20:59.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.989+0000 7f573b05c640 1 -- 172.21.15.40:0/1178308036 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f571806c920 msgr2=0x7f571806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:59.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.989+0000 7f573b05c640 1 --2- 172.21.15.40:0/1178308036 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f571806c920 0x7f571806ede0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5720036000 tx=0x7f5720008030 comp rx=0 tx=0).stop 2024-04-22T07:20:59.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.989+0000 7f573b05c640 1 -- 172.21.15.40:0/1178308036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5734072cc0 msgr2=0x7f57340ca2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:20:59.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.989+0000 7f573b05c640 1 --2- 172.21.15.40:0/1178308036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5734072cc0 0x7f57340ca2b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f572800c3f0 tx=0x7f572800c8b0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.989+0000 7f573b05c640 1 -- 172.21.15.40:0/1178308036 shutdown_connections 2024-04-22T07:20:59.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.989+0000 7f573b05c640 1 --2- 172.21.15.40:0/1178308036 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5734155320 0x7f57341f0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.989+0000 7f573b05c640 1 --2- 172.21.15.40:0/1178308036 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57340d09a0 0x7f5734155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.989+0000 7f573b05c640 1 --2- 172.21.15.40:0/1178308036 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f571806c920 0x7f571806ede0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.989+0000 7f573b05c640 1 --2- 172.21.15.40:0/1178308036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5734072cc0 0x7f57340ca2b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:20:59.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.989+0000 7f573b05c640 1 -- 172.21.15.40:0/1178308036 >> 172.21.15.40:0/1178308036 conn(0x7f57340676b0 msgr2=0x7f57340ceef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:20:59.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.989+0000 7f573b05c640 1 -- 172.21.15.40:0/1178308036 shutdown_connections 2024-04-22T07:20:59.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:20:59.989+0000 7f573b05c640 1 -- 172.21.15.40:0/1178308036 wait complete. 2024-04-22T07:20:59.998 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-22T07:20:59.998 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T07:21:00.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.101+0000 7f11c3025640 1 Processor -- start 2024-04-22T07:21:00.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.101+0000 7f11c3025640 1 -- start start 2024-04-22T07:21:00.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.101+0000 7f11c3025640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f11bc06f590 0x7f11bc0722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:00.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.101+0000 7f11c3025640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f11bc06ff40 0x7f11bc1619b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:00.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.101+0000 7f11c3025640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11bc0727e0 con 0x7f11bc06f970 2024-04-22T07:21:00.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.101+0000 7f11c3025640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f11bc0c6c20 con 0x7f11bc06ff40 2024-04-22T07:21:00.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.102+0000 7f11c3025640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f11bc0c77a0 con 0x7f11bc06f590 2024-04-22T07:21:00.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.102+0000 7f11bbfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f11bc06f970 0x7f11bc150dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33804/0 (socket says 172.21.15.40:33804) 2024-04-22T07:21:00.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.102+0000 7f11c15c2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f11bc06ff40 0x7f11bc1619b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:00.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.102+0000 7f11bbfff640 1 -- 172.21.15.40:0/3132667841 learned_addr learned my addr 172.21.15.40:0/3132667841 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:00.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.102+0000 7f11c0dc1640 1 --2- 172.21.15.40:0/3132667841 >> v2:172.21.15.62:3300/0 conn(0x7f11bc06f590 0x7f11bc0722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:00.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.102+0000 7f11c15c2640 1 -- 172.21.15.40:0/3132667841 >> v2:172.21.15.62:3300/0 conn(0x7f11bc06f590 msgr2=0x7f11bc0722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:00.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.102+0000 7f11c15c2640 1 --2- 172.21.15.40:0/3132667841 >> v2:172.21.15.62:3300/0 conn(0x7f11bc06f590 0x7f11bc0722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:00.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.102+0000 7f11c15c2640 1 -- 172.21.15.40:0/3132667841 >> v1:172.21.15.40:6789/0 conn(0x7f11bc06f970 legacy=0x7f11bc150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:00.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.102+0000 7f11c15c2640 1 -- 172.21.15.40:0/3132667841 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11bc15b400 con 0x7f11bc06ff40 2024-04-22T07:21:00.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.102+0000 7f11bb7fe640 1 -- 172.21.15.40:0/3132667841 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3112958635 0 0) 0x7f11bc0727e0 con 0x7f11bc06f970 2024-04-22T07:21:00.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.103+0000 7f11c15c2640 1 --2- 172.21.15.40:0/3132667841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11bc06ff40 0x7f11bc1619b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f11bc0680d0 tx=0x7f11b402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e451d5fde046784 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:00.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.103+0000 7f11bb7fe640 1 -- 172.21.15.40:0/3132667841 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b4039070 con 0x7f11bc06ff40 2024-04-22T07:21:00.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.103+0000 7f11bb7fe640 1 -- 172.21.15.40:0/3132667841 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b402cc80 con 0x7f11bc06ff40 2024-04-22T07:21:00.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.103+0000 7f11bb7fe640 1 -- 172.21.15.40:0/3132667841 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b4034660 con 0x7f11bc06ff40 2024-04-22T07:21:00.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.103+0000 7f11c3025640 1 -- 172.21.15.40:0/3132667841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11bc06ff40 msgr2=0x7f11bc1619b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:00.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.103+0000 7f11c3025640 1 --2- 172.21.15.40:0/3132667841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11bc06ff40 0x7f11bc1619b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f11bc0680d0 tx=0x7f11b402bed0 comp rx=0 tx=0).stop 2024-04-22T07:21:00.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.103+0000 7f11c3025640 1 -- 172.21.15.40:0/3132667841 shutdown_connections 2024-04-22T07:21:00.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.103+0000 7f11c3025640 1 --2- 172.21.15.40:0/3132667841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11bc06ff40 0x7f11bc1619b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:00.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.103+0000 7f11c3025640 1 --2- 172.21.15.40:0/3132667841 >> v2:172.21.15.62:3300/0 conn(0x7f11bc06f590 0x7f11bc0722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:00.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.104+0000 7f11c3025640 1 -- 172.21.15.40:0/3132667841 >> 172.21.15.40:0/3132667841 conn(0x7f11bc0cc220 msgr2=0x7f11bc0cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:00.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.104+0000 7f11c3025640 1 -- 172.21.15.40:0/3132667841 shutdown_connections 2024-04-22T07:21:00.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.104+0000 7f11c3025640 1 -- 172.21.15.40:0/3132667841 wait complete. 2024-04-22T07:21:00.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.105+0000 7f11c3025640 1 Processor -- start 2024-04-22T07:21:00.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.105+0000 7f11c3025640 1 -- start start 2024-04-22T07:21:00.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.106+0000 7f11c3025640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11bc06f590 0x7f11bc1f3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:00.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.106+0000 7f11c3025640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f11bc06f970 0x7f11bc156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:00.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.106+0000 7f11c3025640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11bc06ff40 0x7f11bc156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:00.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.106+0000 7f11c3025640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f11bc0c7430 con 0x7f11bc06f590 2024-04-22T07:21:00.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.106+0000 7f11c3025640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f11bc0c7150 con 0x7f11bc06ff40 2024-04-22T07:21:00.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.106+0000 7f11c3025640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f11bc071940 con 0x7f11bc06f970 2024-04-22T07:21:00.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.106+0000 7f11c0dc1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11bc06f590 0x7f11bc1f3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:00.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.106+0000 7f11c0dc1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11bc06f590 0x7f11bc1f3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42062/0 (socket says 172.21.15.40:42062) 2024-04-22T07:21:00.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.106+0000 7f11c0dc1640 1 -- 172.21.15.40:0/2280645159 learned_addr learned my addr 172.21.15.40:0/2280645159 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:00.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.106+0000 7f11bbfff640 1 --2- 172.21.15.40:0/2280645159 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f11bc06f970 0x7f11bc156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:00.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.106+0000 7f11c15c2640 1 --2- 172.21.15.40:0/2280645159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11bc06ff40 0x7f11bc156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:00.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.106+0000 7f11c0dc1640 1 -- 172.21.15.40:0/2280645159 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f11bc06f970 msgr2=0x7f11bc156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:00.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.106+0000 7f11c0dc1640 1 --2- 172.21.15.40:0/2280645159 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f11bc06f970 0x7f11bc156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:00.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.106+0000 7f11c0dc1640 1 -- 172.21.15.40:0/2280645159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11bc06ff40 msgr2=0x7f11bc156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:00.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.106+0000 7f11c0dc1640 1 --2- 172.21.15.40:0/2280645159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11bc06ff40 0x7f11bc156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:00.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.106+0000 7f11c0dc1640 1 -- 172.21.15.40:0/2280645159 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11bc0c54e0 con 0x7f11bc06f590 2024-04-22T07:21:00.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.106+0000 7f11bbfff640 1 --2- 172.21.15.40:0/2280645159 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f11bc06f970 0x7f11bc156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:00.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.106+0000 7f11c0dc1640 1 --2- 172.21.15.40:0/2280645159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11bc06f590 0x7f11bc1f3d50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f11b000d830 tx=0x7f11b000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:00.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.106+0000 7f11b97fa640 1 -- 172.21.15.40:0/2280645159 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b000b6c0 con 0x7f11bc06f590 2024-04-22T07:21:00.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.106+0000 7f11b97fa640 1 -- 172.21.15.40:0/2280645159 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b0019070 con 0x7f11bc06f590 2024-04-22T07:21:00.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.106+0000 7f11b97fa640 1 -- 172.21.15.40:0/2280645159 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b000ba80 con 0x7f11bc06f590 2024-04-22T07:21:00.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.106+0000 7f11c3025640 1 -- 172.21.15.40:0/2280645159 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11bc1f4810 con 0x7f11bc06f590 2024-04-22T07:21:00.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.106+0000 7f11c3025640 1 -- 172.21.15.40:0/2280645159 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11bc14f770 con 0x7f11bc06f590 2024-04-22T07:21:00.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.107+0000 7f11c3025640 1 -- 172.21.15.40:0/2280645159 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11bc069d40 con 0x7f11bc06f590 2024-04-22T07:21:00.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.108+0000 7f11b97fa640 1 -- 172.21.15.40:0/2280645159 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f11b001e460 con 0x7f11bc06f590 2024-04-22T07:21:00.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.108+0000 7f11b97fa640 1 --2- 172.21.15.40:0/2280645159 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f11a006c920 0x7f11a006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:00.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.108+0000 7f11bbfff640 1 --2- 172.21.15.40:0/2280645159 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f11a006c920 0x7f11a006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:00.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.108+0000 7f11b97fa640 1 -- 172.21.15.40:0/2280645159 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f11b008c160 con 0x7f11bc06f590 2024-04-22T07:21:00.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.109+0000 7f11bbfff640 1 --2- 172.21.15.40:0/2280645159 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f11a006c920 0x7f11a006ede0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f11bc163fe0 tx=0x7f11a8007c10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:00.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.113+0000 7f11b97fa640 1 -- 172.21.15.40:0/2280645159 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f11b005a590 con 0x7f11bc06f590 2024-04-22T07:21:00.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.292+0000 7f11c3025640 1 -- 172.21.15.40:0/2280645159 --> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f11bc0c8620 con 0x7f11a006c920 2024-04-22T07:21:00.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.298+0000 7f11b97fa640 1 -- 172.21.15.40:0/2280645159 <== mgr.4107 v2:172.21.15.40:6832/91163869 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251845 (secure 0 0 0) 0x7f11bc0c8620 con 0x7f11a006c920 2024-04-22T07:21:00.299 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:21:00.300 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-22T07:21:00.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.301+0000 7f11c3025640 1 -- 172.21.15.40:0/2280645159 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f11a006c920 msgr2=0x7f11a006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:00.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.301+0000 7f11c3025640 1 --2- 172.21.15.40:0/2280645159 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f11a006c920 0x7f11a006ede0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f11bc163fe0 tx=0x7f11a8007c10 comp rx=0 tx=0).stop 2024-04-22T07:21:00.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.301+0000 7f11c3025640 1 -- 172.21.15.40:0/2280645159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11bc06f590 msgr2=0x7f11bc1f3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:00.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.301+0000 7f11c3025640 1 --2- 172.21.15.40:0/2280645159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11bc06f590 0x7f11bc1f3d50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f11b000d830 tx=0x7f11b000dcf0 comp rx=0 tx=0).stop 2024-04-22T07:21:00.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.301+0000 7f11c3025640 1 -- 172.21.15.40:0/2280645159 shutdown_connections 2024-04-22T07:21:00.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.301+0000 7f11c3025640 1 --2- 172.21.15.40:0/2280645159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11bc06ff40 0x7f11bc156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:00.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.301+0000 7f11c3025640 1 --2- 172.21.15.40:0/2280645159 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f11bc06f970 0x7f11bc156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:00.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.301+0000 7f11c3025640 1 --2- 172.21.15.40:0/2280645159 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f11a006c920 0x7f11a006ede0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:00.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.301+0000 7f11c3025640 1 --2- 172.21.15.40:0/2280645159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11bc06f590 0x7f11bc1f3d50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:00.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.301+0000 7f11c3025640 1 -- 172.21.15.40:0/2280645159 >> 172.21.15.40:0/2280645159 conn(0x7f11bc0cc220 msgr2=0x7f11bc0c4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:00.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.301+0000 7f11c3025640 1 -- 172.21.15.40:0/2280645159 shutdown_connections 2024-04-22T07:21:00.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:00.301+0000 7f11c3025640 1 -- 172.21.15.40:0/2280645159 wait complete. 2024-04-22T07:21:00.310 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-04-22T07:20:59.777960+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219112,"kb_used_data":2924,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755608,"statfs":{"total":773094113280,"available":772869742592,"internally_reserved":0,"allocated":2994176,"data_stored":1799116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.938786"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977886+0000","last_change":"2024-04-22T07:20:53.873662+0000","last_active":"2024-04-22T07:20:54.977886+0000","last_peered":"2024-04-22T07:20:54.977886+0000","last_clean":"2024-04-22T07:20:54.977886+0000","last_became_active":"2024-04-22T07:20:53.873384+0000","last_became_peered":"2024-04-22T07:20:53.873384+0000","last_unstale":"2024-04-22T07:20:54.977886+0000","last_undegraded":"2024-04-22T07:20:54.977886+0000","last_fullsized":"2024-04-22T07:20:54.977886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980006+0000","last_change":"2024-04-22T07:20:53.870454+0000","last_active":"2024-04-22T07:20:54.980006+0000","last_peered":"2024-04-22T07:20:54.980006+0000","last_clean":"2024-04-22T07:20:54.980006+0000","last_became_active":"2024-04-22T07:20:53.869964+0000","last_became_peered":"2024-04-22T07:20:53.869964+0000","last_unstale":"2024-04-22T07:20:54.980006+0000","last_undegraded":"2024-04-22T07:20:54.980006+0000","last_fullsized":"2024-04-22T07:20:54.980006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979125+0000","last_change":"2024-04-22T07:20:53.871145+0000","last_active":"2024-04-22T07:20:54.979125+0000","last_peered":"2024-04-22T07:20:54.979125+0000","last_clean":"2024-04-22T07:20:54.979125+0000","last_became_active":"2024-04-22T07:20:53.870819+0000","last_became_peered":"2024-04-22T07:20:53.870819+0000","last_unstale":"2024-04-22T07:20:54.979125+0000","last_undegraded":"2024-04-22T07:20:54.979125+0000","last_fullsized":"2024-04-22T07:20:54.979125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:02:16.373202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861622+0000","last_change":"2024-04-22T07:20:53.870458+0000","last_active":"2024-04-22T07:20:54.861622+0000","last_peered":"2024-04-22T07:20:54.861622+0000","last_clean":"2024-04-22T07:20:54.861622+0000","last_became_active":"2024-04-22T07:20:53.870125+0000","last_became_peered":"2024-04-22T07:20:53.870125+0000","last_unstale":"2024-04-22T07:20:54.861622+0000","last_undegraded":"2024-04-22T07:20:54.861622+0000","last_fullsized":"2024-04-22T07:20:54.861622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977801+0000","last_change":"2024-04-22T07:20:53.877301+0000","last_active":"2024-04-22T07:20:54.977801+0000","last_peered":"2024-04-22T07:20:54.977801+0000","last_clean":"2024-04-22T07:20:54.977801+0000","last_became_active":"2024-04-22T07:20:53.874941+0000","last_became_peered":"2024-04-22T07:20:53.874941+0000","last_unstale":"2024-04-22T07:20:54.977801+0000","last_undegraded":"2024-04-22T07:20:54.977801+0000","last_fullsized":"2024-04-22T07:20:54.977801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:52.686229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861484+0000","last_change":"2024-04-22T07:20:53.869735+0000","last_active":"2024-04-22T07:20:54.861484+0000","last_peered":"2024-04-22T07:20:54.861484+0000","last_clean":"2024-04-22T07:20:54.861484+0000","last_became_active":"2024-04-22T07:20:53.869369+0000","last_became_peered":"2024-04-22T07:20:53.869369+0000","last_unstale":"2024-04-22T07:20:54.861484+0000","last_undegraded":"2024-04-22T07:20:54.861484+0000","last_fullsized":"2024-04-22T07:20:54.861484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:27.624819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977494+0000","last_change":"2024-04-22T07:20:53.873492+0000","last_active":"2024-04-22T07:20:54.977494+0000","last_peered":"2024-04-22T07:20:54.977494+0000","last_clean":"2024-04-22T07:20:54.977494+0000","last_became_active":"2024-04-22T07:20:53.873220+0000","last_became_peered":"2024-04-22T07:20:53.873220+0000","last_unstale":"2024-04-22T07:20:54.977494+0000","last_undegraded":"2024-04-22T07:20:54.977494+0000","last_fullsized":"2024-04-22T07:20:54.977494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:35:26.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979018+0000","last_change":"2024-04-22T07:20:53.875847+0000","last_active":"2024-04-22T07:20:54.979018+0000","last_peered":"2024-04-22T07:20:54.979018+0000","last_clean":"2024-04-22T07:20:54.979018+0000","last_became_active":"2024-04-22T07:20:53.875017+0000","last_became_peered":"2024-04-22T07:20:53.875017+0000","last_unstale":"2024-04-22T07:20:54.979018+0000","last_undegraded":"2024-04-22T07:20:54.979018+0000","last_fullsized":"2024-04-22T07:20:54.979018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:07.080135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863086+0000","last_change":"2024-04-22T07:20:53.869174+0000","last_active":"2024-04-22T07:20:54.863086+0000","last_peered":"2024-04-22T07:20:54.863086+0000","last_clean":"2024-04-22T07:20:54.863086+0000","last_became_active":"2024-04-22T07:20:53.868906+0000","last_became_peered":"2024-04-22T07:20:53.868906+0000","last_unstale":"2024-04-22T07:20:54.863086+0000","last_undegraded":"2024-04-22T07:20:54.863086+0000","last_fullsized":"2024-04-22T07:20:54.863086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977893+0000","last_change":"2024-04-22T07:20:53.874933+0000","last_active":"2024-04-22T07:20:54.977893+0000","last_peered":"2024-04-22T07:20:54.977893+0000","last_clean":"2024-04-22T07:20:54.977893+0000","last_became_active":"2024-04-22T07:20:53.874673+0000","last_became_peered":"2024-04-22T07:20:53.874673+0000","last_unstale":"2024-04-22T07:20:54.977893+0000","last_undegraded":"2024-04-22T07:20:54.977893+0000","last_fullsized":"2024-04-22T07:20:54.977893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977684+0000","last_change":"2024-04-22T07:20:53.874909+0000","last_active":"2024-04-22T07:20:54.977684+0000","last_peered":"2024-04-22T07:20:54.977684+0000","last_clean":"2024-04-22T07:20:54.977684+0000","last_became_active":"2024-04-22T07:20:53.873945+0000","last_became_peered":"2024-04-22T07:20:53.873945+0000","last_unstale":"2024-04-22T07:20:54.977684+0000","last_undegraded":"2024-04-22T07:20:54.977684+0000","last_fullsized":"2024-04-22T07:20:54.977684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:53.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977652+0000","last_change":"2024-04-22T07:20:53.878344+0000","last_active":"2024-04-22T07:20:54.977652+0000","last_peered":"2024-04-22T07:20:54.977652+0000","last_clean":"2024-04-22T07:20:54.977652+0000","last_became_active":"2024-04-22T07:20:53.877192+0000","last_became_peered":"2024-04-22T07:20:53.877192+0000","last_unstale":"2024-04-22T07:20:54.977652+0000","last_undegraded":"2024-04-22T07:20:54.977652+0000","last_fullsized":"2024-04-22T07:20:54.977652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:42:03.637655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979583+0000","last_change":"2024-04-22T07:20:53.879419+0000","last_active":"2024-04-22T07:20:54.979583+0000","last_peered":"2024-04-22T07:20:54.979583+0000","last_clean":"2024-04-22T07:20:54.979583+0000","last_became_active":"2024-04-22T07:20:53.879070+0000","last_became_peered":"2024-04-22T07:20:53.879070+0000","last_unstale":"2024-04-22T07:20:54.979583+0000","last_undegraded":"2024-04-22T07:20:54.979583+0000","last_fullsized":"2024-04-22T07:20:54.979583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979592+0000","last_change":"2024-04-22T07:20:53.877395+0000","last_active":"2024-04-22T07:20:54.979592+0000","last_peered":"2024-04-22T07:20:54.979592+0000","last_clean":"2024-04-22T07:20:54.979592+0000","last_became_active":"2024-04-22T07:20:53.877116+0000","last_became_peered":"2024-04-22T07:20:53.877116+0000","last_unstale":"2024-04-22T07:20:54.979592+0000","last_undegraded":"2024-04-22T07:20:54.979592+0000","last_fullsized":"2024-04-22T07:20:54.979592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:21:25.001413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979310+0000","last_change":"2024-04-22T07:20:53.875156+0000","last_active":"2024-04-22T07:20:54.979310+0000","last_peered":"2024-04-22T07:20:54.979310+0000","last_clean":"2024-04-22T07:20:54.979310+0000","last_became_active":"2024-04-22T07:20:53.874468+0000","last_became_peered":"2024-04-22T07:20:53.874468+0000","last_unstale":"2024-04-22T07:20:54.979310+0000","last_undegraded":"2024-04-22T07:20:54.979310+0000","last_fullsized":"2024-04-22T07:20:54.979310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:42:03.637655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862585+0000","last_change":"2024-04-22T07:20:53.867178+0000","last_active":"2024-04-22T07:20:54.862585+0000","last_peered":"2024-04-22T07:20:54.862585+0000","last_clean":"2024-04-22T07:20:54.862585+0000","last_became_active":"2024-04-22T07:20:53.865491+0000","last_became_peered":"2024-04-22T07:20:53.865491+0000","last_unstale":"2024-04-22T07:20:54.862585+0000","last_undegraded":"2024-04-22T07:20:54.862585+0000","last_fullsized":"2024-04-22T07:20:54.862585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863583+0000","last_change":"2024-04-22T07:20:53.876797+0000","last_active":"2024-04-22T07:20:54.863583+0000","last_peered":"2024-04-22T07:20:54.863583+0000","last_clean":"2024-04-22T07:20:54.863583+0000","last_became_active":"2024-04-22T07:20:53.876321+0000","last_became_peered":"2024-04-22T07:20:53.876321+0000","last_unstale":"2024-04-22T07:20:54.863583+0000","last_undegraded":"2024-04-22T07:20:54.863583+0000","last_fullsized":"2024-04-22T07:20:54.863583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:22:45.699676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980360+0000","last_change":"2024-04-22T07:20:53.868760+0000","last_active":"2024-04-22T07:20:54.980360+0000","last_peered":"2024-04-22T07:20:54.980360+0000","last_clean":"2024-04-22T07:20:54.980360+0000","last_became_active":"2024-04-22T07:20:53.868441+0000","last_became_peered":"2024-04-22T07:20:53.868441+0000","last_unstale":"2024-04-22T07:20:54.980360+0000","last_undegraded":"2024-04-22T07:20:54.980360+0000","last_fullsized":"2024-04-22T07:20:54.980360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863503+0000","last_change":"2024-04-22T07:20:53.864806+0000","last_active":"2024-04-22T07:20:54.863503+0000","last_peered":"2024-04-22T07:20:54.863503+0000","last_clean":"2024-04-22T07:20:54.863503+0000","last_became_active":"2024-04-22T07:20:53.864535+0000","last_became_peered":"2024-04-22T07:20:53.864535+0000","last_unstale":"2024-04-22T07:20:54.863503+0000","last_undegraded":"2024-04-22T07:20:54.863503+0000","last_fullsized":"2024-04-22T07:20:54.863503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:22:07.227993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977721+0000","last_change":"2024-04-22T07:20:53.878013+0000","last_active":"2024-04-22T07:20:54.977721+0000","last_peered":"2024-04-22T07:20:54.977721+0000","last_clean":"2024-04-22T07:20:54.977721+0000","last_became_active":"2024-04-22T07:20:53.876641+0000","last_became_peered":"2024-04-22T07:20:53.876641+0000","last_unstale":"2024-04-22T07:20:54.977721+0000","last_undegraded":"2024-04-22T07:20:54.977721+0000","last_fullsized":"2024-04-22T07:20:54.977721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:45:15.519469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978885+0000","last_change":"2024-04-22T07:20:53.868319+0000","last_active":"2024-04-22T07:20:54.978885+0000","last_peered":"2024-04-22T07:20:54.978885+0000","last_clean":"2024-04-22T07:20:54.978885+0000","last_became_active":"2024-04-22T07:20:53.868014+0000","last_became_peered":"2024-04-22T07:20:53.868014+0000","last_unstale":"2024-04-22T07:20:54.978885+0000","last_undegraded":"2024-04-22T07:20:54.978885+0000","last_fullsized":"2024-04-22T07:20:54.978885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:09:27.178992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862823+0000","last_change":"2024-04-22T07:20:53.867684+0000","last_active":"2024-04-22T07:20:54.862823+0000","last_peered":"2024-04-22T07:20:54.862823+0000","last_clean":"2024-04-22T07:20:54.862823+0000","last_became_active":"2024-04-22T07:20:53.867403+0000","last_became_peered":"2024-04-22T07:20:53.867403+0000","last_unstale":"2024-04-22T07:20:54.862823+0000","last_undegraded":"2024-04-22T07:20:54.862823+0000","last_fullsized":"2024-04-22T07:20:54.862823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979253+0000","last_change":"2024-04-22T07:20:53.869595+0000","last_active":"2024-04-22T07:20:54.979253+0000","last_peered":"2024-04-22T07:20:54.979253+0000","last_clean":"2024-04-22T07:20:54.979253+0000","last_became_active":"2024-04-22T07:20:53.868519+0000","last_became_peered":"2024-04-22T07:20:53.868519+0000","last_unstale":"2024-04-22T07:20:54.979253+0000","last_undegraded":"2024-04-22T07:20:54.979253+0000","last_fullsized":"2024-04-22T07:20:54.979253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:35:26.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862610+0000","last_change":"2024-04-22T07:20:53.865275+0000","last_active":"2024-04-22T07:20:54.862610+0000","last_peered":"2024-04-22T07:20:54.862610+0000","last_clean":"2024-04-22T07:20:54.862610+0000","last_became_active":"2024-04-22T07:20:53.865026+0000","last_became_peered":"2024-04-22T07:20:53.865026+0000","last_unstale":"2024-04-22T07:20:54.862610+0000","last_undegraded":"2024-04-22T07:20:54.862610+0000","last_fullsized":"2024-04-22T07:20:54.862610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:48:40.630407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979451+0000","last_change":"2024-04-22T07:20:53.873457+0000","last_active":"2024-04-22T07:20:54.979451+0000","last_peered":"2024-04-22T07:20:54.979451+0000","last_clean":"2024-04-22T07:20:54.979451+0000","last_became_active":"2024-04-22T07:20:53.873147+0000","last_became_peered":"2024-04-22T07:20:53.873147+0000","last_unstale":"2024-04-22T07:20:54.979451+0000","last_undegraded":"2024-04-22T07:20:54.979451+0000","last_fullsized":"2024-04-22T07:20:54.979451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:53.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861933+0000","last_change":"2024-04-22T07:20:53.865327+0000","last_active":"2024-04-22T07:20:54.861933+0000","last_peered":"2024-04-22T07:20:54.861933+0000","last_clean":"2024-04-22T07:20:54.861933+0000","last_became_active":"2024-04-22T07:20:53.865030+0000","last_became_peered":"2024-04-22T07:20:53.865030+0000","last_unstale":"2024-04-22T07:20:54.861933+0000","last_undegraded":"2024-04-22T07:20:54.861933+0000","last_fullsized":"2024-04-22T07:20:54.861933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979550+0000","last_change":"2024-04-22T07:20:53.876792+0000","last_active":"2024-04-22T07:20:54.979550+0000","last_peered":"2024-04-22T07:20:54.979550+0000","last_clean":"2024-04-22T07:20:54.979550+0000","last_became_active":"2024-04-22T07:20:53.876446+0000","last_became_peered":"2024-04-22T07:20:53.876446+0000","last_unstale":"2024-04-22T07:20:54.979550+0000","last_undegraded":"2024-04-22T07:20:54.979550+0000","last_fullsized":"2024-04-22T07:20:54.979550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:34.943561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979292+0000","last_change":"2024-04-22T07:20:53.878147+0000","last_active":"2024-04-22T07:20:54.979292+0000","last_peered":"2024-04-22T07:20:54.979292+0000","last_clean":"2024-04-22T07:20:54.979292+0000","last_became_active":"2024-04-22T07:20:53.877867+0000","last_became_peered":"2024-04-22T07:20:53.877867+0000","last_unstale":"2024-04-22T07:20:54.979292+0000","last_undegraded":"2024-04-22T07:20:54.979292+0000","last_fullsized":"2024-04-22T07:20:54.979292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979201+0000","last_change":"2024-04-22T07:20:53.872447+0000","last_active":"2024-04-22T07:20:54.979201+0000","last_peered":"2024-04-22T07:20:54.979201+0000","last_clean":"2024-04-22T07:20:54.979201+0000","last_became_active":"2024-04-22T07:20:53.871862+0000","last_became_peered":"2024-04-22T07:20:53.871862+0000","last_unstale":"2024-04-22T07:20:54.979201+0000","last_undegraded":"2024-04-22T07:20:54.979201+0000","last_fullsized":"2024-04-22T07:20:54.979201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:08:33.063318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862747+0000","last_change":"2024-04-22T07:20:53.862483+0000","last_active":"2024-04-22T07:20:54.862747+0000","last_peered":"2024-04-22T07:20:54.862747+0000","last_clean":"2024-04-22T07:20:54.862747+0000","last_became_active":"2024-04-22T07:20:53.862199+0000","last_became_peered":"2024-04-22T07:20:53.862199+0000","last_unstale":"2024-04-22T07:20:54.862747+0000","last_undegraded":"2024-04-22T07:20:54.862747+0000","last_fullsized":"2024-04-22T07:20:54.862747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:10:12.276510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979743+0000","last_change":"2024-04-22T07:20:53.872507+0000","last_active":"2024-04-22T07:20:54.979743+0000","last_peered":"2024-04-22T07:20:54.979743+0000","last_clean":"2024-04-22T07:20:54.979743+0000","last_became_active":"2024-04-22T07:20:53.872199+0000","last_became_peered":"2024-04-22T07:20:53.872199+0000","last_unstale":"2024-04-22T07:20:54.979743+0000","last_undegraded":"2024-04-22T07:20:54.979743+0000","last_fullsized":"2024-04-22T07:20:54.979743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:09.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861399+0000","last_change":"2024-04-22T07:20:53.863946+0000","last_active":"2024-04-22T07:20:54.861399+0000","last_peered":"2024-04-22T07:20:54.861399+0000","last_clean":"2024-04-22T07:20:54.861399+0000","last_became_active":"2024-04-22T07:20:53.863688+0000","last_became_peered":"2024-04-22T07:20:53.863688+0000","last_unstale":"2024-04-22T07:20:54.861399+0000","last_undegraded":"2024-04-22T07:20:54.861399+0000","last_fullsized":"2024-04-22T07:20:54.861399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862947+0000","last_change":"2024-04-22T07:20:53.874785+0000","last_active":"2024-04-22T07:20:54.862947+0000","last_peered":"2024-04-22T07:20:54.862947+0000","last_clean":"2024-04-22T07:20:54.862947+0000","last_became_active":"2024-04-22T07:20:53.874524+0000","last_became_peered":"2024-04-22T07:20:53.874524+0000","last_unstale":"2024-04-22T07:20:54.862947+0000","last_undegraded":"2024-04-22T07:20:54.862947+0000","last_fullsized":"2024-04-22T07:20:54.862947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978859+0000","last_change":"2024-04-22T07:20:52.860712+0000","last_active":"2024-04-22T07:20:54.978859+0000","last_peered":"2024-04-22T07:20:54.978859+0000","last_clean":"2024-04-22T07:20:54.978859+0000","last_became_active":"2024-04-22T07:20:52.860015+0000","last_became_peered":"2024-04-22T07:20:52.860015+0000","last_unstale":"2024-04-22T07:20:54.978859+0000","last_undegraded":"2024-04-22T07:20:54.978859+0000","last_fullsized":"2024-04-22T07:20:54.978859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:59:32.487127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980495+0000","last_change":"2024-04-22T07:20:53.879570+0000","last_active":"2024-04-22T07:20:54.980495+0000","last_peered":"2024-04-22T07:20:54.980495+0000","last_clean":"2024-04-22T07:20:54.980495+0000","last_became_active":"2024-04-22T07:20:53.879191+0000","last_became_peered":"2024-04-22T07:20:53.879191+0000","last_unstale":"2024-04-22T07:20:54.980495+0000","last_undegraded":"2024-04-22T07:20:54.980495+0000","last_fullsized":"2024-04-22T07:20:54.980495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:34:52.306691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863066+0000","last_change":"2024-04-22T07:20:52.862510+0000","last_active":"2024-04-22T07:20:54.863066+0000","last_peered":"2024-04-22T07:20:54.863066+0000","last_clean":"2024-04-22T07:20:54.863066+0000","last_became_active":"2024-04-22T07:20:52.862228+0000","last_became_peered":"2024-04-22T07:20:52.862228+0000","last_unstale":"2024-04-22T07:20:54.863066+0000","last_undegraded":"2024-04-22T07:20:54.863066+0000","last_fullsized":"2024-04-22T07:20:54.863066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:51.683021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979012+0000","last_change":"2024-04-22T07:20:52.856651+0000","last_active":"2024-04-22T07:20:54.979012+0000","last_peered":"2024-04-22T07:20:54.979012+0000","last_clean":"2024-04-22T07:20:54.979012+0000","last_became_active":"2024-04-22T07:20:52.856096+0000","last_became_peered":"2024-04-22T07:20:52.856096+0000","last_unstale":"2024-04-22T07:20:54.979012+0000","last_undegraded":"2024-04-22T07:20:54.979012+0000","last_fullsized":"2024-04-22T07:20:54.979012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:04.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979658+0000","last_change":"2024-04-22T07:20:53.873708+0000","last_active":"2024-04-22T07:20:54.979658+0000","last_peered":"2024-04-22T07:20:54.979658+0000","last_clean":"2024-04-22T07:20:54.979658+0000","last_became_active":"2024-04-22T07:20:53.872793+0000","last_became_peered":"2024-04-22T07:20:53.872793+0000","last_unstale":"2024-04-22T07:20:54.979658+0000","last_undegraded":"2024-04-22T07:20:54.979658+0000","last_fullsized":"2024-04-22T07:20:54.979658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:52.686229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862729+0000","last_change":"2024-04-22T07:20:52.861133+0000","last_active":"2024-04-22T07:20:54.862729+0000","last_peered":"2024-04-22T07:20:54.862729+0000","last_clean":"2024-04-22T07:20:54.862729+0000","last_became_active":"2024-04-22T07:20:52.860736+0000","last_became_peered":"2024-04-22T07:20:52.860736+0000","last_unstale":"2024-04-22T07:20:54.862729+0000","last_undegraded":"2024-04-22T07:20:54.862729+0000","last_fullsized":"2024-04-22T07:20:54.862729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:06.123308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980308+0000","last_change":"2024-04-22T07:20:53.867477+0000","last_active":"2024-04-22T07:20:54.980308+0000","last_peered":"2024-04-22T07:20:54.980308+0000","last_clean":"2024-04-22T07:20:54.980308+0000","last_became_active":"2024-04-22T07:20:53.867086+0000","last_became_peered":"2024-04-22T07:20:53.867086+0000","last_unstale":"2024-04-22T07:20:54.980308+0000","last_undegraded":"2024-04-22T07:20:54.980308+0000","last_fullsized":"2024-04-22T07:20:54.980308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:56:55.644168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863067+0000","last_change":"2024-04-22T07:20:52.863567+0000","last_active":"2024-04-22T07:20:54.863067+0000","last_peered":"2024-04-22T07:20:54.863067+0000","last_clean":"2024-04-22T07:20:54.863067+0000","last_became_active":"2024-04-22T07:20:52.863285+0000","last_became_peered":"2024-04-22T07:20:52.863285+0000","last_unstale":"2024-04-22T07:20:54.863067+0000","last_undegraded":"2024-04-22T07:20:54.863067+0000","last_fullsized":"2024-04-22T07:20:54.863067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861976+0000","last_change":"2024-04-22T07:20:53.864955+0000","last_active":"2024-04-22T07:20:54.861976+0000","last_peered":"2024-04-22T07:20:54.861976+0000","last_clean":"2024-04-22T07:20:54.861976+0000","last_became_active":"2024-04-22T07:20:53.864694+0000","last_became_peered":"2024-04-22T07:20:53.864694+0000","last_unstale":"2024-04-22T07:20:54.861976+0000","last_undegraded":"2024-04-22T07:20:54.861976+0000","last_fullsized":"2024-04-22T07:20:54.861976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977898+0000","last_change":"2024-04-22T07:20:52.858761+0000","last_active":"2024-04-22T07:20:54.977898+0000","last_peered":"2024-04-22T07:20:54.977898+0000","last_clean":"2024-04-22T07:20:54.977898+0000","last_became_active":"2024-04-22T07:20:52.856815+0000","last_became_peered":"2024-04-22T07:20:52.856815+0000","last_unstale":"2024-04-22T07:20:54.977898+0000","last_undegraded":"2024-04-22T07:20:54.977898+0000","last_fullsized":"2024-04-22T07:20:54.977898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:06.123308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979798+0000","last_change":"2024-04-22T07:20:53.867290+0000","last_active":"2024-04-22T07:20:54.979798+0000","last_peered":"2024-04-22T07:20:54.979798+0000","last_clean":"2024-04-22T07:20:54.979798+0000","last_became_active":"2024-04-22T07:20:53.866955+0000","last_became_peered":"2024-04-22T07:20:53.866955+0000","last_unstale":"2024-04-22T07:20:54.979798+0000","last_undegraded":"2024-04-22T07:20:54.979798+0000","last_fullsized":"2024-04-22T07:20:54.979798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:43.442316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980048+0000","last_change":"2024-04-22T07:20:52.863670+0000","last_active":"2024-04-22T07:20:54.980048+0000","last_peered":"2024-04-22T07:20:54.980048+0000","last_clean":"2024-04-22T07:20:54.980048+0000","last_became_active":"2024-04-22T07:20:52.863320+0000","last_became_peered":"2024-04-22T07:20:52.863320+0000","last_unstale":"2024-04-22T07:20:54.980048+0000","last_undegraded":"2024-04-22T07:20:54.980048+0000","last_fullsized":"2024-04-22T07:20:54.980048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:04.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862589+0000","last_change":"2024-04-22T07:20:53.868286+0000","last_active":"2024-04-22T07:20:54.862589+0000","last_peered":"2024-04-22T07:20:54.862589+0000","last_clean":"2024-04-22T07:20:54.862589+0000","last_became_active":"2024-04-22T07:20:53.862811+0000","last_became_peered":"2024-04-22T07:20:53.862811+0000","last_unstale":"2024-04-22T07:20:54.862589+0000","last_undegraded":"2024-04-22T07:20:54.862589+0000","last_fullsized":"2024-04-22T07:20:54.862589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861603+0000","last_change":"2024-04-22T07:20:52.863638+0000","last_active":"2024-04-22T07:20:54.861603+0000","last_peered":"2024-04-22T07:20:54.861603+0000","last_clean":"2024-04-22T07:20:54.861603+0000","last_became_active":"2024-04-22T07:20:52.863244+0000","last_became_peered":"2024-04-22T07:20:52.863244+0000","last_unstale":"2024-04-22T07:20:54.861603+0000","last_undegraded":"2024-04-22T07:20:54.861603+0000","last_fullsized":"2024-04-22T07:20:54.861603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:36:49.017537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977713+0000","last_change":"2024-04-22T07:20:53.875162+0000","last_active":"2024-04-22T07:20:54.977713+0000","last_peered":"2024-04-22T07:20:54.977713+0000","last_clean":"2024-04-22T07:20:54.977713+0000","last_became_active":"2024-04-22T07:20:53.874612+0000","last_became_peered":"2024-04-22T07:20:53.874612+0000","last_unstale":"2024-04-22T07:20:54.977713+0000","last_undegraded":"2024-04-22T07:20:54.977713+0000","last_fullsized":"2024-04-22T07:20:54.977713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:13:12.303505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979428+0000","last_change":"2024-04-22T07:20:52.855194+0000","last_active":"2024-04-22T07:20:54.979428+0000","last_peered":"2024-04-22T07:20:54.979428+0000","last_clean":"2024-04-22T07:20:54.979428+0000","last_became_active":"2024-04-22T07:20:52.854915+0000","last_became_peered":"2024-04-22T07:20:52.854915+0000","last_unstale":"2024-04-22T07:20:54.979428+0000","last_undegraded":"2024-04-22T07:20:54.979428+0000","last_fullsized":"2024-04-22T07:20:54.979428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979725+0000","last_change":"2024-04-22T07:20:53.868695+0000","last_active":"2024-04-22T07:20:54.979725+0000","last_peered":"2024-04-22T07:20:54.979725+0000","last_clean":"2024-04-22T07:20:54.979725+0000","last_became_active":"2024-04-22T07:20:53.868400+0000","last_became_peered":"2024-04-22T07:20:53.868400+0000","last_unstale":"2024-04-22T07:20:54.979725+0000","last_undegraded":"2024-04-22T07:20:54.979725+0000","last_fullsized":"2024-04-22T07:20:54.979725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:30:23.352871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863163+0000","last_change":"2024-04-22T07:20:52.861884+0000","last_active":"2024-04-22T07:20:54.863163+0000","last_peered":"2024-04-22T07:20:54.863163+0000","last_clean":"2024-04-22T07:20:54.863163+0000","last_became_active":"2024-04-22T07:20:52.861546+0000","last_became_peered":"2024-04-22T07:20:52.861546+0000","last_unstale":"2024-04-22T07:20:54.863163+0000","last_undegraded":"2024-04-22T07:20:54.863163+0000","last_fullsized":"2024-04-22T07:20:54.863163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:37.283262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862882+0000","last_change":"2024-04-22T07:20:53.863071+0000","last_active":"2024-04-22T07:20:54.862882+0000","last_peered":"2024-04-22T07:20:54.862882+0000","last_clean":"2024-04-22T07:20:54.862882+0000","last_became_active":"2024-04-22T07:20:53.862763+0000","last_became_peered":"2024-04-22T07:20:53.862763+0000","last_unstale":"2024-04-22T07:20:54.862882+0000","last_undegraded":"2024-04-22T07:20:54.862882+0000","last_fullsized":"2024-04-22T07:20:54.862882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:19:57.432323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977415+0000","last_change":"2024-04-22T07:20:52.865285+0000","last_active":"2024-04-22T07:20:54.977415+0000","last_peered":"2024-04-22T07:20:54.977415+0000","last_clean":"2024-04-22T07:20:54.977415+0000","last_became_active":"2024-04-22T07:20:52.864725+0000","last_became_peered":"2024-04-22T07:20:52.864725+0000","last_unstale":"2024-04-22T07:20:54.977415+0000","last_undegraded":"2024-04-22T07:20:54.977415+0000","last_fullsized":"2024-04-22T07:20:54.977415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:23:28.850031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862533+0000","last_change":"2024-04-22T07:20:53.875479+0000","last_active":"2024-04-22T07:20:54.862533+0000","last_peered":"2024-04-22T07:20:54.862533+0000","last_clean":"2024-04-22T07:20:54.862533+0000","last_became_active":"2024-04-22T07:20:53.874567+0000","last_became_peered":"2024-04-22T07:20:53.874567+0000","last_unstale":"2024-04-22T07:20:54.862533+0000","last_undegraded":"2024-04-22T07:20:54.862533+0000","last_fullsized":"2024-04-22T07:20:54.862533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978479+0000","last_change":"2024-04-22T07:20:52.860646+0000","last_active":"2024-04-22T07:20:54.978479+0000","last_peered":"2024-04-22T07:20:54.978479+0000","last_clean":"2024-04-22T07:20:54.978479+0000","last_became_active":"2024-04-22T07:20:52.860347+0000","last_became_peered":"2024-04-22T07:20:52.860347+0000","last_unstale":"2024-04-22T07:20:54.978479+0000","last_undegraded":"2024-04-22T07:20:54.978479+0000","last_fullsized":"2024-04-22T07:20:54.978479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:53:20.912264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862635+0000","last_change":"2024-04-22T07:20:53.859641+0000","last_active":"2024-04-22T07:20:54.862635+0000","last_peered":"2024-04-22T07:20:54.862635+0000","last_clean":"2024-04-22T07:20:54.862635+0000","last_became_active":"2024-04-22T07:20:53.859365+0000","last_became_peered":"2024-04-22T07:20:53.859365+0000","last_unstale":"2024-04-22T07:20:54.862635+0000","last_undegraded":"2024-04-22T07:20:54.862635+0000","last_fullsized":"2024-04-22T07:20:54.862635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:46:50.322722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977979+0000","last_change":"2024-04-22T07:20:52.866960+0000","last_active":"2024-04-22T07:20:54.977979+0000","last_peered":"2024-04-22T07:20:54.977979+0000","last_clean":"2024-04-22T07:20:54.977979+0000","last_became_active":"2024-04-22T07:20:52.866654+0000","last_became_peered":"2024-04-22T07:20:52.866654+0000","last_unstale":"2024-04-22T07:20:54.977979+0000","last_undegraded":"2024-04-22T07:20:54.977979+0000","last_fullsized":"2024-04-22T07:20:54.977979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:51.683021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862087+0000","last_change":"2024-04-22T07:20:53.874775+0000","last_active":"2024-04-22T07:20:54.862087+0000","last_peered":"2024-04-22T07:20:54.862087+0000","last_clean":"2024-04-22T07:20:54.862087+0000","last_became_active":"2024-04-22T07:20:53.874499+0000","last_became_peered":"2024-04-22T07:20:53.874499+0000","last_unstale":"2024-04-22T07:20:54.862087+0000","last_undegraded":"2024-04-22T07:20:54.862087+0000","last_fullsized":"2024-04-22T07:20:54.862087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:23.268067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980590+0000","last_change":"2024-04-22T07:20:52.867201+0000","last_active":"2024-04-22T07:20:54.980590+0000","last_peered":"2024-04-22T07:20:54.980590+0000","last_clean":"2024-04-22T07:20:54.980590+0000","last_became_active":"2024-04-22T07:20:52.866627+0000","last_became_peered":"2024-04-22T07:20:52.866627+0000","last_unstale":"2024-04-22T07:20:54.980590+0000","last_undegraded":"2024-04-22T07:20:54.980590+0000","last_fullsized":"2024-04-22T07:20:54.980590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:09:08.908298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977901+0000","last_change":"2024-04-22T07:20:53.871645+0000","last_active":"2024-04-22T07:20:54.977901+0000","last_peered":"2024-04-22T07:20:54.977901+0000","last_clean":"2024-04-22T07:20:54.977901+0000","last_became_active":"2024-04-22T07:20:53.871353+0000","last_became_peered":"2024-04-22T07:20:53.871353+0000","last_unstale":"2024-04-22T07:20:54.977901+0000","last_undegraded":"2024-04-22T07:20:54.977901+0000","last_fullsized":"2024-04-22T07:20:54.977901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:48:40.630407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980304+0000","last_change":"2024-04-22T07:20:52.866996+0000","last_active":"2024-04-22T07:20:54.980304+0000","last_peered":"2024-04-22T07:20:54.980304+0000","last_clean":"2024-04-22T07:20:54.980304+0000","last_became_active":"2024-04-22T07:20:52.866677+0000","last_became_peered":"2024-04-22T07:20:52.866677+0000","last_unstale":"2024-04-22T07:20:54.980304+0000","last_undegraded":"2024-04-22T07:20:54.980304+0000","last_fullsized":"2024-04-22T07:20:54.980304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977832+0000","last_change":"2024-04-22T07:20:53.871064+0000","last_active":"2024-04-22T07:20:54.977832+0000","last_peered":"2024-04-22T07:20:54.977832+0000","last_clean":"2024-04-22T07:20:54.977832+0000","last_became_active":"2024-04-22T07:20:53.866968+0000","last_became_peered":"2024-04-22T07:20:53.866968+0000","last_unstale":"2024-04-22T07:20:54.977832+0000","last_undegraded":"2024-04-22T07:20:54.977832+0000","last_fullsized":"2024-04-22T07:20:54.977832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:43.442316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979659+0000","last_change":"2024-04-22T07:20:52.856958+0000","last_active":"2024-04-22T07:20:54.979659+0000","last_peered":"2024-04-22T07:20:54.979659+0000","last_clean":"2024-04-22T07:20:54.979659+0000","last_became_active":"2024-04-22T07:20:52.856289+0000","last_became_peered":"2024-04-22T07:20:52.856289+0000","last_unstale":"2024-04-22T07:20:54.979659+0000","last_undegraded":"2024-04-22T07:20:54.979659+0000","last_fullsized":"2024-04-22T07:20:54.979659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863352+0000","last_change":"2024-04-22T07:20:53.872915+0000","last_active":"2024-04-22T07:20:54.863352+0000","last_peered":"2024-04-22T07:20:54.863352+0000","last_clean":"2024-04-22T07:20:54.863352+0000","last_became_active":"2024-04-22T07:20:53.872005+0000","last_became_peered":"2024-04-22T07:20:53.872005+0000","last_unstale":"2024-04-22T07:20:54.863352+0000","last_undegraded":"2024-04-22T07:20:54.863352+0000","last_fullsized":"2024-04-22T07:20:54.863352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:53:29.242632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862549+0000","last_change":"2024-04-22T07:20:43.747396+0000","last_active":"2024-04-22T07:20:54.862549+0000","last_peered":"2024-04-22T07:20:54.862549+0000","last_clean":"2024-04-22T07:20:54.862549+0000","last_became_active":"2024-04-22T07:20:43.746332+0000","last_became_peered":"2024-04-22T07:20:43.746332+0000","last_unstale":"2024-04-22T07:20:54.862549+0000","last_undegraded":"2024-04-22T07:20:54.862549+0000","last_fullsized":"2024-04-22T07:20:54.862549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:42.732916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:42.732916+0000","last_clean_scrub_stamp":"2024-04-22T07:20:42.732916+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:02:55.086445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863049+0000","last_change":"2024-04-22T07:20:52.862492+0000","last_active":"2024-04-22T07:20:54.863049+0000","last_peered":"2024-04-22T07:20:54.863049+0000","last_clean":"2024-04-22T07:20:54.863049+0000","last_became_active":"2024-04-22T07:20:52.862201+0000","last_became_peered":"2024-04-22T07:20:52.862201+0000","last_unstale":"2024-04-22T07:20:54.863049+0000","last_undegraded":"2024-04-22T07:20:54.863049+0000","last_fullsized":"2024-04-22T07:20:54.863049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:52.015227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979807+0000","last_change":"2024-04-22T07:20:53.868797+0000","last_active":"2024-04-22T07:20:54.979807+0000","last_peered":"2024-04-22T07:20:54.979807+0000","last_clean":"2024-04-22T07:20:54.979807+0000","last_became_active":"2024-04-22T07:20:53.868335+0000","last_became_peered":"2024-04-22T07:20:53.868335+0000","last_unstale":"2024-04-22T07:20:54.979807+0000","last_undegraded":"2024-04-22T07:20:54.979807+0000","last_fullsized":"2024-04-22T07:20:54.979807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:43:02.116289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862731+0000","last_change":"2024-04-22T07:20:52.867622+0000","last_active":"2024-04-22T07:20:54.862731+0000","last_peered":"2024-04-22T07:20:54.862731+0000","last_clean":"2024-04-22T07:20:54.862731+0000","last_became_active":"2024-04-22T07:20:52.866996+0000","last_became_peered":"2024-04-22T07:20:52.866996+0000","last_unstale":"2024-04-22T07:20:54.862731+0000","last_undegraded":"2024-04-22T07:20:54.862731+0000","last_fullsized":"2024-04-22T07:20:54.862731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:08.286530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978392+0000","last_change":"2024-04-22T07:20:53.871576+0000","last_active":"2024-04-22T07:20:54.978392+0000","last_peered":"2024-04-22T07:20:54.978392+0000","last_clean":"2024-04-22T07:20:54.978392+0000","last_became_active":"2024-04-22T07:20:53.871239+0000","last_became_peered":"2024-04-22T07:20:53.871239+0000","last_unstale":"2024-04-22T07:20:54.978392+0000","last_undegraded":"2024-04-22T07:20:54.978392+0000","last_fullsized":"2024-04-22T07:20:54.978392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979845+0000","last_change":"2024-04-22T07:20:52.866974+0000","last_active":"2024-04-22T07:20:54.979845+0000","last_peered":"2024-04-22T07:20:54.979845+0000","last_clean":"2024-04-22T07:20:54.979845+0000","last_became_active":"2024-04-22T07:20:52.866581+0000","last_became_peered":"2024-04-22T07:20:52.866581+0000","last_unstale":"2024-04-22T07:20:54.979845+0000","last_undegraded":"2024-04-22T07:20:54.979845+0000","last_fullsized":"2024-04-22T07:20:54.979845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979503+0000","last_change":"2024-04-22T07:20:53.865035+0000","last_active":"2024-04-22T07:20:54.979503+0000","last_peered":"2024-04-22T07:20:54.979503+0000","last_clean":"2024-04-22T07:20:54.979503+0000","last_became_active":"2024-04-22T07:20:53.864523+0000","last_became_peered":"2024-04-22T07:20:53.864523+0000","last_unstale":"2024-04-22T07:20:54.979503+0000","last_undegraded":"2024-04-22T07:20:54.979503+0000","last_fullsized":"2024-04-22T07:20:54.979503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:13:12.303505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863169+0000","last_change":"2024-04-22T07:20:52.858498+0000","last_active":"2024-04-22T07:20:54.863169+0000","last_peered":"2024-04-22T07:20:54.863169+0000","last_clean":"2024-04-22T07:20:54.863169+0000","last_became_active":"2024-04-22T07:20:52.858139+0000","last_became_peered":"2024-04-22T07:20:52.858139+0000","last_unstale":"2024-04-22T07:20:54.863169+0000","last_undegraded":"2024-04-22T07:20:54.863169+0000","last_fullsized":"2024-04-22T07:20:54.863169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:45.382709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977943+0000","last_change":"2024-04-22T07:20:53.877595+0000","last_active":"2024-04-22T07:20:54.977943+0000","last_peered":"2024-04-22T07:20:54.977943+0000","last_clean":"2024-04-22T07:20:54.977943+0000","last_became_active":"2024-04-22T07:20:53.877208+0000","last_became_peered":"2024-04-22T07:20:53.877208+0000","last_unstale":"2024-04-22T07:20:54.977943+0000","last_undegraded":"2024-04-22T07:20:54.977943+0000","last_fullsized":"2024-04-22T07:20:54.977943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:46:50.322722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979001+0000","last_change":"2024-04-22T07:20:52.866224+0000","last_active":"2024-04-22T07:20:54.979001+0000","last_peered":"2024-04-22T07:20:54.979001+0000","last_clean":"2024-04-22T07:20:54.979001+0000","last_became_active":"2024-04-22T07:20:52.865903+0000","last_became_peered":"2024-04-22T07:20:52.865903+0000","last_unstale":"2024-04-22T07:20:54.979001+0000","last_undegraded":"2024-04-22T07:20:54.979001+0000","last_fullsized":"2024-04-22T07:20:54.979001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861395+0000","last_change":"2024-04-22T07:20:53.873266+0000","last_active":"2024-04-22T07:20:54.861395+0000","last_peered":"2024-04-22T07:20:54.861395+0000","last_clean":"2024-04-22T07:20:54.861395+0000","last_became_active":"2024-04-22T07:20:53.872915+0000","last_became_peered":"2024-04-22T07:20:53.872915+0000","last_unstale":"2024-04-22T07:20:54.861395+0000","last_undegraded":"2024-04-22T07:20:54.861395+0000","last_fullsized":"2024-04-22T07:20:54.861395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:09.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863471+0000","last_change":"2024-04-22T07:20:52.863593+0000","last_active":"2024-04-22T07:20:54.863471+0000","last_peered":"2024-04-22T07:20:54.863471+0000","last_clean":"2024-04-22T07:20:54.863471+0000","last_became_active":"2024-04-22T07:20:52.863296+0000","last_became_peered":"2024-04-22T07:20:52.863296+0000","last_unstale":"2024-04-22T07:20:54.863471+0000","last_undegraded":"2024-04-22T07:20:54.863471+0000","last_fullsized":"2024-04-22T07:20:54.863471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:22.261683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979540+0000","last_change":"2024-04-22T07:20:53.874491+0000","last_active":"2024-04-22T07:20:54.979540+0000","last_peered":"2024-04-22T07:20:54.979540+0000","last_clean":"2024-04-22T07:20:54.979540+0000","last_became_active":"2024-04-22T07:20:53.874202+0000","last_became_peered":"2024-04-22T07:20:53.874202+0000","last_unstale":"2024-04-22T07:20:54.979540+0000","last_undegraded":"2024-04-22T07:20:54.979540+0000","last_fullsized":"2024-04-22T07:20:54.979540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:23.268067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980599+0000","last_change":"2024-04-22T07:20:52.865905+0000","last_active":"2024-04-22T07:20:54.980599+0000","last_peered":"2024-04-22T07:20:54.980599+0000","last_clean":"2024-04-22T07:20:54.980599+0000","last_became_active":"2024-04-22T07:20:52.865566+0000","last_became_peered":"2024-04-22T07:20:52.865566+0000","last_unstale":"2024-04-22T07:20:54.980599+0000","last_undegraded":"2024-04-22T07:20:54.980599+0000","last_fullsized":"2024-04-22T07:20:54.980599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:38:31.271879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980566+0000","last_change":"2024-04-22T07:20:53.869951+0000","last_active":"2024-04-22T07:20:54.980566+0000","last_peered":"2024-04-22T07:20:54.980566+0000","last_clean":"2024-04-22T07:20:54.980566+0000","last_became_active":"2024-04-22T07:20:53.869613+0000","last_became_peered":"2024-04-22T07:20:53.869613+0000","last_unstale":"2024-04-22T07:20:54.980566+0000","last_undegraded":"2024-04-22T07:20:54.980566+0000","last_fullsized":"2024-04-22T07:20:54.980566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:14:09.372107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863610+0000","last_change":"2024-04-22T07:20:52.864740+0000","last_active":"2024-04-22T07:20:54.863610+0000","last_peered":"2024-04-22T07:20:54.863610+0000","last_clean":"2024-04-22T07:20:54.863610+0000","last_became_active":"2024-04-22T07:20:52.864434+0000","last_became_peered":"2024-04-22T07:20:52.864434+0000","last_unstale":"2024-04-22T07:20:54.863610+0000","last_undegraded":"2024-04-22T07:20:54.863610+0000","last_fullsized":"2024-04-22T07:20:54.863610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:33.937176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980498+0000","last_change":"2024-04-22T07:20:53.871156+0000","last_active":"2024-04-22T07:20:54.980498+0000","last_peered":"2024-04-22T07:20:54.980498+0000","last_clean":"2024-04-22T07:20:54.980498+0000","last_became_active":"2024-04-22T07:20:53.870664+0000","last_became_peered":"2024-04-22T07:20:53.870664+0000","last_unstale":"2024-04-22T07:20:54.980498+0000","last_undegraded":"2024-04-22T07:20:54.980498+0000","last_fullsized":"2024-04-22T07:20:54.980498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:01:02.139458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977319+0000","last_change":"2024-04-22T07:20:52.854668+0000","last_active":"2024-04-22T07:20:54.977319+0000","last_peered":"2024-04-22T07:20:54.977319+0000","last_clean":"2024-04-22T07:20:54.977319+0000","last_became_active":"2024-04-22T07:20:52.854395+0000","last_became_peered":"2024-04-22T07:20:52.854395+0000","last_unstale":"2024-04-22T07:20:54.977319+0000","last_undegraded":"2024-04-22T07:20:54.977319+0000","last_fullsized":"2024-04-22T07:20:54.977319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:59:32.487127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862797+0000","last_change":"2024-04-22T07:20:53.870972+0000","last_active":"2024-04-22T07:20:54.862797+0000","last_peered":"2024-04-22T07:20:54.862797+0000","last_clean":"2024-04-22T07:20:54.862797+0000","last_became_active":"2024-04-22T07:20:53.870674+0000","last_became_peered":"2024-04-22T07:20:53.870674+0000","last_unstale":"2024-04-22T07:20:54.862797+0000","last_undegraded":"2024-04-22T07:20:54.862797+0000","last_fullsized":"2024-04-22T07:20:54.862797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:10.431906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980374+0000","last_change":"2024-04-22T07:20:52.866003+0000","last_active":"2024-04-22T07:20:54.980374+0000","last_peered":"2024-04-22T07:20:54.980374+0000","last_clean":"2024-04-22T07:20:54.980374+0000","last_became_active":"2024-04-22T07:20:52.865606+0000","last_became_peered":"2024-04-22T07:20:52.865606+0000","last_unstale":"2024-04-22T07:20:54.980374+0000","last_undegraded":"2024-04-22T07:20:54.980374+0000","last_fullsized":"2024-04-22T07:20:54.980374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:58:06.713204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978351+0000","last_change":"2024-04-22T07:20:53.870737+0000","last_active":"2024-04-22T07:20:54.978351+0000","last_peered":"2024-04-22T07:20:54.978351+0000","last_clean":"2024-04-22T07:20:54.978351+0000","last_became_active":"2024-04-22T07:20:53.870402+0000","last_became_peered":"2024-04-22T07:20:53.870402+0000","last_unstale":"2024-04-22T07:20:54.978351+0000","last_undegraded":"2024-04-22T07:20:54.978351+0000","last_fullsized":"2024-04-22T07:20:54.978351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:30:17.845591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979784+0000","last_change":"2024-04-22T07:20:52.861048+0000","last_active":"2024-04-22T07:20:54.979784+0000","last_peered":"2024-04-22T07:20:54.979784+0000","last_clean":"2024-04-22T07:20:54.979784+0000","last_became_active":"2024-04-22T07:20:52.860702+0000","last_became_peered":"2024-04-22T07:20:52.860702+0000","last_unstale":"2024-04-22T07:20:54.979784+0000","last_undegraded":"2024-04-22T07:20:54.979784+0000","last_fullsized":"2024-04-22T07:20:54.979784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979324+0000","last_change":"2024-04-22T07:20:53.868782+0000","last_active":"2024-04-22T07:20:54.979324+0000","last_peered":"2024-04-22T07:20:54.979324+0000","last_clean":"2024-04-22T07:20:54.979324+0000","last_became_active":"2024-04-22T07:20:53.868509+0000","last_became_peered":"2024-04-22T07:20:53.868509+0000","last_unstale":"2024-04-22T07:20:54.979324+0000","last_undegraded":"2024-04-22T07:20:54.979324+0000","last_fullsized":"2024-04-22T07:20:54.979324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:07.129692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862970+0000","last_change":"2024-04-22T07:20:52.858508+0000","last_active":"2024-04-22T07:20:54.862970+0000","last_peered":"2024-04-22T07:20:54.862970+0000","last_clean":"2024-04-22T07:20:54.862970+0000","last_became_active":"2024-04-22T07:20:52.858215+0000","last_became_peered":"2024-04-22T07:20:52.858215+0000","last_unstale":"2024-04-22T07:20:54.862970+0000","last_undegraded":"2024-04-22T07:20:54.862970+0000","last_fullsized":"2024-04-22T07:20:54.862970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:26.618434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862971+0000","last_change":"2024-04-22T07:20:53.867977+0000","last_active":"2024-04-22T07:20:54.862971+0000","last_peered":"2024-04-22T07:20:54.862971+0000","last_clean":"2024-04-22T07:20:54.862971+0000","last_became_active":"2024-04-22T07:20:53.867447+0000","last_became_peered":"2024-04-22T07:20:53.867447+0000","last_unstale":"2024-04-22T07:20:54.862971+0000","last_undegraded":"2024-04-22T07:20:54.862971+0000","last_fullsized":"2024-04-22T07:20:54.862971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:48:52.934171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863377+0000","last_change":"2024-04-22T07:20:53.875681+0000","last_active":"2024-04-22T07:20:54.863377+0000","last_peered":"2024-04-22T07:20:54.863377+0000","last_clean":"2024-04-22T07:20:54.863377+0000","last_became_active":"2024-04-22T07:20:53.875305+0000","last_became_peered":"2024-04-22T07:20:53.875305+0000","last_unstale":"2024-04-22T07:20:54.863377+0000","last_undegraded":"2024-04-22T07:20:54.863377+0000","last_fullsized":"2024-04-22T07:20:54.863377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:22:34.452869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977916+0000","last_change":"2024-04-22T07:20:52.857445+0000","last_active":"2024-04-22T07:20:54.977916+0000","last_peered":"2024-04-22T07:20:54.977916+0000","last_clean":"2024-04-22T07:20:54.977916+0000","last_became_active":"2024-04-22T07:20:52.856293+0000","last_became_peered":"2024-04-22T07:20:52.856293+0000","last_unstale":"2024-04-22T07:20:54.977916+0000","last_undegraded":"2024-04-22T07:20:54.977916+0000","last_fullsized":"2024-04-22T07:20:54.977916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:10.640191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862780+0000","last_change":"2024-04-22T07:20:53.870827+0000","last_active":"2024-04-22T07:20:54.862780+0000","last_peered":"2024-04-22T07:20:54.862780+0000","last_clean":"2024-04-22T07:20:54.862780+0000","last_became_active":"2024-04-22T07:20:53.870548+0000","last_became_peered":"2024-04-22T07:20:53.870548+0000","last_unstale":"2024-04-22T07:20:54.862780+0000","last_undegraded":"2024-04-22T07:20:54.862780+0000","last_fullsized":"2024-04-22T07:20:54.862780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:27.624819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977785+0000","last_change":"2024-04-22T07:20:52.856933+0000","last_active":"2024-04-22T07:20:54.977785+0000","last_peered":"2024-04-22T07:20:54.977785+0000","last_clean":"2024-04-22T07:20:54.977785+0000","last_became_active":"2024-04-22T07:20:52.856617+0000","last_became_peered":"2024-04-22T07:20:52.856617+0000","last_unstale":"2024-04-22T07:20:54.977785+0000","last_undegraded":"2024-04-22T07:20:54.977785+0000","last_fullsized":"2024-04-22T07:20:54.977785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:08.286530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979619+0000","last_change":"2024-04-22T07:20:53.866552+0000","last_active":"2024-04-22T07:20:54.979619+0000","last_peered":"2024-04-22T07:20:54.979619+0000","last_clean":"2024-04-22T07:20:54.979619+0000","last_became_active":"2024-04-22T07:20:53.866286+0000","last_became_peered":"2024-04-22T07:20:53.866286+0000","last_unstale":"2024-04-22T07:20:54.979619+0000","last_undegraded":"2024-04-22T07:20:54.979619+0000","last_fullsized":"2024-04-22T07:20:54.979619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:45:15.519469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980248+0000","last_change":"2024-04-22T07:20:52.863291+0000","last_active":"2024-04-22T07:20:54.980248+0000","last_peered":"2024-04-22T07:20:54.980248+0000","last_clean":"2024-04-22T07:20:54.980248+0000","last_became_active":"2024-04-22T07:20:52.862967+0000","last_became_peered":"2024-04-22T07:20:52.862967+0000","last_unstale":"2024-04-22T07:20:54.980248+0000","last_undegraded":"2024-04-22T07:20:54.980248+0000","last_fullsized":"2024-04-22T07:20:54.980248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:10.640191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980150+0000","last_change":"2024-04-22T07:20:53.871045+0000","last_active":"2024-04-22T07:20:54.980150+0000","last_peered":"2024-04-22T07:20:54.980150+0000","last_clean":"2024-04-22T07:20:54.980150+0000","last_became_active":"2024-04-22T07:20:53.870715+0000","last_became_peered":"2024-04-22T07:20:53.870715+0000","last_unstale":"2024-04-22T07:20:54.980150+0000","last_undegraded":"2024-04-22T07:20:54.980150+0000","last_fullsized":"2024-04-22T07:20:54.980150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980486+0000","last_change":"2024-04-22T07:20:52.869553+0000","last_active":"2024-04-22T07:20:54.980486+0000","last_peered":"2024-04-22T07:20:54.980486+0000","last_clean":"2024-04-22T07:20:54.980486+0000","last_became_active":"2024-04-22T07:20:52.869300+0000","last_became_peered":"2024-04-22T07:20:52.869300+0000","last_unstale":"2024-04-22T07:20:54.980486+0000","last_undegraded":"2024-04-22T07:20:54.980486+0000","last_fullsized":"2024-04-22T07:20:54.980486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:27.709073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":815104,"data_stored":665303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":74935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":671603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T07:21:03.315 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T07:21:03.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.430+0000 7fd0e2e3f640 1 Processor -- start 2024-04-22T07:21:03.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.431+0000 7fd0e2e3f640 1 -- start start 2024-04-22T07:21:03.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.431+0000 7fd0e2e3f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd0dc1551a0 0x7fd0dc0cd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:03.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.431+0000 7fd0e2e3f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0dc15e410 con 0x7fd0dc0cbe00 2024-04-22T07:21:03.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.431+0000 7fd0e2e3f640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0dc155580 con 0x7fd0dc15bae0 2024-04-22T07:21:03.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.431+0000 7fd0e2e3f640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fd0dc15e6b0 con 0x7fd0dc1551a0 2024-04-22T07:21:03.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.432+0000 7fd0e13dc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd0dc0cbe00 0x7fd0dc0b4ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33818/0 (socket says 172.21.15.40:33818) 2024-04-22T07:21:03.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.432+0000 7fd0e13dc640 1 -- 172.21.15.40:0/2860632092 learned_addr learned my addr 172.21.15.40:0/2860632092 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:03.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.432+0000 7fd0e0bdb640 1 --2- 172.21.15.40:0/2860632092 >> v2:172.21.15.62:3300/0 conn(0x7fd0dc1551a0 0x7fd0dc0cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:03.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.432+0000 7fd0db7fe640 1 -- 172.21.15.40:0/2860632092 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1364725937 0 0) 0x7fd0dc15e410 con 0x7fd0dc0cbe00 2024-04-22T07:21:03.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.432+0000 7fd0db7fe640 1 -- 172.21.15.40:0/2860632092 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0c8003520 con 0x7fd0dc0cbe00 2024-04-22T07:21:03.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.432+0000 7fd0db7fe640 1 -- 172.21.15.40:0/2860632092 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1814887394 0 0) 0x7fd0c8003520 con 0x7fd0dc0cbe00 2024-04-22T07:21:03.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.432+0000 7fd0db7fe640 1 -- 172.21.15.40:0/2860632092 >> v2:172.21.15.62:3300/0 conn(0x7fd0dc1551a0 msgr2=0x7fd0dc0cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:03.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.432+0000 7fd0db7fe640 1 --2- 172.21.15.40:0/2860632092 >> v2:172.21.15.62:3300/0 conn(0x7fd0dc1551a0 0x7fd0dc0cd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:03.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.432+0000 7fd0db7fe640 1 -- 172.21.15.40:0/2860632092 >> v1:172.21.15.62:6789/0 conn(0x7fd0dc15bae0 legacy=0x7fd0dc0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:03.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.432+0000 7fd0db7fe640 1 -- 172.21.15.40:0/2860632092 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0dc15e990 con 0x7fd0dc0cbe00 2024-04-22T07:21:03.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.432+0000 7fd0db7fe640 1 -- 172.21.15.40:0/2860632092 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7fd0cc001670 con 0x7fd0dc0cbe00 2024-04-22T07:21:03.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.432+0000 7fd0db7fe640 1 -- 172.21.15.40:0/2860632092 >> v1:172.21.15.40:6789/0 conn(0x7fd0dc0cbe00 legacy=0x7fd0dc0b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:03.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.432+0000 7fd0db7fe640 1 --2- 172.21.15.40:0/2860632092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0c80039b0 0x7fd0c8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:03.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.432+0000 7fd0db7fe640 1 --2- 172.21.15.40:0/2860632092 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0c8004800 0x7fd0c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:03.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.432+0000 7fd0db7fe640 1 --2- 172.21.15.40:0/2860632092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0c80051c0 0x7fd0c800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:03.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.432+0000 7fd0db7fe640 1 -- 172.21.15.40:0/2860632092 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc15e6b0 con 0x7fd0c80039b0 2024-04-22T07:21:03.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.432+0000 7fd0db7fe640 1 -- 172.21.15.40:0/2860632092 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c800c060 con 0x7fd0c80051c0 2024-04-22T07:21:03.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.432+0000 7fd0db7fe640 1 -- 172.21.15.40:0/2860632092 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fd0c800c260 con 0x7fd0c8004800 2024-04-22T07:21:03.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.432+0000 7fd0e0bdb640 1 --2- 172.21.15.40:0/2860632092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0c80039b0 0x7fd0c8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:03.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.432+0000 7fd0dbfff640 1 --2- 172.21.15.40:0/2860632092 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0c8004800 0x7fd0c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:03.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.432+0000 7fd0e13dc640 1 --2- 172.21.15.40:0/2860632092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0c80051c0 0x7fd0c800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:03.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.433+0000 7fd0e0bdb640 1 -- 172.21.15.40:0/2860632092 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0c8004800 msgr2=0x7fd0c8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:03.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.433+0000 7fd0e0bdb640 1 --2- 172.21.15.40:0/2860632092 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0c8004800 0x7fd0c8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:03.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.433+0000 7fd0e0bdb640 1 -- 172.21.15.40:0/2860632092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0c80051c0 msgr2=0x7fd0c800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:03.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.433+0000 7fd0e0bdb640 1 --2- 172.21.15.40:0/2860632092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0c80051c0 0x7fd0c800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:03.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.433+0000 7fd0e0bdb640 1 -- 172.21.15.40:0/2860632092 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c8003520 con 0x7fd0c80039b0 2024-04-22T07:21:03.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.433+0000 7fd0e13dc640 1 --2- 172.21.15.40:0/2860632092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0c80051c0 0x7fd0c800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:03.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.433+0000 7fd0e13dc640 1 -- 172.21.15.40:0/2860632092 reap_dead start 2024-04-22T07:21:03.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.433+0000 7fd0e0bdb640 1 --2- 172.21.15.40:0/2860632092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0c80039b0 0x7fd0c8003dd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009fc0 tx=0x7fd0c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae5bc8cf5e4cfa85 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:03.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.433+0000 7fd0db7fe640 1 -- 172.21.15.40:0/2860632092 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4039070 con 0x7fd0c80039b0 2024-04-22T07:21:03.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.434+0000 7fd0db7fe640 1 -- 172.21.15.40:0/2860632092 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d402cc20 con 0x7fd0c80039b0 2024-04-22T07:21:03.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.434+0000 7fd0db7fe640 1 -- 172.21.15.40:0/2860632092 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4009c10 con 0x7fd0c80039b0 2024-04-22T07:21:03.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.434+0000 7fd0e2e3f640 1 -- 172.21.15.40:0/2860632092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0c80039b0 msgr2=0x7fd0c8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:03.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.434+0000 7fd0e2e3f640 1 --2- 172.21.15.40:0/2860632092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0c80039b0 0x7fd0c8003dd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009fc0 tx=0x7fd0c8005830 comp rx=0 tx=0).stop 2024-04-22T07:21:03.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.434+0000 7fd0e2e3f640 1 -- 172.21.15.40:0/2860632092 shutdown_connections 2024-04-22T07:21:03.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.434+0000 7fd0e2e3f640 1 --2- 172.21.15.40:0/2860632092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0c80039b0 0x7fd0c8003dd0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:03.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.434+0000 7fd0e2e3f640 1 -- 172.21.15.40:0/2860632092 >> 172.21.15.40:0/2860632092 conn(0x7fd0dc0678c0 msgr2=0x7fd0dc072860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:03.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.434+0000 7fd0e2e3f640 1 -- 172.21.15.40:0/2860632092 shutdown_connections 2024-04-22T07:21:03.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.434+0000 7fd0e2e3f640 1 -- 172.21.15.40:0/2860632092 wait complete. 2024-04-22T07:21:03.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.435+0000 7fd0e2e3f640 1 Processor -- start 2024-04-22T07:21:03.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.435+0000 7fd0e2e3f640 1 -- start start 2024-04-22T07:21:03.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.436+0000 7fd0e2e3f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0c80039b0 0x7fd0dc150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:03.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.436+0000 7fd0e2e3f640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0dc15a460 0x7fd0dc1f1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:03.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.436+0000 7fd0e2e3f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc15a890 0x7fd0dc1f1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:03.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.436+0000 7fd0e2e3f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc15f230 con 0x7fd0c80039b0 2024-04-22T07:21:03.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.436+0000 7fd0e2e3f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd0dc15ef50 con 0x7fd0dc15a890 2024-04-22T07:21:03.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.436+0000 7fd0e2e3f640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fd0dc0cb6f0 con 0x7fd0dc15a460 2024-04-22T07:21:03.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.436+0000 7fd0e0bdb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0c80039b0 0x7fd0dc150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:03.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.436+0000 7fd0e0bdb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0c80039b0 0x7fd0dc150700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42082/0 (socket says 172.21.15.40:42082) 2024-04-22T07:21:03.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.436+0000 7fd0e0bdb640 1 -- 172.21.15.40:0/2770889491 learned_addr learned my addr 172.21.15.40:0/2770889491 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:03.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.437+0000 7fd0e13dc640 1 --2- 172.21.15.40:0/2770889491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc15a890 0x7fd0dc1f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:03.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.437+0000 7fd0dbfff640 1 --2- 172.21.15.40:0/2770889491 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0dc15a460 0x7fd0dc1f1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:03.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.437+0000 7fd0e0bdb640 1 -- 172.21.15.40:0/2770889491 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0dc15a460 msgr2=0x7fd0dc1f1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:03.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.437+0000 7fd0e0bdb640 1 --2- 172.21.15.40:0/2770889491 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0dc15a460 0x7fd0dc1f1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:03.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.437+0000 7fd0e0bdb640 1 -- 172.21.15.40:0/2770889491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc15a890 msgr2=0x7fd0dc1f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:03.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.437+0000 7fd0e0bdb640 1 --2- 172.21.15.40:0/2770889491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc15a890 0x7fd0dc1f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:03.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.437+0000 7fd0e0bdb640 1 -- 172.21.15.40:0/2770889491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0dc157ab0 con 0x7fd0c80039b0 2024-04-22T07:21:03.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.437+0000 7fd0e13dc640 1 --2- 172.21.15.40:0/2770889491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc15a890 0x7fd0dc1f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:03.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.437+0000 7fd0dbfff640 1 --2- 172.21.15.40:0/2770889491 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0dc15a460 0x7fd0dc1f1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:03.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.437+0000 7fd0e0bdb640 1 --2- 172.21.15.40:0/2770889491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0c80039b0 0x7fd0dc150700 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd0d402c690 tx=0x7fd0d4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:03.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.437+0000 7fd0d97fa640 1 -- 172.21.15.40:0/2770889491 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4039050 con 0x7fd0c80039b0 2024-04-22T07:21:03.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.437+0000 7fd0d97fa640 1 -- 172.21.15.40:0/2770889491 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d403a040 con 0x7fd0c80039b0 2024-04-22T07:21:03.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.437+0000 7fd0e2e3f640 1 -- 172.21.15.40:0/2770889491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0dc157d90 con 0x7fd0c80039b0 2024-04-22T07:21:03.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.437+0000 7fd0d97fa640 1 -- 172.21.15.40:0/2770889491 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4009c10 con 0x7fd0c80039b0 2024-04-22T07:21:03.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.437+0000 7fd0e2e3f640 1 -- 172.21.15.40:0/2770889491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0dc158350 con 0x7fd0c80039b0 2024-04-22T07:21:03.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.438+0000 7fd0e2e3f640 1 -- 172.21.15.40:0/2770889491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0dc069d40 con 0x7fd0c80039b0 2024-04-22T07:21:03.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.439+0000 7fd0d97fa640 1 -- 172.21.15.40:0/2770889491 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd0d4003bb0 con 0x7fd0c80039b0 2024-04-22T07:21:03.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.439+0000 7fd0d97fa640 1 --2- 172.21.15.40:0/2770889491 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fd0bc06c8f0 0x7fd0bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:03.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.439+0000 7fd0d97fa640 1 -- 172.21.15.40:0/2770889491 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd0d40ae420 con 0x7fd0c80039b0 2024-04-22T07:21:03.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.439+0000 7fd0dbfff640 1 --2- 172.21.15.40:0/2770889491 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fd0bc06c8f0 0x7fd0bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:03.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.440+0000 7fd0dbfff640 1 --2- 172.21.15.40:0/2770889491 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fd0bc06c8f0 0x7fd0bc06edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc15a840 tx=0x7fd0c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:03.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.444+0000 7fd0d97fa640 1 -- 172.21.15.40:0/2770889491 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd0d407c7c0 con 0x7fd0c80039b0 2024-04-22T07:21:03.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.625+0000 7fd0e2e3f640 1 -- 172.21.15.40:0/2770889491 --> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd0dc0b6050 con 0x7fd0bc06c8f0 2024-04-22T07:21:03.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.631+0000 7fd0d97fa640 1 -- 172.21.15.40:0/2770889491 <== mgr.4107 v2:172.21.15.40:6832/91163869 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251915 (secure 0 0 0) 0x7fd0dc0b6050 con 0x7fd0bc06c8f0 2024-04-22T07:21:03.632 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:21:03.633 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-22T07:21:03.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.635+0000 7fd0e2e3f640 1 -- 172.21.15.40:0/2770889491 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fd0bc06c8f0 msgr2=0x7fd0bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:03.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.635+0000 7fd0e2e3f640 1 --2- 172.21.15.40:0/2770889491 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fd0bc06c8f0 0x7fd0bc06edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc15a840 tx=0x7fd0c4009040 comp rx=0 tx=0).stop 2024-04-22T07:21:03.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.635+0000 7fd0e2e3f640 1 -- 172.21.15.40:0/2770889491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0c80039b0 msgr2=0x7fd0dc150700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:03.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.635+0000 7fd0e2e3f640 1 --2- 172.21.15.40:0/2770889491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0c80039b0 0x7fd0dc150700 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd0d402c690 tx=0x7fd0d4009750 comp rx=0 tx=0).stop 2024-04-22T07:21:03.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.635+0000 7fd0e2e3f640 1 -- 172.21.15.40:0/2770889491 shutdown_connections 2024-04-22T07:21:03.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.635+0000 7fd0e2e3f640 1 --2- 172.21.15.40:0/2770889491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc15a890 0x7fd0dc1f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:03.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.635+0000 7fd0e2e3f640 1 --2- 172.21.15.40:0/2770889491 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0dc15a460 0x7fd0dc1f1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:03.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.635+0000 7fd0e2e3f640 1 --2- 172.21.15.40:0/2770889491 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fd0bc06c8f0 0x7fd0bc06edb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:03.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.635+0000 7fd0e2e3f640 1 --2- 172.21.15.40:0/2770889491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0c80039b0 0x7fd0dc150700 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:03.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.635+0000 7fd0e2e3f640 1 -- 172.21.15.40:0/2770889491 >> 172.21.15.40:0/2770889491 conn(0x7fd0dc0678c0 msgr2=0x7fd0dc0cf210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:03.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.635+0000 7fd0e2e3f640 1 -- 172.21.15.40:0/2770889491 shutdown_connections 2024-04-22T07:21:03.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.635+0000 7fd0e2e3f640 1 -- 172.21.15.40:0/2770889491 wait complete. 2024-04-22T07:21:03.643 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-04-22T07:21:01.778304+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":184,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219172,"kb_used_data":3028,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755548,"statfs":{"total":773094113280,"available":772869681152,"internally_reserved":0,"allocated":3100672,"data_stored":1833152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001408"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977886+0000","last_change":"2024-04-22T07:20:53.873662+0000","last_active":"2024-04-22T07:20:54.977886+0000","last_peered":"2024-04-22T07:20:54.977886+0000","last_clean":"2024-04-22T07:20:54.977886+0000","last_became_active":"2024-04-22T07:20:53.873384+0000","last_became_peered":"2024-04-22T07:20:53.873384+0000","last_unstale":"2024-04-22T07:20:54.977886+0000","last_undegraded":"2024-04-22T07:20:54.977886+0000","last_fullsized":"2024-04-22T07:20:54.977886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980006+0000","last_change":"2024-04-22T07:20:53.870454+0000","last_active":"2024-04-22T07:20:54.980006+0000","last_peered":"2024-04-22T07:20:54.980006+0000","last_clean":"2024-04-22T07:20:54.980006+0000","last_became_active":"2024-04-22T07:20:53.869964+0000","last_became_peered":"2024-04-22T07:20:53.869964+0000","last_unstale":"2024-04-22T07:20:54.980006+0000","last_undegraded":"2024-04-22T07:20:54.980006+0000","last_fullsized":"2024-04-22T07:20:54.980006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979125+0000","last_change":"2024-04-22T07:20:53.871145+0000","last_active":"2024-04-22T07:20:54.979125+0000","last_peered":"2024-04-22T07:20:54.979125+0000","last_clean":"2024-04-22T07:20:54.979125+0000","last_became_active":"2024-04-22T07:20:53.870819+0000","last_became_peered":"2024-04-22T07:20:53.870819+0000","last_unstale":"2024-04-22T07:20:54.979125+0000","last_undegraded":"2024-04-22T07:20:54.979125+0000","last_fullsized":"2024-04-22T07:20:54.979125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:02:16.373202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861622+0000","last_change":"2024-04-22T07:20:53.870458+0000","last_active":"2024-04-22T07:20:54.861622+0000","last_peered":"2024-04-22T07:20:54.861622+0000","last_clean":"2024-04-22T07:20:54.861622+0000","last_became_active":"2024-04-22T07:20:53.870125+0000","last_became_peered":"2024-04-22T07:20:53.870125+0000","last_unstale":"2024-04-22T07:20:54.861622+0000","last_undegraded":"2024-04-22T07:20:54.861622+0000","last_fullsized":"2024-04-22T07:20:54.861622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977801+0000","last_change":"2024-04-22T07:20:53.877301+0000","last_active":"2024-04-22T07:20:54.977801+0000","last_peered":"2024-04-22T07:20:54.977801+0000","last_clean":"2024-04-22T07:20:54.977801+0000","last_became_active":"2024-04-22T07:20:53.874941+0000","last_became_peered":"2024-04-22T07:20:53.874941+0000","last_unstale":"2024-04-22T07:20:54.977801+0000","last_undegraded":"2024-04-22T07:20:54.977801+0000","last_fullsized":"2024-04-22T07:20:54.977801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:52.686229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861484+0000","last_change":"2024-04-22T07:20:53.869735+0000","last_active":"2024-04-22T07:20:54.861484+0000","last_peered":"2024-04-22T07:20:54.861484+0000","last_clean":"2024-04-22T07:20:54.861484+0000","last_became_active":"2024-04-22T07:20:53.869369+0000","last_became_peered":"2024-04-22T07:20:53.869369+0000","last_unstale":"2024-04-22T07:20:54.861484+0000","last_undegraded":"2024-04-22T07:20:54.861484+0000","last_fullsized":"2024-04-22T07:20:54.861484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:27.624819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977494+0000","last_change":"2024-04-22T07:20:53.873492+0000","last_active":"2024-04-22T07:20:54.977494+0000","last_peered":"2024-04-22T07:20:54.977494+0000","last_clean":"2024-04-22T07:20:54.977494+0000","last_became_active":"2024-04-22T07:20:53.873220+0000","last_became_peered":"2024-04-22T07:20:53.873220+0000","last_unstale":"2024-04-22T07:20:54.977494+0000","last_undegraded":"2024-04-22T07:20:54.977494+0000","last_fullsized":"2024-04-22T07:20:54.977494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:35:26.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979018+0000","last_change":"2024-04-22T07:20:53.875847+0000","last_active":"2024-04-22T07:20:54.979018+0000","last_peered":"2024-04-22T07:20:54.979018+0000","last_clean":"2024-04-22T07:20:54.979018+0000","last_became_active":"2024-04-22T07:20:53.875017+0000","last_became_peered":"2024-04-22T07:20:53.875017+0000","last_unstale":"2024-04-22T07:20:54.979018+0000","last_undegraded":"2024-04-22T07:20:54.979018+0000","last_fullsized":"2024-04-22T07:20:54.979018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:07.080135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863086+0000","last_change":"2024-04-22T07:20:53.869174+0000","last_active":"2024-04-22T07:20:54.863086+0000","last_peered":"2024-04-22T07:20:54.863086+0000","last_clean":"2024-04-22T07:20:54.863086+0000","last_became_active":"2024-04-22T07:20:53.868906+0000","last_became_peered":"2024-04-22T07:20:53.868906+0000","last_unstale":"2024-04-22T07:20:54.863086+0000","last_undegraded":"2024-04-22T07:20:54.863086+0000","last_fullsized":"2024-04-22T07:20:54.863086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977893+0000","last_change":"2024-04-22T07:20:53.874933+0000","last_active":"2024-04-22T07:20:54.977893+0000","last_peered":"2024-04-22T07:20:54.977893+0000","last_clean":"2024-04-22T07:20:54.977893+0000","last_became_active":"2024-04-22T07:20:53.874673+0000","last_became_peered":"2024-04-22T07:20:53.874673+0000","last_unstale":"2024-04-22T07:20:54.977893+0000","last_undegraded":"2024-04-22T07:20:54.977893+0000","last_fullsized":"2024-04-22T07:20:54.977893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977684+0000","last_change":"2024-04-22T07:20:53.874909+0000","last_active":"2024-04-22T07:20:54.977684+0000","last_peered":"2024-04-22T07:20:54.977684+0000","last_clean":"2024-04-22T07:20:54.977684+0000","last_became_active":"2024-04-22T07:20:53.873945+0000","last_became_peered":"2024-04-22T07:20:53.873945+0000","last_unstale":"2024-04-22T07:20:54.977684+0000","last_undegraded":"2024-04-22T07:20:54.977684+0000","last_fullsized":"2024-04-22T07:20:54.977684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:53.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977652+0000","last_change":"2024-04-22T07:20:53.878344+0000","last_active":"2024-04-22T07:20:54.977652+0000","last_peered":"2024-04-22T07:20:54.977652+0000","last_clean":"2024-04-22T07:20:54.977652+0000","last_became_active":"2024-04-22T07:20:53.877192+0000","last_became_peered":"2024-04-22T07:20:53.877192+0000","last_unstale":"2024-04-22T07:20:54.977652+0000","last_undegraded":"2024-04-22T07:20:54.977652+0000","last_fullsized":"2024-04-22T07:20:54.977652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:42:03.637655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979583+0000","last_change":"2024-04-22T07:20:53.879419+0000","last_active":"2024-04-22T07:20:54.979583+0000","last_peered":"2024-04-22T07:20:54.979583+0000","last_clean":"2024-04-22T07:20:54.979583+0000","last_became_active":"2024-04-22T07:20:53.879070+0000","last_became_peered":"2024-04-22T07:20:53.879070+0000","last_unstale":"2024-04-22T07:20:54.979583+0000","last_undegraded":"2024-04-22T07:20:54.979583+0000","last_fullsized":"2024-04-22T07:20:54.979583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979592+0000","last_change":"2024-04-22T07:20:53.877395+0000","last_active":"2024-04-22T07:20:54.979592+0000","last_peered":"2024-04-22T07:20:54.979592+0000","last_clean":"2024-04-22T07:20:54.979592+0000","last_became_active":"2024-04-22T07:20:53.877116+0000","last_became_peered":"2024-04-22T07:20:53.877116+0000","last_unstale":"2024-04-22T07:20:54.979592+0000","last_undegraded":"2024-04-22T07:20:54.979592+0000","last_fullsized":"2024-04-22T07:20:54.979592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:21:25.001413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979310+0000","last_change":"2024-04-22T07:20:53.875156+0000","last_active":"2024-04-22T07:20:54.979310+0000","last_peered":"2024-04-22T07:20:54.979310+0000","last_clean":"2024-04-22T07:20:54.979310+0000","last_became_active":"2024-04-22T07:20:53.874468+0000","last_became_peered":"2024-04-22T07:20:53.874468+0000","last_unstale":"2024-04-22T07:20:54.979310+0000","last_undegraded":"2024-04-22T07:20:54.979310+0000","last_fullsized":"2024-04-22T07:20:54.979310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:42:03.637655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862585+0000","last_change":"2024-04-22T07:20:53.867178+0000","last_active":"2024-04-22T07:20:54.862585+0000","last_peered":"2024-04-22T07:20:54.862585+0000","last_clean":"2024-04-22T07:20:54.862585+0000","last_became_active":"2024-04-22T07:20:53.865491+0000","last_became_peered":"2024-04-22T07:20:53.865491+0000","last_unstale":"2024-04-22T07:20:54.862585+0000","last_undegraded":"2024-04-22T07:20:54.862585+0000","last_fullsized":"2024-04-22T07:20:54.862585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863583+0000","last_change":"2024-04-22T07:20:53.876797+0000","last_active":"2024-04-22T07:20:54.863583+0000","last_peered":"2024-04-22T07:20:54.863583+0000","last_clean":"2024-04-22T07:20:54.863583+0000","last_became_active":"2024-04-22T07:20:53.876321+0000","last_became_peered":"2024-04-22T07:20:53.876321+0000","last_unstale":"2024-04-22T07:20:54.863583+0000","last_undegraded":"2024-04-22T07:20:54.863583+0000","last_fullsized":"2024-04-22T07:20:54.863583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:22:45.699676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980360+0000","last_change":"2024-04-22T07:20:53.868760+0000","last_active":"2024-04-22T07:20:54.980360+0000","last_peered":"2024-04-22T07:20:54.980360+0000","last_clean":"2024-04-22T07:20:54.980360+0000","last_became_active":"2024-04-22T07:20:53.868441+0000","last_became_peered":"2024-04-22T07:20:53.868441+0000","last_unstale":"2024-04-22T07:20:54.980360+0000","last_undegraded":"2024-04-22T07:20:54.980360+0000","last_fullsized":"2024-04-22T07:20:54.980360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863503+0000","last_change":"2024-04-22T07:20:53.864806+0000","last_active":"2024-04-22T07:20:54.863503+0000","last_peered":"2024-04-22T07:20:54.863503+0000","last_clean":"2024-04-22T07:20:54.863503+0000","last_became_active":"2024-04-22T07:20:53.864535+0000","last_became_peered":"2024-04-22T07:20:53.864535+0000","last_unstale":"2024-04-22T07:20:54.863503+0000","last_undegraded":"2024-04-22T07:20:54.863503+0000","last_fullsized":"2024-04-22T07:20:54.863503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:22:07.227993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977721+0000","last_change":"2024-04-22T07:20:53.878013+0000","last_active":"2024-04-22T07:20:54.977721+0000","last_peered":"2024-04-22T07:20:54.977721+0000","last_clean":"2024-04-22T07:20:54.977721+0000","last_became_active":"2024-04-22T07:20:53.876641+0000","last_became_peered":"2024-04-22T07:20:53.876641+0000","last_unstale":"2024-04-22T07:20:54.977721+0000","last_undegraded":"2024-04-22T07:20:54.977721+0000","last_fullsized":"2024-04-22T07:20:54.977721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:45:15.519469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978885+0000","last_change":"2024-04-22T07:20:53.868319+0000","last_active":"2024-04-22T07:20:54.978885+0000","last_peered":"2024-04-22T07:20:54.978885+0000","last_clean":"2024-04-22T07:20:54.978885+0000","last_became_active":"2024-04-22T07:20:53.868014+0000","last_became_peered":"2024-04-22T07:20:53.868014+0000","last_unstale":"2024-04-22T07:20:54.978885+0000","last_undegraded":"2024-04-22T07:20:54.978885+0000","last_fullsized":"2024-04-22T07:20:54.978885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:09:27.178992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862823+0000","last_change":"2024-04-22T07:20:53.867684+0000","last_active":"2024-04-22T07:20:54.862823+0000","last_peered":"2024-04-22T07:20:54.862823+0000","last_clean":"2024-04-22T07:20:54.862823+0000","last_became_active":"2024-04-22T07:20:53.867403+0000","last_became_peered":"2024-04-22T07:20:53.867403+0000","last_unstale":"2024-04-22T07:20:54.862823+0000","last_undegraded":"2024-04-22T07:20:54.862823+0000","last_fullsized":"2024-04-22T07:20:54.862823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979253+0000","last_change":"2024-04-22T07:20:53.869595+0000","last_active":"2024-04-22T07:20:54.979253+0000","last_peered":"2024-04-22T07:20:54.979253+0000","last_clean":"2024-04-22T07:20:54.979253+0000","last_became_active":"2024-04-22T07:20:53.868519+0000","last_became_peered":"2024-04-22T07:20:53.868519+0000","last_unstale":"2024-04-22T07:20:54.979253+0000","last_undegraded":"2024-04-22T07:20:54.979253+0000","last_fullsized":"2024-04-22T07:20:54.979253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:35:26.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862610+0000","last_change":"2024-04-22T07:20:53.865275+0000","last_active":"2024-04-22T07:20:54.862610+0000","last_peered":"2024-04-22T07:20:54.862610+0000","last_clean":"2024-04-22T07:20:54.862610+0000","last_became_active":"2024-04-22T07:20:53.865026+0000","last_became_peered":"2024-04-22T07:20:53.865026+0000","last_unstale":"2024-04-22T07:20:54.862610+0000","last_undegraded":"2024-04-22T07:20:54.862610+0000","last_fullsized":"2024-04-22T07:20:54.862610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:48:40.630407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979451+0000","last_change":"2024-04-22T07:20:53.873457+0000","last_active":"2024-04-22T07:20:54.979451+0000","last_peered":"2024-04-22T07:20:54.979451+0000","last_clean":"2024-04-22T07:20:54.979451+0000","last_became_active":"2024-04-22T07:20:53.873147+0000","last_became_peered":"2024-04-22T07:20:53.873147+0000","last_unstale":"2024-04-22T07:20:54.979451+0000","last_undegraded":"2024-04-22T07:20:54.979451+0000","last_fullsized":"2024-04-22T07:20:54.979451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:53.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861933+0000","last_change":"2024-04-22T07:20:53.865327+0000","last_active":"2024-04-22T07:20:54.861933+0000","last_peered":"2024-04-22T07:20:54.861933+0000","last_clean":"2024-04-22T07:20:54.861933+0000","last_became_active":"2024-04-22T07:20:53.865030+0000","last_became_peered":"2024-04-22T07:20:53.865030+0000","last_unstale":"2024-04-22T07:20:54.861933+0000","last_undegraded":"2024-04-22T07:20:54.861933+0000","last_fullsized":"2024-04-22T07:20:54.861933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979550+0000","last_change":"2024-04-22T07:20:53.876792+0000","last_active":"2024-04-22T07:20:54.979550+0000","last_peered":"2024-04-22T07:20:54.979550+0000","last_clean":"2024-04-22T07:20:54.979550+0000","last_became_active":"2024-04-22T07:20:53.876446+0000","last_became_peered":"2024-04-22T07:20:53.876446+0000","last_unstale":"2024-04-22T07:20:54.979550+0000","last_undegraded":"2024-04-22T07:20:54.979550+0000","last_fullsized":"2024-04-22T07:20:54.979550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:34.943561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979292+0000","last_change":"2024-04-22T07:20:53.878147+0000","last_active":"2024-04-22T07:20:54.979292+0000","last_peered":"2024-04-22T07:20:54.979292+0000","last_clean":"2024-04-22T07:20:54.979292+0000","last_became_active":"2024-04-22T07:20:53.877867+0000","last_became_peered":"2024-04-22T07:20:53.877867+0000","last_unstale":"2024-04-22T07:20:54.979292+0000","last_undegraded":"2024-04-22T07:20:54.979292+0000","last_fullsized":"2024-04-22T07:20:54.979292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979201+0000","last_change":"2024-04-22T07:20:53.872447+0000","last_active":"2024-04-22T07:20:54.979201+0000","last_peered":"2024-04-22T07:20:54.979201+0000","last_clean":"2024-04-22T07:20:54.979201+0000","last_became_active":"2024-04-22T07:20:53.871862+0000","last_became_peered":"2024-04-22T07:20:53.871862+0000","last_unstale":"2024-04-22T07:20:54.979201+0000","last_undegraded":"2024-04-22T07:20:54.979201+0000","last_fullsized":"2024-04-22T07:20:54.979201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:08:33.063318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862747+0000","last_change":"2024-04-22T07:20:53.862483+0000","last_active":"2024-04-22T07:20:54.862747+0000","last_peered":"2024-04-22T07:20:54.862747+0000","last_clean":"2024-04-22T07:20:54.862747+0000","last_became_active":"2024-04-22T07:20:53.862199+0000","last_became_peered":"2024-04-22T07:20:53.862199+0000","last_unstale":"2024-04-22T07:20:54.862747+0000","last_undegraded":"2024-04-22T07:20:54.862747+0000","last_fullsized":"2024-04-22T07:20:54.862747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:10:12.276510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979743+0000","last_change":"2024-04-22T07:20:53.872507+0000","last_active":"2024-04-22T07:20:54.979743+0000","last_peered":"2024-04-22T07:20:54.979743+0000","last_clean":"2024-04-22T07:20:54.979743+0000","last_became_active":"2024-04-22T07:20:53.872199+0000","last_became_peered":"2024-04-22T07:20:53.872199+0000","last_unstale":"2024-04-22T07:20:54.979743+0000","last_undegraded":"2024-04-22T07:20:54.979743+0000","last_fullsized":"2024-04-22T07:20:54.979743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:09.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861399+0000","last_change":"2024-04-22T07:20:53.863946+0000","last_active":"2024-04-22T07:20:54.861399+0000","last_peered":"2024-04-22T07:20:54.861399+0000","last_clean":"2024-04-22T07:20:54.861399+0000","last_became_active":"2024-04-22T07:20:53.863688+0000","last_became_peered":"2024-04-22T07:20:53.863688+0000","last_unstale":"2024-04-22T07:20:54.861399+0000","last_undegraded":"2024-04-22T07:20:54.861399+0000","last_fullsized":"2024-04-22T07:20:54.861399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862947+0000","last_change":"2024-04-22T07:20:53.874785+0000","last_active":"2024-04-22T07:20:54.862947+0000","last_peered":"2024-04-22T07:20:54.862947+0000","last_clean":"2024-04-22T07:20:54.862947+0000","last_became_active":"2024-04-22T07:20:53.874524+0000","last_became_peered":"2024-04-22T07:20:53.874524+0000","last_unstale":"2024-04-22T07:20:54.862947+0000","last_undegraded":"2024-04-22T07:20:54.862947+0000","last_fullsized":"2024-04-22T07:20:54.862947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.787613+0000","last_change":"2024-04-22T07:20:52.860712+0000","last_active":"2024-04-22T07:20:55.787613+0000","last_peered":"2024-04-22T07:20:55.787613+0000","last_clean":"2024-04-22T07:20:55.787613+0000","last_became_active":"2024-04-22T07:20:52.860015+0000","last_became_peered":"2024-04-22T07:20:52.860015+0000","last_unstale":"2024-04-22T07:20:55.787613+0000","last_undegraded":"2024-04-22T07:20:55.787613+0000","last_fullsized":"2024-04-22T07:20:55.787613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:59:32.487127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980495+0000","last_change":"2024-04-22T07:20:53.879570+0000","last_active":"2024-04-22T07:20:54.980495+0000","last_peered":"2024-04-22T07:20:54.980495+0000","last_clean":"2024-04-22T07:20:54.980495+0000","last_became_active":"2024-04-22T07:20:53.879191+0000","last_became_peered":"2024-04-22T07:20:53.879191+0000","last_unstale":"2024-04-22T07:20:54.980495+0000","last_undegraded":"2024-04-22T07:20:54.980495+0000","last_fullsized":"2024-04-22T07:20:54.980495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:34:52.306691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.787136+0000","last_change":"2024-04-22T07:20:52.862510+0000","last_active":"2024-04-22T07:20:55.787136+0000","last_peered":"2024-04-22T07:20:55.787136+0000","last_clean":"2024-04-22T07:20:55.787136+0000","last_became_active":"2024-04-22T07:20:52.862228+0000","last_became_peered":"2024-04-22T07:20:52.862228+0000","last_unstale":"2024-04-22T07:20:55.787136+0000","last_undegraded":"2024-04-22T07:20:55.787136+0000","last_fullsized":"2024-04-22T07:20:55.787136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:51.683021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979012+0000","last_change":"2024-04-22T07:20:52.856651+0000","last_active":"2024-04-22T07:20:54.979012+0000","last_peered":"2024-04-22T07:20:54.979012+0000","last_clean":"2024-04-22T07:20:54.979012+0000","last_became_active":"2024-04-22T07:20:52.856096+0000","last_became_peered":"2024-04-22T07:20:52.856096+0000","last_unstale":"2024-04-22T07:20:54.979012+0000","last_undegraded":"2024-04-22T07:20:54.979012+0000","last_fullsized":"2024-04-22T07:20:54.979012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:04.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979658+0000","last_change":"2024-04-22T07:20:53.873708+0000","last_active":"2024-04-22T07:20:54.979658+0000","last_peered":"2024-04-22T07:20:54.979658+0000","last_clean":"2024-04-22T07:20:54.979658+0000","last_became_active":"2024-04-22T07:20:53.872793+0000","last_became_peered":"2024-04-22T07:20:53.872793+0000","last_unstale":"2024-04-22T07:20:54.979658+0000","last_undegraded":"2024-04-22T07:20:54.979658+0000","last_fullsized":"2024-04-22T07:20:54.979658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:52.686229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862729+0000","last_change":"2024-04-22T07:20:52.861133+0000","last_active":"2024-04-22T07:20:54.862729+0000","last_peered":"2024-04-22T07:20:54.862729+0000","last_clean":"2024-04-22T07:20:54.862729+0000","last_became_active":"2024-04-22T07:20:52.860736+0000","last_became_peered":"2024-04-22T07:20:52.860736+0000","last_unstale":"2024-04-22T07:20:54.862729+0000","last_undegraded":"2024-04-22T07:20:54.862729+0000","last_fullsized":"2024-04-22T07:20:54.862729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:06.123308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980308+0000","last_change":"2024-04-22T07:20:53.867477+0000","last_active":"2024-04-22T07:20:54.980308+0000","last_peered":"2024-04-22T07:20:54.980308+0000","last_clean":"2024-04-22T07:20:54.980308+0000","last_became_active":"2024-04-22T07:20:53.867086+0000","last_became_peered":"2024-04-22T07:20:53.867086+0000","last_unstale":"2024-04-22T07:20:54.980308+0000","last_undegraded":"2024-04-22T07:20:54.980308+0000","last_fullsized":"2024-04-22T07:20:54.980308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:56:55.644168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863067+0000","last_change":"2024-04-22T07:20:52.863567+0000","last_active":"2024-04-22T07:20:54.863067+0000","last_peered":"2024-04-22T07:20:54.863067+0000","last_clean":"2024-04-22T07:20:54.863067+0000","last_became_active":"2024-04-22T07:20:52.863285+0000","last_became_peered":"2024-04-22T07:20:52.863285+0000","last_unstale":"2024-04-22T07:20:54.863067+0000","last_undegraded":"2024-04-22T07:20:54.863067+0000","last_fullsized":"2024-04-22T07:20:54.863067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861976+0000","last_change":"2024-04-22T07:20:53.864955+0000","last_active":"2024-04-22T07:20:54.861976+0000","last_peered":"2024-04-22T07:20:54.861976+0000","last_clean":"2024-04-22T07:20:54.861976+0000","last_became_active":"2024-04-22T07:20:53.864694+0000","last_became_peered":"2024-04-22T07:20:53.864694+0000","last_unstale":"2024-04-22T07:20:54.861976+0000","last_undegraded":"2024-04-22T07:20:54.861976+0000","last_fullsized":"2024-04-22T07:20:54.861976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977898+0000","last_change":"2024-04-22T07:20:52.858761+0000","last_active":"2024-04-22T07:20:54.977898+0000","last_peered":"2024-04-22T07:20:54.977898+0000","last_clean":"2024-04-22T07:20:54.977898+0000","last_became_active":"2024-04-22T07:20:52.856815+0000","last_became_peered":"2024-04-22T07:20:52.856815+0000","last_unstale":"2024-04-22T07:20:54.977898+0000","last_undegraded":"2024-04-22T07:20:54.977898+0000","last_fullsized":"2024-04-22T07:20:54.977898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:06.123308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979798+0000","last_change":"2024-04-22T07:20:53.867290+0000","last_active":"2024-04-22T07:20:54.979798+0000","last_peered":"2024-04-22T07:20:54.979798+0000","last_clean":"2024-04-22T07:20:54.979798+0000","last_became_active":"2024-04-22T07:20:53.866955+0000","last_became_peered":"2024-04-22T07:20:53.866955+0000","last_unstale":"2024-04-22T07:20:54.979798+0000","last_undegraded":"2024-04-22T07:20:54.979798+0000","last_fullsized":"2024-04-22T07:20:54.979798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:43.442316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.870244+0000","last_change":"2024-04-22T07:20:52.863670+0000","last_active":"2024-04-22T07:20:58.870244+0000","last_peered":"2024-04-22T07:20:58.870244+0000","last_clean":"2024-04-22T07:20:58.870244+0000","last_became_active":"2024-04-22T07:20:52.863320+0000","last_became_peered":"2024-04-22T07:20:52.863320+0000","last_unstale":"2024-04-22T07:20:58.870244+0000","last_undegraded":"2024-04-22T07:20:58.870244+0000","last_fullsized":"2024-04-22T07:20:58.870244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:04.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862589+0000","last_change":"2024-04-22T07:20:53.868286+0000","last_active":"2024-04-22T07:20:54.862589+0000","last_peered":"2024-04-22T07:20:54.862589+0000","last_clean":"2024-04-22T07:20:54.862589+0000","last_became_active":"2024-04-22T07:20:53.862811+0000","last_became_peered":"2024-04-22T07:20:53.862811+0000","last_unstale":"2024-04-22T07:20:54.862589+0000","last_undegraded":"2024-04-22T07:20:54.862589+0000","last_fullsized":"2024-04-22T07:20:54.862589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.870351+0000","last_change":"2024-04-22T07:20:52.863638+0000","last_active":"2024-04-22T07:20:58.870351+0000","last_peered":"2024-04-22T07:20:58.870351+0000","last_clean":"2024-04-22T07:20:58.870351+0000","last_became_active":"2024-04-22T07:20:52.863244+0000","last_became_peered":"2024-04-22T07:20:52.863244+0000","last_unstale":"2024-04-22T07:20:58.870351+0000","last_undegraded":"2024-04-22T07:20:58.870351+0000","last_fullsized":"2024-04-22T07:20:58.870351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:36:49.017537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977713+0000","last_change":"2024-04-22T07:20:53.875162+0000","last_active":"2024-04-22T07:20:54.977713+0000","last_peered":"2024-04-22T07:20:54.977713+0000","last_clean":"2024-04-22T07:20:54.977713+0000","last_became_active":"2024-04-22T07:20:53.874612+0000","last_became_peered":"2024-04-22T07:20:53.874612+0000","last_unstale":"2024-04-22T07:20:54.977713+0000","last_undegraded":"2024-04-22T07:20:54.977713+0000","last_fullsized":"2024-04-22T07:20:54.977713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:13:12.303505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.869961+0000","last_change":"2024-04-22T07:20:52.855194+0000","last_active":"2024-04-22T07:20:58.869961+0000","last_peered":"2024-04-22T07:20:58.869961+0000","last_clean":"2024-04-22T07:20:58.869961+0000","last_became_active":"2024-04-22T07:20:52.854915+0000","last_became_peered":"2024-04-22T07:20:52.854915+0000","last_unstale":"2024-04-22T07:20:58.869961+0000","last_undegraded":"2024-04-22T07:20:58.869961+0000","last_fullsized":"2024-04-22T07:20:58.869961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979725+0000","last_change":"2024-04-22T07:20:53.868695+0000","last_active":"2024-04-22T07:20:54.979725+0000","last_peered":"2024-04-22T07:20:54.979725+0000","last_clean":"2024-04-22T07:20:54.979725+0000","last_became_active":"2024-04-22T07:20:53.868400+0000","last_became_peered":"2024-04-22T07:20:53.868400+0000","last_unstale":"2024-04-22T07:20:54.979725+0000","last_undegraded":"2024-04-22T07:20:54.979725+0000","last_fullsized":"2024-04-22T07:20:54.979725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:30:23.352871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863163+0000","last_change":"2024-04-22T07:20:52.861884+0000","last_active":"2024-04-22T07:20:54.863163+0000","last_peered":"2024-04-22T07:20:54.863163+0000","last_clean":"2024-04-22T07:20:54.863163+0000","last_became_active":"2024-04-22T07:20:52.861546+0000","last_became_peered":"2024-04-22T07:20:52.861546+0000","last_unstale":"2024-04-22T07:20:54.863163+0000","last_undegraded":"2024-04-22T07:20:54.863163+0000","last_fullsized":"2024-04-22T07:20:54.863163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:37.283262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862882+0000","last_change":"2024-04-22T07:20:53.863071+0000","last_active":"2024-04-22T07:20:54.862882+0000","last_peered":"2024-04-22T07:20:54.862882+0000","last_clean":"2024-04-22T07:20:54.862882+0000","last_became_active":"2024-04-22T07:20:53.862763+0000","last_became_peered":"2024-04-22T07:20:53.862763+0000","last_unstale":"2024-04-22T07:20:54.862882+0000","last_undegraded":"2024-04-22T07:20:54.862882+0000","last_fullsized":"2024-04-22T07:20:54.862882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:19:57.432323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977415+0000","last_change":"2024-04-22T07:20:52.865285+0000","last_active":"2024-04-22T07:20:54.977415+0000","last_peered":"2024-04-22T07:20:54.977415+0000","last_clean":"2024-04-22T07:20:54.977415+0000","last_became_active":"2024-04-22T07:20:52.864725+0000","last_became_peered":"2024-04-22T07:20:52.864725+0000","last_unstale":"2024-04-22T07:20:54.977415+0000","last_undegraded":"2024-04-22T07:20:54.977415+0000","last_fullsized":"2024-04-22T07:20:54.977415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:23:28.850031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862533+0000","last_change":"2024-04-22T07:20:53.875479+0000","last_active":"2024-04-22T07:20:54.862533+0000","last_peered":"2024-04-22T07:20:54.862533+0000","last_clean":"2024-04-22T07:20:54.862533+0000","last_became_active":"2024-04-22T07:20:53.874567+0000","last_became_peered":"2024-04-22T07:20:53.874567+0000","last_unstale":"2024-04-22T07:20:54.862533+0000","last_undegraded":"2024-04-22T07:20:54.862533+0000","last_fullsized":"2024-04-22T07:20:54.862533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978479+0000","last_change":"2024-04-22T07:20:52.860646+0000","last_active":"2024-04-22T07:20:54.978479+0000","last_peered":"2024-04-22T07:20:54.978479+0000","last_clean":"2024-04-22T07:20:54.978479+0000","last_became_active":"2024-04-22T07:20:52.860347+0000","last_became_peered":"2024-04-22T07:20:52.860347+0000","last_unstale":"2024-04-22T07:20:54.978479+0000","last_undegraded":"2024-04-22T07:20:54.978479+0000","last_fullsized":"2024-04-22T07:20:54.978479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:53:20.912264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862635+0000","last_change":"2024-04-22T07:20:53.859641+0000","last_active":"2024-04-22T07:20:54.862635+0000","last_peered":"2024-04-22T07:20:54.862635+0000","last_clean":"2024-04-22T07:20:54.862635+0000","last_became_active":"2024-04-22T07:20:53.859365+0000","last_became_peered":"2024-04-22T07:20:53.859365+0000","last_unstale":"2024-04-22T07:20:54.862635+0000","last_undegraded":"2024-04-22T07:20:54.862635+0000","last_fullsized":"2024-04-22T07:20:54.862635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:46:50.322722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.788730+0000","last_change":"2024-04-22T07:20:52.866960+0000","last_active":"2024-04-22T07:20:55.788730+0000","last_peered":"2024-04-22T07:20:55.788730+0000","last_clean":"2024-04-22T07:20:55.788730+0000","last_became_active":"2024-04-22T07:20:52.866654+0000","last_became_peered":"2024-04-22T07:20:52.866654+0000","last_unstale":"2024-04-22T07:20:55.788730+0000","last_undegraded":"2024-04-22T07:20:55.788730+0000","last_fullsized":"2024-04-22T07:20:55.788730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:51.683021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862087+0000","last_change":"2024-04-22T07:20:53.874775+0000","last_active":"2024-04-22T07:20:54.862087+0000","last_peered":"2024-04-22T07:20:54.862087+0000","last_clean":"2024-04-22T07:20:54.862087+0000","last_became_active":"2024-04-22T07:20:53.874499+0000","last_became_peered":"2024-04-22T07:20:53.874499+0000","last_unstale":"2024-04-22T07:20:54.862087+0000","last_undegraded":"2024-04-22T07:20:54.862087+0000","last_fullsized":"2024-04-22T07:20:54.862087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:23.268067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980590+0000","last_change":"2024-04-22T07:20:52.867201+0000","last_active":"2024-04-22T07:20:54.980590+0000","last_peered":"2024-04-22T07:20:54.980590+0000","last_clean":"2024-04-22T07:20:54.980590+0000","last_became_active":"2024-04-22T07:20:52.866627+0000","last_became_peered":"2024-04-22T07:20:52.866627+0000","last_unstale":"2024-04-22T07:20:54.980590+0000","last_undegraded":"2024-04-22T07:20:54.980590+0000","last_fullsized":"2024-04-22T07:20:54.980590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:09:08.908298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977901+0000","last_change":"2024-04-22T07:20:53.871645+0000","last_active":"2024-04-22T07:20:54.977901+0000","last_peered":"2024-04-22T07:20:54.977901+0000","last_clean":"2024-04-22T07:20:54.977901+0000","last_became_active":"2024-04-22T07:20:53.871353+0000","last_became_peered":"2024-04-22T07:20:53.871353+0000","last_unstale":"2024-04-22T07:20:54.977901+0000","last_undegraded":"2024-04-22T07:20:54.977901+0000","last_fullsized":"2024-04-22T07:20:54.977901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:48:40.630407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.787667+0000","last_change":"2024-04-22T07:20:52.866996+0000","last_active":"2024-04-22T07:20:55.787667+0000","last_peered":"2024-04-22T07:20:55.787667+0000","last_clean":"2024-04-22T07:20:55.787667+0000","last_became_active":"2024-04-22T07:20:52.866677+0000","last_became_peered":"2024-04-22T07:20:52.866677+0000","last_unstale":"2024-04-22T07:20:55.787667+0000","last_undegraded":"2024-04-22T07:20:55.787667+0000","last_fullsized":"2024-04-22T07:20:55.787667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977832+0000","last_change":"2024-04-22T07:20:53.871064+0000","last_active":"2024-04-22T07:20:54.977832+0000","last_peered":"2024-04-22T07:20:54.977832+0000","last_clean":"2024-04-22T07:20:54.977832+0000","last_became_active":"2024-04-22T07:20:53.866968+0000","last_became_peered":"2024-04-22T07:20:53.866968+0000","last_unstale":"2024-04-22T07:20:54.977832+0000","last_undegraded":"2024-04-22T07:20:54.977832+0000","last_fullsized":"2024-04-22T07:20:54.977832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:43.442316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979659+0000","last_change":"2024-04-22T07:20:52.856958+0000","last_active":"2024-04-22T07:20:54.979659+0000","last_peered":"2024-04-22T07:20:54.979659+0000","last_clean":"2024-04-22T07:20:54.979659+0000","last_became_active":"2024-04-22T07:20:52.856289+0000","last_became_peered":"2024-04-22T07:20:52.856289+0000","last_unstale":"2024-04-22T07:20:54.979659+0000","last_undegraded":"2024-04-22T07:20:54.979659+0000","last_fullsized":"2024-04-22T07:20:54.979659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863352+0000","last_change":"2024-04-22T07:20:53.872915+0000","last_active":"2024-04-22T07:20:54.863352+0000","last_peered":"2024-04-22T07:20:54.863352+0000","last_clean":"2024-04-22T07:20:54.863352+0000","last_became_active":"2024-04-22T07:20:53.872005+0000","last_became_peered":"2024-04-22T07:20:53.872005+0000","last_unstale":"2024-04-22T07:20:54.863352+0000","last_undegraded":"2024-04-22T07:20:54.863352+0000","last_fullsized":"2024-04-22T07:20:54.863352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:53:29.242632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862549+0000","last_change":"2024-04-22T07:20:43.747396+0000","last_active":"2024-04-22T07:20:54.862549+0000","last_peered":"2024-04-22T07:20:54.862549+0000","last_clean":"2024-04-22T07:20:54.862549+0000","last_became_active":"2024-04-22T07:20:43.746332+0000","last_became_peered":"2024-04-22T07:20:43.746332+0000","last_unstale":"2024-04-22T07:20:54.862549+0000","last_undegraded":"2024-04-22T07:20:54.862549+0000","last_fullsized":"2024-04-22T07:20:54.862549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:42.732916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:42.732916+0000","last_clean_scrub_stamp":"2024-04-22T07:20:42.732916+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:02:55.086445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863049+0000","last_change":"2024-04-22T07:20:52.862492+0000","last_active":"2024-04-22T07:20:54.863049+0000","last_peered":"2024-04-22T07:20:54.863049+0000","last_clean":"2024-04-22T07:20:54.863049+0000","last_became_active":"2024-04-22T07:20:52.862201+0000","last_became_peered":"2024-04-22T07:20:52.862201+0000","last_unstale":"2024-04-22T07:20:54.863049+0000","last_undegraded":"2024-04-22T07:20:54.863049+0000","last_fullsized":"2024-04-22T07:20:54.863049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:52.015227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979807+0000","last_change":"2024-04-22T07:20:53.868797+0000","last_active":"2024-04-22T07:20:54.979807+0000","last_peered":"2024-04-22T07:20:54.979807+0000","last_clean":"2024-04-22T07:20:54.979807+0000","last_became_active":"2024-04-22T07:20:53.868335+0000","last_became_peered":"2024-04-22T07:20:53.868335+0000","last_unstale":"2024-04-22T07:20:54.979807+0000","last_undegraded":"2024-04-22T07:20:54.979807+0000","last_fullsized":"2024-04-22T07:20:54.979807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:43:02.116289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862731+0000","last_change":"2024-04-22T07:20:52.867622+0000","last_active":"2024-04-22T07:20:54.862731+0000","last_peered":"2024-04-22T07:20:54.862731+0000","last_clean":"2024-04-22T07:20:54.862731+0000","last_became_active":"2024-04-22T07:20:52.866996+0000","last_became_peered":"2024-04-22T07:20:52.866996+0000","last_unstale":"2024-04-22T07:20:54.862731+0000","last_undegraded":"2024-04-22T07:20:54.862731+0000","last_fullsized":"2024-04-22T07:20:54.862731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:08.286530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978392+0000","last_change":"2024-04-22T07:20:53.871576+0000","last_active":"2024-04-22T07:20:54.978392+0000","last_peered":"2024-04-22T07:20:54.978392+0000","last_clean":"2024-04-22T07:20:54.978392+0000","last_became_active":"2024-04-22T07:20:53.871239+0000","last_became_peered":"2024-04-22T07:20:53.871239+0000","last_unstale":"2024-04-22T07:20:54.978392+0000","last_undegraded":"2024-04-22T07:20:54.978392+0000","last_fullsized":"2024-04-22T07:20:54.978392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979845+0000","last_change":"2024-04-22T07:20:52.866974+0000","last_active":"2024-04-22T07:20:54.979845+0000","last_peered":"2024-04-22T07:20:54.979845+0000","last_clean":"2024-04-22T07:20:54.979845+0000","last_became_active":"2024-04-22T07:20:52.866581+0000","last_became_peered":"2024-04-22T07:20:52.866581+0000","last_unstale":"2024-04-22T07:20:54.979845+0000","last_undegraded":"2024-04-22T07:20:54.979845+0000","last_fullsized":"2024-04-22T07:20:54.979845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979503+0000","last_change":"2024-04-22T07:20:53.865035+0000","last_active":"2024-04-22T07:20:54.979503+0000","last_peered":"2024-04-22T07:20:54.979503+0000","last_clean":"2024-04-22T07:20:54.979503+0000","last_became_active":"2024-04-22T07:20:53.864523+0000","last_became_peered":"2024-04-22T07:20:53.864523+0000","last_unstale":"2024-04-22T07:20:54.979503+0000","last_undegraded":"2024-04-22T07:20:54.979503+0000","last_fullsized":"2024-04-22T07:20:54.979503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:13:12.303505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863169+0000","last_change":"2024-04-22T07:20:52.858498+0000","last_active":"2024-04-22T07:20:54.863169+0000","last_peered":"2024-04-22T07:20:54.863169+0000","last_clean":"2024-04-22T07:20:54.863169+0000","last_became_active":"2024-04-22T07:20:52.858139+0000","last_became_peered":"2024-04-22T07:20:52.858139+0000","last_unstale":"2024-04-22T07:20:54.863169+0000","last_undegraded":"2024-04-22T07:20:54.863169+0000","last_fullsized":"2024-04-22T07:20:54.863169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:45.382709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977943+0000","last_change":"2024-04-22T07:20:53.877595+0000","last_active":"2024-04-22T07:20:54.977943+0000","last_peered":"2024-04-22T07:20:54.977943+0000","last_clean":"2024-04-22T07:20:54.977943+0000","last_became_active":"2024-04-22T07:20:53.877208+0000","last_became_peered":"2024-04-22T07:20:53.877208+0000","last_unstale":"2024-04-22T07:20:54.977943+0000","last_undegraded":"2024-04-22T07:20:54.977943+0000","last_fullsized":"2024-04-22T07:20:54.977943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:46:50.322722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979001+0000","last_change":"2024-04-22T07:20:52.866224+0000","last_active":"2024-04-22T07:20:54.979001+0000","last_peered":"2024-04-22T07:20:54.979001+0000","last_clean":"2024-04-22T07:20:54.979001+0000","last_became_active":"2024-04-22T07:20:52.865903+0000","last_became_peered":"2024-04-22T07:20:52.865903+0000","last_unstale":"2024-04-22T07:20:54.979001+0000","last_undegraded":"2024-04-22T07:20:54.979001+0000","last_fullsized":"2024-04-22T07:20:54.979001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861395+0000","last_change":"2024-04-22T07:20:53.873266+0000","last_active":"2024-04-22T07:20:54.861395+0000","last_peered":"2024-04-22T07:20:54.861395+0000","last_clean":"2024-04-22T07:20:54.861395+0000","last_became_active":"2024-04-22T07:20:53.872915+0000","last_became_peered":"2024-04-22T07:20:53.872915+0000","last_unstale":"2024-04-22T07:20:54.861395+0000","last_undegraded":"2024-04-22T07:20:54.861395+0000","last_fullsized":"2024-04-22T07:20:54.861395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:09.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863471+0000","last_change":"2024-04-22T07:20:52.863593+0000","last_active":"2024-04-22T07:20:54.863471+0000","last_peered":"2024-04-22T07:20:54.863471+0000","last_clean":"2024-04-22T07:20:54.863471+0000","last_became_active":"2024-04-22T07:20:52.863296+0000","last_became_peered":"2024-04-22T07:20:52.863296+0000","last_unstale":"2024-04-22T07:20:54.863471+0000","last_undegraded":"2024-04-22T07:20:54.863471+0000","last_fullsized":"2024-04-22T07:20:54.863471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:22.261683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979540+0000","last_change":"2024-04-22T07:20:53.874491+0000","last_active":"2024-04-22T07:20:54.979540+0000","last_peered":"2024-04-22T07:20:54.979540+0000","last_clean":"2024-04-22T07:20:54.979540+0000","last_became_active":"2024-04-22T07:20:53.874202+0000","last_became_peered":"2024-04-22T07:20:53.874202+0000","last_unstale":"2024-04-22T07:20:54.979540+0000","last_undegraded":"2024-04-22T07:20:54.979540+0000","last_fullsized":"2024-04-22T07:20:54.979540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:23.268067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980599+0000","last_change":"2024-04-22T07:20:52.865905+0000","last_active":"2024-04-22T07:20:54.980599+0000","last_peered":"2024-04-22T07:20:54.980599+0000","last_clean":"2024-04-22T07:20:54.980599+0000","last_became_active":"2024-04-22T07:20:52.865566+0000","last_became_peered":"2024-04-22T07:20:52.865566+0000","last_unstale":"2024-04-22T07:20:54.980599+0000","last_undegraded":"2024-04-22T07:20:54.980599+0000","last_fullsized":"2024-04-22T07:20:54.980599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:38:31.271879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980566+0000","last_change":"2024-04-22T07:20:53.869951+0000","last_active":"2024-04-22T07:20:54.980566+0000","last_peered":"2024-04-22T07:20:54.980566+0000","last_clean":"2024-04-22T07:20:54.980566+0000","last_became_active":"2024-04-22T07:20:53.869613+0000","last_became_peered":"2024-04-22T07:20:53.869613+0000","last_unstale":"2024-04-22T07:20:54.980566+0000","last_undegraded":"2024-04-22T07:20:54.980566+0000","last_fullsized":"2024-04-22T07:20:54.980566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:14:09.372107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.867345+0000","last_change":"2024-04-22T07:20:52.864740+0000","last_active":"2024-04-22T07:20:58.867345+0000","last_peered":"2024-04-22T07:20:58.867345+0000","last_clean":"2024-04-22T07:20:58.867345+0000","last_became_active":"2024-04-22T07:20:52.864434+0000","last_became_peered":"2024-04-22T07:20:52.864434+0000","last_unstale":"2024-04-22T07:20:58.867345+0000","last_undegraded":"2024-04-22T07:20:58.867345+0000","last_fullsized":"2024-04-22T07:20:58.867345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:33.937176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980498+0000","last_change":"2024-04-22T07:20:53.871156+0000","last_active":"2024-04-22T07:20:54.980498+0000","last_peered":"2024-04-22T07:20:54.980498+0000","last_clean":"2024-04-22T07:20:54.980498+0000","last_became_active":"2024-04-22T07:20:53.870664+0000","last_became_peered":"2024-04-22T07:20:53.870664+0000","last_unstale":"2024-04-22T07:20:54.980498+0000","last_undegraded":"2024-04-22T07:20:54.980498+0000","last_fullsized":"2024-04-22T07:20:54.980498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:01:02.139458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977319+0000","last_change":"2024-04-22T07:20:52.854668+0000","last_active":"2024-04-22T07:20:54.977319+0000","last_peered":"2024-04-22T07:20:54.977319+0000","last_clean":"2024-04-22T07:20:54.977319+0000","last_became_active":"2024-04-22T07:20:52.854395+0000","last_became_peered":"2024-04-22T07:20:52.854395+0000","last_unstale":"2024-04-22T07:20:54.977319+0000","last_undegraded":"2024-04-22T07:20:54.977319+0000","last_fullsized":"2024-04-22T07:20:54.977319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:59:32.487127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862797+0000","last_change":"2024-04-22T07:20:53.870972+0000","last_active":"2024-04-22T07:20:54.862797+0000","last_peered":"2024-04-22T07:20:54.862797+0000","last_clean":"2024-04-22T07:20:54.862797+0000","last_became_active":"2024-04-22T07:20:53.870674+0000","last_became_peered":"2024-04-22T07:20:53.870674+0000","last_unstale":"2024-04-22T07:20:54.862797+0000","last_undegraded":"2024-04-22T07:20:54.862797+0000","last_fullsized":"2024-04-22T07:20:54.862797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:10.431906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980374+0000","last_change":"2024-04-22T07:20:52.866003+0000","last_active":"2024-04-22T07:20:54.980374+0000","last_peered":"2024-04-22T07:20:54.980374+0000","last_clean":"2024-04-22T07:20:54.980374+0000","last_became_active":"2024-04-22T07:20:52.865606+0000","last_became_peered":"2024-04-22T07:20:52.865606+0000","last_unstale":"2024-04-22T07:20:54.980374+0000","last_undegraded":"2024-04-22T07:20:54.980374+0000","last_fullsized":"2024-04-22T07:20:54.980374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:58:06.713204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978351+0000","last_change":"2024-04-22T07:20:53.870737+0000","last_active":"2024-04-22T07:20:54.978351+0000","last_peered":"2024-04-22T07:20:54.978351+0000","last_clean":"2024-04-22T07:20:54.978351+0000","last_became_active":"2024-04-22T07:20:53.870402+0000","last_became_peered":"2024-04-22T07:20:53.870402+0000","last_unstale":"2024-04-22T07:20:54.978351+0000","last_undegraded":"2024-04-22T07:20:54.978351+0000","last_fullsized":"2024-04-22T07:20:54.978351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:30:17.845591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979784+0000","last_change":"2024-04-22T07:20:52.861048+0000","last_active":"2024-04-22T07:20:54.979784+0000","last_peered":"2024-04-22T07:20:54.979784+0000","last_clean":"2024-04-22T07:20:54.979784+0000","last_became_active":"2024-04-22T07:20:52.860702+0000","last_became_peered":"2024-04-22T07:20:52.860702+0000","last_unstale":"2024-04-22T07:20:54.979784+0000","last_undegraded":"2024-04-22T07:20:54.979784+0000","last_fullsized":"2024-04-22T07:20:54.979784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979324+0000","last_change":"2024-04-22T07:20:53.868782+0000","last_active":"2024-04-22T07:20:54.979324+0000","last_peered":"2024-04-22T07:20:54.979324+0000","last_clean":"2024-04-22T07:20:54.979324+0000","last_became_active":"2024-04-22T07:20:53.868509+0000","last_became_peered":"2024-04-22T07:20:53.868509+0000","last_unstale":"2024-04-22T07:20:54.979324+0000","last_undegraded":"2024-04-22T07:20:54.979324+0000","last_fullsized":"2024-04-22T07:20:54.979324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:07.129692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.867515+0000","last_change":"2024-04-22T07:20:52.858508+0000","last_active":"2024-04-22T07:20:58.867515+0000","last_peered":"2024-04-22T07:20:58.867515+0000","last_clean":"2024-04-22T07:20:58.867515+0000","last_became_active":"2024-04-22T07:20:52.858215+0000","last_became_peered":"2024-04-22T07:20:52.858215+0000","last_unstale":"2024-04-22T07:20:58.867515+0000","last_undegraded":"2024-04-22T07:20:58.867515+0000","last_fullsized":"2024-04-22T07:20:58.867515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:26.618434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862971+0000","last_change":"2024-04-22T07:20:53.867977+0000","last_active":"2024-04-22T07:20:54.862971+0000","last_peered":"2024-04-22T07:20:54.862971+0000","last_clean":"2024-04-22T07:20:54.862971+0000","last_became_active":"2024-04-22T07:20:53.867447+0000","last_became_peered":"2024-04-22T07:20:53.867447+0000","last_unstale":"2024-04-22T07:20:54.862971+0000","last_undegraded":"2024-04-22T07:20:54.862971+0000","last_fullsized":"2024-04-22T07:20:54.862971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:48:52.934171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863377+0000","last_change":"2024-04-22T07:20:53.875681+0000","last_active":"2024-04-22T07:20:54.863377+0000","last_peered":"2024-04-22T07:20:54.863377+0000","last_clean":"2024-04-22T07:20:54.863377+0000","last_became_active":"2024-04-22T07:20:53.875305+0000","last_became_peered":"2024-04-22T07:20:53.875305+0000","last_unstale":"2024-04-22T07:20:54.863377+0000","last_undegraded":"2024-04-22T07:20:54.863377+0000","last_fullsized":"2024-04-22T07:20:54.863377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:22:34.452869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.866736+0000","last_change":"2024-04-22T07:20:52.857445+0000","last_active":"2024-04-22T07:20:58.866736+0000","last_peered":"2024-04-22T07:20:58.866736+0000","last_clean":"2024-04-22T07:20:58.866736+0000","last_became_active":"2024-04-22T07:20:52.856293+0000","last_became_peered":"2024-04-22T07:20:52.856293+0000","last_unstale":"2024-04-22T07:20:58.866736+0000","last_undegraded":"2024-04-22T07:20:58.866736+0000","last_fullsized":"2024-04-22T07:20:58.866736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:10.640191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862780+0000","last_change":"2024-04-22T07:20:53.870827+0000","last_active":"2024-04-22T07:20:54.862780+0000","last_peered":"2024-04-22T07:20:54.862780+0000","last_clean":"2024-04-22T07:20:54.862780+0000","last_became_active":"2024-04-22T07:20:53.870548+0000","last_became_peered":"2024-04-22T07:20:53.870548+0000","last_unstale":"2024-04-22T07:20:54.862780+0000","last_undegraded":"2024-04-22T07:20:54.862780+0000","last_fullsized":"2024-04-22T07:20:54.862780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:27.624819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.867037+0000","last_change":"2024-04-22T07:20:52.856933+0000","last_active":"2024-04-22T07:20:58.867037+0000","last_peered":"2024-04-22T07:20:58.867037+0000","last_clean":"2024-04-22T07:20:58.867037+0000","last_became_active":"2024-04-22T07:20:52.856617+0000","last_became_peered":"2024-04-22T07:20:52.856617+0000","last_unstale":"2024-04-22T07:20:58.867037+0000","last_undegraded":"2024-04-22T07:20:58.867037+0000","last_fullsized":"2024-04-22T07:20:58.867037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:08.286530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979619+0000","last_change":"2024-04-22T07:20:53.866552+0000","last_active":"2024-04-22T07:20:54.979619+0000","last_peered":"2024-04-22T07:20:54.979619+0000","last_clean":"2024-04-22T07:20:54.979619+0000","last_became_active":"2024-04-22T07:20:53.866286+0000","last_became_peered":"2024-04-22T07:20:53.866286+0000","last_unstale":"2024-04-22T07:20:54.979619+0000","last_undegraded":"2024-04-22T07:20:54.979619+0000","last_fullsized":"2024-04-22T07:20:54.979619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:45:15.519469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.787690+0000","last_change":"2024-04-22T07:20:52.863291+0000","last_active":"2024-04-22T07:20:55.787690+0000","last_peered":"2024-04-22T07:20:55.787690+0000","last_clean":"2024-04-22T07:20:55.787690+0000","last_became_active":"2024-04-22T07:20:52.862967+0000","last_became_peered":"2024-04-22T07:20:52.862967+0000","last_unstale":"2024-04-22T07:20:55.787690+0000","last_undegraded":"2024-04-22T07:20:55.787690+0000","last_fullsized":"2024-04-22T07:20:55.787690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:10.640191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980150+0000","last_change":"2024-04-22T07:20:53.871045+0000","last_active":"2024-04-22T07:20:54.980150+0000","last_peered":"2024-04-22T07:20:54.980150+0000","last_clean":"2024-04-22T07:20:54.980150+0000","last_became_active":"2024-04-22T07:20:53.870715+0000","last_became_peered":"2024-04-22T07:20:53.870715+0000","last_unstale":"2024-04-22T07:20:54.980150+0000","last_undegraded":"2024-04-22T07:20:54.980150+0000","last_fullsized":"2024-04-22T07:20:54.980150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980486+0000","last_change":"2024-04-22T07:20:52.869553+0000","last_active":"2024-04-22T07:20:54.980486+0000","last_peered":"2024-04-22T07:20:54.980486+0000","last_clean":"2024-04-22T07:20:54.980486+0000","last_became_active":"2024-04-22T07:20:52.869300+0000","last_became_peered":"2024-04-22T07:20:52.869300+0000","last_unstale":"2024-04-22T07:20:54.980486+0000","last_undegraded":"2024-04-22T07:20:54.980486+0000","last_fullsized":"2024-04-22T07:20:54.980486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:27.709073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":81359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":835584,"data_stored":671695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":831488,"data_stored":671673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":81291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T07:21:03.648 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-22T07:21:03.648 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-22T07:21:03.648 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-22T07:21:03.649 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-22T07:21:03.649 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-22T07:21:03.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.787+0000 7f29b9f40640 1 Processor -- start 2024-04-22T07:21:03.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.787+0000 7f29b9f40640 1 -- start start 2024-04-22T07:21:03.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.787+0000 7f29b9f40640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f29b415baf0 0x7f29b40d09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:03.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.787+0000 7f29b9f40640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29b415e6e0 con 0x7f29b4154f50 2024-04-22T07:21:03.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.788+0000 7f29b9f40640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29b415e9c0 con 0x7f29b40d0590 2024-04-22T07:21:03.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.788+0000 7f29b9f40640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f29b415af50 con 0x7f29b415baf0 2024-04-22T07:21:03.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.788+0000 7f29b37fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f29b4154f50 0x7f29b40cc060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33834/0 (socket says 172.21.15.40:33834) 2024-04-22T07:21:03.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.788+0000 7f29b37fe640 1 -- 172.21.15.40:0/35503951 learned_addr learned my addr 172.21.15.40:0/35503951 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:03.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.788+0000 7f29b27fc640 1 -- 172.21.15.40:0/35503951 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2531742501 0 0) 0x7f29b415e6e0 con 0x7f29b4154f50 2024-04-22T07:21:03.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.788+0000 7f29b27fc640 1 -- 172.21.15.40:0/35503951 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f299c003520 con 0x7f29b4154f50 2024-04-22T07:21:03.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.788+0000 7f29b3fff640 1 --2- 172.21.15.40:0/35503951 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f29b415baf0 0x7f29b40d09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:03.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.788+0000 7f29b27fc640 1 -- 172.21.15.40:0/35503951 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 233488028 0 0) 0x7f299c003520 con 0x7f29b4154f50 2024-04-22T07:21:03.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.788+0000 7f29b27fc640 1 -- 172.21.15.40:0/35503951 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f29b415baf0 msgr2=0x7f29b40d09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:03.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.788+0000 7f29b27fc640 1 --2- 172.21.15.40:0/35503951 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f29b415baf0 0x7f29b40d09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:03.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.788+0000 7f29b27fc640 1 -- 172.21.15.40:0/35503951 >> v1:172.21.15.62:6789/0 conn(0x7f29b40d0590 legacy=0x7f29b415b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:03.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.788+0000 7f29b27fc640 1 -- 172.21.15.40:0/35503951 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b415eca0 con 0x7f29b4154f50 2024-04-22T07:21:03.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.788+0000 7f29b27fc640 1 -- 172.21.15.40:0/35503951 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7f29a4001670 con 0x7f29b4154f50 2024-04-22T07:21:03.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.788+0000 7f29b3fff640 1 --2- 172.21.15.40:0/35503951 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f29b415baf0 0x7f29b40d09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:03.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.788+0000 7f29b27fc640 1 -- 172.21.15.40:0/35503951 >> v1:172.21.15.40:6789/0 conn(0x7f29b4154f50 legacy=0x7f29b40cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:03.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.788+0000 7f29b27fc640 1 --2- 172.21.15.40:0/35503951 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f29b415baf0 0x7f299c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:03.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.788+0000 7f29b27fc640 1 --2- 172.21.15.40:0/35503951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f299c004020 0x7f299c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:03.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.788+0000 7f29b27fc640 1 --2- 172.21.15.40:0/35503951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f299c004d40 0x7f299c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:03.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.788+0000 7f29b27fc640 1 -- 172.21.15.40:0/35503951 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f29b415af50 con 0x7f299c004020 2024-04-22T07:21:03.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.788+0000 7f29b27fc640 1 -- 172.21.15.40:0/35503951 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f299c00bc10 con 0x7f299c004d40 2024-04-22T07:21:03.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.788+0000 7f29b27fc640 1 -- 172.21.15.40:0/35503951 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f299c00be10 con 0x7f29b415baf0 2024-04-22T07:21:03.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.788+0000 7f29b2ffd640 1 --2- 172.21.15.40:0/35503951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f299c004020 0x7f299c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:03.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.788+0000 7f29b3fff640 1 --2- 172.21.15.40:0/35503951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f299c004d40 0x7f299c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:03.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.788+0000 7f29b37fe640 1 --2- 172.21.15.40:0/35503951 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f29b415baf0 0x7f299c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:03.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.789+0000 7f29b2ffd640 1 -- 172.21.15.40:0/35503951 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f29b415baf0 msgr2=0x7f299c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:03.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.789+0000 7f29b2ffd640 1 --2- 172.21.15.40:0/35503951 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f29b415baf0 0x7f299c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:03.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.789+0000 7f29b2ffd640 1 -- 172.21.15.40:0/35503951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f299c004d40 msgr2=0x7f299c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:03.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.789+0000 7f29b2ffd640 1 --2- 172.21.15.40:0/35503951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f299c004d40 0x7f299c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:03.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.789+0000 7f29b2ffd640 1 -- 172.21.15.40:0/35503951 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f299c003520 con 0x7f299c004020 2024-04-22T07:21:03.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.789+0000 7f29b2ffd640 1 --2- 172.21.15.40:0/35503951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f299c004020 0x7f299c004800 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f29a8001750 tx=0x7f299c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b17724a444338847 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:03.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.789+0000 7f29b27fc640 1 -- 172.21.15.40:0/35503951 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8001370 con 0x7f299c004020 2024-04-22T07:21:03.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.790+0000 7f29b27fc640 1 -- 172.21.15.40:0/35503951 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a80052d0 con 0x7f299c004020 2024-04-22T07:21:03.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.790+0000 7f29b27fc640 1 -- 172.21.15.40:0/35503951 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8003830 con 0x7f299c004020 2024-04-22T07:21:03.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.790+0000 7f29b9f40640 1 -- 172.21.15.40:0/35503951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f299c004020 msgr2=0x7f299c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:03.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.790+0000 7f29b9f40640 1 --2- 172.21.15.40:0/35503951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f299c004020 0x7f299c004800 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f29a8001750 tx=0x7f299c005830 comp rx=0 tx=0).stop 2024-04-22T07:21:03.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.790+0000 7f29b3fff640 1 -- 172.21.15.40:0/35503951 reap_dead start 2024-04-22T07:21:03.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.790+0000 7f29b9f40640 1 -- 172.21.15.40:0/35503951 shutdown_connections 2024-04-22T07:21:03.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.790+0000 7f29b9f40640 1 -- 172.21.15.40:0/35503951 >> 172.21.15.40:0/35503951 conn(0x7f29b40676b0 msgr2=0x7f29b4067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:03.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.790+0000 7f29b9f40640 1 -- 172.21.15.40:0/35503951 shutdown_connections 2024-04-22T07:21:03.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.790+0000 7f29b9f40640 1 -- 172.21.15.40:0/35503951 wait complete. 2024-04-22T07:21:03.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.791+0000 7f29b9f40640 1 Processor -- start 2024-04-22T07:21:03.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.791+0000 7f29b9f40640 1 -- start start 2024-04-22T07:21:03.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.792+0000 7f29b9f40640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f299c004020 0x7f29b415c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:03.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.792+0000 7f29b9f40640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f29b415bf70 0x7f29b40ce770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:03.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.792+0000 7f29b9f40640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29b4158280 0x7f29b4146f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:03.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.792+0000 7f29b9f40640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f29b415e3a0 con 0x7f299c004020 2024-04-22T07:21:03.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.792+0000 7f29b9f40640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f29b415f260 con 0x7f29b4158280 2024-04-22T07:21:03.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.792+0000 7f29b9f40640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f29b40cc770 con 0x7f29b415bf70 2024-04-22T07:21:03.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.792+0000 7f29b37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f299c004020 0x7f29b415c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:03.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.792+0000 7f29b37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f299c004020 0x7f29b415c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42104/0 (socket says 172.21.15.40:42104) 2024-04-22T07:21:03.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.792+0000 7f29b37fe640 1 -- 172.21.15.40:0/3294462766 learned_addr learned my addr 172.21.15.40:0/3294462766 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:03.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.792+0000 7f29b2ffd640 1 --2- 172.21.15.40:0/3294462766 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f29b415bf70 0x7f29b40ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:03.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.792+0000 7f29b3fff640 1 --2- 172.21.15.40:0/3294462766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29b4158280 0x7f29b4146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:03.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.792+0000 7f29b37fe640 1 -- 172.21.15.40:0/3294462766 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f29b415bf70 msgr2=0x7f29b40ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:03.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.792+0000 7f29b37fe640 1 --2- 172.21.15.40:0/3294462766 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f29b415bf70 0x7f29b40ce770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:03.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.792+0000 7f29b37fe640 1 -- 172.21.15.40:0/3294462766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29b4158280 msgr2=0x7f29b4146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:03.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.792+0000 7f29b37fe640 1 --2- 172.21.15.40:0/3294462766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29b4158280 0x7f29b4146f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:03.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.792+0000 7f29b37fe640 1 -- 172.21.15.40:0/3294462766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b415cfa0 con 0x7f299c004020 2024-04-22T07:21:03.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.793+0000 7f29b3fff640 1 --2- 172.21.15.40:0/3294462766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29b4158280 0x7f29b4146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:03.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.793+0000 7f29b37fe640 1 --2- 172.21.15.40:0/3294462766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f299c004020 0x7f29b415c6d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f29a4004f40 tx=0x7f29a40074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:03.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.793+0000 7f299bfff640 1 -- 172.21.15.40:0/3294462766 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a400f750 con 0x7f299c004020 2024-04-22T07:21:03.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.793+0000 7f299bfff640 1 -- 172.21.15.40:0/3294462766 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a4018070 con 0x7f299c004020 2024-04-22T07:21:03.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.793+0000 7f29b9f40640 1 -- 172.21.15.40:0/3294462766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b415d210 con 0x7f299c004020 2024-04-22T07:21:03.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.793+0000 7f299bfff640 1 -- 172.21.15.40:0/3294462766 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a400fb50 con 0x7f299c004020 2024-04-22T07:21:03.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.793+0000 7f29b9f40640 1 -- 172.21.15.40:0/3294462766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b415d7d0 con 0x7f299c004020 2024-04-22T07:21:03.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.794+0000 7f29b9f40640 1 -- 172.21.15.40:0/3294462766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29b40ccdb0 con 0x7f299c004020 2024-04-22T07:21:03.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.794+0000 7f299bfff640 1 -- 172.21.15.40:0/3294462766 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f29a400fcf0 con 0x7f299c004020 2024-04-22T07:21:03.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.795+0000 7f299bfff640 1 --2- 172.21.15.40:0/3294462766 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f29a006c920 0x7f29a006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:03.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.795+0000 7f29b2ffd640 1 --2- 172.21.15.40:0/3294462766 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f29a006c920 0x7f29a006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:03.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.795+0000 7f299bfff640 1 -- 172.21.15.40:0/3294462766 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f29a408bae0 con 0x7f299c004020 2024-04-22T07:21:03.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.795+0000 7f29b2ffd640 1 --2- 172.21.15.40:0/3294462766 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f29a006c920 0x7f29a006ede0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f29a8033000 tx=0x7f29a8009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:03.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:03.799+0000 7f299bfff640 1 -- 172.21.15.40:0/3294462766 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f29b40ccdb0 con 0x7f299c004020 2024-04-22T07:21:04.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.037+0000 7f29b9f40640 1 -- 172.21.15.40:0/3294462766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f29b4069d40 con 0x7f299c004020 2024-04-22T07:21:04.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.040+0000 7f299bfff640 1 -- 172.21.15.40:0/3294462766 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174131 (secure 0 0 0) 0x7f29a4059f10 con 0x7f299c004020 2024-04-22T07:21:04.040 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:21:04.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.042+0000 7f29b9f40640 1 -- 172.21.15.40:0/3294462766 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f29a006c920 msgr2=0x7f29a006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.042+0000 7f29b9f40640 1 --2- 172.21.15.40:0/3294462766 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f29a006c920 0x7f29a006ede0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f29a8033000 tx=0x7f29a8009030 comp rx=0 tx=0).stop 2024-04-22T07:21:04.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.042+0000 7f29b9f40640 1 -- 172.21.15.40:0/3294462766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f299c004020 msgr2=0x7f29b415c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.042+0000 7f29b9f40640 1 --2- 172.21.15.40:0/3294462766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f299c004020 0x7f29b415c6d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f29a4004f40 tx=0x7f29a40074f0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.042+0000 7f29b9f40640 1 -- 172.21.15.40:0/3294462766 shutdown_connections 2024-04-22T07:21:04.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.042+0000 7f29b9f40640 1 --2- 172.21.15.40:0/3294462766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29b4158280 0x7f29b4146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.042+0000 7f29b9f40640 1 --2- 172.21.15.40:0/3294462766 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f29b415bf70 0x7f29b40ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.042+0000 7f29b9f40640 1 --2- 172.21.15.40:0/3294462766 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f29a006c920 0x7f29a006ede0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.042+0000 7f29b9f40640 1 --2- 172.21.15.40:0/3294462766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f299c004020 0x7f29b415c6d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.042+0000 7f29b9f40640 1 -- 172.21.15.40:0/3294462766 >> 172.21.15.40:0/3294462766 conn(0x7f29b40676b0 msgr2=0x7f29b4062390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:04.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.042+0000 7f29b9f40640 1 -- 172.21.15.40:0/3294462766 shutdown_connections 2024-04-22T07:21:04.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.042+0000 7f29b9f40640 1 -- 172.21.15.40:0/3294462766 wait complete. 2024-04-22T07:21:04.051 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":91163869},{"type":"v1","addr":"172.21.15.40:6833","nonce":91163869}]},"active_addr":"172.21.15.40:6833/91163869","active_change":"2024-04-22T07:20:33.765784+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":3532154133}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":3464319513}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":2859408945}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":3597449252}]}]} 2024-04-22T07:21:04.055 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-22T07:21:04.055 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-22T07:21:04.055 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:21:04.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.157+0000 7f613a38f640 1 Processor -- start 2024-04-22T07:21:04.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.157+0000 7f613a38f640 1 -- start start 2024-04-22T07:21:04.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.158+0000 7f613a38f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6134154ed0 0x7f61340cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.158+0000 7f613a38f640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f61340cc650 0x7f613415e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.158+0000 7f613a38f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61340c5960 con 0x7f613415ef10 2024-04-22T07:21:04.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.158+0000 7f613a38f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f613415e260 con 0x7f6134154ed0 2024-04-22T07:21:04.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.158+0000 7f613a38f640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f613415b7b0 con 0x7f61340cc650 2024-04-22T07:21:04.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.158+0000 7f6133fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6134154ed0 0x7f61340cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.158+0000 7f613892c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f613415ef10 0x7f61340ccfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33836/0 (socket says 172.21.15.40:33836) 2024-04-22T07:21:04.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.158+0000 7f613892c640 1 -- 172.21.15.40:0/1688349651 learned_addr learned my addr 172.21.15.40:0/1688349651 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:04.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.158+0000 7f61337fe640 1 --2- 172.21.15.40:0/1688349651 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f61340cc650 0x7f613415e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.158+0000 7f6133fff640 1 -- 172.21.15.40:0/1688349651 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f61340cc650 msgr2=0x7f613415e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:04.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.158+0000 7f6133fff640 1 --2- 172.21.15.40:0/1688349651 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f61340cc650 0x7f613415e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.158+0000 7f6133fff640 1 -- 172.21.15.40:0/1688349651 >> v1:172.21.15.40:6789/0 conn(0x7f613415ef10 legacy=0x7f61340ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.158+0000 7f6133fff640 1 -- 172.21.15.40:0/1688349651 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61340cc0f0 con 0x7f6134154ed0 2024-04-22T07:21:04.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.158+0000 7f6132ffd640 1 -- 172.21.15.40:0/1688349651 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 430155661 0 0) 0x7f612c001490 con 0x7f613415ef10 2024-04-22T07:21:04.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.159+0000 7f6133fff640 1 --2- 172.21.15.40:0/1688349651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6134154ed0 0x7f61340cb490 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f61240097a0 tx=0x7f612402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e36b37019ce588 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.159+0000 7f6132ffd640 1 -- 172.21.15.40:0/1688349651 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61240315a0 con 0x7f6134154ed0 2024-04-22T07:21:04.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.159+0000 7f6132ffd640 1 -- 172.21.15.40:0/1688349651 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6124037070 con 0x7f6134154ed0 2024-04-22T07:21:04.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.159+0000 7f6132ffd640 1 -- 172.21.15.40:0/1688349651 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6124031960 con 0x7f6134154ed0 2024-04-22T07:21:04.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.160+0000 7f613a38f640 1 -- 172.21.15.40:0/1688349651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6134154ed0 msgr2=0x7f61340cb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.160+0000 7f613a38f640 1 --2- 172.21.15.40:0/1688349651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6134154ed0 0x7f61340cb490 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f61240097a0 tx=0x7f612402b840 comp rx=0 tx=0).stop 2024-04-22T07:21:04.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.160+0000 7f613a38f640 1 -- 172.21.15.40:0/1688349651 shutdown_connections 2024-04-22T07:21:04.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.160+0000 7f613a38f640 1 --2- 172.21.15.40:0/1688349651 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f61340cc650 0x7f613415e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.160+0000 7f613a38f640 1 --2- 172.21.15.40:0/1688349651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6134154ed0 0x7f61340cb490 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.160+0000 7f613a38f640 1 -- 172.21.15.40:0/1688349651 >> 172.21.15.40:0/1688349651 conn(0x7f6134073d10 msgr2=0x7f613406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:04.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.160+0000 7f613a38f640 1 -- 172.21.15.40:0/1688349651 shutdown_connections 2024-04-22T07:21:04.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.160+0000 7f613a38f640 1 -- 172.21.15.40:0/1688349651 wait complete. 2024-04-22T07:21:04.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.161+0000 7f613a38f640 1 Processor -- start 2024-04-22T07:21:04.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.161+0000 7f613a38f640 1 -- start start 2024-04-22T07:21:04.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.162+0000 7f613a38f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61340cc650 0x7f6134159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.162+0000 7f613a38f640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6134154ed0 0x7f61341e53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.162+0000 7f613a38f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f613415ef10 0x7f61341e5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.162+0000 7f613a38f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f61340cc3b0 con 0x7f61340cc650 2024-04-22T07:21:04.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.162+0000 7f613a38f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f613415e4b0 con 0x7f613415ef10 2024-04-22T07:21:04.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.162+0000 7f613a38f640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f61340cbb20 con 0x7f6134154ed0 2024-04-22T07:21:04.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.162+0000 7f6133fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61340cc650 0x7f6134159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.162+0000 7f6133fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61340cc650 0x7f6134159650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42116/0 (socket says 172.21.15.40:42116) 2024-04-22T07:21:04.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.162+0000 7f6133fff640 1 -- 172.21.15.40:0/3195659620 learned_addr learned my addr 172.21.15.40:0/3195659620 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:04.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.162+0000 7f613892c640 1 --2- 172.21.15.40:0/3195659620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f613415ef10 0x7f61341e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.162+0000 7f61337fe640 1 --2- 172.21.15.40:0/3195659620 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6134154ed0 0x7f61341e53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.162+0000 7f6133fff640 1 -- 172.21.15.40:0/3195659620 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6134154ed0 msgr2=0x7f61341e53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.162+0000 7f6133fff640 1 --2- 172.21.15.40:0/3195659620 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6134154ed0 0x7f61341e53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.162+0000 7f6133fff640 1 -- 172.21.15.40:0/3195659620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f613415ef10 msgr2=0x7f61341e5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.162+0000 7f6133fff640 1 --2- 172.21.15.40:0/3195659620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f613415ef10 0x7f61341e5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.162+0000 7f6133fff640 1 -- 172.21.15.40:0/3195659620 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613414ffb0 con 0x7f61340cc650 2024-04-22T07:21:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.162+0000 7f61337fe640 1 --2- 172.21.15.40:0/3195659620 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6134154ed0 0x7f61341e53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.163+0000 7f6133fff640 1 --2- 172.21.15.40:0/3195659620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61340cc650 0x7f6134159650 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6124000c00 tx=0x7f61240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.163+0000 7f6130ff9640 1 -- 172.21.15.40:0/3195659620 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6124004230 con 0x7f61340cc650 2024-04-22T07:21:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.163+0000 7f6130ff9640 1 -- 172.21.15.40:0/3195659620 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61240043f0 con 0x7f61340cc650 2024-04-22T07:21:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.163+0000 7f613a38f640 1 -- 172.21.15.40:0/3195659620 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61341e6b80 con 0x7f61340cc650 2024-04-22T07:21:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.163+0000 7f6130ff9640 1 -- 172.21.15.40:0/3195659620 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6124003850 con 0x7f61340cc650 2024-04-22T07:21:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.163+0000 7f613a38f640 1 -- 172.21.15.40:0/3195659620 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f613414b260 con 0x7f61340cc650 2024-04-22T07:21:04.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.164+0000 7f613a38f640 1 -- 172.21.15.40:0/3195659620 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61341552b0 con 0x7f61340cc650 2024-04-22T07:21:04.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.164+0000 7f6130ff9640 1 -- 172.21.15.40:0/3195659620 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f61240039f0 con 0x7f61340cc650 2024-04-22T07:21:04.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.165+0000 7f6130ff9640 1 --2- 172.21.15.40:0/3195659620 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f612006c920 0x7f612006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.165+0000 7f61337fe640 1 --2- 172.21.15.40:0/3195659620 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f612006c920 0x7f612006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.165+0000 7f6130ff9640 1 -- 172.21.15.40:0/3195659620 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f612402f030 con 0x7f61340cc650 2024-04-22T07:21:04.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.165+0000 7f61337fe640 1 --2- 172.21.15.40:0/3195659620 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f612006c920 0x7f612006ede0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6134158930 tx=0x7f6128008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.169+0000 7f6130ff9640 1 -- 172.21.15.40:0/3195659620 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f61341552b0 con 0x7f61340cc650 2024-04-22T07:21:04.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.354+0000 7f613a38f640 1 -- 172.21.15.40:0/3195659620 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f61340cbe30 con 0x7f61340cc650 2024-04-22T07:21:04.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.355+0000 7f6130ff9640 1 -- 172.21.15.40:0/3195659620 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16537 (secure 0 0 0) 0x7f613414ffb0 con 0x7f61340cc650 2024-04-22T07:21:04.354 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:21:04.354 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":23,"fsid":"dd5b16e4-89fe-4602-b37f-062846793158","created":"2024-04-22T07:20:29.488892+0000","modified":"2024-04-22T07:20:54.858120+0000","last_up_change":"2024-04-22T07:20:40.397383+0000","last_in_change":"2024-04-22T07:20:31.702551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:20:41.793179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:20:51.815779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:20:52.164265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32238b7e-228b-4a67-bfca-16e8f0020a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6801","nonce":1526385055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6803","nonce":1526385055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6807","nonce":1526385055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6805","nonce":1526385055}]},"public_addr":"172.21.15.40:6801/1526385055","cluster_addr":"172.21.15.40:6803/1526385055","heartbeat_back_addr":"172.21.15.40:6807/1526385055","heartbeat_front_addr":"172.21.15.40:6805/1526385055","state":["exists","up"]},{"osd":1,"uuid":"5ad8da43-39b1-4295-b4d1-0f1e1d06fc0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6809","nonce":623026645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6811","nonce":623026645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6815","nonce":623026645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6813","nonce":623026645}]},"public_addr":"172.21.15.40:6809/623026645","cluster_addr":"172.21.15.40:6811/623026645","heartbeat_back_addr":"172.21.15.40:6815/623026645","heartbeat_front_addr":"172.21.15.40:6813/623026645","state":["exists","up"]},{"osd":2,"uuid":"7d2c6d50-719d-4232-ad47-f04dcf1a8bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6820","nonce":1885686505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6824","nonce":1885686505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6831","nonce":1885686505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6828","nonce":1885686505}]},"public_addr":"172.21.15.40:6820/1885686505","cluster_addr":"172.21.15.40:6824/1885686505","heartbeat_back_addr":"172.21.15.40:6831/1885686505","heartbeat_front_addr":"172.21.15.40:6828/1885686505","state":["exists","up"]},{"osd":3,"uuid":"af42e7d6-a6bf-403e-92e7-162d7c4fbf0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6817","nonce":130276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6819","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6821","nonce":130276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6829","nonce":130276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6823","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6825","nonce":130276746}]},"public_addr":"172.21.15.40:6817/130276746","cluster_addr":"172.21.15.40:6821/130276746","heartbeat_back_addr":"172.21.15.40:6829/130276746","heartbeat_front_addr":"172.21.15.40:6825/130276746","state":["exists","up"]},{"osd":4,"uuid":"f8e89e0d-be96-4f19-88c0-69c408df7d98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6801","nonce":2251435758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6803","nonce":2251435758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6807","nonce":2251435758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6805","nonce":2251435758}]},"public_addr":"172.21.15.62:6801/2251435758","cluster_addr":"172.21.15.62:6803/2251435758","heartbeat_back_addr":"172.21.15.62:6807/2251435758","heartbeat_front_addr":"172.21.15.62:6805/2251435758","state":["exists","up"]},{"osd":5,"uuid":"ba6dc1bc-272b-4f80-b55f-40bc4a0c3ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6809","nonce":3509322231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6811","nonce":3509322231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6815","nonce":3509322231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6813","nonce":3509322231}]},"public_addr":"172.21.15.62:6809/3509322231","cluster_addr":"172.21.15.62:6811/3509322231","heartbeat_back_addr":"172.21.15.62:6815/3509322231","heartbeat_front_addr":"172.21.15.62:6813/3509322231","state":["exists","up"]},{"osd":6,"uuid":"834fcd74-14bf-45ec-a10a-0374f4ce9bf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6825","nonce":3094315954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6827","nonce":3094315954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6831","nonce":3094315954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6829","nonce":3094315954}]},"public_addr":"172.21.15.62:6825/3094315954","cluster_addr":"172.21.15.62:6827/3094315954","heartbeat_back_addr":"172.21.15.62:6831/3094315954","heartbeat_front_addr":"172.21.15.62:6829/3094315954","state":["exists","up"]},{"osd":7,"uuid":"831c9a73-960e-4d2e-b86a-33a6916be059","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6817","nonce":147453972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6819","nonce":147453972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6823","nonce":147453972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6821","nonce":147453972}]},"public_addr":"172.21.15.62:6817/147453972","cluster_addr":"172.21.15.62:6819/147453972","heartbeat_back_addr":"172.21.15.62:6823/147453972","heartbeat_front_addr":"172.21.15.62:6821/147453972","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.828738+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.873471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.908090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.894782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:37.686796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.801123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.852323+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.812139+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:21:04.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.357+0000 7f613a38f640 1 -- 172.21.15.40:0/3195659620 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f612006c920 msgr2=0x7f612006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.357+0000 7f613a38f640 1 --2- 172.21.15.40:0/3195659620 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f612006c920 0x7f612006ede0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6134158930 tx=0x7f6128008040 comp rx=0 tx=0).stop 2024-04-22T07:21:04.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.357+0000 7f613a38f640 1 -- 172.21.15.40:0/3195659620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61340cc650 msgr2=0x7f6134159650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.357+0000 7f613a38f640 1 --2- 172.21.15.40:0/3195659620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61340cc650 0x7f6134159650 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6124000c00 tx=0x7f61240046c0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.357+0000 7f613a38f640 1 -- 172.21.15.40:0/3195659620 shutdown_connections 2024-04-22T07:21:04.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.357+0000 7f613a38f640 1 --2- 172.21.15.40:0/3195659620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f613415ef10 0x7f61341e5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.357+0000 7f613a38f640 1 --2- 172.21.15.40:0/3195659620 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6134154ed0 0x7f61341e53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.357+0000 7f613a38f640 1 --2- 172.21.15.40:0/3195659620 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f612006c920 0x7f612006ede0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.357+0000 7f613a38f640 1 --2- 172.21.15.40:0/3195659620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61340cc650 0x7f6134159650 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.357+0000 7f613a38f640 1 -- 172.21.15.40:0/3195659620 >> 172.21.15.40:0/3195659620 conn(0x7f6134073d10 msgr2=0x7f613415c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:04.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.358+0000 7f613a38f640 1 -- 172.21.15.40:0/3195659620 shutdown_connections 2024-04-22T07:21:04.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.358+0000 7f613a38f640 1 -- 172.21.15.40:0/3195659620 wait complete. 2024-04-22T07:21:04.367 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-22T07:21:04.367 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:21:04.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.469+0000 7f3d3777e640 1 Processor -- start 2024-04-22T07:21:04.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.469+0000 7f3d3777e640 1 -- start start 2024-04-22T07:21:04.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.470+0000 7f3d3777e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d30154ed0 0x7f3d300cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.470+0000 7f3d3777e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d300c5960 con 0x7f3d300ccfd0 2024-04-22T07:21:04.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.470+0000 7f3d3777e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d3015b7b0 con 0x7f3d300cc650 2024-04-22T07:21:04.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.470+0000 7f3d3777e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f3d3015e260 con 0x7f3d30154ed0 2024-04-22T07:21:04.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.470+0000 7f3d35d1b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3d300ccfd0 0x7f3d301655f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33842/0 (socket says 172.21.15.40:33842) 2024-04-22T07:21:04.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.470+0000 7f3d35d1b640 1 -- 172.21.15.40:0/2486503127 learned_addr learned my addr 172.21.15.40:0/2486503127 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:04.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.470+0000 7f3d2ffff640 1 -- 172.21.15.40:0/2486503127 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2738130693 0 0) 0x7f3d28001110 con 0x7f3d300ccfd0 2024-04-22T07:21:04.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.470+0000 7f3d2ffff640 1 -- 172.21.15.40:0/2486503127 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d18003520 con 0x7f3d300ccfd0 2024-04-22T07:21:04.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.470+0000 7f3d3551a640 1 --2- 172.21.15.40:0/2486503127 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d30154ed0 0x7f3d300cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.471+0000 7f3d2ffff640 1 -- 172.21.15.40:0/2486503127 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 906750242 0 0) 0x7f3d18003520 con 0x7f3d300ccfd0 2024-04-22T07:21:04.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.471+0000 7f3d2ffff640 1 -- 172.21.15.40:0/2486503127 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d30154ed0 msgr2=0x7f3d300cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:04.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.471+0000 7f3d2ffff640 1 --2- 172.21.15.40:0/2486503127 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d30154ed0 0x7f3d300cb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.471+0000 7f3d2ffff640 1 -- 172.21.15.40:0/2486503127 >> v1:172.21.15.62:6789/0 conn(0x7f3d300cc650 legacy=0x7f3d3015e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.471+0000 7f3d2ffff640 1 -- 172.21.15.40:0/2486503127 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d300cc0f0 con 0x7f3d300ccfd0 2024-04-22T07:21:04.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.471+0000 7f3d2ffff640 1 -- 172.21.15.40:0/2486503127 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7f3d28001840 con 0x7f3d300ccfd0 2024-04-22T07:21:04.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.471+0000 7f3d2ffff640 1 -- 172.21.15.40:0/2486503127 >> v1:172.21.15.40:6789/0 conn(0x7f3d300ccfd0 legacy=0x7f3d301655f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.471+0000 7f3d2ffff640 1 --2- 172.21.15.40:0/2486503127 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d30154ed0 0x7f3d18003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.471+0000 7f3d2ffff640 1 --2- 172.21.15.40:0/2486503127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d18004030 0x7f3d18004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.471+0000 7f3d2ffff640 1 --2- 172.21.15.40:0/2486503127 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d18004d40 0x7f3d180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.471+0000 7f3d2ffff640 1 -- 172.21.15.40:0/2486503127 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3015e260 con 0x7f3d18004d40 2024-04-22T07:21:04.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.471+0000 7f3d2ffff640 1 -- 172.21.15.40:0/2486503127 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1800bc20 con 0x7f3d18004030 2024-04-22T07:21:04.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.471+0000 7f3d2ffff640 1 -- 172.21.15.40:0/2486503127 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f3d1800be20 con 0x7f3d30154ed0 2024-04-22T07:21:04.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.471+0000 7f3d35d1b640 1 --2- 172.21.15.40:0/2486503127 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d18004d40 0x7f3d180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.471+0000 7f3d3551a640 1 --2- 172.21.15.40:0/2486503127 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d30154ed0 0x7f3d18003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.471+0000 7f3d34d19640 1 --2- 172.21.15.40:0/2486503127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d18004030 0x7f3d18004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.471+0000 7f3d35d1b640 1 -- 172.21.15.40:0/2486503127 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d30154ed0 msgr2=0x7f3d18003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:04.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.471+0000 7f3d35d1b640 1 --2- 172.21.15.40:0/2486503127 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d30154ed0 0x7f3d18003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.471+0000 7f3d35d1b640 1 -- 172.21.15.40:0/2486503127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d18004030 msgr2=0x7f3d18004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:04.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.471+0000 7f3d35d1b640 1 --2- 172.21.15.40:0/2486503127 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d18004030 0x7f3d18004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.471+0000 7f3d35d1b640 1 -- 172.21.15.40:0/2486503127 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d18003520 con 0x7f3d18004d40 2024-04-22T07:21:04.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.472+0000 7f3d35d1b640 1 --2- 172.21.15.40:0/2486503127 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d18004d40 0x7f3d180051c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3d2800c4c0 tx=0x7f3d18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc61b5f27478f50 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.472+0000 7f3d2ffff640 1 -- 172.21.15.40:0/2486503127 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2800c0e0 con 0x7f3d18004d40 2024-04-22T07:21:04.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.472+0000 7f3d2ffff640 1 -- 172.21.15.40:0/2486503127 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d28030070 con 0x7f3d18004d40 2024-04-22T07:21:04.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.472+0000 7f3d2ffff640 1 -- 172.21.15.40:0/2486503127 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d280058d0 con 0x7f3d18004d40 2024-04-22T07:21:04.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.473+0000 7f3d3777e640 1 -- 172.21.15.40:0/2486503127 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d18004d40 msgr2=0x7f3d180051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.473+0000 7f3d3777e640 1 --2- 172.21.15.40:0/2486503127 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d18004d40 0x7f3d180051c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3d2800c4c0 tx=0x7f3d18005830 comp rx=0 tx=0).stop 2024-04-22T07:21:04.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.473+0000 7f3d35d1b640 1 -- 172.21.15.40:0/2486503127 reap_dead start 2024-04-22T07:21:04.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.473+0000 7f3d3777e640 1 -- 172.21.15.40:0/2486503127 shutdown_connections 2024-04-22T07:21:04.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.473+0000 7f3d3777e640 1 -- 172.21.15.40:0/2486503127 >> 172.21.15.40:0/2486503127 conn(0x7f3d30073d10 msgr2=0x7f3d3006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:04.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.473+0000 7f3d3777e640 1 -- 172.21.15.40:0/2486503127 shutdown_connections 2024-04-22T07:21:04.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.473+0000 7f3d3777e640 1 -- 172.21.15.40:0/2486503127 wait complete. 2024-04-22T07:21:04.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.474+0000 7f3d3777e640 1 Processor -- start 2024-04-22T07:21:04.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.474+0000 7f3d3777e640 1 -- start start 2024-04-22T07:21:04.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.475+0000 7f3d3777e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d30159d90 0x7f3d30152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.475+0000 7f3d3777e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d3015a170 0x7f3d301543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.475+0000 7f3d3777e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d300ca160 0x7f3d301f40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.475+0000 7f3d3777e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3d300cc3b0 con 0x7f3d300ca160 2024-04-22T07:21:04.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.475+0000 7f3d3777e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3015e4b0 con 0x7f3d3015a170 2024-04-22T07:21:04.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.475+0000 7f3d3777e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f3d300cbb20 con 0x7f3d30159d90 2024-04-22T07:21:04.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.475+0000 7f3d35d1b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d300ca160 0x7f3d301f40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.475+0000 7f3d35d1b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d300ca160 0x7f3d301f40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42144/0 (socket says 172.21.15.40:42144) 2024-04-22T07:21:04.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.475+0000 7f3d35d1b640 1 -- 172.21.15.40:0/1552578465 learned_addr learned my addr 172.21.15.40:0/1552578465 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:04.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.475+0000 7f3d3551a640 1 --2- 172.21.15.40:0/1552578465 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d30159d90 0x7f3d30152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.475+0000 7f3d34d19640 1 --2- 172.21.15.40:0/1552578465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d3015a170 0x7f3d301543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.475+0000 7f3d35d1b640 1 -- 172.21.15.40:0/1552578465 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d30159d90 msgr2=0x7f3d30152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.475+0000 7f3d35d1b640 1 --2- 172.21.15.40:0/1552578465 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d30159d90 0x7f3d30152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.475+0000 7f3d35d1b640 1 -- 172.21.15.40:0/1552578465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d3015a170 msgr2=0x7f3d301543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.475+0000 7f3d35d1b640 1 --2- 172.21.15.40:0/1552578465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d3015a170 0x7f3d301543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.475+0000 7f3d35d1b640 1 -- 172.21.15.40:0/1552578465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d30153150 con 0x7f3d300ca160 2024-04-22T07:21:04.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.475+0000 7f3d35d1b640 1 --2- 172.21.15.40:0/1552578465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d300ca160 0x7f3d301f40f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3d2800c4c0 tx=0x7f3d3015ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.475+0000 7f3d2dffb640 1 -- 172.21.15.40:0/1552578465 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d28000ed0 con 0x7f3d300ca160 2024-04-22T07:21:04.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.475+0000 7f3d2dffb640 1 -- 172.21.15.40:0/1552578465 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d28001110 con 0x7f3d300ca160 2024-04-22T07:21:04.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.475+0000 7f3d2dffb640 1 -- 172.21.15.40:0/1552578465 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d28007070 con 0x7f3d300ca160 2024-04-22T07:21:04.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.475+0000 7f3d3777e640 1 -- 172.21.15.40:0/1552578465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d300b6120 con 0x7f3d300ca160 2024-04-22T07:21:04.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.476+0000 7f3d3777e640 1 -- 172.21.15.40:0/1552578465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d300b63a0 con 0x7f3d300ca160 2024-04-22T07:21:04.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.477+0000 7f3d3777e640 1 -- 172.21.15.40:0/1552578465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d30069d40 con 0x7f3d300ca160 2024-04-22T07:21:04.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.477+0000 7f3d2dffb640 1 -- 172.21.15.40:0/1552578465 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3d28007210 con 0x7f3d300ca160 2024-04-22T07:21:04.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.477+0000 7f3d2dffb640 1 --2- 172.21.15.40:0/1552578465 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f3d1c06ca90 0x7f3d1c06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.478+0000 7f3d2dffb640 1 -- 172.21.15.40:0/1552578465 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f3d280ac700 con 0x7f3d300ca160 2024-04-22T07:21:04.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.478+0000 7f3d3551a640 1 --2- 172.21.15.40:0/1552578465 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f3d1c06ca90 0x7f3d1c06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.478+0000 7f3d3551a640 1 --2- 172.21.15.40:0/1552578465 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f3d1c06ca90 0x7f3d1c06ef50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3d20003b30 tx=0x7f3d20009760 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.482+0000 7f3d2dffb640 1 -- 172.21.15.40:0/1552578465 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3d300b6120 con 0x7f3d300ca160 2024-04-22T07:21:04.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.667+0000 7f3d3777e640 1 -- 172.21.15.40:0/1552578465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3d300cbe30 con 0x7f3d300ca160 2024-04-22T07:21:04.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.668+0000 7f3d2dffb640 1 -- 172.21.15.40:0/1552578465 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16537 (secure 0 0 0) 0x7f3d300c5960 con 0x7f3d300ca160 2024-04-22T07:21:04.666 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:21:04.666 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":23,"fsid":"dd5b16e4-89fe-4602-b37f-062846793158","created":"2024-04-22T07:20:29.488892+0000","modified":"2024-04-22T07:20:54.858120+0000","last_up_change":"2024-04-22T07:20:40.397383+0000","last_in_change":"2024-04-22T07:20:31.702551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:20:41.793179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:20:51.815779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:20:52.164265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32238b7e-228b-4a67-bfca-16e8f0020a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6801","nonce":1526385055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6803","nonce":1526385055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6807","nonce":1526385055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6805","nonce":1526385055}]},"public_addr":"172.21.15.40:6801/1526385055","cluster_addr":"172.21.15.40:6803/1526385055","heartbeat_back_addr":"172.21.15.40:6807/1526385055","heartbeat_front_addr":"172.21.15.40:6805/1526385055","state":["exists","up"]},{"osd":1,"uuid":"5ad8da43-39b1-4295-b4d1-0f1e1d06fc0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6809","nonce":623026645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6811","nonce":623026645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6815","nonce":623026645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6813","nonce":623026645}]},"public_addr":"172.21.15.40:6809/623026645","cluster_addr":"172.21.15.40:6811/623026645","heartbeat_back_addr":"172.21.15.40:6815/623026645","heartbeat_front_addr":"172.21.15.40:6813/623026645","state":["exists","up"]},{"osd":2,"uuid":"7d2c6d50-719d-4232-ad47-f04dcf1a8bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6820","nonce":1885686505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6824","nonce":1885686505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6831","nonce":1885686505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6828","nonce":1885686505}]},"public_addr":"172.21.15.40:6820/1885686505","cluster_addr":"172.21.15.40:6824/1885686505","heartbeat_back_addr":"172.21.15.40:6831/1885686505","heartbeat_front_addr":"172.21.15.40:6828/1885686505","state":["exists","up"]},{"osd":3,"uuid":"af42e7d6-a6bf-403e-92e7-162d7c4fbf0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6817","nonce":130276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6819","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6821","nonce":130276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6829","nonce":130276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6823","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6825","nonce":130276746}]},"public_addr":"172.21.15.40:6817/130276746","cluster_addr":"172.21.15.40:6821/130276746","heartbeat_back_addr":"172.21.15.40:6829/130276746","heartbeat_front_addr":"172.21.15.40:6825/130276746","state":["exists","up"]},{"osd":4,"uuid":"f8e89e0d-be96-4f19-88c0-69c408df7d98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6801","nonce":2251435758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6803","nonce":2251435758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6807","nonce":2251435758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6805","nonce":2251435758}]},"public_addr":"172.21.15.62:6801/2251435758","cluster_addr":"172.21.15.62:6803/2251435758","heartbeat_back_addr":"172.21.15.62:6807/2251435758","heartbeat_front_addr":"172.21.15.62:6805/2251435758","state":["exists","up"]},{"osd":5,"uuid":"ba6dc1bc-272b-4f80-b55f-40bc4a0c3ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6809","nonce":3509322231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6811","nonce":3509322231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6815","nonce":3509322231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6813","nonce":3509322231}]},"public_addr":"172.21.15.62:6809/3509322231","cluster_addr":"172.21.15.62:6811/3509322231","heartbeat_back_addr":"172.21.15.62:6815/3509322231","heartbeat_front_addr":"172.21.15.62:6813/3509322231","state":["exists","up"]},{"osd":6,"uuid":"834fcd74-14bf-45ec-a10a-0374f4ce9bf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6825","nonce":3094315954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6827","nonce":3094315954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6831","nonce":3094315954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6829","nonce":3094315954}]},"public_addr":"172.21.15.62:6825/3094315954","cluster_addr":"172.21.15.62:6827/3094315954","heartbeat_back_addr":"172.21.15.62:6831/3094315954","heartbeat_front_addr":"172.21.15.62:6829/3094315954","state":["exists","up"]},{"osd":7,"uuid":"831c9a73-960e-4d2e-b86a-33a6916be059","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6817","nonce":147453972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6819","nonce":147453972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6823","nonce":147453972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6821","nonce":147453972}]},"public_addr":"172.21.15.62:6817/147453972","cluster_addr":"172.21.15.62:6819/147453972","heartbeat_back_addr":"172.21.15.62:6823/147453972","heartbeat_front_addr":"172.21.15.62:6821/147453972","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.828738+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.873471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.908090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.894782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:37.686796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.801123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.852323+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.812139+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:21:04.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.670+0000 7f3d3777e640 1 -- 172.21.15.40:0/1552578465 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f3d1c06ca90 msgr2=0x7f3d1c06ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.670+0000 7f3d3777e640 1 --2- 172.21.15.40:0/1552578465 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f3d1c06ca90 0x7f3d1c06ef50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3d20003b30 tx=0x7f3d20009760 comp rx=0 tx=0).stop 2024-04-22T07:21:04.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.670+0000 7f3d3777e640 1 -- 172.21.15.40:0/1552578465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d300ca160 msgr2=0x7f3d301f40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.670+0000 7f3d3777e640 1 --2- 172.21.15.40:0/1552578465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d300ca160 0x7f3d301f40f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3d2800c4c0 tx=0x7f3d3015ac90 comp rx=0 tx=0).stop 2024-04-22T07:21:04.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.670+0000 7f3d3777e640 1 -- 172.21.15.40:0/1552578465 shutdown_connections 2024-04-22T07:21:04.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.670+0000 7f3d3777e640 1 --2- 172.21.15.40:0/1552578465 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f3d1c06ca90 0x7f3d1c06ef50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.670+0000 7f3d3777e640 1 --2- 172.21.15.40:0/1552578465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d300ca160 0x7f3d301f40f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.670+0000 7f3d3777e640 1 --2- 172.21.15.40:0/1552578465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d3015a170 0x7f3d301543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.670+0000 7f3d3777e640 1 --2- 172.21.15.40:0/1552578465 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d30159d90 0x7f3d30152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.670+0000 7f3d3777e640 1 -- 172.21.15.40:0/1552578465 >> 172.21.15.40:0/1552578465 conn(0x7f3d30073d10 msgr2=0x7f3d300c67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:04.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.670+0000 7f3d3777e640 1 -- 172.21.15.40:0/1552578465 shutdown_connections 2024-04-22T07:21:04.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.670+0000 7f3d3777e640 1 -- 172.21.15.40:0/1552578465 wait complete. 2024-04-22T07:21:04.679 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-22T07:21:04.679 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-22T07:21:04.680 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-22T07:21:04.680 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-22T07:21:04.681 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-22T07:21:04.681 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-22T07:21:04.681 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-22T07:21:04.682 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-22T07:21:04.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.856+0000 7f9aca49b640 1 Processor -- start 2024-04-22T07:21:04.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.856+0000 7f9aca49b640 1 -- start start 2024-04-22T07:21:04.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.858+0000 7f9aca49b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9abc04b500 0x7f9abc0dac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.858+0000 7f9aca49b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9abc04b8e0 0x7f9abc005ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.858+0000 7f9aca49b640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9abc007760 con 0x7f9abc006420 2024-04-22T07:21:04.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.858+0000 7f9aca49b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f9abc006900 con 0x7f9abc04b500 2024-04-22T07:21:04.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.858+0000 7f9aca49b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9abc006be0 con 0x7f9abc04b8e0 2024-04-22T07:21:04.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.858+0000 7f9ac9c9a640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f9abc006420 0x7f9abc034a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.40:49296/0 (socket says 172.21.15.40:49296) 2024-04-22T07:21:04.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.858+0000 7f9ac9c9a640 1 -- 172.21.15.40:0/4278285199 learned_addr learned my addr 172.21.15.40:0/4278285199 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:04.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.858+0000 7f9ac9499640 1 --2- 172.21.15.40:0/4278285199 >> v2:172.21.15.40:3300/0 conn(0x7f9abc04b500 0x7f9abc0dac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.859+0000 7fef3dd6c640 1 Processor -- start 2024-04-22T07:21:04.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.859+0000 7f9639af2640 1 Processor -- start 2024-04-22T07:21:04.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.859+0000 7fb5755ca640 1 Processor -- start 2024-04-22T07:21:04.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.859+0000 7f9639af2640 1 -- start start 2024-04-22T07:21:04.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.859+0000 7f0f51baf640 1 Processor -- start 2024-04-22T07:21:04.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.860+0000 7fb5755ca640 1 -- start start 2024-04-22T07:21:04.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.860+0000 7f0f51baf640 1 -- start start 2024-04-22T07:21:04.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.860+0000 7f577f59e640 1 Processor -- start 2024-04-22T07:21:04.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.859+0000 7fef3dd6c640 1 -- start start 2024-04-22T07:21:04.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.859+0000 7f9ac8c98640 1 --2- 172.21.15.40:0/4278285199 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9abc04b8e0 0x7f9abc005ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.859+0000 7f9abbfff640 1 -- 172.21.15.40:0/4278285199 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4037756106 0 0) 0x7f9abc007760 con 0x7f9abc006420 2024-04-22T07:21:04.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.859+0000 7f9abbfff640 1 -- 172.21.15.40:0/4278285199 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ab0003520 con 0x7f9abc006420 2024-04-22T07:21:04.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.860+0000 7f9abbfff640 1 -- 172.21.15.40:0/4278285199 <== mon.1 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1074016894 0 0) 0x7f9ab0003520 con 0x7f9abc006420 2024-04-22T07:21:04.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.860+0000 7f9abbfff640 1 -- 172.21.15.40:0/4278285199 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9abc04b8e0 msgr2=0x7f9abc005ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:04.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.860+0000 7f9abbfff640 1 --2- 172.21.15.40:0/4278285199 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9abc04b8e0 0x7f9abc005ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.860+0000 7f9abbfff640 1 -- 172.21.15.40:0/4278285199 >> v2:172.21.15.40:3300/0 conn(0x7f9abc04b500 msgr2=0x7f9abc0dac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:04.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.860+0000 7f9abbfff640 1 --2- 172.21.15.40:0/4278285199 >> v2:172.21.15.40:3300/0 conn(0x7f9abc04b500 0x7f9abc0dac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.860+0000 7efca8898640 1 Processor -- start 2024-04-22T07:21:04.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.860+0000 7f9abbfff640 1 -- 172.21.15.40:0/4278285199 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9abc006ec0 con 0x7f9abc006420 2024-04-22T07:21:04.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.860+0000 7f9abbfff640 1 -- 172.21.15.40:0/4278285199 <== mon.1 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7f9ac4050200 con 0x7f9abc006420 2024-04-22T07:21:04.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.860+0000 7f9abbfff640 1 -- 172.21.15.40:0/4278285199 >> v1:172.21.15.62:6789/0 conn(0x7f9abc006420 legacy=0x7f9abc034a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.860+0000 7f9abbfff640 1 --2- 172.21.15.40:0/4278285199 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9abc04b8e0 0x7f9ab0005b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.860+0000 7f9abbfff640 1 --2- 172.21.15.40:0/4278285199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ab0006110 0x7f9ab00085a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f9abbfff640 1 --2- 172.21.15.40:0/4278285199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ab0008c20 0x7f9ab000b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f9abbfff640 1 -- 172.21.15.40:0/4278285199 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc006900 con 0x7f9ab0006110 2024-04-22T07:21:04.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f9ac9c9a640 1 --2- 172.21.15.40:0/4278285199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ab0008c20 0x7f9ab000b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f9abbfff640 1 -- 172.21.15.40:0/4278285199 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc006be0 con 0x7f9ab0008c20 2024-04-22T07:21:04.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f9abbfff640 1 -- 172.21.15.40:0/4278285199 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9ab000ba00 con 0x7f9abc04b8e0 2024-04-22T07:21:04.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f9ac8c98640 1 --2- 172.21.15.40:0/4278285199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ab0006110 0x7f9ab00085a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.860+0000 7efca8898640 1 -- start start 2024-04-22T07:21:04.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.860+0000 7f577f59e640 1 -- start start 2024-04-22T07:21:04.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f577f59e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f57800cb5e0 0x7f57800b3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f577f59e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f57800cb9c0 0x7f57800cc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f577f59e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57800b3670 con 0x7f57800cc740 2024-04-22T07:21:04.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f577f59e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f57800b3be0 con 0x7f57800cb5e0 2024-04-22T07:21:04.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f577f59e640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f57800b3900 con 0x7f57800cb9c0 2024-04-22T07:21:04.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.860+0000 7fef3dd6c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fef380cc290 0x7fef3815ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.860+0000 7fef3dd6c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef38072cf0 con 0x7fef381571f0 2024-04-22T07:21:04.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.860+0000 7fef3dd6c640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef38072fd0 con 0x7fef380716b0 2024-04-22T07:21:04.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.860+0000 7fef3dd6c640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fef380720b0 con 0x7fef380cc290 2024-04-22T07:21:04.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7fef3d56b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fef381571f0 0x7fef3815b430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33866/0 (socket says 172.21.15.40:33866) 2024-04-22T07:21:04.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7fef3d56b640 1 -- 172.21.15.40:0/393215815 learned_addr learned my addr 172.21.15.40:0/393215815 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:04.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7fef3cd6a640 1 --2- 172.21.15.40:0/393215815 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fef380cc290 0x7fef3815ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7fef377fe640 1 -- 172.21.15.40:0/393215815 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 507193974 0 0) 0x7fef38072cf0 con 0x7fef381571f0 2024-04-22T07:21:04.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7fef377fe640 1 -- 172.21.15.40:0/393215815 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef24003520 con 0x7fef381571f0 2024-04-22T07:21:04.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.860+0000 7f9639af2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f962c0d5d40 0x7f962c04c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.860+0000 7f9639af2640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f962c04cbd0 con 0x7f962c046ac0 2024-04-22T07:21:04.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.860+0000 7f9639af2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f962c008740 con 0x7f962c04d820 2024-04-22T07:21:04.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.860+0000 7f9639af2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f962c008a20 con 0x7f962c0d5d40 2024-04-22T07:21:04.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f9633fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f962c04d820 0x7f962c0463b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.40:49300/0 (socket says 172.21.15.40:49300) 2024-04-22T07:21:04.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f9633fff640 1 -- 172.21.15.40:0/2111955833 learned_addr learned my addr 172.21.15.40:0/2111955833 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:04.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f9638af0640 1 --2- 172.21.15.40:0/2111955833 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f962c0d5d40 0x7f962c04c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f96337fe640 1 -- 172.21.15.40:0/2111955833 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1044664447 0 0) 0x7f962c008740 con 0x7f962c04d820 2024-04-22T07:21:04.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f96337fe640 1 -- 172.21.15.40:0/2111955833 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9624003520 con 0x7f962c04d820 2024-04-22T07:21:04.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f96337fe640 1 -- 172.21.15.40:0/2111955833 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3200863435 0 0) 0x7f962c04cbd0 con 0x7f962c046ac0 2024-04-22T07:21:04.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f96337fe640 1 -- 172.21.15.40:0/2111955833 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9624003880 con 0x7f962c046ac0 2024-04-22T07:21:04.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f9638af0640 1 -- 172.21.15.40:0/2111955833 >> v1:172.21.15.62:6789/0 conn(0x7f962c04d820 legacy=0x7f962c0463b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f9638af0640 1 -- 172.21.15.40:0/2111955833 >> v1:172.21.15.40:6789/0 conn(0x7f962c046ac0 legacy=0x7f962c0df0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f9638af0640 1 -- 172.21.15.40:0/2111955833 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f962c008d00 con 0x7f962c0d5d40 2024-04-22T07:21:04.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7efca8898640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efca40c6520 0x7efca41664f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7efca8898640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efca415f030 con 0x7efca4154d50 2024-04-22T07:21:04.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7efca8898640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efca40cb100 con 0x7efca4155130 2024-04-22T07:21:04.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7efca8898640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7efca4072d00 con 0x7efca40c6520 2024-04-22T07:21:04.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f0f51baf640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f4c154ce0 0x7f0f4c15aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f95b7fff640 1 Processor -- start 2024-04-22T07:21:04.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f95b7fff640 1 -- start start 2024-04-22T07:21:04.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f0f51baf640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f4c0c7ff0 con 0x7f0f4c071700 2024-04-22T07:21:04.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7f9ac9c9a640 1 -- 172.21.15.40:0/4278285199 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9abc04b8e0 msgr2=0x7f9ab0005b90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-22T07:21:04.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7f9ac9c9a640 1 --2- 172.21.15.40:0/4278285199 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9abc04b8e0 0x7f9ab0005b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7f9ac9c9a640 1 -- 172.21.15.40:0/4278285199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ab0006110 msgr2=0x7f9ab00085a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:04.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f0f51baf640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f4c06e010 con 0x7f0f4c0727d0 2024-04-22T07:21:04.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f0f51baf640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0f4c072340 con 0x7f0f4c154ce0 2024-04-22T07:21:04.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7efca259c640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7efca4155130 0x7efca40c5e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.40:49326/0 (socket says 172.21.15.40:49326) 2024-04-22T07:21:04.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7efca259c640 1 -- 172.21.15.40:0/1386110620 learned_addr learned my addr 172.21.15.40:0/1386110620 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f5775d9b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f57800cb9c0 0x7f57800cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f5775d9b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f57800cb9c0 0x7f57800cc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.40:42070/0 (socket says 172.21.15.40:42070) 2024-04-22T07:21:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7f5775d9b640 1 -- 172.21.15.40:0/3718682333 learned_addr learned my addr 172.21.15.40:0/3718682333 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7f577e59c640 1 --2- 172.21.15.40:0/3718682333 >> v2:172.21.15.40:3300/0 conn(0x7f57800cb5e0 0x7f57800b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7fb5755ca640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5680e2510 0x7fb568046870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7fb5755ca640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb5680e2e10 0x7fb568005ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7fb5755ca640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb56804b400 con 0x7fb5680e28f0 2024-04-22T07:21:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7fb5755ca640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fb568045860 con 0x7fb5680e2e10 2024-04-22T07:21:04.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.861+0000 7fb5755ca640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb568045ab0 con 0x7fb5680e2510 2024-04-22T07:21:04.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7fb56e7fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb5680e2e10 0x7fb568005ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7fb56e7fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb5680e2e10 0x7fb568005ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.40:42084/0 (socket says 172.21.15.40:42084) 2024-04-22T07:21:04.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7fb56e7fc640 1 -- 172.21.15.40:0/1112860996 learned_addr learned my addr 172.21.15.40:0/1112860996 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:04.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7f0f513ae640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0f4c0727d0 0x7f0f4c072c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.40:49338/0 (socket says 172.21.15.40:49338) 2024-04-22T07:21:04.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7f0f513ae640 1 -- 172.21.15.40:0/161668497 learned_addr learned my addr 172.21.15.40:0/161668497 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:04.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7f0f50bad640 1 --2- 172.21.15.40:0/161668497 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f4c154ce0 0x7f0f4c15aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7fb56effd640 1 --2- 172.21.15.40:0/1112860996 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5680e2510 0x7fb568046870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7fef377fe640 1 -- 172.21.15.40:0/393215815 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 713190825 0 0) 0x7fef38072fd0 con 0x7fef380716b0 2024-04-22T07:21:04.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7fef377fe640 1 -- 172.21.15.40:0/393215815 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef24003880 con 0x7fef380716b0 2024-04-22T07:21:04.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7efca2d9d640 1 --1- 172.21.15.40:0/1386110620 >> v1:172.21.15.40:6789/0 conn(0x7efca4154d50 0x7efca40d07e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33872/0 (socket says 172.21.15.40:33872) 2024-04-22T07:21:04.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7efca1d9b640 1 -- 172.21.15.40:0/1386110620 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 49890869 0 0) 0x7efca40cb100 con 0x7efca4155130 2024-04-22T07:21:04.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7fb56e7fc640 1 -- 172.21.15.40:0/1112860996 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5680e2510 msgr2=0x7fb568046870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:04.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7fb56e7fc640 1 --2- 172.21.15.40:0/1112860996 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5680e2510 0x7fb568046870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7efca1d9b640 1 -- 172.21.15.40:0/1386110620 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc8c003520 con 0x7efca4155130 2024-04-22T07:21:04.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7fb56e7fc640 1 -- 172.21.15.40:0/1112860996 >> v1:172.21.15.62:6789/0 conn(0x7fb5680e28f0 legacy=0x7fb56804c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:04.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7fb56e7fc640 1 -- 172.21.15.40:0/1112860996 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb568045d90 con 0x7fb5680e2e10 2024-04-22T07:21:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7f0f4b7fe640 1 -- 172.21.15.40:0/161668497 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4080010534 0 0) 0x7f0f4c0c7ff0 con 0x7f0f4c071700 2024-04-22T07:21:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7f0f4b7fe640 1 -- 172.21.15.40:0/161668497 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f34003520 con 0x7f0f4c071700 2024-04-22T07:21:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7f0f4b7fe640 1 -- 172.21.15.40:0/161668497 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3029402553 0 0) 0x7f0f4c06e010 con 0x7f0f4c0727d0 2024-04-22T07:21:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7f0f4b7fe640 1 -- 172.21.15.40:0/161668497 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f4c0c7ff0 con 0x7f0f4c0727d0 2024-04-22T07:21:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7f95b7fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f95b00d6f80 0x7f95b004edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7f0f50bad640 1 -- 172.21.15.40:0/161668497 >> v1:172.21.15.62:6789/0 conn(0x7f0f4c0727d0 legacy=0x7f0f4c072c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7f0f50bad640 1 -- 172.21.15.40:0/161668497 >> v1:172.21.15.40:6789/0 conn(0x7f0f4c071700 legacy=0x7f0f4c0c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.863+0000 7f0f50bad640 1 -- 172.21.15.40:0/161668497 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4c0c6b50 con 0x7f0f4c154ce0 2024-04-22T07:21:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.863+0000 7f9638af0640 1 --2- 172.21.15.40:0/2111955833 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f962c0d5d40 0x7f962c04c490 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9620010bc0 tx=0x7f962002bbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43f06d062b4ae205 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.863+0000 7f95b7fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f95b004cd20 0x7f95b004d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7fef3cd6a640 1 -- 172.21.15.40:0/393215815 >> v1:172.21.15.62:6789/0 conn(0x7fef380716b0 legacy=0x7fef380c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7fef3cd6a640 1 -- 172.21.15.40:0/393215815 >> v1:172.21.15.40:6789/0 conn(0x7fef381571f0 legacy=0x7fef3815b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7fef3cd6a640 1 -- 172.21.15.40:0/393215815 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef38072390 con 0x7fef380cc290 2024-04-22T07:21:04.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7f9ac9c9a640 1 --2- 172.21.15.40:0/4278285199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ab0006110 0x7f9ab00085a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.862+0000 7f9ac9c9a640 1 -- 172.21.15.40:0/4278285199 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab0003520 con 0x7f9ab0008c20 2024-04-22T07:21:04.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.863+0000 7f9ac8c98640 1 --2- 172.21.15.40:0/4278285199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ab0006110 0x7f9ab00085a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:04.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.863+0000 7f95b7fff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95b00d7360 con 0x7f95b004f2f0 2024-04-22T07:21:04.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.863+0000 7f95b67fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f95b004cd20 0x7f95b004d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.863+0000 7f95b67fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f95b004cd20 0x7f95b004d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.40:42098/0 (socket says 172.21.15.40:42098) 2024-04-22T07:21:04.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.863+0000 7f95b67fc640 1 -- 172.21.15.40:0/3890248601 learned_addr learned my addr 172.21.15.40:0/3890248601 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:04.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.863+0000 7f95b7fff640 1 -- 172.21.15.40:0/3890248601 --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f95b004f8b0 con 0x7f95b00d6f80 2024-04-22T07:21:04.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.863+0000 7f9ac9c9a640 1 --2- 172.21.15.40:0/4278285199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ab0008c20 0x7f9ab000b0b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9ac406a730 tx=0x7f9ab0003810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e28d33b5be544c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.863+0000 7f95b7fff640 1 -- 172.21.15.40:0/3890248601 --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f95b00dcd60 con 0x7f95b004cd20 2024-04-22T07:21:04.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.863+0000 7f577e59c640 1 -- 172.21.15.40:0/3718682333 >> v2:172.21.15.62:3300/0 conn(0x7f57800cb9c0 msgr2=0x7f57800cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:04.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.863+0000 7f577e59c640 1 --2- 172.21.15.40:0/3718682333 >> v2:172.21.15.62:3300/0 conn(0x7f57800cb9c0 0x7f57800cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.863+0000 7f577e59c640 1 -- 172.21.15.40:0/3718682333 >> v1:172.21.15.62:6789/0 conn(0x7f57800cc740 legacy=0x7f578015ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:04.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.863+0000 7f577e59c640 1 -- 172.21.15.40:0/3718682333 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f578015e450 con 0x7f57800cb5e0 2024-04-22T07:21:04.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.863+0000 7f96337fe640 1 -- 172.21.15.40:0/2111955833 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9620039070 con 0x7f962c0d5d40 2024-04-22T07:21:04.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.863+0000 7efca359e640 1 --2- 172.21.15.40:0/1386110620 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efca40c6520 0x7efca41664f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.863+0000 7f96337fe640 1 -- 172.21.15.40:0/2111955833 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f962002c980 con 0x7f962c0d5d40 2024-04-22T07:21:04.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.863+0000 7f96337fe640 1 -- 172.21.15.40:0/2111955833 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9620039070 con 0x7f962c0d5d40 2024-04-22T07:21:04.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.863+0000 7f95b6ffd640 1 --2- 172.21.15.40:0/3890248601 >> v2:172.21.15.40:3300/0 conn(0x7f95b00d6f80 0x7f95b004edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.864+0000 7f95b67fc640 1 -- 172.21.15.40:0/3890248601 >> v2:172.21.15.40:3300/0 conn(0x7f95b00d6f80 msgr2=0x7f95b004edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:04.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.864+0000 7f95b67fc640 1 --2- 172.21.15.40:0/3890248601 >> v2:172.21.15.40:3300/0 conn(0x7f95b00d6f80 0x7f95b004edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.864+0000 7f95b67fc640 1 -- 172.21.15.40:0/3890248601 >> v1:172.21.15.40:6789/0 conn(0x7f95b004f2f0 legacy=0x7f95b0047850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:04.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.864+0000 7f95b67fc640 1 -- 172.21.15.40:0/3890248601 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b00dd040 con 0x7f95b004cd20 2024-04-22T07:21:04.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.864+0000 7fef3cd6a640 1 --2- 172.21.15.40:0/393215815 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fef380cc290 0x7fef3815ab40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fef280097d0 tx=0x7fef2802b9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10111d8f67134c1d server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.864+0000 7fb56e7fc640 1 --2- 172.21.15.40:0/1112860996 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5680e2e10 0x7fb568005ee0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb5600098a0 tx=0x7fb56002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c941cb3ad80d769 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.864+0000 7efca359e640 1 -- 172.21.15.40:0/1386110620 >> v1:172.21.15.62:6789/0 conn(0x7efca4155130 legacy=0x7efca40c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.864+0000 7efca359e640 1 -- 172.21.15.40:0/1386110620 >> v1:172.21.15.40:6789/0 conn(0x7efca4154d50 legacy=0x7efca40d07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.864+0000 7efca359e640 1 -- 172.21.15.40:0/1386110620 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca4072fe0 con 0x7efca40c6520 2024-04-22T07:21:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.864+0000 7fef377fe640 1 -- 172.21.15.40:0/393215815 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef28034070 con 0x7fef380cc290 2024-04-22T07:21:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.864+0000 7fb56dffb640 1 -- 172.21.15.40:0/1112860996 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb560035020 con 0x7fb5680e2e10 2024-04-22T07:21:04.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.864+0000 7fef377fe640 1 -- 172.21.15.40:0/393215815 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef28030890 con 0x7fef380cc290 2024-04-22T07:21:04.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.864+0000 7f0f50bad640 1 --2- 172.21.15.40:0/161668497 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f4c154ce0 0x7f0f4c15aa70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0097d0 tx=0x7f0f3c02b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f49cd6e2774fd205 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.864+0000 7fef377fe640 1 -- 172.21.15.40:0/393215815 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef28030c60 con 0x7fef380cc290 2024-04-22T07:21:04.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.864+0000 7fb56dffb640 1 -- 172.21.15.40:0/1112860996 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb560031640 con 0x7fb5680e2e10 2024-04-22T07:21:04.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.864+0000 7fb56dffb640 1 -- 172.21.15.40:0/1112860996 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56002d040 con 0x7fb5680e2e10 2024-04-22T07:21:04.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.864+0000 7f9639af2640 1 -- 172.21.15.40:0/2111955833 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f962c0d5d40 msgr2=0x7f962c04c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.864+0000 7f9639af2640 1 --2- 172.21.15.40:0/2111955833 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f962c0d5d40 0x7f962c04c490 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9620010bc0 tx=0x7f962002bbd0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.864+0000 7f9639af2640 1 -- 172.21.15.40:0/2111955833 shutdown_connections 2024-04-22T07:21:04.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.864+0000 7f9639af2640 1 --2- 172.21.15.40:0/2111955833 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f962c0d5d40 0x7f962c04c490 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.864+0000 7f9639af2640 1 -- 172.21.15.40:0/2111955833 >> 172.21.15.40:0/2111955833 conn(0x7f962c051310 msgr2=0x7f962c051720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:04.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.864+0000 7f577e59c640 1 --2- 172.21.15.40:0/3718682333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57800cb5e0 0x7f57800b3130 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f57800c7550 tx=0x7f577002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d526839e527f9272 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.864+0000 7f9639af2640 1 -- 172.21.15.40:0/2111955833 shutdown_connections 2024-04-22T07:21:04.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.865+0000 7f9639af2640 1 -- 172.21.15.40:0/2111955833 wait complete. 2024-04-22T07:21:04.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.865+0000 7f577dd9b640 1 -- 172.21.15.40:0/3718682333 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5770035020 con 0x7f57800cb5e0 2024-04-22T07:21:04.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.865+0000 7f9abbfff640 1 -- 172.21.15.40:0/4278285199 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac40b5070 con 0x7f9ab0008c20 2024-04-22T07:21:04.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.865+0000 7f577dd9b640 1 -- 172.21.15.40:0/3718682333 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5770031830 con 0x7f57800cb5e0 2024-04-22T07:21:04.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.865+0000 7f95b67fc640 1 --2- 172.21.15.40:0/3890248601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95b004cd20 0x7f95b004d680 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f95b8075df0 tx=0x7f95b80a7b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc1a8809f34c459f server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.865+0000 7f9abbfff640 1 -- 172.21.15.40:0/4278285199 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ac40a8e00 con 0x7f9ab0008c20 2024-04-22T07:21:04.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.865+0000 7f9abbfff640 1 -- 172.21.15.40:0/4278285199 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac404fce0 con 0x7f9ab0008c20 2024-04-22T07:21:04.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.865+0000 7f95b5ffb640 1 -- 172.21.15.40:0/3890248601 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b80b5070 con 0x7f95b004cd20 2024-04-22T07:21:04.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.865+0000 7f95b5ffb640 1 -- 172.21.15.40:0/3890248601 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95b80a8a40 con 0x7f95b004cd20 2024-04-22T07:21:04.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.865+0000 7f95b5ffb640 1 -- 172.21.15.40:0/3890248601 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b80b0440 con 0x7f95b004cd20 2024-04-22T07:21:04.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.865+0000 7fef3dd6c640 1 -- 172.21.15.40:0/393215815 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fef380cc290 msgr2=0x7fef3815ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.865+0000 7fb5755ca640 1 -- 172.21.15.40:0/1112860996 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5680e2e10 msgr2=0x7fb568005ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.865+0000 7fb5755ca640 1 --2- 172.21.15.40:0/1112860996 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5680e2e10 0x7fb568005ee0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb5600098a0 tx=0x7fb56002b8f0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.865+0000 7f0f4b7fe640 1 -- 172.21.15.40:0/161668497 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c034070 con 0x7f0f4c154ce0 2024-04-22T07:21:04.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.865+0000 7fb5755ca640 1 -- 172.21.15.40:0/1112860996 shutdown_connections 2024-04-22T07:21:04.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.865+0000 7fb5755ca640 1 --2- 172.21.15.40:0/1112860996 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5680e2e10 0x7fb568005ee0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.865+0000 7fb5755ca640 1 --2- 172.21.15.40:0/1112860996 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5680e2510 0x7fb568046870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.865+0000 7fb5755ca640 1 -- 172.21.15.40:0/1112860996 >> 172.21.15.40:0/1112860996 conn(0x7fb568050180 msgr2=0x7fb568050590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:04.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7f9aca49b640 1 -- 172.21.15.40:0/4278285199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ab0008c20 msgr2=0x7f9ab000b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7f9aca49b640 1 --2- 172.21.15.40:0/4278285199 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ab0008c20 0x7f9ab000b0b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9ac406a730 tx=0x7f9ab0003810 comp rx=0 tx=0).stop 2024-04-22T07:21:04.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.865+0000 7fb5755ca640 1 -- 172.21.15.40:0/1112860996 shutdown_connections 2024-04-22T07:21:04.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.865+0000 7f0f4b7fe640 1 -- 172.21.15.40:0/161668497 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f3c030800 con 0x7f0f4c154ce0 2024-04-22T07:21:04.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7f0f4b7fe640 1 -- 172.21.15.40:0/161668497 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c030bd0 con 0x7f0f4c154ce0 2024-04-22T07:21:04.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7f577f59e640 1 -- 172.21.15.40:0/3718682333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57800cb5e0 msgr2=0x7f57800b3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7f577dd9b640 1 -- 172.21.15.40:0/3718682333 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5770035020 con 0x7f57800cb5e0 2024-04-22T07:21:04.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7f9ac9c9a640 1 -- 172.21.15.40:0/4278285199 reap_dead start 2024-04-22T07:21:04.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7f9aca49b640 1 -- 172.21.15.40:0/4278285199 shutdown_connections 2024-04-22T07:21:04.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7f9aca49b640 1 -- 172.21.15.40:0/4278285199 >> 172.21.15.40:0/4278285199 conn(0x7f9abc050180 msgr2=0x7f9abc050590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:04.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7efca359e640 1 --2- 172.21.15.40:0/1386110620 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efca40c6520 0x7efca41664f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efc98009750 tx=0x7efc9802b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=288b82cf9c44ab5e server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7f577f59e640 1 --2- 172.21.15.40:0/3718682333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57800cb5e0 0x7f57800b3130 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f57800c7550 tx=0x7f577002b8d0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7f95b7fff640 1 -- 172.21.15.40:0/3890248601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95b004cd20 msgr2=0x7f95b004d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7f95b7fff640 1 --2- 172.21.15.40:0/3890248601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95b004cd20 0x7f95b004d680 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f95b8075df0 tx=0x7f95b80a7b90 comp rx=0 tx=0).stop 2024-04-22T07:21:04.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.865+0000 7fef3dd6c640 1 --2- 172.21.15.40:0/393215815 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fef380cc290 0x7fef3815ab40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fef280097d0 tx=0x7fef2802b9d0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7efca1d9b640 1 -- 172.21.15.40:0/1386110620 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc98039070 con 0x7efca40c6520 2024-04-22T07:21:04.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7efca1d9b640 1 -- 172.21.15.40:0/1386110620 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc980314f0 con 0x7efca40c6520 2024-04-22T07:21:04.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7f95b7fff640 1 -- 172.21.15.40:0/3890248601 shutdown_connections 2024-04-22T07:21:04.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7f95b7fff640 1 --2- 172.21.15.40:0/3890248601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95b004cd20 0x7f95b004d680 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7f95b7fff640 1 --2- 172.21.15.40:0/3890248601 >> v2:172.21.15.40:3300/0 conn(0x7f95b00d6f80 0x7f95b004edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7f95b7fff640 1 -- 172.21.15.40:0/3890248601 >> 172.21.15.40:0/3890248601 conn(0x7f95b000e6a0 msgr2=0x7f95b0009dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:04.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7f95b7fff640 1 -- 172.21.15.40:0/3890248601 shutdown_connections 2024-04-22T07:21:04.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7fef3dd6c640 1 -- 172.21.15.40:0/393215815 shutdown_connections 2024-04-22T07:21:04.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7fef3dd6c640 1 --2- 172.21.15.40:0/393215815 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fef380cc290 0x7fef3815ab40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7fef3dd6c640 1 -- 172.21.15.40:0/393215815 >> 172.21.15.40:0/393215815 conn(0x7fef3806f5c0 msgr2=0x7fef3806f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:04.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7f9aca49b640 1 -- 172.21.15.40:0/4278285199 shutdown_connections 2024-04-22T07:21:04.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7f95b7fff640 1 -- 172.21.15.40:0/3890248601 wait complete. 2024-04-22T07:21:04.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7f9639af2640 1 Processor -- start 2024-04-22T07:21:04.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7efca1d9b640 1 -- 172.21.15.40:0/1386110620 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c001670 con 0x7efca40c6520 2024-04-22T07:21:04.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7fef3dd6c640 1 -- 172.21.15.40:0/393215815 shutdown_connections 2024-04-22T07:21:04.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7f9639af2640 1 -- start start 2024-04-22T07:21:04.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7f9aca49b640 1 -- 172.21.15.40:0/4278285199 wait complete. 2024-04-22T07:21:04.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7f0f51baf640 1 -- 172.21.15.40:0/161668497 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f4c154ce0 msgr2=0x7f0f4c15aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7f0f51baf640 1 --2- 172.21.15.40:0/161668497 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f4c154ce0 0x7f0f4c15aa70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0097d0 tx=0x7f0f3c02b940 comp rx=0 tx=0).stop 2024-04-22T07:21:04.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.867+0000 7f0f51baf640 1 -- 172.21.15.40:0/161668497 shutdown_connections 2024-04-22T07:21:04.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.867+0000 7f0f51baf640 1 --2- 172.21.15.40:0/161668497 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f4c154ce0 0x7f0f4c15aa70 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0097d0 tx=0x7f0f3c02b940 comp rx=0 tx=0).stop 2024-04-22T07:21:04.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.867+0000 7f0f51baf640 1 -- 172.21.15.40:0/161668497 >> 172.21.15.40:0/161668497 conn(0x7f0f4c06f210 msgr2=0x7f0f4c06f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:04.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7fef3dd6c640 1 -- 172.21.15.40:0/393215815 wait complete. 2024-04-22T07:21:04.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7f577f59e640 1 -- 172.21.15.40:0/3718682333 shutdown_connections 2024-04-22T07:21:04.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7f577f59e640 1 --2- 172.21.15.40:0/3718682333 >> v2:172.21.15.62:3300/0 conn(0x7f57800cb9c0 0x7f57800cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7f577f59e640 1 --2- 172.21.15.40:0/3718682333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57800cb5e0 0x7f57800b3130 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7f577f59e640 1 -- 172.21.15.40:0/3718682333 >> 172.21.15.40:0/3718682333 conn(0x7f57800d04d0 msgr2=0x7f57800d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:04.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.866+0000 7fb5755ca640 1 -- 172.21.15.40:0/1112860996 wait complete. 2024-04-22T07:21:04.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.867+0000 7f0f51baf640 1 -- 172.21.15.40:0/161668497 shutdown_connections 2024-04-22T07:21:04.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.867+0000 7efca8898640 1 -- 172.21.15.40:0/1386110620 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efca40c6520 msgr2=0x7efca41664f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.867+0000 7efca8898640 1 --2- 172.21.15.40:0/1386110620 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efca40c6520 0x7efca41664f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efc98009750 tx=0x7efc9802b790 comp rx=0 tx=0).stop 2024-04-22T07:21:04.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.867+0000 7f577f59e640 1 -- 172.21.15.40:0/3718682333 shutdown_connections 2024-04-22T07:21:04.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.867+0000 7f0f51baf640 1 -- 172.21.15.40:0/161668497 wait complete. 2024-04-22T07:21:04.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.867+0000 7fb5755ca640 1 Processor -- start 2024-04-22T07:21:04.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.868+0000 7fb5755ca640 1 -- start start 2024-04-22T07:21:04.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.868+0000 7f9639af2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f962c046ac0 0x7f962c0dc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.867+0000 7f577f59e640 1 -- 172.21.15.40:0/3718682333 wait complete. 2024-04-22T07:21:04.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.868+0000 7fef3dd6c640 1 Processor -- start 2024-04-22T07:21:04.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.868+0000 7f9639af2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f962c04d820 0x7f962c0d9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.868+0000 7f95b7fff640 1 Processor -- start 2024-04-22T07:21:04.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.868+0000 7f9639af2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f962c0d5d40 0x7f962c0d9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.868+0000 7fef3dd6c640 1 -- start start 2024-04-22T07:21:04.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.868+0000 7f95b7fff640 1 -- start start 2024-04-22T07:21:04.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.868+0000 7f9639af2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f962c0d6120 con 0x7f962c0d5d40 2024-04-22T07:21:04.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.868+0000 7f9639af2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f962c0092c0 con 0x7f962c04d820 2024-04-22T07:21:04.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.868+0000 7f9639af2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f962c0dd5c0 con 0x7f962c046ac0 2024-04-22T07:21:04.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.868+0000 7f96392f1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f962c0d5d40 0x7f962c0d9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.868+0000 7f96392f1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f962c0d5d40 0x7f962c0d9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42172/0 (socket says 172.21.15.40:42172) 2024-04-22T07:21:04.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.868+0000 7f96392f1640 1 -- 172.21.15.40:0/2982487196 learned_addr learned my addr 172.21.15.40:0/2982487196 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:04.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.869+0000 7f0f51baf640 1 Processor -- start 2024-04-22T07:21:04.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.869+0000 7f0f51baf640 1 -- start start 2024-04-22T07:21:04.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.869+0000 7f9633fff640 1 --2- 172.21.15.40:0/2982487196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f962c04d820 0x7f962c0d9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.869+0000 7f9638af0640 1 --2- 172.21.15.40:0/2982487196 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f962c046ac0 0x7f962c0dc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.869+0000 7f9aca49b640 1 Processor -- start 2024-04-22T07:21:04.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.869+0000 7fb5755ca640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5680e2510 0x7fb568031390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.869+0000 7f9aca49b640 1 -- start start 2024-04-22T07:21:04.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.869+0000 7f96392f1640 1 -- 172.21.15.40:0/2982487196 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f962c046ac0 msgr2=0x7f962c0dc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.869+0000 7f96392f1640 1 --2- 172.21.15.40:0/2982487196 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f962c046ac0 0x7f962c0dc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.869+0000 7f96392f1640 1 -- 172.21.15.40:0/2982487196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f962c04d820 msgr2=0x7f962c0d9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.869+0000 7f96392f1640 1 --2- 172.21.15.40:0/2982487196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f962c04d820 0x7f962c0d9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.869+0000 7f96392f1640 1 -- 172.21.15.40:0/2982487196 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f962c0d8610 con 0x7f962c0d5d40 2024-04-22T07:21:04.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.869+0000 7fb5755ca640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5680e28f0 0x7fb5681818e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.869+0000 7fb5755ca640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5680e2e10 0x7fb568181e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.869+0000 7f577f59e640 1 Processor -- start 2024-04-22T07:21:04.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.869+0000 7fb5755ca640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb56804aee0 con 0x7fb5680e2510 2024-04-22T07:21:04.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.869+0000 7fb5755ca640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb568046350 con 0x7fb5680e2e10 2024-04-22T07:21:04.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.869+0000 7fb5755ca640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb56804b060 con 0x7fb5680e28f0 2024-04-22T07:21:04.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.869+0000 7fef3dd6c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef380716b0 0x7fef381551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.869+0000 7fb56e7fc640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5680e28f0 0x7fb5681818e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7fb56effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5680e2510 0x7fb568031390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7fb56e7fc640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5680e28f0 0x7fb5681818e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.40:50292/0 (socket says 172.21.15.40:50292) 2024-04-22T07:21:04.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7fb56e7fc640 1 -- 172.21.15.40:0/1327137159 learned_addr learned my addr 172.21.15.40:0/1327137159 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:04.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7efca8898640 1 -- 172.21.15.40:0/1386110620 shutdown_connections 2024-04-22T07:21:04.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7efca8898640 1 --2- 172.21.15.40:0/1386110620 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efca40c6520 0x7efca41664f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7efca8898640 1 -- 172.21.15.40:0/1386110620 >> 172.21.15.40:0/1386110620 conn(0x7efca40676b0 msgr2=0x7efca4067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:04.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7efca8898640 1 -- 172.21.15.40:0/1386110620 shutdown_connections 2024-04-22T07:21:04.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7f95b7fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95b004cd20 0x7f95b0035d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7f95b7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95b004f2f0 0x7f95b00d07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7f95b7fff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95b00d6f80 0x7f95b0172aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.869+0000 7f577f59e640 1 -- start start 2024-04-22T07:21:04.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7f96392f1640 1 --2- 172.21.15.40:0/2982487196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f962c0d5d40 0x7f962c0d9fb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9634069a50 tx=0x7f9634068ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7f96317fa640 1 -- 172.21.15.40:0/2982487196 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96340924b0 con 0x7f962c0d5d40 2024-04-22T07:21:04.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7f96317fa640 1 -- 172.21.15.40:0/2982487196 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9634092650 con 0x7f962c0d5d40 2024-04-22T07:21:04.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7f96317fa640 1 -- 172.21.15.40:0/2982487196 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9634092a40 con 0x7f962c0d5d40 2024-04-22T07:21:04.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7f9639af2640 1 -- 172.21.15.40:0/2982487196 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f962c0d67c0 con 0x7f962c0d5d40 2024-04-22T07:21:04.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7f9639af2640 1 -- 172.21.15.40:0/2982487196 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f962c0d6d80 con 0x7f962c0d5d40 2024-04-22T07:21:04.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7f95b7fff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f95b00dd8e0 con 0x7f95b004f2f0 2024-04-22T07:21:04.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7f95b7fff640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f95b00dd600 con 0x7f95b004cd20 2024-04-22T07:21:04.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7f95b7fff640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f95b0047f60 con 0x7f95b00d6f80 2024-04-22T07:21:04.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7f95b77fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95b00d6f80 0x7f95b0172aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7f95b67fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95b004f2f0 0x7f95b00d07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7f95b77fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95b00d6f80 0x7f95b0172aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.40:50304/0 (socket says 172.21.15.40:50304) 2024-04-22T07:21:04.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7f95b77fe640 1 -- 172.21.15.40:0/570637351 learned_addr learned my addr 172.21.15.40:0/570637351 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:04.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f9aca49b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ab0008c20 0x7f9abc16b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7fef3dd6c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef380cc290 0x7fef38149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f0f51baf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f4c071700 0x7f0f4c1f8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7fef3dd6c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fef381571f0 0x7fef380cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f577f59e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57800cb9c0 0x7f578006dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7fef3dd6c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fef3806eaf0 con 0x7fef380716b0 2024-04-22T07:21:04.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f0f51baf640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f4c0727d0 0x7f0f4c14ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f9aca49b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9abc16cd10 0x7f9abc0d9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f577f59e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f57800cc740 0x7f578006e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f577f59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57800c8a70 0x7f57800c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f577f59e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f578015ecf0 con 0x7f57800c8a70 2024-04-22T07:21:04.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f577f59e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f578015ea10 con 0x7f57800cb9c0 2024-04-22T07:21:04.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f577f59e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f578015f210 con 0x7f57800cc740 2024-04-22T07:21:04.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f9aca49b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9abc17aa60 0x7f9abc17aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7fef37fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef380cc290 0x7fef38149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f577e59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57800cb9c0 0x7f578006dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f577e59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57800cb9c0 0x7f578006dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.40:42126/0 (socket says 172.21.15.40:42126) 2024-04-22T07:21:04.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f0f51baf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f4c14f7b0 0x7f0f4c150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f577e59c640 1 -- 172.21.15.40:0/596480104 learned_addr learned my addr 172.21.15.40:0/596480104 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7fef37fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef380cc290 0x7fef38149d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.40:42114/0 (socket says 172.21.15.40:42114) 2024-04-22T07:21:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7fef37fff640 1 -- 172.21.15.40:0/3880998963 learned_addr learned my addr 172.21.15.40:0/3880998963 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f0f4bfff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f4c0727d0 0x7f0f4c14ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f0f4bfff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f4c0727d0 0x7f0f4c14ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.40:50332/0 (socket says 172.21.15.40:50332) 2024-04-22T07:21:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f0f4bfff640 1 -- 172.21.15.40:0/2546909710 learned_addr learned my addr 172.21.15.40:0/2546909710 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:04.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f9ac9499640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ab0008c20 0x7f9abc16b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f9aca49b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc04bd00 con 0x7f9ab0008c20 2024-04-22T07:21:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f9ac9499640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ab0008c20 0x7f9abc16b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42206/0 (socket says 172.21.15.40:42206) 2024-04-22T07:21:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f9aca49b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc007480 con 0x7f9abc17aa60 2024-04-22T07:21:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f9ac9499640 1 -- 172.21.15.40:0/403285132 learned_addr learned my addr 172.21.15.40:0/403285132 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f9ac9c9a640 1 --2- 172.21.15.40:0/403285132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9abc17aa60 0x7f9abc17aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f0f513ae640 1 --2- 172.21.15.40:0/2546909710 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f4c14f7b0 0x7f0f4c150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f9aca49b640 1 -- 172.21.15.40:0/403285132 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9abc0d5000 con 0x7f9abc16cd10 2024-04-22T07:21:04.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f0f51baf640 1 -- 172.21.15.40:0/2546909710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4c1550c0 con 0x7f0f4c071700 2024-04-22T07:21:04.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f0f51baf640 1 -- 172.21.15.40:0/2546909710 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4c071fd0 con 0x7f0f4c14f7b0 2024-04-22T07:21:04.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f0f51baf640 1 -- 172.21.15.40:0/2546909710 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0f4c155240 con 0x7f0f4c0727d0 2024-04-22T07:21:04.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f5775d9b640 1 --2- 172.21.15.40:0/596480104 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f57800cc740 0x7f578006e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f577ed9d640 1 --2- 172.21.15.40:0/596480104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57800c8a70 0x7f57800c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7fef3d56b640 1 --2- 172.21.15.40:0/3880998963 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fef381571f0 0x7fef380cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f95b6ffd640 1 --2- 172.21.15.40:0/570637351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95b004cd20 0x7f95b0035d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7fef3cd6a640 1 --2- 172.21.15.40:0/3880998963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef380716b0 0x7fef381551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f9ac8c98640 1 --2- 172.21.15.40:0/403285132 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9abc16cd10 0x7f9abc0d9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7fef3dd6c640 1 -- 172.21.15.40:0/3880998963 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fef38156cd0 con 0x7fef380cc290 2024-04-22T07:21:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f95b77fe640 1 -- 172.21.15.40:0/570637351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95b004cd20 msgr2=0x7f95b0035d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f95b77fe640 1 --2- 172.21.15.40:0/570637351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95b004cd20 0x7f95b0035d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7f95b77fe640 1 -- 172.21.15.40:0/570637351 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95b004f2f0 msgr2=0x7f95b00d07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.872+0000 7f95b77fe640 1 --2- 172.21.15.40:0/570637351 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95b004f2f0 0x7f95b00d07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.872+0000 7f95b77fe640 1 -- 172.21.15.40:0/570637351 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b0175f90 con 0x7f95b00d6f80 2024-04-22T07:21:04.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7fef3dd6c640 1 -- 172.21.15.40:0/3880998963 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fef3806ec70 con 0x7fef381571f0 2024-04-22T07:21:04.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7fb56effd640 1 -- 172.21.15.40:0/1327137159 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5680e28f0 msgr2=0x7fb5681818e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7fb56effd640 1 --2- 172.21.15.40:0/1327137159 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb5680e28f0 0x7fb5681818e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7fb56effd640 1 -- 172.21.15.40:0/1327137159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5680e2e10 msgr2=0x7fb568181e20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-22T07:21:04.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7fb56effd640 1 --2- 172.21.15.40:0/1327137159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb5680e2e10 0x7fb568181e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7fb56effd640 1 -- 172.21.15.40:0/1327137159 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5680dd820 con 0x7fb5680e2510 2024-04-22T07:21:04.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7fef37fff640 1 -- 172.21.15.40:0/3880998963 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fef381571f0 msgr2=0x7fef380cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7fef37fff640 1 --2- 172.21.15.40:0/3880998963 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fef381571f0 0x7fef380cb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7fef37fff640 1 -- 172.21.15.40:0/3880998963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef380716b0 msgr2=0x7fef381551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7fef37fff640 1 --2- 172.21.15.40:0/3880998963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef380716b0 0x7fef381551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.871+0000 7fef37fff640 1 -- 172.21.15.40:0/3880998963 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef38155b90 con 0x7fef380cc290 2024-04-22T07:21:04.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.872+0000 7f9ac9c9a640 1 -- 172.21.15.40:0/403285132 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9abc16cd10 msgr2=0x7f9abc0d9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.872+0000 7f9ac9c9a640 1 --2- 172.21.15.40:0/403285132 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9abc16cd10 0x7f9abc0d9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.872+0000 7f9ac9c9a640 1 -- 172.21.15.40:0/403285132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ab0008c20 msgr2=0x7f9abc16b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.872+0000 7f0f513ae640 1 -- 172.21.15.40:0/2546909710 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f4c0727d0 msgr2=0x7f0f4c14ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.872+0000 7f0f513ae640 1 --2- 172.21.15.40:0/2546909710 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0f4c0727d0 0x7f0f4c14ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.872+0000 7f0f50bad640 1 --2- 172.21.15.40:0/2546909710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f4c071700 0x7f0f4c1f8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.872+0000 7f0f513ae640 1 -- 172.21.15.40:0/2546909710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f4c071700 msgr2=0x7f0f4c1f8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.872+0000 7f0f513ae640 1 --2- 172.21.15.40:0/2546909710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f4c071700 0x7f0f4c1f8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.872+0000 7f0f513ae640 1 -- 172.21.15.40:0/2546909710 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4c1f83c0 con 0x7f0f4c14f7b0 2024-04-22T07:21:04.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.872+0000 7f577e59c640 1 -- 172.21.15.40:0/596480104 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f57800cc740 msgr2=0x7f578006e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.872+0000 7f577e59c640 1 --2- 172.21.15.40:0/596480104 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f57800cc740 0x7f578006e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.872+0000 7f577e59c640 1 -- 172.21.15.40:0/596480104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57800c8a70 msgr2=0x7f57800c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.872+0000 7f0f50bad640 1 --2- 172.21.15.40:0/2546909710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f4c071700 0x7f0f4c1f8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:04.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.872+0000 7f577e59c640 1 --2- 172.21.15.40:0/596480104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57800c8a70 0x7f57800c9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.872+0000 7f577e59c640 1 -- 172.21.15.40:0/596480104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57800c6a70 con 0x7f57800cb9c0 2024-04-22T07:21:04.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.872+0000 7fef37fff640 1 --2- 172.21.15.40:0/3880998963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef380cc290 0x7fef38149d60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fef3000c7a0 tx=0x7fef3000cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.872+0000 7f9ac9c9a640 1 --2- 172.21.15.40:0/403285132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ab0008c20 0x7f9abc16b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.872+0000 7f9ac9c9a640 1 -- 172.21.15.40:0/403285132 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9abc17b420 con 0x7f9abc17aa60 2024-04-22T07:21:04.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.872+0000 7f9ac9499640 1 --2- 172.21.15.40:0/403285132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ab0008c20 0x7f9abc16b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:21:04.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.872+0000 7f577e59c640 1 --2- 172.21.15.40:0/596480104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57800cb9c0 0x7f578006dda0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f577002b910 tx=0x7f57700046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.872+0000 7fef357fa640 1 -- 172.21.15.40:0/3880998963 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef30003b70 con 0x7fef380cc290 2024-04-22T07:21:04.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.872+0000 7fef357fa640 1 -- 172.21.15.40:0/3880998963 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef30003d10 con 0x7fef380cc290 2024-04-22T07:21:04.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.872+0000 7fef357fa640 1 -- 172.21.15.40:0/3880998963 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3000aa90 con 0x7fef380cc290 2024-04-22T07:21:04.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.870+0000 7efca8898640 1 -- 172.21.15.40:0/1386110620 wait complete. 2024-04-22T07:21:04.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.872+0000 7f0f513ae640 1 --2- 172.21.15.40:0/2546909710 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f4c14f7b0 0x7f0f4c150440 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400cad0 tx=0x7f0f4400cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.873+0000 7fef3dd6c640 1 -- 172.21.15.40:0/3880998963 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef38155e30 con 0x7fef380cc290 2024-04-22T07:21:04.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.873+0000 7efca8898640 1 Processor -- start 2024-04-22T07:21:04.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.873+0000 7f9ac9c9a640 1 --2- 172.21.15.40:0/403285132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9abc17aa60 0x7f9abc17aee0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4063510 tx=0x7f9ac40698a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.872+0000 7f95b77fe640 1 --2- 172.21.15.40:0/570637351 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95b00d6f80 0x7f95b0172aa0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0041f0 tx=0x7f95ac014420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.873+0000 7f959f7fe640 1 -- 172.21.15.40:0/570637351 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac014ab0 con 0x7f95b00d6f80 2024-04-22T07:21:04.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.873+0000 7f95b7fff640 1 -- 172.21.15.40:0/570637351 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95b0176270 con 0x7f95b00d6f80 2024-04-22T07:21:04.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.873+0000 7f95b7fff640 1 -- 172.21.15.40:0/570637351 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f95b0176830 con 0x7f95b00d6f80 2024-04-22T07:21:04.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.873+0000 7f57777fe640 1 -- 172.21.15.40:0/596480104 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5770035040 con 0x7f57800cb9c0 2024-04-22T07:21:04.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.873+0000 7f57777fe640 1 -- 172.21.15.40:0/596480104 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5770031650 con 0x7f57800cb9c0 2024-04-22T07:21:04.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.873+0000 7fef3dd6c640 1 -- 172.21.15.40:0/3880998963 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef381563d0 con 0x7fef380cc290 2024-04-22T07:21:04.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.873+0000 7efca8898640 1 -- start start 2024-04-22T07:21:04.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.874+0000 7f96317fa640 1 -- 172.21.15.40:0/2982487196 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9634092be0 con 0x7f962c0d5d40 2024-04-22T07:21:04.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.874+0000 7efca8898640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efca40c6520 0x7efca40cf270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.874+0000 7fef3dd6c640 1 -- 172.21.15.40:0/3880998963 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fef3804fce0 con 0x7fef380cc290 2024-04-22T07:21:04.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.874+0000 7f959f7fe640 1 -- 172.21.15.40:0/570637351 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95ac014c50 con 0x7f95b00d6f80 2024-04-22T07:21:04.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.872+0000 7fb56effd640 1 --2- 172.21.15.40:0/1327137159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5680e2510 0x7fb568031390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb56400d550 tx=0x7fb56400da10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.873+0000 7fb5577fe640 1 -- 172.21.15.40:0/1327137159 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5640125f0 con 0x7fb5680e2510 2024-04-22T07:21:04.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.873+0000 7fb5577fe640 1 -- 172.21.15.40:0/1327137159 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb564019070 con 0x7fb5680e2510 2024-04-22T07:21:04.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.873+0000 7fb5577fe640 1 -- 172.21.15.40:0/1327137159 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5640129b0 con 0x7fb5680e2510 2024-04-22T07:21:04.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.873+0000 7fb5755ca640 1 -- 172.21.15.40:0/1327137159 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5680d29b0 con 0x7fb5680e2510 2024-04-22T07:21:04.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.873+0000 7fb5755ca640 1 -- 172.21.15.40:0/1327137159 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5680ddda0 con 0x7fb5680e2510 2024-04-22T07:21:04.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.874+0000 7efca8898640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efca4154d50 0x7efca41fdf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.874+0000 7efca8898640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efca4155130 0x7efca415d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.874+0000 7efca8898640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7efca40d0ef0 con 0x7efca4155130 2024-04-22T07:21:04.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.874+0000 7efca8898640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efca40c58f0 con 0x7efca4154d50 2024-04-22T07:21:04.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.874+0000 7efca8898640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7efca40d1070 con 0x7efca40c6520 2024-04-22T07:21:04.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.874+0000 7f961effd640 1 -- 172.21.15.40:0/2982487196 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f962c0dce10 con 0x7f962c0d5d40 2024-04-22T07:21:04.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.874+0000 7efca2d9d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efca40c6520 0x7efca40cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.874+0000 7efca359e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efca4155130 0x7efca415d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.874+0000 7f96317fa640 1 --2- 172.21.15.40:0/2982487196 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f961806c940 0x7f961806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.874+0000 7efca359e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efca4155130 0x7efca415d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42234/0 (socket says 172.21.15.40:42234) 2024-04-22T07:21:04.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.874+0000 7efca359e640 1 -- 172.21.15.40:0/1766540166 learned_addr learned my addr 172.21.15.40:0/1766540166 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:04.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.875+0000 7f9638af0640 1 --2- 172.21.15.40:0/2982487196 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f961806c940 0x7f961806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.875+0000 7efca259c640 1 --2- 172.21.15.40:0/1766540166 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efca4154d50 0x7efca41fdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.875+0000 7efca359e640 1 -- 172.21.15.40:0/1766540166 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efca40c6520 msgr2=0x7efca40cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.875+0000 7efca359e640 1 --2- 172.21.15.40:0/1766540166 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efca40c6520 0x7efca40cf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.875+0000 7efca359e640 1 -- 172.21.15.40:0/1766540166 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efca4154d50 msgr2=0x7efca41fdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.875+0000 7efca359e640 1 --2- 172.21.15.40:0/1766540166 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efca4154d50 0x7efca41fdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.875+0000 7f959f7fe640 1 -- 172.21.15.40:0/570637351 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac0120d0 con 0x7f95b00d6f80 2024-04-22T07:21:04.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.875+0000 7f96317fa640 1 -- 172.21.15.40:0/2982487196 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f96340d29b0 con 0x7f962c0d5d40 2024-04-22T07:21:04.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.875+0000 7f96317fa640 1 --2- 172.21.15.40:0/2982487196 >> [v2:172.21.15.62:6824/3094315954,v1:172.21.15.62:6825/3094315954] conn(0x7f9618074b60 0x7f9618076f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.875+0000 7f96317fa640 1 -- 172.21.15.40:0/2982487196 --> [v2:172.21.15.62:6824/3094315954,v1:172.21.15.62:6825/3094315954] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9618077630 con 0x7f9618074b60 2024-04-22T07:21:04.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.875+0000 7f96317fa640 1 -- 172.21.15.40:0/2982487196 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f963410c060 con 0x7f962c0d5d40 2024-04-22T07:21:04.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.875+0000 7efca359e640 1 -- 172.21.15.40:0/1766540166 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca41fd470 con 0x7efca4155130 2024-04-22T07:21:04.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.875+0000 7fb5755ca640 1 -- 172.21.15.40:0/1327137159 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb5680d2760 con 0x7fb5680e2510 2024-04-22T07:21:04.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.875+0000 7efca359e640 1 --2- 172.21.15.40:0/1766540166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efca4155130 0x7efca415d6c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efc98009840 tx=0x7efc980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.875+0000 7f9ab9ffb640 1 -- 172.21.15.40:0/403285132 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac40b5040 con 0x7f9abc17aa60 2024-04-22T07:21:04.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.875+0000 7f9ab9ffb640 1 -- 172.21.15.40:0/403285132 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ac4050bd0 con 0x7f9abc17aa60 2024-04-22T07:21:04.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.875+0000 7f9ab9ffb640 1 -- 172.21.15.40:0/403285132 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac404fce0 con 0x7f9abc17aa60 2024-04-22T07:21:04.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.876+0000 7f9aca49b640 1 -- 172.21.15.40:0/403285132 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9abc179340 con 0x7f9abc17aa60 2024-04-22T07:21:04.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.876+0000 7f57777fe640 1 -- 172.21.15.40:0/596480104 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5770003850 con 0x7f57800cb9c0 2024-04-22T07:21:04.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.876+0000 7f9aca49b640 1 -- 172.21.15.40:0/403285132 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9abc179900 con 0x7f9abc17aa60 2024-04-22T07:21:04.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.876+0000 7efc8b7fe640 1 -- 172.21.15.40:0/1766540166 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc98039040 con 0x7efca4155130 2024-04-22T07:21:04.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.876+0000 7efc8b7fe640 1 -- 172.21.15.40:0/1766540166 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc98045070 con 0x7efca4155130 2024-04-22T07:21:04.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.876+0000 7efc8b7fe640 1 -- 172.21.15.40:0/1766540166 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc980346c0 con 0x7efca4155130 2024-04-22T07:21:04.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.876+0000 7f577f59e640 1 -- 172.21.15.40:0/596480104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57801f5a30 con 0x7f57800cb9c0 2024-04-22T07:21:04.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.876+0000 7f577f59e640 1 -- 172.21.15.40:0/596480104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57801f5190 con 0x7f57800cb9c0 2024-04-22T07:21:04.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.875+0000 7fef357fa640 1 -- 172.21.15.40:0/3880998963 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fef3000ac30 con 0x7fef380cc290 2024-04-22T07:21:04.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.876+0000 7fef357fa640 1 --2- 172.21.15.40:0/3880998963 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fef1806c9f0 0x7fef1806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.876+0000 7fef357fa640 1 -- 172.21.15.40:0/3880998963 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fef3008bcc0 con 0x7fef380cc290 2024-04-22T07:21:04.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.876+0000 7fef357fa640 1 --2- 172.21.15.40:0/3880998963 >> [v2:172.21.15.62:6808/3509322231,v1:172.21.15.62:6809/3509322231] conn(0x7fef18074c10 0x7fef18077030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.876+0000 7fef357fa640 1 -- 172.21.15.40:0/3880998963 --> [v2:172.21.15.62:6808/3509322231,v1:172.21.15.62:6809/3509322231] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fef3001ce50 con 0x7fef18074c10 2024-04-22T07:21:04.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.876+0000 7fef357fa640 1 -- 172.21.15.40:0/3880998963 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fef3008c0b0 con 0x7fef380cc290 2024-04-22T07:21:04.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.875+0000 7f9633fff640 1 --2- 172.21.15.40:0/2982487196 >> [v2:172.21.15.62:6824/3094315954,v1:172.21.15.62:6825/3094315954] conn(0x7f9618074b60 0x7f9618076f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.875+0000 7f9638af0640 1 --2- 172.21.15.40:0/2982487196 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f961806c940 0x7f961806ee00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9620036000 tx=0x7f9620030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.876+0000 7efca8898640 1 -- 172.21.15.40:0/1766540166 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efca40ce6d0 con 0x7efca4155130 2024-04-22T07:21:04.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.876+0000 7efca8898640 1 -- 172.21.15.40:0/1766540166 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efca40cec90 con 0x7efca4155130 2024-04-22T07:21:04.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.876+0000 7f959f7fe640 1 -- 172.21.15.40:0/570637351 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f95ac012330 con 0x7f95b00d6f80 2024-04-22T07:21:04.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.876+0000 7fb5577fe640 1 -- 172.21.15.40:0/1327137159 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb564012b50 con 0x7fb5680e2510 2024-04-22T07:21:04.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.876+0000 7fb5577fe640 1 --2- 172.21.15.40:0/1327137159 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fb55c06c9c0 0x7fb55c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.877+0000 7fb5577fe640 1 -- 172.21.15.40:0/1327137159 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb56408bdd0 con 0x7fb5680e2510 2024-04-22T07:21:04.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.877+0000 7fb5577fe640 1 --2- 172.21.15.40:0/1327137159 >> [v2:172.21.15.62:6800/2251435758,v1:172.21.15.62:6801/2251435758] conn(0x7fb55c074b60 0x7fb55c076f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.877+0000 7f95b7fff640 1 -- 172.21.15.40:0/570637351 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f95b0005710 con 0x7f95b00d6f80 2024-04-22T07:21:04.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.875+0000 7f0f497fa640 1 -- 172.21.15.40:0/2546909710 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f44017070 con 0x7f0f4c14f7b0 2024-04-22T07:21:04.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.875+0000 7f0f497fa640 1 -- 172.21.15.40:0/2546909710 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4400ab30 con 0x7f0f4c14f7b0 2024-04-22T07:21:04.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.876+0000 7f0f497fa640 1 -- 172.21.15.40:0/2546909710 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f44012400 con 0x7f0f4c14f7b0 2024-04-22T07:21:04.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.876+0000 7f0f51baf640 1 -- 172.21.15.40:0/2546909710 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f4c1f4f70 con 0x7f0f4c14f7b0 2024-04-22T07:21:04.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.877+0000 7f0f51baf640 1 -- 172.21.15.40:0/2546909710 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f4c1f5530 con 0x7f0f4c14f7b0 2024-04-22T07:21:04.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.877+0000 7f959f7fe640 1 --2- 172.21.15.40:0/570637351 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f95a406c9c0 0x7f95a406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.877+0000 7f9633fff640 1 --2- 172.21.15.40:0/2982487196 >> [v2:172.21.15.62:6824/3094315954,v1:172.21.15.62:6825/3094315954] conn(0x7f9618074b60 0x7f9618076f80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.877+0000 7fb5577fe640 1 -- 172.21.15.40:0/1327137159 --> [v2:172.21.15.62:6800/2251435758,v1:172.21.15.62:6801/2251435758] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb564001d30 con 0x7fb55c074b60 2024-04-22T07:21:04.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.877+0000 7f577f59e640 1 -- 172.21.15.40:0/596480104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f57800c9790 con 0x7f57800cb9c0 2024-04-22T07:21:04.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.877+0000 7efc897fa640 1 -- 172.21.15.40:0/1766540166 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efca404fce0 con 0x7efca4155130 2024-04-22T07:21:04.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.877+0000 7f959f7fe640 1 -- 172.21.15.40:0/570637351 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f95ac093d70 con 0x7f95b00d6f80 2024-04-22T07:21:04.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.877+0000 7f959f7fe640 1 --2- 172.21.15.40:0/570637351 >> [v2:172.21.15.40:6818/1885686505,v1:172.21.15.40:6820/1885686505] conn(0x7f95a4074bc0 0x7f95a4076fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.878+0000 7f959f7fe640 1 -- 172.21.15.40:0/570637351 --> [v2:172.21.15.40:6818/1885686505,v1:172.21.15.40:6820/1885686505] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f95ac014c50 con 0x7f95a4074bc0 2024-04-22T07:21:04.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.878+0000 7f959f7fe640 1 -- 172.21.15.40:0/570637351 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f95ac05dac0 con 0x7f95b00d6f80 2024-04-22T07:21:04.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.878+0000 7f95b6ffd640 1 --2- 172.21.15.40:0/570637351 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f95a406c9c0 0x7f95a406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.877+0000 7fb5577fe640 1 -- 172.21.15.40:0/1327137159 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fb564055d80 con 0x7fb5680e2510 2024-04-22T07:21:04.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.878+0000 7fb56e7fc640 1 --2- 172.21.15.40:0/1327137159 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fb55c06c9c0 0x7fb55c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.878+0000 7fb56f7fe640 1 --2- 172.21.15.40:0/1327137159 >> [v2:172.21.15.62:6800/2251435758,v1:172.21.15.62:6801/2251435758] conn(0x7fb55c074b60 0x7fb55c076f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.878+0000 7fef3cd6a640 1 --2- 172.21.15.40:0/3880998963 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fef1806c9f0 0x7fef1806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.878+0000 7fef3d56b640 1 --2- 172.21.15.40:0/3880998963 >> [v2:172.21.15.62:6808/3509322231,v1:172.21.15.62:6809/3509322231] conn(0x7fef18074c10 0x7fef18077030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.878+0000 7f9aca49b640 1 -- 172.21.15.40:0/403285132 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9abc0052c0 con 0x7f9abc17aa60 2024-04-22T07:21:04.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.879+0000 7efc8b7fe640 1 -- 172.21.15.40:0/1766540166 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efc9803c070 con 0x7efca4155130 2024-04-22T07:21:04.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.878+0000 7f95b67fc640 1 --2- 172.21.15.40:0/570637351 >> [v2:172.21.15.40:6818/1885686505,v1:172.21.15.40:6820/1885686505] conn(0x7f95a4074bc0 0x7f95a4076fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.879+0000 7f95b67fc640 1 --2- 172.21.15.40:0/570637351 >> [v2:172.21.15.40:6818/1885686505,v1:172.21.15.40:6820/1885686505] conn(0x7f95a4074bc0 0x7f95a4076fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.879+0000 7f95b6ffd640 1 --2- 172.21.15.40:0/570637351 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f95a406c9c0 0x7f95a406ee80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f95a8009a30 tx=0x7f95a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.878+0000 7f57777fe640 1 -- 172.21.15.40:0/596480104 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5770038020 con 0x7f57800cb9c0 2024-04-22T07:21:04.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.879+0000 7f57777fe640 1 --2- 172.21.15.40:0/596480104 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f576006c9c0 0x7f576006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.879+0000 7fb56e7fc640 1 --2- 172.21.15.40:0/1327137159 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fb55c06c9c0 0x7fb55c06ee80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb5600090b0 tx=0x7fb56003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.878+0000 7f96317fa640 1 -- 172.21.15.40:0/2982487196 <== osd.6 v2:172.21.15.62:6824/3094315954 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9618077630 con 0x7f9618074b60 2024-04-22T07:21:04.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.879+0000 7f0f51baf640 1 -- 172.21.15.40:0/2546909710 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0f4c149d90 con 0x7f0f4c14f7b0 2024-04-22T07:21:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.879+0000 7f57777fe640 1 -- 172.21.15.40:0/596480104 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f57700adc80 con 0x7f57800cb9c0 2024-04-22T07:21:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.879+0000 7f57777fe640 1 --2- 172.21.15.40:0/596480104 >> [v2:172.21.15.40:6816/130276746,v1:172.21.15.40:6817/130276746] conn(0x7f5760074c40 0x7f5760077060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.879+0000 7f0f497fa640 1 -- 172.21.15.40:0/2546909710 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0f4401a070 con 0x7f0f4c14f7b0 2024-04-22T07:21:04.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.879+0000 7f5775d9b640 1 --2- 172.21.15.40:0/596480104 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f576006c9c0 0x7f576006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.879+0000 7f57777fe640 1 -- 172.21.15.40:0/596480104 --> [v2:172.21.15.40:6816/130276746,v1:172.21.15.40:6817/130276746] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5760077710 con 0x7f5760074c40 2024-04-22T07:21:04.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.880+0000 7f57777fe640 1 -- 172.21.15.40:0/596480104 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f57700ae070 con 0x7f57800cb9c0 2024-04-22T07:21:04.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.880+0000 7f577ed9d640 1 --2- 172.21.15.40:0/596480104 >> [v2:172.21.15.40:6816/130276746,v1:172.21.15.40:6817/130276746] conn(0x7f5760074c40 0x7f5760077060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.879+0000 7efc8b7fe640 1 --2- 172.21.15.40:0/1766540166 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7efc9006c940 0x7efc9006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.880+0000 7efc8b7fe640 1 -- 172.21.15.40:0/1766540166 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7efc980adcd0 con 0x7efca4155130 2024-04-22T07:21:04.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.880+0000 7efc8b7fe640 1 --2- 172.21.15.40:0/1766540166 >> [v2:172.21.15.40:6808/623026645,v1:172.21.15.40:6809/623026645] conn(0x7efc90074bc0 0x7efc90076fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.880+0000 7efc8b7fe640 1 -- 172.21.15.40:0/1766540166 --> [v2:172.21.15.40:6808/623026645,v1:172.21.15.40:6809/623026645] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efc980314f0 con 0x7efc90074bc0 2024-04-22T07:21:04.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.880+0000 7efc8b7fe640 1 -- 172.21.15.40:0/1766540166 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7efc980ae080 con 0x7efca4155130 2024-04-22T07:21:04.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.880+0000 7f0f497fa640 1 --2- 172.21.15.40:0/2546909710 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f0f3806c9f0 0x7f0f3806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.880+0000 7efca2d9d640 1 --2- 172.21.15.40:0/1766540166 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7efc9006c940 0x7efc9006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.880+0000 7f959f7fe640 1 -- 172.21.15.40:0/570637351 <== osd.2 v2:172.21.15.40:6818/1885686505 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f95ac014c50 con 0x7f95a4074bc0 2024-04-22T07:21:04.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.879+0000 7f9ab9ffb640 1 -- 172.21.15.40:0/403285132 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9ac40c0020 con 0x7f9abc17aa60 2024-04-22T07:21:04.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.880+0000 7f9ab9ffb640 1 --2- 172.21.15.40:0/403285132 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9aa806c9b0 0x7f9aa806ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.880+0000 7f9ab9ffb640 1 -- 172.21.15.40:0/403285132 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9ac4128790 con 0x7f9abc17aa60 2024-04-22T07:21:04.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.880+0000 7f5775d9b640 1 --2- 172.21.15.40:0/596480104 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f576006c9c0 0x7f576006ee80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f57800c7480 tx=0x7f5768009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.880+0000 7f577ed9d640 1 --2- 172.21.15.40:0/596480104 >> [v2:172.21.15.40:6816/130276746,v1:172.21.15.40:6817/130276746] conn(0x7f5760074c40 0x7f5760077060 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.880+0000 7f9ab9ffb640 1 --2- 172.21.15.40:0/403285132 >> [v2:172.21.15.40:6800/1526385055,v1:172.21.15.40:6801/1526385055] conn(0x7f9aa8074c30 0x7f9aa8077050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.880+0000 7f9ab9ffb640 1 -- 172.21.15.40:0/403285132 --> [v2:172.21.15.40:6800/1526385055,v1:172.21.15.40:6801/1526385055] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ac40afec0 con 0x7f9aa8074c30 2024-04-22T07:21:04.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.880+0000 7f9ab9ffb640 1 -- 172.21.15.40:0/403285132 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f9ac412f050 con 0x7f9abc17aa60 2024-04-22T07:21:04.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.880+0000 7f0f50bad640 1 --2- 172.21.15.40:0/2546909710 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f0f3806c9f0 0x7f0f3806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.880+0000 7f9ac9499640 1 --2- 172.21.15.40:0/403285132 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9aa806c9b0 0x7f9aa806ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.879+0000 7fef3cd6a640 1 --2- 172.21.15.40:0/3880998963 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fef1806c9f0 0x7fef1806eeb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fef28036000 tx=0x7fef2803b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.880+0000 7fef3d56b640 1 --2- 172.21.15.40:0/3880998963 >> [v2:172.21.15.62:6808/3509322231,v1:172.21.15.62:6809/3509322231] conn(0x7fef18074c10 0x7fef18077030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.880+0000 7efca259c640 1 --2- 172.21.15.40:0/1766540166 >> [v2:172.21.15.40:6808/623026645,v1:172.21.15.40:6809/623026645] conn(0x7efc90074bc0 0x7efc90076fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.881+0000 7fb56f7fe640 1 --2- 172.21.15.40:0/1327137159 >> [v2:172.21.15.62:6800/2251435758,v1:172.21.15.62:6801/2251435758] conn(0x7fb55c074b60 0x7fb55c076f80 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.881+0000 7f9ac8c98640 1 --2- 172.21.15.40:0/403285132 >> [v2:172.21.15.40:6800/1526385055,v1:172.21.15.40:6801/1526385055] conn(0x7f9aa8074c30 0x7f9aa8077050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.881+0000 7f0f497fa640 1 -- 172.21.15.40:0/2546909710 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0f4408b870 con 0x7f0f4c14f7b0 2024-04-22T07:21:04.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.881+0000 7f9ac9499640 1 --2- 172.21.15.40:0/403285132 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9aa806c9b0 0x7f9aa806ee70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4006fd0 tx=0x7f9ab4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.881+0000 7efca259c640 1 --2- 172.21.15.40:0/1766540166 >> [v2:172.21.15.40:6808/623026645,v1:172.21.15.40:6809/623026645] conn(0x7efc90074bc0 0x7efc90076fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.881+0000 7f0f497fa640 1 --2- 172.21.15.40:0/2546909710 >> [v2:172.21.15.62:6816/147453972,v1:172.21.15.62:6817/147453972] conn(0x7f0f38074bf0 0x7f0f38077010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:04.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.881+0000 7f0f497fa640 1 -- 172.21.15.40:0/2546909710 --> [v2:172.21.15.62:6816/147453972,v1:172.21.15.62:6817/147453972] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0f4401dec0 con 0x7f0f38074bf0 2024-04-22T07:21:04.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.881+0000 7f0f50bad640 1 --2- 172.21.15.40:0/2546909710 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f0f3806c9f0 0x7f0f3806eeb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c036000 tx=0x7f0f3c03b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.881+0000 7f0f497fa640 1 -- 172.21.15.40:0/2546909710 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f0f440555e0 con 0x7f0f4c14f7b0 2024-04-22T07:21:04.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.881+0000 7efca2d9d640 1 --2- 172.21.15.40:0/1766540166 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7efc9006c940 0x7efc9006ee00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efc940012e0 tx=0x7efc940016f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.881+0000 7f57777fe640 1 -- 172.21.15.40:0/596480104 <== osd.3 v2:172.21.15.40:6816/130276746 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5760077710 con 0x7f5760074c40 2024-04-22T07:21:04.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.882+0000 7f9ac8c98640 1 --2- 172.21.15.40:0/403285132 >> [v2:172.21.15.40:6800/1526385055,v1:172.21.15.40:6801/1526385055] conn(0x7f9aa8074c30 0x7f9aa8077050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.881+0000 7fef357fa640 1 -- 172.21.15.40:0/3880998963 <== osd.5 v2:172.21.15.62:6808/3509322231 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fef3001ce50 con 0x7fef18074c10 2024-04-22T07:21:04.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.882+0000 7f0f4bfff640 1 --2- 172.21.15.40:0/2546909710 >> [v2:172.21.15.62:6816/147453972,v1:172.21.15.62:6817/147453972] conn(0x7f0f38074bf0 0x7f0f38077010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:04.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.882+0000 7f0f4bfff640 1 --2- 172.21.15.40:0/2546909710 >> [v2:172.21.15.62:6816/147453972,v1:172.21.15.62:6817/147453972] conn(0x7f0f38074bf0 0x7f0f38077010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:04.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.882+0000 7efc8b7fe640 1 -- 172.21.15.40:0/1766540166 <== osd.1 v2:172.21.15.40:6808/623026645 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efc980314f0 con 0x7efc90074bc0 2024-04-22T07:21:04.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.882+0000 7fb5577fe640 1 -- 172.21.15.40:0/1327137159 <== osd.4 v2:172.21.15.62:6800/2251435758 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb564001d30 con 0x7fb55c074b60 2024-04-22T07:21:04.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.883+0000 7f9ab9ffb640 1 -- 172.21.15.40:0/403285132 <== osd.0 v2:172.21.15.40:6800/1526385055 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9ac40afec0 con 0x7f9aa8074c30 2024-04-22T07:21:04.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.885+0000 7f0f497fa640 1 -- 172.21.15.40:0/2546909710 <== osd.7 v2:172.21.15.62:6816/147453972 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0f4401dec0 con 0x7f0f38074bf0 2024-04-22T07:21:04.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.912+0000 7f961effd640 1 -- 172.21.15.40:0/2982487196 --> [v2:172.21.15.62:6824/3094315954,v1:172.21.15.62:6825/3094315954] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f962c0dce10 con 0x7f9618074b60 2024-04-22T07:21:04.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.912+0000 7fb5755ca640 1 -- 172.21.15.40:0/1327137159 --> [v2:172.21.15.62:6800/2251435758,v1:172.21.15.62:6801/2251435758] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb5680052c0 con 0x7fb55c074b60 2024-04-22T07:21:04.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.912+0000 7f96317fa640 1 -- 172.21.15.40:0/2982487196 <== osd.6 v2:172.21.15.62:6824/3094315954 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f96280072c0 con 0x7f9618074b60 2024-04-22T07:21:04.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.913+0000 7fb5577fe640 1 -- 172.21.15.40:0/1327137159 <== osd.4 v2:172.21.15.62:6800/2251435758 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb5680052c0 con 0x7fb55c074b60 2024-04-22T07:21:04.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.913+0000 7f9639af2640 1 -- 172.21.15.40:0/2982487196 >> [v2:172.21.15.62:6824/3094315954,v1:172.21.15.62:6825/3094315954] conn(0x7f9618074b60 msgr2=0x7f9618076f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.913+0000 7f9639af2640 1 --2- 172.21.15.40:0/2982487196 >> [v2:172.21.15.62:6824/3094315954,v1:172.21.15.62:6825/3094315954] conn(0x7f9618074b60 0x7f9618076f80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.913+0000 7f9639af2640 1 -- 172.21.15.40:0/2982487196 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f961806c940 msgr2=0x7f961806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.913+0000 7f9639af2640 1 --2- 172.21.15.40:0/2982487196 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f961806c940 0x7f961806ee00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9620036000 tx=0x7f9620030000 comp rx=0 tx=0).stop 2024-04-22T07:21:04.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.913+0000 7fb5557fa640 1 -- 172.21.15.40:0/1327137159 >> [v2:172.21.15.62:6800/2251435758,v1:172.21.15.62:6801/2251435758] conn(0x7fb55c074b60 msgr2=0x7fb55c076f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.913+0000 7fb5557fa640 1 --2- 172.21.15.40:0/1327137159 >> [v2:172.21.15.62:6800/2251435758,v1:172.21.15.62:6801/2251435758] conn(0x7fb55c074b60 0x7fb55c076f80 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.913+0000 7f9639af2640 1 -- 172.21.15.40:0/2982487196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f962c0d5d40 msgr2=0x7f962c0d9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.913+0000 7f9639af2640 1 --2- 172.21.15.40:0/2982487196 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f962c0d5d40 0x7f962c0d9fb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9634069a50 tx=0x7f9634068ef0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.913+0000 7f95b7fff640 1 -- 172.21.15.40:0/570637351 --> [v2:172.21.15.40:6818/1885686505,v1:172.21.15.40:6820/1885686505] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f95b0005710 con 0x7f95a4074bc0 2024-04-22T07:21:04.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.914+0000 7f96392f1640 1 -- 172.21.15.40:0/2982487196 reap_dead start 2024-04-22T07:21:04.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.914+0000 7f959f7fe640 1 -- 172.21.15.40:0/570637351 <== osd.2 v2:172.21.15.40:6818/1885686505 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f95b0005710 con 0x7f95a4074bc0 2024-04-22T07:21:04.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.914+0000 7fb5557fa640 1 -- 172.21.15.40:0/1327137159 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fb55c06c9c0 msgr2=0x7fb55c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.914+0000 7fb5557fa640 1 --2- 172.21.15.40:0/1327137159 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fb55c06c9c0 0x7fb55c06ee80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb5600090b0 tx=0x7fb56003c040 comp rx=0 tx=0).stop 2024-04-22T07:21:04.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.914+0000 7f9639af2640 1 -- 172.21.15.40:0/2982487196 shutdown_connections 2024-04-22T07:21:04.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.914+0000 7f9639af2640 1 -- 172.21.15.40:0/2982487196 >> 172.21.15.40:0/2982487196 conn(0x7f962c051310 msgr2=0x7f962c007f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:04.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.914+0000 7fb5557fa640 1 -- 172.21.15.40:0/1327137159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5680e2510 msgr2=0x7fb568031390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.914+0000 7fb5557fa640 1 --2- 172.21.15.40:0/1327137159 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5680e2510 0x7fb568031390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb56400d550 tx=0x7fb56400da10 comp rx=0 tx=0).stop 2024-04-22T07:21:04.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.914+0000 7fb56f7fe640 1 -- 172.21.15.40:0/1327137159 reap_dead start 2024-04-22T07:21:04.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.914+0000 7fb5557fa640 1 -- 172.21.15.40:0/1327137159 shutdown_connections 2024-04-22T07:21:04.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.914+0000 7f9639af2640 1 -- 172.21.15.40:0/2982487196 shutdown_connections 2024-04-22T07:21:04.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.914+0000 7f9639af2640 1 -- 172.21.15.40:0/2982487196 wait complete. 2024-04-22T07:21:04.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.914+0000 7fb5557fa640 1 -- 172.21.15.40:0/1327137159 >> 172.21.15.40:0/1327137159 conn(0x7fb568050180 msgr2=0x7fb5680d7230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:04.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.915+0000 7f959d7fa640 1 -- 172.21.15.40:0/570637351 >> [v2:172.21.15.40:6818/1885686505,v1:172.21.15.40:6820/1885686505] conn(0x7f95a4074bc0 msgr2=0x7f95a4076fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.915+0000 7f959d7fa640 1 --2- 172.21.15.40:0/570637351 >> [v2:172.21.15.40:6818/1885686505,v1:172.21.15.40:6820/1885686505] conn(0x7f95a4074bc0 0x7f95a4076fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.915+0000 7fb5557fa640 1 -- 172.21.15.40:0/1327137159 shutdown_connections 2024-04-22T07:21:04.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.915+0000 7f959d7fa640 1 -- 172.21.15.40:0/570637351 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f95a406c9c0 msgr2=0x7f95a406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.915+0000 7f959d7fa640 1 --2- 172.21.15.40:0/570637351 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f95a406c9c0 0x7f95a406ee80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f95a8009a30 tx=0x7f95a8008040 comp rx=0 tx=0).stop 2024-04-22T07:21:04.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.915+0000 7fb5557fa640 1 -- 172.21.15.40:0/1327137159 wait complete. 2024-04-22T07:21:04.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.915+0000 7f959d7fa640 1 -- 172.21.15.40:0/570637351 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95b00d6f80 msgr2=0x7f95b0172aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.915+0000 7f959d7fa640 1 --2- 172.21.15.40:0/570637351 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95b00d6f80 0x7f95b0172aa0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0041f0 tx=0x7f95ac014420 comp rx=0 tx=0).stop 2024-04-22T07:21:04.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.915+0000 7f95b77fe640 1 -- 172.21.15.40:0/570637351 reap_dead start 2024-04-22T07:21:04.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.915+0000 7f577f59e640 1 -- 172.21.15.40:0/596480104 --> [v2:172.21.15.40:6816/130276746,v1:172.21.15.40:6817/130276746] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5780153530 con 0x7f5760074c40 2024-04-22T07:21:04.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.915+0000 7f959d7fa640 1 -- 172.21.15.40:0/570637351 shutdown_connections 2024-04-22T07:21:04.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.915+0000 7f959d7fa640 1 -- 172.21.15.40:0/570637351 >> 172.21.15.40:0/570637351 conn(0x7f95b000e6a0 msgr2=0x7f95b00d5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:04.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.915+0000 7f959d7fa640 1 -- 172.21.15.40:0/570637351 shutdown_connections 2024-04-22T07:21:04.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.915+0000 7f959d7fa640 1 -- 172.21.15.40:0/570637351 wait complete. 2024-04-22T07:21:04.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.916+0000 7f57777fe640 1 -- 172.21.15.40:0/596480104 <== osd.3 v2:172.21.15.40:6816/130276746 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5780153530 con 0x7f5760074c40 2024-04-22T07:21:04.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.916+0000 7efc897fa640 1 -- 172.21.15.40:0/1766540166 --> [v2:172.21.15.40:6808/623026645,v1:172.21.15.40:6809/623026645] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efca40c62d0 con 0x7efc90074bc0 2024-04-22T07:21:04.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.916+0000 7f577f59e640 1 -- 172.21.15.40:0/596480104 >> [v2:172.21.15.40:6816/130276746,v1:172.21.15.40:6817/130276746] conn(0x7f5760074c40 msgr2=0x7f5760077060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.916+0000 7f577f59e640 1 --2- 172.21.15.40:0/596480104 >> [v2:172.21.15.40:6816/130276746,v1:172.21.15.40:6817/130276746] conn(0x7f5760074c40 0x7f5760077060 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.916+0000 7f577f59e640 1 -- 172.21.15.40:0/596480104 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f576006c9c0 msgr2=0x7f576006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.916+0000 7f577f59e640 1 --2- 172.21.15.40:0/596480104 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f576006c9c0 0x7f576006ee80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f57800c7480 tx=0x7f5768009240 comp rx=0 tx=0).stop 2024-04-22T07:21:04.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.917+0000 7f577f59e640 1 -- 172.21.15.40:0/596480104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57800cb9c0 msgr2=0x7f578006dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.917+0000 7f577f59e640 1 --2- 172.21.15.40:0/596480104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57800cb9c0 0x7f578006dda0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f577002b910 tx=0x7f57700046c0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.917+0000 7f577ed9d640 1 -- 172.21.15.40:0/596480104 reap_dead start 2024-04-22T07:21:04.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.917+0000 7efc8b7fe640 1 -- 172.21.15.40:0/1766540166 <== osd.1 v2:172.21.15.40:6808/623026645 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efca40c62d0 con 0x7efc90074bc0 2024-04-22T07:21:04.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.917+0000 7f577f59e640 1 -- 172.21.15.40:0/596480104 shutdown_connections 2024-04-22T07:21:04.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.917+0000 7f577f59e640 1 -- 172.21.15.40:0/596480104 >> 172.21.15.40:0/596480104 conn(0x7f57800d04d0 msgr2=0x7f578006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:04.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.917+0000 7fef3dd6c640 1 -- 172.21.15.40:0/3880998963 --> [v2:172.21.15.62:6808/3509322231,v1:172.21.15.62:6809/3509322231] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fef380c7480 con 0x7fef18074c10 2024-04-22T07:21:04.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.917+0000 7f577f59e640 1 -- 172.21.15.40:0/596480104 shutdown_connections 2024-04-22T07:21:04.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.917+0000 7f0f51baf640 1 -- 172.21.15.40:0/2546909710 --> [v2:172.21.15.62:6816/147453972,v1:172.21.15.62:6817/147453972] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0f4c04fce0 con 0x7f0f38074bf0 2024-04-22T07:21:04.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.917+0000 7efca8898640 1 -- 172.21.15.40:0/1766540166 >> [v2:172.21.15.40:6808/623026645,v1:172.21.15.40:6809/623026645] conn(0x7efc90074bc0 msgr2=0x7efc90076fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.917+0000 7efca8898640 1 --2- 172.21.15.40:0/1766540166 >> [v2:172.21.15.40:6808/623026645,v1:172.21.15.40:6809/623026645] conn(0x7efc90074bc0 0x7efc90076fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.917+0000 7f577f59e640 1 -- 172.21.15.40:0/596480104 wait complete. 2024-04-22T07:21:04.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.917+0000 7efca8898640 1 -- 172.21.15.40:0/1766540166 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7efc9006c940 msgr2=0x7efc9006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.917+0000 7efca8898640 1 --2- 172.21.15.40:0/1766540166 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7efc9006c940 0x7efc9006ee00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efc940012e0 tx=0x7efc940016f0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.917+0000 7efca8898640 1 -- 172.21.15.40:0/1766540166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efca4155130 msgr2=0x7efca415d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.917+0000 7efca8898640 1 --2- 172.21.15.40:0/1766540166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efca4155130 0x7efca415d6c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efc98009840 tx=0x7efc980046c0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.917+0000 7efca359e640 1 -- 172.21.15.40:0/1766540166 reap_dead start 2024-04-22T07:21:04.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.917+0000 7efca8898640 1 -- 172.21.15.40:0/1766540166 shutdown_connections 2024-04-22T07:21:04.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.917+0000 7efca8898640 1 -- 172.21.15.40:0/1766540166 >> 172.21.15.40:0/1766540166 conn(0x7efca40676b0 msgr2=0x7efca40cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:04.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.918+0000 7f0f497fa640 1 -- 172.21.15.40:0/2546909710 <== osd.7 v2:172.21.15.62:6816/147453972 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0f4c04fce0 con 0x7f0f38074bf0 2024-04-22T07:21:04.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.918+0000 7f0f51baf640 1 -- 172.21.15.40:0/2546909710 >> [v2:172.21.15.62:6816/147453972,v1:172.21.15.62:6817/147453972] conn(0x7f0f38074bf0 msgr2=0x7f0f38077010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.918+0000 7f0f51baf640 1 --2- 172.21.15.40:0/2546909710 >> [v2:172.21.15.62:6816/147453972,v1:172.21.15.62:6817/147453972] conn(0x7f0f38074bf0 0x7f0f38077010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.919+0000 7f0f51baf640 1 -- 172.21.15.40:0/2546909710 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f0f3806c9f0 msgr2=0x7f0f3806eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.919+0000 7f0f51baf640 1 --2- 172.21.15.40:0/2546909710 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f0f3806c9f0 0x7f0f3806eeb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c036000 tx=0x7f0f3c03b040 comp rx=0 tx=0).stop 2024-04-22T07:21:04.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.919+0000 7f0f51baf640 1 -- 172.21.15.40:0/2546909710 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f4c14f7b0 msgr2=0x7f0f4c150440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.919+0000 7efca8898640 1 -- 172.21.15.40:0/1766540166 shutdown_connections 2024-04-22T07:21:04.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.919+0000 7f0f51baf640 1 --2- 172.21.15.40:0/2546909710 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f4c14f7b0 0x7f0f4c150440 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400cad0 tx=0x7f0f4400cf90 comp rx=0 tx=0).stop 2024-04-22T07:21:04.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.919+0000 7fef357fa640 1 -- 172.21.15.40:0/3880998963 <== osd.5 v2:172.21.15.62:6808/3509322231 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fef380c7480 con 0x7fef18074c10 2024-04-22T07:21:04.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.919+0000 7f0f513ae640 1 -- 172.21.15.40:0/2546909710 reap_dead start 2024-04-22T07:21:04.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.919+0000 7f0f51baf640 1 -- 172.21.15.40:0/2546909710 shutdown_connections 2024-04-22T07:21:04.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.919+0000 7f0f51baf640 1 -- 172.21.15.40:0/2546909710 >> 172.21.15.40:0/2546909710 conn(0x7f0f4c06f210 msgr2=0x7f0f4c15b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:04.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.919+0000 7efca8898640 1 -- 172.21.15.40:0/1766540166 wait complete. 2024-04-22T07:21:04.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.919+0000 7f0f51baf640 1 -- 172.21.15.40:0/2546909710 shutdown_connections 2024-04-22T07:21:04.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.919+0000 7f0f51baf640 1 -- 172.21.15.40:0/2546909710 wait complete. 2024-04-22T07:21:04.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.919+0000 7fef3dd6c640 1 -- 172.21.15.40:0/3880998963 >> [v2:172.21.15.62:6808/3509322231,v1:172.21.15.62:6809/3509322231] conn(0x7fef18074c10 msgr2=0x7fef18077030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.919+0000 7fef3dd6c640 1 --2- 172.21.15.40:0/3880998963 >> [v2:172.21.15.62:6808/3509322231,v1:172.21.15.62:6809/3509322231] conn(0x7fef18074c10 0x7fef18077030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.920+0000 7fef3dd6c640 1 -- 172.21.15.40:0/3880998963 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fef1806c9f0 msgr2=0x7fef1806eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.920+0000 7fef3dd6c640 1 --2- 172.21.15.40:0/3880998963 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fef1806c9f0 0x7fef1806eeb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fef28036000 tx=0x7fef2803b040 comp rx=0 tx=0).stop 2024-04-22T07:21:04.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.920+0000 7fef3dd6c640 1 -- 172.21.15.40:0/3880998963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef380cc290 msgr2=0x7fef38149d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.920+0000 7fef3dd6c640 1 --2- 172.21.15.40:0/3880998963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef380cc290 0x7fef38149d60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fef3000c7a0 tx=0x7fef3000cc60 comp rx=0 tx=0).stop 2024-04-22T07:21:04.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.920+0000 7fef3d56b640 1 -- 172.21.15.40:0/3880998963 reap_dead start 2024-04-22T07:21:04.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.920+0000 7fef3dd6c640 1 -- 172.21.15.40:0/3880998963 shutdown_connections 2024-04-22T07:21:04.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.920+0000 7fef3dd6c640 1 -- 172.21.15.40:0/3880998963 >> 172.21.15.40:0/3880998963 conn(0x7fef3806f5c0 msgr2=0x7fef380c8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:04.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.920+0000 7fef3dd6c640 1 -- 172.21.15.40:0/3880998963 shutdown_connections 2024-04-22T07:21:04.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.920+0000 7fef3dd6c640 1 -- 172.21.15.40:0/3880998963 wait complete. 2024-04-22T07:21:04.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.921+0000 7f9aca49b640 1 -- 172.21.15.40:0/403285132 --> [v2:172.21.15.40:6800/1526385055,v1:172.21.15.40:6801/1526385055] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9abc04e6b0 con 0x7f9aa8074c30 2024-04-22T07:21:04.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.922+0000 7f9ab9ffb640 1 -- 172.21.15.40:0/403285132 <== osd.0 v2:172.21.15.40:6800/1526385055 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9abc04e6b0 con 0x7f9aa8074c30 2024-04-22T07:21:04.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.923+0000 7f9aca49b640 1 -- 172.21.15.40:0/403285132 >> [v2:172.21.15.40:6800/1526385055,v1:172.21.15.40:6801/1526385055] conn(0x7f9aa8074c30 msgr2=0x7f9aa8077050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.923+0000 7f9aca49b640 1 --2- 172.21.15.40:0/403285132 >> [v2:172.21.15.40:6800/1526385055,v1:172.21.15.40:6801/1526385055] conn(0x7f9aa8074c30 0x7f9aa8077050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.924+0000 7f9aca49b640 1 -- 172.21.15.40:0/403285132 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9aa806c9b0 msgr2=0x7f9aa806ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.924+0000 7f9aca49b640 1 --2- 172.21.15.40:0/403285132 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9aa806c9b0 0x7f9aa806ee70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4006fd0 tx=0x7f9ab4008040 comp rx=0 tx=0).stop 2024-04-22T07:21:04.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.924+0000 7f9aca49b640 1 -- 172.21.15.40:0/403285132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9abc17aa60 msgr2=0x7f9abc17aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:04.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.924+0000 7f9aca49b640 1 --2- 172.21.15.40:0/403285132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9abc17aa60 0x7f9abc17aee0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4063510 tx=0x7f9ac40698a0 comp rx=0 tx=0).stop 2024-04-22T07:21:04.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.929+0000 7f9ac9c9a640 1 -- 172.21.15.40:0/403285132 reap_dead start 2024-04-22T07:21:04.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.929+0000 7f9aca49b640 1 -- 172.21.15.40:0/403285132 shutdown_connections 2024-04-22T07:21:04.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.929+0000 7f9aca49b640 1 -- 172.21.15.40:0/403285132 >> 172.21.15.40:0/403285132 conn(0x7f9abc050180 msgr2=0x7f9abc04ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:04.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.932+0000 7f9aca49b640 1 -- 172.21.15.40:0/403285132 shutdown_connections 2024-04-22T07:21:04.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:04.932+0000 7f9aca49b640 1 -- 172.21.15.40:0/403285132 wait complete. 2024-04-22T07:21:04.987 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-04-22T07:21:04.988 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-22T07:21:04.989 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-04-22T07:21:04.989 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-22T07:21:04.990 INFO:teuthology.orchestra.run.smithi040.stdout:55834574855 2024-04-22T07:21:04.990 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-22T07:21:04.991 INFO:teuthology.orchestra.run.smithi040.stdout:64424509448 2024-04-22T07:21:04.991 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-22T07:21:04.992 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-04-22T07:21:04.992 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-22T07:21:04.993 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-04-22T07:21:04.993 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-22T07:21:04.994 INFO:teuthology.orchestra.run.smithi040.stdout:64424509446 2024-04-22T07:21:04.994 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-22T07:21:04.995 INFO:teuthology.orchestra.run.smithi040.stdout:64424509449 2024-04-22T07:21:04.995 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-22T07:21:05.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.203+0000 7f9a47759640 1 Processor -- start 2024-04-22T07:21:05.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.203+0000 7f9a47759640 1 -- start start 2024-04-22T07:21:05.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.204+0000 7f9a47759640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9a4006c030 0x7f9a40151010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.204+0000 7f9a47759640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a40156ef0 con 0x7f9a4015afb0 2024-04-22T07:21:05.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.204+0000 7f9a47759640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a401571d0 con 0x7f9a400c74c0 2024-04-22T07:21:05.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.204+0000 7f9a47759640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f9a401574b0 con 0x7f9a4006c030 2024-04-22T07:21:05.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.205+0000 7f9a44cf4640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9a4015afb0 0x7f9a400c8dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33902/0 (socket says 172.21.15.40:33902) 2024-04-22T07:21:05.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.205+0000 7f9a44cf4640 1 -- 172.21.15.40:0/2170382228 learned_addr learned my addr 172.21.15.40:0/2170382228 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:05.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.205+0000 7f9a454f5640 1 --2- 172.21.15.40:0/2170382228 >> v2:172.21.15.62:3300/0 conn(0x7f9a4006c030 0x7f9a40151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.206+0000 7f9a454f5640 1 -- 172.21.15.40:0/2170382228 >> v1:172.21.15.62:6789/0 conn(0x7f9a400c74c0 legacy=0x7f9a401585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.206+0000 7f9a454f5640 1 -- 172.21.15.40:0/2170382228 >> v1:172.21.15.40:6789/0 conn(0x7f9a4015afb0 legacy=0x7f9a400c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.206+0000 7f9a37fff640 1 -- 172.21.15.40:0/2170382228 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2188600090 0 0) 0x7f9a40156ef0 con 0x7f9a4015afb0 2024-04-22T07:21:05.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.206+0000 7f9a454f5640 1 -- 172.21.15.40:0/2170382228 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a40157790 con 0x7f9a4006c030 2024-04-22T07:21:05.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.206+0000 7f8def998640 1 Processor -- start 2024-04-22T07:21:05.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.206+0000 7fba1f406640 1 Processor -- start 2024-04-22T07:21:05.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.206+0000 7fba1f406640 1 -- start start 2024-04-22T07:21:05.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.206+0000 7f8def998640 1 -- start start 2024-04-22T07:21:05.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.206+0000 7f0471d24640 1 Processor -- start 2024-04-22T07:21:05.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.207+0000 7f010a5c3640 1 Processor -- start 2024-04-22T07:21:05.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.207+0000 7f010a5c3640 1 -- start start 2024-04-22T07:21:05.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7f8def998640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8de81594a0 0x7f8de80c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7f8def998640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8de80c8360 0x7f8de815f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7f8def998640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8de815fce0 con 0x7f8de815f8a0 2024-04-22T07:21:05.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7f8def998640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f8de8163460 con 0x7f8de80c8360 2024-04-22T07:21:05.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7f8def998640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f8de8159880 con 0x7f8de81594a0 2024-04-22T07:21:05.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7fba1f406640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fba100d5ab0 0x7fba1004c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7fba1f406640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fba10006280 0x7fba100350f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7fba1f406640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba10036230 con 0x7fba100dc510 2024-04-22T07:21:05.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.207+0000 7f0471d24640 1 -- start start 2024-04-22T07:21:05.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7fba1f406640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fba100dc9a0 con 0x7fba100d5ab0 2024-04-22T07:21:05.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7fba1f406640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fba10046cc0 con 0x7fba10006280 2024-04-22T07:21:05.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7fba1d9a3640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fba100dc510 0x7fba10045ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33908/0 (socket says 172.21.15.40:33908) 2024-04-22T07:21:05.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7fba1d9a3640 1 -- 172.21.15.40:0/1301642482 learned_addr learned my addr 172.21.15.40:0/1301642482 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:05.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.207+0000 7f71c58d0640 1 Processor -- start 2024-04-22T07:21:05.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.207+0000 7f71c58d0640 1 -- start start 2024-04-22T07:21:05.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7f0471d24640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f046c1594a0 0x7f046c0c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7f8decf33640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8de80c8360 0x7f8de815f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7fba1d1a2640 1 --2- 172.21.15.40:0/1301642482 >> v2:172.21.15.62:3300/0 conn(0x7fba100d5ab0 0x7fba1004c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7f71c58d0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f71c0156b30 0x7f71c0150b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7f71c58d0640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f71c00c7e50 0x7f71c00c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7f8decf33640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8de80c8360 0x7f8de815f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42250/0 (socket says 172.21.15.40:42250) 2024-04-22T07:21:05.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7f8decf33640 1 -- 172.21.15.40:0/439065698 learned_addr learned my addr 172.21.15.40:0/439065698 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:05.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7f046b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f046c1594a0 0x7f046c0c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7f046b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f046c1594a0 0x7f046c0c7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42256/0 (socket says 172.21.15.40:42256) 2024-04-22T07:21:05.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7f046b7fe640 1 -- 172.21.15.40:0/852861294 learned_addr learned my addr 172.21.15.40:0/852861294 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:05.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7f010a5c3640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00fc0d7020 0x7f00fc04c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7f71c48ce640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f71c0156b30 0x7f71c0150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7f010a5c3640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f00fc0e0890 0x7f00fc0dca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7f010a5c3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f00fc0e0cd0 0x7f00fc0dcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7f010a5c3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f00fc04b930 con 0x7f00fc0e0cd0 2024-04-22T07:21:05.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7f010a5c3640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f00fc0e0400 con 0x7f00fc0e0890 2024-04-22T07:21:05.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7f010a5c3640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f00fc04bb80 con 0x7f00fc0d7020 2024-04-22T07:21:05.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f0109dc2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f00fc0e0cd0 0x7f00fc0dcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f0109dc2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f00fc0e0cd0 0x7f00fc0dcfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42266/0 (socket says 172.21.15.40:42266) 2024-04-22T07:21:05.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f0109dc2640 1 -- 172.21.15.40:0/1831751695 learned_addr learned my addr 172.21.15.40:0/1831751695 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:05.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7f8ded734640 1 --2- 172.21.15.40:0/439065698 >> v2:172.21.15.62:3300/0 conn(0x7f8de81594a0 0x7f8de80c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7f71c58d0640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71c0072600 con 0x7f71c00c8c00 2024-04-22T07:21:05.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7f71c48ce640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f71c0156b30 0x7f71c0150b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.40:42158/0 (socket says 172.21.15.40:42158) 2024-04-22T07:21:05.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f71c48ce640 1 -- 172.21.15.40:0/2793524321 learned_addr learned my addr 172.21.15.40:0/2793524321 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:05.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f71c58d0640 1 -- 172.21.15.40:0/2793524321 --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f71c00730e0 con 0x7f71c0156b30 2024-04-22T07:21:05.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f71c58d0640 1 -- 172.21.15.40:0/2793524321 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f71c0072bc0 con 0x7f71c00c7e50 2024-04-22T07:21:05.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f5f3953b640 1 Processor -- start 2024-04-22T07:21:05.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f01095c1640 1 --2- 172.21.15.40:0/1831751695 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00fc0d7020 0x7f00fc04c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f0108dc0640 1 --2- 172.21.15.40:0/1831751695 >> v2:172.21.15.62:3300/0 conn(0x7f00fc0e0890 0x7f00fc0dca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f0109dc2640 1 -- 172.21.15.40:0/1831751695 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00fc0d7020 msgr2=0x7f00fc04c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:05.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f9a454f5640 1 --2- 172.21.15.40:0/2170382228 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a4006c030 0x7f9a40151010 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0097a0 tx=0x7f9a3c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b7bb4e97f595a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:05.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f0109dc2640 1 --2- 172.21.15.40:0/1831751695 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00fc0d7020 0x7f00fc04c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f0109dc2640 1 -- 172.21.15.40:0/1831751695 >> v2:172.21.15.62:3300/0 conn(0x7f00fc0e0890 msgr2=0x7f00fc0dca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:05.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f0109dc2640 1 --2- 172.21.15.40:0/1831751695 >> v2:172.21.15.62:3300/0 conn(0x7f00fc0e0890 0x7f00fc0dca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f0109dc2640 1 -- 172.21.15.40:0/1831751695 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00fc04be60 con 0x7f00fc0e0cd0 2024-04-22T07:21:05.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.208+0000 7f0471d24640 1 --2- 172.21.15.40:0/852861294 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f046c0c8360 0x7f046c15f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f0471d24640 1 -- 172.21.15.40:0/852861294 --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f046c15fce0 con 0x7f046c15f8a0 2024-04-22T07:21:05.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f0471d24640 1 -- 172.21.15.40:0/852861294 --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f046c163460 con 0x7f046c1594a0 2024-04-22T07:21:05.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f0471d24640 1 -- 172.21.15.40:0/852861294 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f046c159880 con 0x7f046c0c8360 2024-04-22T07:21:05.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f046b7fe640 1 -- 172.21.15.40:0/852861294 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f046c0c8360 msgr2=0x7f046c15f360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-22T07:21:05.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f046b7fe640 1 --2- 172.21.15.40:0/852861294 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f046c0c8360 0x7f046c15f360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f046b7fe640 1 -- 172.21.15.40:0/852861294 >> v1:172.21.15.62:6789/0 conn(0x7f046c15f8a0 legacy=0x7f046c0c8960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T07:21:05.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f046b7fe640 1 -- 172.21.15.40:0/852861294 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f046c162850 con 0x7f046c1594a0 2024-04-22T07:21:05.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f71bffff640 1 --2- 172.21.15.40:0/2793524321 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f71c00c7e50 0x7f71c00c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f71bf7fe640 1 -- 172.21.15.40:0/2793524321 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1629727995 0 0) 0x7f71c0072600 con 0x7f71c00c8c00 2024-04-22T07:21:05.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f71bf7fe640 1 -- 172.21.15.40:0/2793524321 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71b0003520 con 0x7f71c00c8c00 2024-04-22T07:21:05.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f71c48ce640 1 -- 172.21.15.40:0/2793524321 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f71c00c7e50 msgr2=0x7f71c00c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:05.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f71c48ce640 1 --2- 172.21.15.40:0/2793524321 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f71c00c7e50 0x7f71c00c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f71c48ce640 1 -- 172.21.15.40:0/2793524321 >> v1:172.21.15.62:6789/0 conn(0x7f71c00c8c00 legacy=0x7f71c00c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f71c48ce640 1 -- 172.21.15.40:0/2793524321 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c00728e0 con 0x7f71c0156b30 2024-04-22T07:21:05.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f8decf33640 1 -- 172.21.15.40:0/439065698 >> v2:172.21.15.62:3300/0 conn(0x7f8de81594a0 msgr2=0x7f8de80c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:05.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f8decf33640 1 --2- 172.21.15.40:0/439065698 >> v2:172.21.15.62:3300/0 conn(0x7f8de81594a0 0x7f8de80c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f8decf33640 1 -- 172.21.15.40:0/439065698 >> v1:172.21.15.62:6789/0 conn(0x7f8de815f8a0 legacy=0x7f8de80c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f8decf33640 1 -- 172.21.15.40:0/439065698 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de8162850 con 0x7f8de80c8360 2024-04-22T07:21:05.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.210+0000 7f9a37fff640 1 -- 172.21.15.40:0/2170382228 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c034070 con 0x7f9a4006c030 2024-04-22T07:21:05.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.210+0000 7f9a37fff640 1 -- 172.21.15.40:0/2170382228 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a3c030610 con 0x7f9a4006c030 2024-04-22T07:21:05.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.210+0000 7f9a37fff640 1 -- 172.21.15.40:0/2170382228 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c0309e0 con 0x7f9a4006c030 2024-04-22T07:21:05.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.210+0000 7f0109dc2640 1 --2- 172.21.15.40:0/1831751695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00fc0e0cd0 0x7f00fc0dcfd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0104075df0 tx=0x7f01040a7c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8bf8c716c771dc server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:05.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.210+0000 7f046b7fe640 1 --2- 172.21.15.40:0/852861294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f046c1594a0 0x7f046c0c7e20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f046c1635e0 tx=0x7f045c02bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f488817589b8596e server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:05.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f5f3953b640 1 -- start start 2024-04-22T07:21:05.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.210+0000 7f5f3953b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5f340c7ec0 0x7f5f3416a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.210+0000 7f5f3953b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f3415f640 con 0x7f5f340c6ab0 2024-04-22T07:21:05.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.210+0000 7f5f3953b640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f34072110 con 0x7f5f34159420 2024-04-22T07:21:05.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f2b34d8f640 1 Processor -- start 2024-04-22T07:21:05.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7f2b34d8f640 1 -- start start 2024-04-22T07:21:05.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.210+0000 7f5f3953b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f5f34071ec0 con 0x7f5f340c7ec0 2024-04-22T07:21:05.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.210+0000 7f8ded734640 1 --2- 172.21.15.40:0/439065698 >> v2:172.21.15.62:3300/0 conn(0x7f8de81594a0 0x7f8de80c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:05.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.210+0000 7f2b34d8f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2b280dd430 0x7f2b280e7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.210+0000 7f2b34d8f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b2804bc80 0x7f2b28007580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7f5f33fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f5f34159420 0x7f5f3415ef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.40:49378/0 (socket says 172.21.15.40:49378) 2024-04-22T07:21:05.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7f5f33fff640 1 -- 172.21.15.40:0/2075349428 learned_addr learned my addr 172.21.15.40:0/2075349428 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:05.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.210+0000 7f2b34d8f640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b280e7660 con 0x7f2b28047690 2024-04-22T07:21:05.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.210+0000 7f2b34d8f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f2b28007330 con 0x7f2b2804bc80 2024-04-22T07:21:05.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.210+0000 7f2b34d8f640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f2b280e6c90 con 0x7f2b280dd430 2024-04-22T07:21:05.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7f9a47759640 1 -- 172.21.15.40:0/2170382228 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a4006c030 msgr2=0x7f9a40151010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7f046a7fc640 1 -- 172.21.15.40:0/852861294 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c039070 con 0x7f046c1594a0 2024-04-22T07:21:05.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7f046a7fc640 1 -- 172.21.15.40:0/852861294 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f045c02c7b0 con 0x7f046c1594a0 2024-04-22T07:21:05.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7f046a7fc640 1 -- 172.21.15.40:0/852861294 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c02cb80 con 0x7f046c1594a0 2024-04-22T07:21:05.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7f5f38d3a640 1 --2- 172.21.15.40:0/2075349428 >> v2:172.21.15.40:3300/0 conn(0x7f5f340c7ec0 0x7f5f3416a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7f2b2dd9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b2804bc80 0x7f2b28007580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7f2b2dd9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b2804bc80 0x7f2b28007580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42284/0 (socket says 172.21.15.40:42284) 2024-04-22T07:21:05.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7f9a47759640 1 --2- 172.21.15.40:0/2170382228 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a4006c030 0x7f9a40151010 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0097a0 tx=0x7f9a3c02b960 comp rx=0 tx=0).stop 2024-04-22T07:21:05.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7f2b2dd9b640 1 -- 172.21.15.40:0/1553550320 learned_addr learned my addr 172.21.15.40:0/1553550320 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:05.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7fba0ffff640 1 -- 172.21.15.40:0/1301642482 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2064643732 0 0) 0x7fba14001110 con 0x7fba100dc510 2024-04-22T07:21:05.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.210+0000 7fba0ffff640 1 -- 172.21.15.40:0/1301642482 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba04005730 con 0x7fba100dc510 2024-04-22T07:21:05.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7fba1d1a2640 1 -- 172.21.15.40:0/1301642482 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fba10006280 msgr2=0x7fba100350f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:05.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7fba0ffff640 1 -- 172.21.15.40:0/1301642482 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 38649799 0 0) 0x7fba04005730 con 0x7fba100dc510 2024-04-22T07:21:05.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.209+0000 7fba1c9a1640 1 --2- 172.21.15.40:0/1301642482 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fba10006280 0x7fba100350f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7f9a47759640 1 -- 172.21.15.40:0/2170382228 shutdown_connections 2024-04-22T07:21:05.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7f9a47759640 1 --2- 172.21.15.40:0/2170382228 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a4006c030 0x7f9a40151010 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7f9a47759640 1 -- 172.21.15.40:0/2170382228 >> 172.21.15.40:0/2170382228 conn(0x7f9a4006de50 msgr2=0x7f9a4006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:05.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f9a47759640 1 -- 172.21.15.40:0/2170382228 shutdown_connections 2024-04-22T07:21:05.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f9a47759640 1 -- 172.21.15.40:0/2170382228 wait complete. 2024-04-22T07:21:05.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7fba1d1a2640 1 --2- 172.21.15.40:0/1301642482 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fba10006280 0x7fba100350f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7fba1d1a2640 1 -- 172.21.15.40:0/1301642482 >> v1:172.21.15.40:6789/0 conn(0x7fba100dc510 legacy=0x7fba10045ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7fba1d1a2640 1 -- 172.21.15.40:0/1301642482 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba100d5e90 con 0x7fba100d5ab0 2024-04-22T07:21:05.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7fba1c9a1640 1 --2- 172.21.15.40:0/1301642482 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fba10006280 0x7fba100350f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:05.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7f71c48ce640 1 --2- 172.21.15.40:0/2793524321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71c0156b30 0x7f71c0150b50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f71b4009870 tx=0x7f71b402ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a002aa241dd84bba server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:05.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7f71bf7fe640 1 -- 172.21.15.40:0/2793524321 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b402f850 con 0x7f71c0156b30 2024-04-22T07:21:05.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f71bf7fe640 1 -- 172.21.15.40:0/2793524321 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b402f9f0 con 0x7f71c0156b30 2024-04-22T07:21:05.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f71bf7fe640 1 -- 172.21.15.40:0/2793524321 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b402fda0 con 0x7f71c0156b30 2024-04-22T07:21:05.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f0471d24640 1 -- 172.21.15.40:0/852861294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f046c1594a0 msgr2=0x7f046c0c7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f0471d24640 1 --2- 172.21.15.40:0/852861294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f046c1594a0 0x7f046c0c7e20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f046c1635e0 tx=0x7f045c02bc10 comp rx=0 tx=0).stop 2024-04-22T07:21:05.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7f5f32ffd640 1 -- 172.21.15.40:0/2075349428 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2193661564 0 0) 0x7f5f3415f640 con 0x7f5f340c6ab0 2024-04-22T07:21:05.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7f5f32ffd640 1 -- 172.21.15.40:0/2075349428 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f1c003520 con 0x7f5f340c6ab0 2024-04-22T07:21:05.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7f5f32ffd640 1 -- 172.21.15.40:0/2075349428 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1152476382 0 0) 0x7f5f34072110 con 0x7f5f34159420 2024-04-22T07:21:05.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7f5f32ffd640 1 -- 172.21.15.40:0/2075349428 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f3415f640 con 0x7f5f34159420 2024-04-22T07:21:05.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f5f32ffd640 1 -- 172.21.15.40:0/2075349428 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1453477368 0 0) 0x7f5f1c003520 con 0x7f5f340c6ab0 2024-04-22T07:21:05.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f5f32ffd640 1 -- 172.21.15.40:0/2075349428 >> v2:172.21.15.40:3300/0 conn(0x7f5f340c7ec0 msgr2=0x7f5f3416a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:05.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f5f32ffd640 1 --2- 172.21.15.40:0/2075349428 >> v2:172.21.15.40:3300/0 conn(0x7f5f340c7ec0 0x7f5f3416a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f5f32ffd640 1 -- 172.21.15.40:0/2075349428 >> v1:172.21.15.62:6789/0 conn(0x7f5f34159420 legacy=0x7f5f3415ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f5f32ffd640 1 -- 172.21.15.40:0/2075349428 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f3406dbf0 con 0x7f5f340c6ab0 2024-04-22T07:21:05.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f5f32ffd640 1 -- 172.21.15.40:0/2075349428 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7f5f28001670 con 0x7f5f340c6ab0 2024-04-22T07:21:05.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f5f32ffd640 1 -- 172.21.15.40:0/2075349428 >> v1:172.21.15.40:6789/0 conn(0x7f5f340c6ab0 legacy=0x7f5f340c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f5f32ffd640 1 --2- 172.21.15.40:0/2075349428 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f1c003b90 0x7f5f1c003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f5f32ffd640 1 --2- 172.21.15.40:0/2075349428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f1c004800 0x7f5f1c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f5f32ffd640 1 --2- 172.21.15.40:0/2075349428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f1c0051c0 0x7f5f1c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f5f32ffd640 1 -- 172.21.15.40:0/2075349428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5f34071ec0 con 0x7f5f1c004800 2024-04-22T07:21:05.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f5f32ffd640 1 -- 172.21.15.40:0/2075349428 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5f1c00c090 con 0x7f5f1c0051c0 2024-04-22T07:21:05.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f5f32ffd640 1 -- 172.21.15.40:0/2075349428 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5f1c00c290 con 0x7f5f1c003b90 2024-04-22T07:21:05.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f5f38d3a640 1 --2- 172.21.15.40:0/2075349428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f1c0051c0 0x7f5f1c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f5f337fe640 1 --2- 172.21.15.40:0/2075349428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f1c004800 0x7f5f1c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f5f33fff640 1 --2- 172.21.15.40:0/2075349428 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f1c003b90 0x7f5f1c003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7f00fbfff640 1 -- 172.21.15.40:0/1831751695 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01040b5070 con 0x7f00fc0e0cd0 2024-04-22T07:21:05.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7f00fbfff640 1 -- 172.21.15.40:0/1831751695 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01040a8ae0 con 0x7f00fc0e0cd0 2024-04-22T07:21:05.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7f00fbfff640 1 -- 172.21.15.40:0/1831751695 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01040b0440 con 0x7f00fc0e0cd0 2024-04-22T07:21:05.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f010a5c3640 1 -- 172.21.15.40:0/1831751695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00fc0e0cd0 msgr2=0x7f00fc0dcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f010a5c3640 1 --2- 172.21.15.40:0/1831751695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00fc0e0cd0 0x7f00fc0dcfd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0104075df0 tx=0x7f01040a7c30 comp rx=0 tx=0).stop 2024-04-22T07:21:05.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f010a5c3640 1 -- 172.21.15.40:0/1831751695 shutdown_connections 2024-04-22T07:21:05.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f010a5c3640 1 --2- 172.21.15.40:0/1831751695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00fc0e0cd0 0x7f00fc0dcfd0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f010a5c3640 1 --2- 172.21.15.40:0/1831751695 >> v2:172.21.15.62:3300/0 conn(0x7f00fc0e0890 0x7f00fc0dca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f010a5c3640 1 --2- 172.21.15.40:0/1831751695 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00fc0d7020 0x7f00fc04c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f010a5c3640 1 -- 172.21.15.40:0/1831751695 >> 172.21.15.40:0/1831751695 conn(0x7f00fc050180 msgr2=0x7f00fc050590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:05.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f010a5c3640 1 -- 172.21.15.40:0/1831751695 shutdown_connections 2024-04-22T07:21:05.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7f2b2dd9b640 1 -- 172.21.15.40:0/1553550320 >> v2:172.21.15.62:3300/0 conn(0x7f2b280dd430 msgr2=0x7f2b280e7120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-22T07:21:05.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7f2b2dd9b640 1 --2- 172.21.15.40:0/1553550320 >> v2:172.21.15.62:3300/0 conn(0x7f2b280dd430 0x7f2b280e7120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7f2b2dd9b640 1 -- 172.21.15.40:0/1553550320 >> v1:172.21.15.62:6789/0 conn(0x7f2b28047690 legacy=0x7f2b280e31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7f2b2dd9b640 1 -- 172.21.15.40:0/1553550320 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b28046340 con 0x7f2b2804bc80 2024-04-22T07:21:05.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.211+0000 7f8decf33640 1 --2- 172.21.15.40:0/439065698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8de80c8360 0x7f8de815f360 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8de81635e0 tx=0x7f8de002be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db932e2d4930135f server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:05.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f8ddffff640 1 -- 172.21.15.40:0/439065698 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de002c950 con 0x7f8de80c8360 2024-04-22T07:21:05.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f8ddffff640 1 -- 172.21.15.40:0/439065698 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8de002caf0 con 0x7f8de80c8360 2024-04-22T07:21:05.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.213+0000 7f010a5c3640 1 -- 172.21.15.40:0/1831751695 wait complete. 2024-04-22T07:21:05.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.213+0000 7f5f38d3a640 1 -- 172.21.15.40:0/2075349428 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f1c003b90 msgr2=0x7f5f1c003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:05.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.213+0000 7f2b2dd9b640 1 --2- 172.21.15.40:0/1553550320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b2804bc80 0x7f2b28007580 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2b28052370 tx=0x7f2b2402ba60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbb9c4fb938356b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:05.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.213+0000 7f71c58d0640 1 -- 172.21.15.40:0/2793524321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71c0156b30 msgr2=0x7f71c0150b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.213+0000 7f71c58d0640 1 --2- 172.21.15.40:0/2793524321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71c0156b30 0x7f71c0150b50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f71b4009870 tx=0x7f71b402ba30 comp rx=0 tx=0).stop 2024-04-22T07:21:05.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.213+0000 7f71c58d0640 1 -- 172.21.15.40:0/2793524321 shutdown_connections 2024-04-22T07:21:05.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.213+0000 7f71c58d0640 1 --2- 172.21.15.40:0/2793524321 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f71c00c7e50 0x7f71c00c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.213+0000 7f5f38d3a640 1 --2- 172.21.15.40:0/2075349428 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f1c003b90 0x7f5f1c003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.213+0000 7f5f38d3a640 1 -- 172.21.15.40:0/2075349428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f1c004800 msgr2=0x7f5f1c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:05.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.213+0000 7fba1d1a2640 1 --2- 172.21.15.40:0/1301642482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba100d5ab0 0x7fba1004c6b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fba080097d0 tx=0x7fba0802b800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68da43f77fe0ffd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:05.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.213+0000 7f71c58d0640 1 --2- 172.21.15.40:0/2793524321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71c0156b30 0x7f71c0150b50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.213+0000 7f71c58d0640 1 -- 172.21.15.40:0/2793524321 >> 172.21.15.40:0/2793524321 conn(0x7f71c006f290 msgr2=0x7f71c006f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:05.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.213+0000 7f5f38d3a640 1 --2- 172.21.15.40:0/2075349428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f1c004800 0x7f5f1c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f0471d24640 1 -- 172.21.15.40:0/852861294 shutdown_connections 2024-04-22T07:21:05.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f0471d24640 1 --2- 172.21.15.40:0/852861294 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f046c0c8360 0x7f046c15f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f0471d24640 1 --2- 172.21.15.40:0/852861294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f046c1594a0 0x7f046c0c7e20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.212+0000 7f0471d24640 1 -- 172.21.15.40:0/852861294 >> 172.21.15.40:0/852861294 conn(0x7f046c06de50 msgr2=0x7f046c06b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:05.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.213+0000 7f5f38d3a640 1 -- 172.21.15.40:0/2075349428 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f1c003520 con 0x7f5f1c0051c0 2024-04-22T07:21:05.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.213+0000 7fba0ffff640 1 -- 172.21.15.40:0/1301642482 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba08037070 con 0x7fba100d5ab0 2024-04-22T07:21:05.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.213+0000 7fba0ffff640 1 -- 172.21.15.40:0/1301642482 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba08030510 con 0x7fba100d5ab0 2024-04-22T07:21:05.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.213+0000 7fba0ffff640 1 -- 172.21.15.40:0/1301642482 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba08037070 con 0x7fba100d5ab0 2024-04-22T07:21:05.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.213+0000 7f8def998640 1 -- 172.21.15.40:0/439065698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8de80c8360 msgr2=0x7f8de815f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.213+0000 7f0471d24640 1 -- 172.21.15.40:0/852861294 shutdown_connections 2024-04-22T07:21:05.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.213+0000 7f8ddffff640 1 -- 172.21.15.40:0/439065698 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de002c950 con 0x7f8de80c8360 2024-04-22T07:21:05.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.213+0000 7f8def998640 1 --2- 172.21.15.40:0/439065698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8de80c8360 0x7f8de815f360 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8de81635e0 tx=0x7f8de002be30 comp rx=0 tx=0).stop 2024-04-22T07:21:05.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.213+0000 7f2b2d59a640 1 -- 172.21.15.40:0/1553550320 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2402d820 con 0x7f2b2804bc80 2024-04-22T07:21:05.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.213+0000 7f0471d24640 1 -- 172.21.15.40:0/852861294 wait complete. 2024-04-22T07:21:05.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.213+0000 7f2b2d59a640 1 -- 172.21.15.40:0/1553550320 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b2402d9c0 con 0x7f2b2804bc80 2024-04-22T07:21:05.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.214+0000 7f2b2d59a640 1 -- 172.21.15.40:0/1553550320 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2402dd90 con 0x7f2b2804bc80 2024-04-22T07:21:05.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.214+0000 7f5f33fff640 1 --2- 172.21.15.40:0/2075349428 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f1c003b90 0x7f5f1c003f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:05.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.214+0000 7f9a47759640 1 Processor -- start 2024-04-22T07:21:05.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.214+0000 7f8def998640 1 -- 172.21.15.40:0/439065698 shutdown_connections 2024-04-22T07:21:05.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.214+0000 7f8def998640 1 --2- 172.21.15.40:0/439065698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8de80c8360 0x7f8de815f360 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.214+0000 7f8def998640 1 --2- 172.21.15.40:0/439065698 >> v2:172.21.15.62:3300/0 conn(0x7f8de81594a0 0x7f8de80c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.214+0000 7f8def998640 1 -- 172.21.15.40:0/439065698 >> 172.21.15.40:0/439065698 conn(0x7f8de806de50 msgr2=0x7f8de806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:05.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.214+0000 7f5f38d3a640 1 -- 172.21.15.40:0/2075349428 reap_dead start 2024-04-22T07:21:05.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.214+0000 7f5f38d3a640 1 --2- 172.21.15.40:0/2075349428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f1c0051c0 0x7f5f1c00b9c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c009f90 tx=0x7f5f1c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb94132ffea1e979 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:05.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.214+0000 7f010a5c3640 1 Processor -- start 2024-04-22T07:21:05.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.214+0000 7f5f32ffd640 1 -- 172.21.15.40:0/2075349428 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c039070 con 0x7f5f1c0051c0 2024-04-22T07:21:05.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.214+0000 7f5f32ffd640 1 -- 172.21.15.40:0/2075349428 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f2c02cc00 con 0x7f5f1c0051c0 2024-04-22T07:21:05.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.215+0000 7f5f32ffd640 1 -- 172.21.15.40:0/2075349428 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c009c10 con 0x7f5f1c0051c0 2024-04-22T07:21:05.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.214+0000 7f010a5c3640 1 -- start start 2024-04-22T07:21:05.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.214+0000 7f2b34d8f640 1 -- 172.21.15.40:0/1553550320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b2804bc80 msgr2=0x7f2b28007580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.214+0000 7f2b34d8f640 1 --2- 172.21.15.40:0/1553550320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b2804bc80 0x7f2b28007580 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2b28052370 tx=0x7f2b2402ba60 comp rx=0 tx=0).stop 2024-04-22T07:21:05.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.215+0000 7f0471d24640 1 Processor -- start 2024-04-22T07:21:05.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.215+0000 7f2b34d8f640 1 -- 172.21.15.40:0/1553550320 shutdown_connections 2024-04-22T07:21:05.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.215+0000 7f2b34d8f640 1 --2- 172.21.15.40:0/1553550320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b2804bc80 0x7f2b28007580 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.215+0000 7f2b34d8f640 1 --2- 172.21.15.40:0/1553550320 >> v2:172.21.15.62:3300/0 conn(0x7f2b280dd430 0x7f2b280e7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.215+0000 7f2b34d8f640 1 -- 172.21.15.40:0/1553550320 >> 172.21.15.40:0/1553550320 conn(0x7f2b28051300 msgr2=0x7f2b28051710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:05.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.215+0000 7f2b34d8f640 1 -- 172.21.15.40:0/1553550320 shutdown_connections 2024-04-22T07:21:05.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.215+0000 7f0471d24640 1 -- start start 2024-04-22T07:21:05.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.215+0000 7f2b34d8f640 1 -- 172.21.15.40:0/1553550320 wait complete. 2024-04-22T07:21:05.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.215+0000 7f8def998640 1 -- 172.21.15.40:0/439065698 shutdown_connections 2024-04-22T07:21:05.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.214+0000 7f9a47759640 1 -- start start 2024-04-22T07:21:05.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.215+0000 7f8def998640 1 -- 172.21.15.40:0/439065698 wait complete. 2024-04-22T07:21:05.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.215+0000 7f9a47759640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a4006c030 0x7f9a4014b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.215+0000 7f9a47759640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a400c74c0 0x7f9a401561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.215+0000 7f9a47759640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a4015afb0 0x7f9a40072c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.215+0000 7f9a47759640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9a400c9650 con 0x7f9a400c74c0 2024-04-22T07:21:05.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.215+0000 7f9a47759640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9a400c94d0 con 0x7f9a4006c030 2024-04-22T07:21:05.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.215+0000 7f9a47759640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9a40158cc0 con 0x7f9a4015afb0 2024-04-22T07:21:05.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.215+0000 7f5f3953b640 1 -- 172.21.15.40:0/2075349428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f1c0051c0 msgr2=0x7f5f1c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.215+0000 7f5f3953b640 1 --2- 172.21.15.40:0/2075349428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f1c0051c0 0x7f5f1c00b9c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c009f90 tx=0x7f5f1c005830 comp rx=0 tx=0).stop 2024-04-22T07:21:05.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.215+0000 7f010a5c3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00fc0d7020 0x7f00fc0df390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.215+0000 7f9a44cf4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a400c74c0 0x7f9a401561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.215+0000 7f5f3953b640 1 -- 172.21.15.40:0/2075349428 shutdown_connections 2024-04-22T07:21:05.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f010a5c3640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00fc0e0890 0x7f00fc0d1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f010a5c3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00fc0e0cd0 0x7f00fc0cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.215+0000 7f5f3953b640 1 --2- 172.21.15.40:0/2075349428 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f1c0051c0 0x7f5f1c00b9c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f01095c1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00fc0d7020 0x7f00fc0df390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f01095c1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00fc0d7020 0x7f00fc0df390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42318/0 (socket says 172.21.15.40:42318) 2024-04-22T07:21:05.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.215+0000 7f9a44cf4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a400c74c0 0x7f9a401561f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42306/0 (socket says 172.21.15.40:42306) 2024-04-22T07:21:05.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.215+0000 7f9a44cf4640 1 -- 172.21.15.40:0/2974429816 learned_addr learned my addr 172.21.15.40:0/2974429816 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:05.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f01095c1640 1 -- 172.21.15.40:0/4238284390 learned_addr learned my addr 172.21.15.40:0/4238284390 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:05.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.215+0000 7f5f3953b640 1 -- 172.21.15.40:0/2075349428 >> 172.21.15.40:0/2075349428 conn(0x7f5f3406f210 msgr2=0x7f5f3406f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:05.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f010a5c3640 1 -- 172.21.15.40:0/4238284390 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc005ee0 con 0x7f00fc0d7020 2024-04-22T07:21:05.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f5f3953b640 1 -- 172.21.15.40:0/2075349428 shutdown_connections 2024-04-22T07:21:05.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f010a5c3640 1 -- 172.21.15.40:0/4238284390 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc0e0090 con 0x7f00fc0e0cd0 2024-04-22T07:21:05.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f0109dc2640 1 --2- 172.21.15.40:0/4238284390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00fc0e0cd0 0x7f00fc0cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f5f3953b640 1 -- 172.21.15.40:0/2075349428 wait complete. 2024-04-22T07:21:05.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f0471d24640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f046c0c8360 0x7f046c1f4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f0471d24640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f046c1594a0 0x7f046c156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f046b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f046c0c8360 0x7f046c1f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f0471d24640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f046c15f8a0 0x7f046c154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f0471d24640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f046c1630f0 con 0x7f046c0c8360 2024-04-22T07:21:05.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f0471d24640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f046c162e10 con 0x7f046c1594a0 2024-04-22T07:21:05.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f046b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f046c0c8360 0x7f046c1f4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42326/0 (socket says 172.21.15.40:42326) 2024-04-22T07:21:05.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f0471d24640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f046c071e20 con 0x7f046c15f8a0 2024-04-22T07:21:05.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f046b7fe640 1 -- 172.21.15.40:0/370388275 learned_addr learned my addr 172.21.15.40:0/370388275 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:05.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f010a5c3640 1 -- 172.21.15.40:0/4238284390 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f00fc00e380 con 0x7f00fc0e0890 2024-04-22T07:21:05.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.217+0000 7f9a44cf4640 1 -- 172.21.15.40:0/2974429816 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a4015afb0 msgr2=0x7f9a40072c30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T07:21:05.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.217+0000 7f9a44cf4640 1 --2- 172.21.15.40:0/2974429816 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a4015afb0 0x7f9a40072c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.217+0000 7f9a44cf4640 1 -- 172.21.15.40:0/2974429816 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a4006c030 msgr2=0x7f9a4014b730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T07:21:05.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.217+0000 7f046affd640 1 --2- 172.21.15.40:0/370388275 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f046c1594a0 0x7f046c156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f0108dc0640 1 --2- 172.21.15.40:0/4238284390 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00fc0e0890 0x7f00fc0d1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.217+0000 7f9a44cf4640 1 --2- 172.21.15.40:0/2974429816 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a4006c030 0x7f9a4014b730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.217+0000 7f9a44cf4640 1 -- 172.21.15.40:0/2974429816 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a40156810 con 0x7f9a400c74c0 2024-04-22T07:21:05.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f01095c1640 1 -- 172.21.15.40:0/4238284390 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00fc0e0890 msgr2=0x7f00fc0d1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.217+0000 7f2b34d8f640 1 Processor -- start 2024-04-22T07:21:05.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f01095c1640 1 --2- 172.21.15.40:0/4238284390 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00fc0e0890 0x7f00fc0d1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.213+0000 7f71c58d0640 1 -- 172.21.15.40:0/2793524321 shutdown_connections 2024-04-22T07:21:05.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.213+0000 7f71c58d0640 1 -- 172.21.15.40:0/2793524321 wait complete. 2024-04-22T07:21:05.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.217+0000 7f2b34d8f640 1 -- start start 2024-04-22T07:21:05.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.215+0000 7f71c58d0640 1 Processor -- start 2024-04-22T07:21:05.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.215+0000 7f71c58d0640 1 -- start start 2024-04-22T07:21:05.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f71c58d0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71c00c7e50 0x7f71c013f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f71c58d0640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f71c00c8c00 0x7f71c01f0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f71c58d0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71c0156b30 0x7f71c014e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f71c48ce640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71c00c7e50 0x7f71c013f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f71c48ce640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71c00c7e50 0x7f71c013f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.40:42204/0 (socket says 172.21.15.40:42204) 2024-04-22T07:21:05.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f71bffff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f71c00c8c00 0x7f71c01f0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f71bffff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f71c00c8c00 0x7f71c01f0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.40:50428/0 (socket says 172.21.15.40:50428) 2024-04-22T07:21:05.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f71c48ce640 1 -- 172.21.15.40:0/1157882968 learned_addr learned my addr 172.21.15.40:0/1157882968 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:05.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.217+0000 7f046b7fe640 1 -- 172.21.15.40:0/370388275 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f046c15f8a0 msgr2=0x7f046c154170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.217+0000 7f046b7fe640 1 --2- 172.21.15.40:0/370388275 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f046c15f8a0 0x7f046c154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.217+0000 7f046b7fe640 1 -- 172.21.15.40:0/370388275 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f046c1594a0 msgr2=0x7f046c156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.217+0000 7f046b7fe640 1 --2- 172.21.15.40:0/370388275 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f046c1594a0 0x7f046c156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.217+0000 7f046b7fe640 1 -- 172.21.15.40:0/370388275 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f046c155890 con 0x7f046c0c8360 2024-04-22T07:21:05.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.217+0000 7f9a44cf4640 1 --2- 172.21.15.40:0/2974429816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a400c74c0 0x7f9a401561f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9a3800caf0 tx=0x7f9a38002150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:05.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.217+0000 7f71c58d0640 1 -- 172.21.15.40:0/1157882968 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f71c00c7650 con 0x7f71c0156b30 2024-04-22T07:21:05.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.217+0000 7f71c58d0640 1 -- 172.21.15.40:0/1157882968 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f71c00c79c0 con 0x7f71c00c7e50 2024-04-22T07:21:05.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.217+0000 7f71c58d0640 1 -- 172.21.15.40:0/1157882968 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f71c0071700 con 0x7f71c00c8c00 2024-04-22T07:21:05.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.217+0000 7f01095c1640 1 -- 172.21.15.40:0/4238284390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00fc0e0cd0 msgr2=0x7f00fc0cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.216+0000 7f71c50cf640 1 --2- 172.21.15.40:0/1157882968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71c0156b30 0x7f71c014e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.217+0000 7f8def998640 1 Processor -- start 2024-04-22T07:21:05.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.218+0000 7f9a35ffb640 1 -- 172.21.15.40:0/2974429816 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a38018070 con 0x7f9a400c74c0 2024-04-22T07:21:05.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.217+0000 7f046b7fe640 1 --2- 172.21.15.40:0/370388275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f046c0c8360 0x7f046c1f4e30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f045c02c150 tx=0x7f045c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:05.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.218+0000 7fba1f406640 1 -- 172.21.15.40:0/1301642482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba100d5ab0 msgr2=0x7fba1004c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.218+0000 7fba1f406640 1 --2- 172.21.15.40:0/1301642482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba100d5ab0 0x7fba1004c6b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fba080097d0 tx=0x7fba0802b800 comp rx=0 tx=0).stop 2024-04-22T07:21:05.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.218+0000 7f8def998640 1 -- start start 2024-04-22T07:21:05.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.218+0000 7f5f3953b640 1 Processor -- start 2024-04-22T07:21:05.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.218+0000 7f9a47759640 1 -- 172.21.15.40:0/2974429816 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a40151ab0 con 0x7f9a400c74c0 2024-04-22T07:21:05.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.218+0000 7f9a35ffb640 1 -- 172.21.15.40:0/2974429816 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a38004d60 con 0x7f9a400c74c0 2024-04-22T07:21:05.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.218+0000 7f71c50cf640 1 -- 172.21.15.40:0/1157882968 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f71c00c8c00 msgr2=0x7f71c01f0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.218+0000 7f71c50cf640 1 --2- 172.21.15.40:0/1157882968 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f71c00c8c00 0x7f71c01f0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.218+0000 7f9a35ffb640 1 -- 172.21.15.40:0/2974429816 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3800a9a0 con 0x7f9a400c74c0 2024-04-22T07:21:05.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.218+0000 7f71c50cf640 1 -- 172.21.15.40:0/1157882968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71c00c7e50 msgr2=0x7f71c013f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.218+0000 7f71c50cf640 1 --2- 172.21.15.40:0/1157882968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71c00c7e50 0x7f71c013f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.218+0000 7f71c50cf640 1 -- 172.21.15.40:0/1157882968 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c0142360 con 0x7f71c0156b30 2024-04-22T07:21:05.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.218+0000 7fba1f406640 1 -- 172.21.15.40:0/1301642482 shutdown_connections 2024-04-22T07:21:05.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.218+0000 7fba1f406640 1 --2- 172.21.15.40:0/1301642482 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fba10006280 0x7fba100350f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.218+0000 7fba1f406640 1 --2- 172.21.15.40:0/1301642482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba100d5ab0 0x7fba1004c6b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.218+0000 7fba1f406640 1 -- 172.21.15.40:0/1301642482 >> 172.21.15.40:0/1301642482 conn(0x7fba10050170 msgr2=0x7fba10050580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:05.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.218+0000 7f71c48ce640 1 --2- 172.21.15.40:0/1157882968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71c00c7e50 0x7f71c013f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:05.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.218+0000 7f9a47759640 1 -- 172.21.15.40:0/2974429816 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a40152070 con 0x7f9a400c74c0 2024-04-22T07:21:05.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.218+0000 7f71c50cf640 1 --2- 172.21.15.40:0/1157882968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71c0156b30 0x7f71c014e780 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f71b800c760 tx=0x7f71b800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:05.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.218+0000 7f5f3953b640 1 -- start start 2024-04-22T07:21:05.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.217+0000 7f01095c1640 1 --2- 172.21.15.40:0/4238284390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00fc0e0cd0 0x7f00fc0cf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.217+0000 7f01095c1640 1 -- 172.21.15.40:0/4238284390 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00fc179db0 con 0x7f00fc0d7020 2024-04-22T07:21:05.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.218+0000 7f2b34d8f640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2b28047690 0x7f2b28036d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.219+0000 7f9a47759640 1 -- 172.21.15.40:0/2974429816 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a20005290 con 0x7f9a400c74c0 2024-04-22T07:21:05.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.219+0000 7fba1f406640 1 -- 172.21.15.40:0/1301642482 shutdown_connections 2024-04-22T07:21:05.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.219+0000 7f71bd7fa640 1 -- 172.21.15.40:0/1157882968 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b8003b70 con 0x7f71c0156b30 2024-04-22T07:21:05.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.219+0000 7f71c58d0640 1 -- 172.21.15.40:0/1157882968 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71c0142640 con 0x7f71c0156b30 2024-04-22T07:21:05.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.219+0000 7f71c58d0640 1 -- 172.21.15.40:0/1157882968 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71c0142c00 con 0x7f71c0156b30 2024-04-22T07:21:05.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.219+0000 7f71bd7fa640 1 -- 172.21.15.40:0/1157882968 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b8003d30 con 0x7f71c0156b30 2024-04-22T07:21:05.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f71bd7fa640 1 -- 172.21.15.40:0/1157882968 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b800aa90 con 0x7f71c0156b30 2024-04-22T07:21:05.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.219+0000 7f0453fff640 1 -- 172.21.15.40:0/370388275 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c043070 con 0x7f046c0c8360 2024-04-22T07:21:05.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f0471d24640 1 -- 172.21.15.40:0/370388275 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f046c1546b0 con 0x7f046c0c8360 2024-04-22T07:21:05.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f0471d24640 1 -- 172.21.15.40:0/370388275 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f046c162180 con 0x7f046c0c8360 2024-04-22T07:21:05.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.219+0000 7f5f3953b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f1c0051c0 0x7f5f3415b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.219+0000 7f5f3953b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f34159800 0x7f5f34154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.219+0000 7f5f3953b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f340cb320 0x7f5f340cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.219+0000 7f5f3953b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5f340c7a30 con 0x7f5f340cb320 2024-04-22T07:21:05.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.219+0000 7f5f3953b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5f340c7470 con 0x7f5f34159800 2024-04-22T07:21:05.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.219+0000 7f5f3953b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5f340c76c0 con 0x7f5f1c0051c0 2024-04-22T07:21:05.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f5f38d3a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f340cb320 0x7f5f340cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f5f38d3a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f340cb320 0x7f5f340cb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42346/0 (socket says 172.21.15.40:42346) 2024-04-22T07:21:05.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f5f38d3a640 1 -- 172.21.15.40:0/1406955461 learned_addr learned my addr 172.21.15.40:0/1406955461 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:05.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f01095c1640 1 --2- 172.21.15.40:0/4238284390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00fc0d7020 0x7f00fc0df390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0100009f70 tx=0x7f010000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:05.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.219+0000 7f2b34d8f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b2804bc80 0x7f2b280e4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.219+0000 7f2b34d8f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b280dd430 0x7f2b280d18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.219+0000 7f2b2dd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b2804bc80 0x7f2b280e4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f2b2dd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b2804bc80 0x7f2b280e4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.40:42226/0 (socket says 172.21.15.40:42226) 2024-04-22T07:21:05.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f2b2dd9b640 1 -- 172.21.15.40:0/1194355329 learned_addr learned my addr 172.21.15.40:0/1194355329 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:05.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f2b2e59c640 1 --2- 172.21.15.40:0/1194355329 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2b28047690 0x7f2b28036d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f2b34d8f640 1 -- 172.21.15.40:0/1194355329 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2b28046bd0 con 0x7f2b280dd430 2024-04-22T07:21:05.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f2b34d8f640 1 -- 172.21.15.40:0/1194355329 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2b280e6920 con 0x7f2b2804bc80 2024-04-22T07:21:05.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f2b34d8f640 1 -- 172.21.15.40:0/1194355329 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f2b280dd810 con 0x7f2b28047690 2024-04-22T07:21:05.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f2b2ed9d640 1 --2- 172.21.15.40:0/1194355329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b280dd430 0x7f2b280d18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.219+0000 7f8def998640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8de80c8360 0x7f8de80ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.219+0000 7f8def998640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8de81594a0 0x7f8de815e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.219+0000 7f8def998640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8de815f8a0 0x7f8de80ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.219+0000 7f8def998640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8de81630f0 con 0x7f8de815f8a0 2024-04-22T07:21:05.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.219+0000 7f8def998640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8de8162e10 con 0x7f8de81594a0 2024-04-22T07:21:05.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.219+0000 7f8ded734640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8de80c8360 0x7f8de80ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f8def998640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f8de8071e20 con 0x7f8de80c8360 2024-04-22T07:21:05.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f8dedf35640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8de815f8a0 0x7f8de80ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f8ded734640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8de80c8360 0x7f8de80ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.40:50442/0 (socket says 172.21.15.40:50442) 2024-04-22T07:21:05.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f8ded734640 1 -- 172.21.15.40:0/3106274615 learned_addr learned my addr 172.21.15.40:0/3106274615 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:05.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f8decf33640 1 --2- 172.21.15.40:0/3106274615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8de81594a0 0x7f8de815e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f8decf33640 1 -- 172.21.15.40:0/3106274615 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8de80c8360 msgr2=0x7f8de80ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f8decf33640 1 --2- 172.21.15.40:0/3106274615 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8de80c8360 0x7f8de80ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f5f33fff640 1 --2- 172.21.15.40:0/1406955461 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f1c0051c0 0x7f5f3415b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f5f38d3a640 1 -- 172.21.15.40:0/1406955461 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f1c0051c0 msgr2=0x7f5f3415b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f8decf33640 1 -- 172.21.15.40:0/3106274615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8de815f8a0 msgr2=0x7f8de80ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f5f38d3a640 1 --2- 172.21.15.40:0/1406955461 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f1c0051c0 0x7f5f3415b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f5f38d3a640 1 -- 172.21.15.40:0/1406955461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f34159800 msgr2=0x7f5f34154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f8decf33640 1 --2- 172.21.15.40:0/3106274615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8de815f8a0 0x7f8de80ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.219+0000 7fba1f406640 1 -- 172.21.15.40:0/1301642482 wait complete. 2024-04-22T07:21:05.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f8decf33640 1 -- 172.21.15.40:0/3106274615 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de81f8570 con 0x7f8de81594a0 2024-04-22T07:21:05.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7fba1f406640 1 Processor -- start 2024-04-22T07:21:05.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.221+0000 7fba1f406640 1 -- start start 2024-04-22T07:21:05.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f2b2dd9b640 1 -- 172.21.15.40:0/1194355329 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2b28047690 msgr2=0x7f2b28036d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.221+0000 7f2b2dd9b640 1 --2- 172.21.15.40:0/1194355329 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2b28047690 0x7f2b28036d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.221+0000 7f2b2dd9b640 1 -- 172.21.15.40:0/1194355329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b280dd430 msgr2=0x7f2b280d18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.221+0000 7f2b2dd9b640 1 --2- 172.21.15.40:0/1194355329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b280dd430 0x7f2b280d18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.221+0000 7f2b2dd9b640 1 -- 172.21.15.40:0/1194355329 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2817dcd0 con 0x7f2b2804bc80 2024-04-22T07:21:05.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.221+0000 7f8decf33640 1 --2- 172.21.15.40:0/3106274615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8de81594a0 0x7f8de815e3a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8de0032000 tx=0x7f8de0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:05.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f5f337fe640 1 --2- 172.21.15.40:0/1406955461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f34159800 0x7f5f34154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f5f38d3a640 1 --2- 172.21.15.40:0/1406955461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f34159800 0x7f5f34154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.220+0000 7f5f38d3a640 1 -- 172.21.15.40:0/1406955461 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f3415e6d0 con 0x7f5f340cb320 2024-04-22T07:21:05.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.221+0000 7f5f38d3a640 1 --2- 172.21.15.40:0/1406955461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f340cb320 0x7f5f340cb7a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00e200 tx=0x7f5f2c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:05.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.221+0000 7f5f337fe640 1 --2- 172.21.15.40:0/1406955461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f34159800 0x7f5f34154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:05.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.221+0000 7f2b2dd9b640 1 --2- 172.21.15.40:0/1194355329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b2804bc80 0x7f2b280e4330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2b24009960 tx=0x7f2b24004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:05.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.221+0000 7f71c58d0640 1 -- 172.21.15.40:0/1157882968 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71c0069d40 con 0x7f71c0156b30 2024-04-22T07:21:05.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.221+0000 7f8dddffb640 1 -- 172.21.15.40:0/3106274615 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de0043020 con 0x7f8de81594a0 2024-04-22T07:21:05.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.221+0000 7f8dddffb640 1 -- 172.21.15.40:0/3106274615 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8de0004250 con 0x7f8de81594a0 2024-04-22T07:21:05.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.221+0000 7f2b1effd640 1 -- 172.21.15.40:0/1194355329 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b24047070 con 0x7f2b2804bc80 2024-04-22T07:21:05.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.221+0000 7f2b1effd640 1 -- 172.21.15.40:0/1194355329 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b24037c40 con 0x7f2b2804bc80 2024-04-22T07:21:05.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.221+0000 7f8dddffb640 1 -- 172.21.15.40:0/3106274615 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de0004640 con 0x7f8de81594a0 2024-04-22T07:21:05.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.221+0000 7f9a35ffb640 1 -- 172.21.15.40:0/2974429816 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9a3801b070 con 0x7f9a400c74c0 2024-04-22T07:21:05.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.221+0000 7f2b1effd640 1 -- 172.21.15.40:0/1194355329 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b240423f0 con 0x7f2b2804bc80 2024-04-22T07:21:05.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.222+0000 7f2b34d8f640 1 -- 172.21.15.40:0/1194355329 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b2816e310 con 0x7f2b2804bc80 2024-04-22T07:21:05.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.222+0000 7fba1f406640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba10006280 0x7fba10165970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.222+0000 7f2b34d8f640 1 -- 172.21.15.40:0/1194355329 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b2816e8d0 con 0x7f2b2804bc80 2024-04-22T07:21:05.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.222+0000 7f9a35ffb640 1 --2- 172.21.15.40:0/2974429816 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9a2406c9c0 0x7f9a2406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.222+0000 7f8def998640 1 -- 172.21.15.40:0/3106274615 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8de81f8850 con 0x7f8de81594a0 2024-04-22T07:21:05.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.222+0000 7f8def998640 1 -- 172.21.15.40:0/3106274615 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8de81f8e10 con 0x7f8de81594a0 2024-04-22T07:21:05.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.222+0000 7fba1d1a2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba10006280 0x7fba10165970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.221+0000 7f0453fff640 1 -- 172.21.15.40:0/370388275 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f045c02c7b0 con 0x7f046c0c8360 2024-04-22T07:21:05.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.221+0000 7f0453fff640 1 -- 172.21.15.40:0/370388275 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c039040 con 0x7f046c0c8360 2024-04-22T07:21:05.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.222+0000 7f9a35ffb640 1 -- 172.21.15.40:0/2974429816 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9a3808b250 con 0x7f9a400c74c0 2024-04-22T07:21:05.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.222+0000 7fba1d1a2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba10006280 0x7fba10165970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.40:42242/0 (socket says 172.21.15.40:42242) 2024-04-22T07:21:05.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.222+0000 7fba1f406640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fba100d5ab0 0x7fba100d4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.222+0000 7fba1d1a2640 1 -- 172.21.15.40:0/989390409 learned_addr learned my addr 172.21.15.40:0/989390409 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:05.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.222+0000 7fba1f406640 1 --2- 172.21.15.40:0/989390409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba100dc510 0x7fba10173a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.222+0000 7f9a454f5640 1 --2- 172.21.15.40:0/2974429816 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9a2406c9c0 0x7f9a2406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.222+0000 7fba1f406640 1 -- 172.21.15.40:0/989390409 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fba100dbd10 con 0x7fba100dc510 2024-04-22T07:21:05.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.222+0000 7f0471d24640 1 -- 172.21.15.40:0/370388275 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f044c005290 con 0x7f046c0c8360 2024-04-22T07:21:05.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.222+0000 7fba1f406640 1 -- 172.21.15.40:0/989390409 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fba100471e0 con 0x7fba10006280 2024-04-22T07:21:05.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.222+0000 7fba1f406640 1 -- 172.21.15.40:0/989390409 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fba100dbff0 con 0x7fba100d5ab0 2024-04-22T07:21:05.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.223+0000 7fba1d1a2640 1 -- 172.21.15.40:0/989390409 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fba100d5ab0 msgr2=0x7fba100d4740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T07:21:05.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.223+0000 7f5f30ff9640 1 -- 172.21.15.40:0/1406955461 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c046070 con 0x7f5f340cb320 2024-04-22T07:21:05.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.223+0000 7fba1d1a2640 1 --2- 172.21.15.40:0/989390409 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fba100d5ab0 0x7fba100d4740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.223+0000 7fba1d1a2640 1 -- 172.21.15.40:0/989390409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba100dc510 msgr2=0x7fba10173a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.223+0000 7fba1d1a2640 1 --2- 172.21.15.40:0/989390409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba100dc510 0x7fba10173a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.223+0000 7f9a454f5640 1 --2- 172.21.15.40:0/2974429816 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9a2406c9c0 0x7f9a2406ee80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c036000 tx=0x7f9a3c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:05.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.223+0000 7fba1d1a2640 1 -- 172.21.15.40:0/989390409 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba100cda10 con 0x7fba10006280 2024-04-22T07:21:05.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.223+0000 7fba1d1a2640 1 --2- 172.21.15.40:0/989390409 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba10006280 0x7fba10165970 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fba080098f0 tx=0x7fba080046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:05.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.223+0000 7f5f3953b640 1 -- 172.21.15.40:0/1406955461 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f340cbce0 con 0x7f5f340cb320 2024-04-22T07:21:05.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.223+0000 7f5f3953b640 1 -- 172.21.15.40:0/1406955461 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f3415b8d0 con 0x7f5f340cb320 2024-04-22T07:21:05.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.223+0000 7f2b34d8f640 1 -- 172.21.15.40:0/1194355329 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b280dc830 con 0x7f2b2804bc80 2024-04-22T07:21:05.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.223+0000 7f71bd7fa640 1 -- 172.21.15.40:0/1157882968 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f71b800ac30 con 0x7f71c0156b30 2024-04-22T07:21:05.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.223+0000 7f8def998640 1 -- 172.21.15.40:0/3106274615 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dc8005290 con 0x7f8de81594a0 2024-04-22T07:21:05.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.223+0000 7f00f9ffb640 1 -- 172.21.15.40:0/4238284390 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0100028070 con 0x7f00fc0d7020 2024-04-22T07:21:05.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.223+0000 7f010a5c3640 1 -- 172.21.15.40:0/4238284390 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00fc179230 con 0x7f00fc0d7020 2024-04-22T07:21:05.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.224+0000 7f010a5c3640 1 -- 172.21.15.40:0/4238284390 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00fc1797f0 con 0x7f00fc0d7020 2024-04-22T07:21:05.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.224+0000 7fba0dffb640 1 -- 172.21.15.40:0/989390409 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba08041070 con 0x7fba10006280 2024-04-22T07:21:05.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.224+0000 7fba0dffb640 1 -- 172.21.15.40:0/989390409 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba08032790 con 0x7fba10006280 2024-04-22T07:21:05.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.224+0000 7fba0dffb640 1 -- 172.21.15.40:0/989390409 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba08037070 con 0x7fba10006280 2024-04-22T07:21:05.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.224+0000 7fba1f406640 1 -- 172.21.15.40:0/989390409 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba100cdcf0 con 0x7fba10006280 2024-04-22T07:21:05.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.224+0000 7f5f30ff9640 1 -- 172.21.15.40:0/1406955461 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f2c02cc00 con 0x7f5f340cb320 2024-04-22T07:21:05.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.224+0000 7f5f30ff9640 1 -- 172.21.15.40:0/1406955461 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c039040 con 0x7f5f340cb320 2024-04-22T07:21:05.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.224+0000 7fba1f406640 1 -- 172.21.15.40:0/989390409 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba100ce2b0 con 0x7fba10006280 2024-04-22T07:21:05.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.224+0000 7f2b1effd640 1 -- 172.21.15.40:0/1194355329 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2b24041390 con 0x7f2b2804bc80 2024-04-22T07:21:05.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.224+0000 7f71bd7fa640 1 --2- 172.21.15.40:0/1157882968 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f71a406c8f0 0x7f71a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.224+0000 7f71bd7fa640 1 -- 172.21.15.40:0/1157882968 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f71b808baf0 con 0x7f71c0156b30 2024-04-22T07:21:05.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.225+0000 7f71c48ce640 1 --2- 172.21.15.40:0/1157882968 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f71a406c8f0 0x7f71a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.225+0000 7f2b1effd640 1 --2- 172.21.15.40:0/1194355329 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2b1006c9c0 0x7f2b1006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.225+0000 7f0453fff640 1 -- 172.21.15.40:0/370388275 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f045c046070 con 0x7f046c0c8360 2024-04-22T07:21:05.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.225+0000 7f2b1effd640 1 -- 172.21.15.40:0/1194355329 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2b240ad6c0 con 0x7f2b2804bc80 2024-04-22T07:21:05.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.225+0000 7f5f3953b640 1 -- 172.21.15.40:0/1406955461 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f14005290 con 0x7f5f340cb320 2024-04-22T07:21:05.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.225+0000 7f2b2e59c640 1 --2- 172.21.15.40:0/1194355329 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2b1006c9c0 0x7f2b1006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.226+0000 7f0453fff640 1 --2- 172.21.15.40:0/370388275 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f045806c920 0x7f045806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.226+0000 7f8dddffb640 1 -- 172.21.15.40:0/3106274615 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8de0046020 con 0x7f8de81594a0 2024-04-22T07:21:05.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.226+0000 7f046affd640 1 --2- 172.21.15.40:0/370388275 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f045806c920 0x7f045806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.226+0000 7fb9fb7fe640 1 -- 172.21.15.40:0/989390409 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba100052b0 con 0x7fba10006280 2024-04-22T07:21:05.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.226+0000 7f2b2e59c640 1 --2- 172.21.15.40:0/1194355329 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2b1006c9c0 0x7f2b1006ee80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2b20006fd0 tx=0x7f2b20009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:05.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.226+0000 7f71c48ce640 1 --2- 172.21.15.40:0/1157882968 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f71a406c8f0 0x7f71a406edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f71b4009870 tx=0x7f71b4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:05.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.226+0000 7f8dddffb640 1 --2- 172.21.15.40:0/3106274615 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8dcc06c940 0x7f8dcc06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.226+0000 7f8dddffb640 1 -- 172.21.15.40:0/3106274615 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f8de00ae270 con 0x7f8de81594a0 2024-04-22T07:21:05.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.226+0000 7f046affd640 1 --2- 172.21.15.40:0/370388275 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f045806c920 0x7f045806ede0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f046c15e7c0 tx=0x7f04640094f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:05.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.226+0000 7f010a5c3640 1 -- 172.21.15.40:0/4238284390 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00fc008130 con 0x7f00fc0d7020 2024-04-22T07:21:05.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.226+0000 7f8ded734640 1 --2- 172.21.15.40:0/3106274615 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8dcc06c940 0x7f8dcc06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.227+0000 7f8ded734640 1 --2- 172.21.15.40:0/3106274615 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8dcc06c940 0x7f8dcc06ee00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8dd800aab0 tx=0x7f8dd8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:05.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.229+0000 7f8dddffb640 1 -- 172.21.15.40:0/3106274615 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8de004d030 con 0x7f8de81594a0 2024-04-22T07:21:05.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.229+0000 7f00f9ffb640 1 -- 172.21.15.40:0/4238284390 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0100005990 con 0x7f00fc0d7020 2024-04-22T07:21:05.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.229+0000 7f00f9ffb640 1 -- 172.21.15.40:0/4238284390 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0100032060 con 0x7f00fc0d7020 2024-04-22T07:21:05.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.229+0000 7f9a35ffb640 1 -- 172.21.15.40:0/2974429816 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9a38059660 con 0x7f9a400c74c0 2024-04-22T07:21:05.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.229+0000 7f0453fff640 1 -- 172.21.15.40:0/370388275 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f045c079db0 con 0x7f046c0c8360 2024-04-22T07:21:05.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.230+0000 7fba0dffb640 1 -- 172.21.15.40:0/989390409 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fba08044070 con 0x7fba10006280 2024-04-22T07:21:05.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.230+0000 7fba0dffb640 1 --2- 172.21.15.40:0/989390409 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fb9fc06c940 0x7fb9fc06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.231+0000 7fba1c9a1640 1 --2- 172.21.15.40:0/989390409 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fb9fc06c940 0x7fb9fc06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.231+0000 7fba1c9a1640 1 --2- 172.21.15.40:0/989390409 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fb9fc06c940 0x7fb9fc06ee00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fba18075df0 tx=0x7fba1806e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:05.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.233+0000 7fba0dffb640 1 -- 172.21.15.40:0/989390409 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fba08079350 con 0x7fba10006280 2024-04-22T07:21:05.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.234+0000 7f2b1effd640 1 -- 172.21.15.40:0/1194355329 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2b280dc830 con 0x7f2b2804bc80 2024-04-22T07:21:05.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.238+0000 7fba0dffb640 1 -- 172.21.15.40:0/989390409 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fba0807b9b0 con 0x7fba10006280 2024-04-22T07:21:05.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.238+0000 7f71bd7fa640 1 -- 172.21.15.40:0/1157882968 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f71c0069d40 con 0x7f71c0156b30 2024-04-22T07:21:05.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.241+0000 7f5f30ff9640 1 -- 172.21.15.40:0/1406955461 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5f2c005d10 con 0x7f5f340cb320 2024-04-22T07:21:05.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.241+0000 7f5f30ff9640 1 --2- 172.21.15.40:0/1406955461 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5f2006c8f0 0x7f5f2006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.241+0000 7f00f9ffb640 1 -- 172.21.15.40:0/4238284390 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f010002b070 con 0x7f00fc0d7020 2024-04-22T07:21:05.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.242+0000 7f00f9ffb640 1 --2- 172.21.15.40:0/4238284390 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f00e806c8f0 0x7f00e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:05.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.242+0000 7f5f33fff640 1 --2- 172.21.15.40:0/1406955461 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5f2006c8f0 0x7f5f2006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.242+0000 7f0108dc0640 1 --2- 172.21.15.40:0/4238284390 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f00e806c8f0 0x7f00e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:05.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.242+0000 7f5f33fff640 1 --2- 172.21.15.40:0/1406955461 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5f2006c8f0 0x7f5f2006edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5f24000f60 tx=0x7f5f24009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:05.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.242+0000 7f0108dc0640 1 --2- 172.21.15.40:0/4238284390 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f00e806c8f0 0x7f00e806edb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f00fc1737c0 tx=0x7f00f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:05.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.249+0000 7f0453fff640 1 -- 172.21.15.40:0/370388275 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f045c07c410 con 0x7f046c0c8360 2024-04-22T07:21:05.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.249+0000 7f5f30ff9640 1 -- 172.21.15.40:0/1406955461 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5f2c0795c0 con 0x7f5f340cb320 2024-04-22T07:21:05.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.248+0000 7f00f9ffb640 1 -- 172.21.15.40:0/4238284390 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0100069020 con 0x7f00fc0d7020 2024-04-22T07:21:05.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.267+0000 7f00f9ffb640 1 -- 172.21.15.40:0/4238284390 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f00fc008130 con 0x7f00fc0d7020 2024-04-22T07:21:05.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.267+0000 7f5f30ff9640 1 -- 172.21.15.40:0/1406955461 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5f340cbce0 con 0x7f5f340cb320 2024-04-22T07:21:05.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.659+0000 7f0471d24640 1 -- 172.21.15.40:0/370388275 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f044c005850 con 0x7f046c0c8360 2024-04-22T07:21:05.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.660+0000 7f0453fff640 1 -- 172.21.15.40:0/370388275 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f045c07bd10 con 0x7f046c0c8360 2024-04-22T07:21:05.658 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-04-22T07:21:05.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.661+0000 7f9a47759640 1 -- 172.21.15.40:0/2974429816 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9a20005580 con 0x7f9a400c74c0 2024-04-22T07:21:05.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.662+0000 7f9a35ffb640 1 -- 172.21.15.40:0/2974429816 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9a38058f60 con 0x7f9a400c74c0 2024-04-22T07:21:05.660 INFO:teuthology.orchestra.run.smithi040.stdout:64424509446 2024-04-22T07:21:05.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.663+0000 7f0451ffb640 1 -- 172.21.15.40:0/370388275 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f045806c920 msgr2=0x7f045806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.663+0000 7f0451ffb640 1 --2- 172.21.15.40:0/370388275 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f045806c920 0x7f045806ede0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f046c15e7c0 tx=0x7f04640094f0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.663+0000 7f0451ffb640 1 -- 172.21.15.40:0/370388275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f046c0c8360 msgr2=0x7f046c1f4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.663+0000 7f0451ffb640 1 --2- 172.21.15.40:0/370388275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f046c0c8360 0x7f046c1f4e30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f045c02c150 tx=0x7f045c0046c0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.663+0000 7f0451ffb640 1 -- 172.21.15.40:0/370388275 shutdown_connections 2024-04-22T07:21:05.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.663+0000 7f0451ffb640 1 --2- 172.21.15.40:0/370388275 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f046c15f8a0 0x7f046c154170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.663+0000 7f0451ffb640 1 --2- 172.21.15.40:0/370388275 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f046c1594a0 0x7f046c156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.663+0000 7f0451ffb640 1 --2- 172.21.15.40:0/370388275 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f045806c920 0x7f045806ede0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.663+0000 7f0451ffb640 1 --2- 172.21.15.40:0/370388275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f046c0c8360 0x7f046c1f4e30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.663+0000 7f0451ffb640 1 -- 172.21.15.40:0/370388275 >> 172.21.15.40:0/370388275 conn(0x7f046c06de50 msgr2=0x7f046c0c4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:05.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.663+0000 7f8def998640 1 -- 172.21.15.40:0/3106274615 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8dc8005850 con 0x7f8de81594a0 2024-04-22T07:21:05.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.664+0000 7f0451ffb640 1 -- 172.21.15.40:0/370388275 shutdown_connections 2024-04-22T07:21:05.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.664+0000 7f0451ffb640 1 -- 172.21.15.40:0/370388275 wait complete. 2024-04-22T07:21:05.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.664+0000 7f8dddffb640 1 -- 172.21.15.40:0/3106274615 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8de007c780 con 0x7f8de81594a0 2024-04-22T07:21:05.663 INFO:teuthology.orchestra.run.smithi040.stdout:64424509448 2024-04-22T07:21:05.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.665+0000 7f9a47759640 1 -- 172.21.15.40:0/2974429816 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9a2406c9c0 msgr2=0x7f9a2406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.665+0000 7f9a47759640 1 --2- 172.21.15.40:0/2974429816 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9a2406c9c0 0x7f9a2406ee80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c036000 tx=0x7f9a3c008030 comp rx=0 tx=0).stop 2024-04-22T07:21:05.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.666+0000 7f9a47759640 1 -- 172.21.15.40:0/2974429816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a400c74c0 msgr2=0x7f9a401561f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.666+0000 7f2b34d8f640 1 -- 172.21.15.40:0/1194355329 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f2b28005700 con 0x7f2b2804bc80 2024-04-22T07:21:05.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.666+0000 7f9a47759640 1 --2- 172.21.15.40:0/2974429816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a400c74c0 0x7f9a401561f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9a3800caf0 tx=0x7f9a38002150 comp rx=0 tx=0).stop 2024-04-22T07:21:05.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.666+0000 7f9a47759640 1 -- 172.21.15.40:0/2974429816 shutdown_connections 2024-04-22T07:21:05.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.666+0000 7f9a47759640 1 --2- 172.21.15.40:0/2974429816 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9a4015afb0 0x7f9a40072c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.666+0000 7f9a47759640 1 --2- 172.21.15.40:0/2974429816 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9a2406c9c0 0x7f9a2406ee80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.666+0000 7f9a47759640 1 --2- 172.21.15.40:0/2974429816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a400c74c0 0x7f9a401561f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.666+0000 7f9a47759640 1 --2- 172.21.15.40:0/2974429816 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a4006c030 0x7f9a4014b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.666+0000 7f9a47759640 1 -- 172.21.15.40:0/2974429816 >> 172.21.15.40:0/2974429816 conn(0x7f9a4006de50 msgr2=0x7f9a400c78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:05.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.666+0000 7f2b1effd640 1 -- 172.21.15.40:0/1194355329 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2b2407b510 con 0x7f2b2804bc80 2024-04-22T07:21:05.666 INFO:teuthology.orchestra.run.smithi040.stdout:64424509445 2024-04-22T07:21:05.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.667+0000 7f9a47759640 1 -- 172.21.15.40:0/2974429816 shutdown_connections 2024-04-22T07:21:05.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.667+0000 7f9a47759640 1 -- 172.21.15.40:0/2974429816 wait complete. 2024-04-22T07:21:05.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.668+0000 7f8dd37fe640 1 -- 172.21.15.40:0/3106274615 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8dcc06c940 msgr2=0x7f8dcc06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.668+0000 7f8dd37fe640 1 --2- 172.21.15.40:0/3106274615 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8dcc06c940 0x7f8dcc06ee00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8dd800aab0 tx=0x7f8dd8008040 comp rx=0 tx=0).stop 2024-04-22T07:21:05.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.668+0000 7f8dd37fe640 1 -- 172.21.15.40:0/3106274615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8de81594a0 msgr2=0x7f8de815e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.668+0000 7f8dd37fe640 1 --2- 172.21.15.40:0/3106274615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8de81594a0 0x7f8de815e3a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8de0032000 tx=0x7f8de0004a40 comp rx=0 tx=0).stop 2024-04-22T07:21:05.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.668+0000 7f8dd37fe640 1 -- 172.21.15.40:0/3106274615 shutdown_connections 2024-04-22T07:21:05.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.668+0000 7f8dd37fe640 1 --2- 172.21.15.40:0/3106274615 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8dcc06c940 0x7f8dcc06ee00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.668+0000 7f8dd37fe640 1 --2- 172.21.15.40:0/3106274615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8de815f8a0 0x7f8de80ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.668+0000 7f8dd37fe640 1 --2- 172.21.15.40:0/3106274615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8de81594a0 0x7f8de815e3a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.668+0000 7f8dd37fe640 1 --2- 172.21.15.40:0/3106274615 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8de80c8360 0x7f8de80ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.668+0000 7f8dd37fe640 1 -- 172.21.15.40:0/3106274615 >> 172.21.15.40:0/3106274615 conn(0x7f8de806de50 msgr2=0x7f8de80c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:05.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.668+0000 7f8dd37fe640 1 -- 172.21.15.40:0/3106274615 shutdown_connections 2024-04-22T07:21:05.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.668+0000 7f8dd37fe640 1 -- 172.21.15.40:0/3106274615 wait complete. 2024-04-22T07:21:05.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.670+0000 7f2b34d8f640 1 -- 172.21.15.40:0/1194355329 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2b1006c9c0 msgr2=0x7f2b1006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.670+0000 7f2b34d8f640 1 --2- 172.21.15.40:0/1194355329 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2b1006c9c0 0x7f2b1006ee80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2b20006fd0 tx=0x7f2b20009060 comp rx=0 tx=0).stop 2024-04-22T07:21:05.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.670+0000 7f2b34d8f640 1 -- 172.21.15.40:0/1194355329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b2804bc80 msgr2=0x7f2b280e4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.670+0000 7f2b34d8f640 1 --2- 172.21.15.40:0/1194355329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b2804bc80 0x7f2b280e4330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2b24009960 tx=0x7f2b24004730 comp rx=0 tx=0).stop 2024-04-22T07:21:05.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.670+0000 7f2b34d8f640 1 -- 172.21.15.40:0/1194355329 shutdown_connections 2024-04-22T07:21:05.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.670+0000 7f2b34d8f640 1 --2- 172.21.15.40:0/1194355329 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2b1006c9c0 0x7f2b1006ee80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.671+0000 7f2b34d8f640 1 --2- 172.21.15.40:0/1194355329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b280dd430 0x7f2b280d18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.671+0000 7f2b34d8f640 1 --2- 172.21.15.40:0/1194355329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b2804bc80 0x7f2b280e4330 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.671+0000 7f2b34d8f640 1 --2- 172.21.15.40:0/1194355329 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2b28047690 0x7f2b28036d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.671+0000 7f2b34d8f640 1 -- 172.21.15.40:0/1194355329 >> 172.21.15.40:0/1194355329 conn(0x7f2b28051300 msgr2=0x7f2b2804c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:05.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.671+0000 7f2b34d8f640 1 -- 172.21.15.40:0/1194355329 shutdown_connections 2024-04-22T07:21:05.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.671+0000 7f2b34d8f640 1 -- 172.21.15.40:0/1194355329 wait complete. 2024-04-22T07:21:05.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.674+0000 7fb9fb7fe640 1 -- 172.21.15.40:0/989390409 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fba100d3a80 con 0x7fba10006280 2024-04-22T07:21:05.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.675+0000 7fba0dffb640 1 -- 172.21.15.40:0/989390409 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fba0807b2b0 con 0x7fba10006280 2024-04-22T07:21:05.673 INFO:teuthology.orchestra.run.smithi040.stdout:64424509446 2024-04-22T07:21:05.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.676+0000 7f71c58d0640 1 -- 172.21.15.40:0/1157882968 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f71c00694f0 con 0x7f71c0156b30 2024-04-22T07:21:05.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.676+0000 7f71bd7fa640 1 -- 172.21.15.40:0/1157882968 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f71c00694f0 con 0x7f71c0156b30 2024-04-22T07:21:05.674 INFO:teuthology.orchestra.run.smithi040.stdout:55834574854 2024-04-22T07:21:05.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.679+0000 7fb9fb7fe640 1 -- 172.21.15.40:0/989390409 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fb9fc06c940 msgr2=0x7fb9fc06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.679+0000 7fb9fb7fe640 1 --2- 172.21.15.40:0/989390409 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fb9fc06c940 0x7fb9fc06ee00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fba18075df0 tx=0x7fba1806e040 comp rx=0 tx=0).stop 2024-04-22T07:21:05.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.679+0000 7fb9fb7fe640 1 -- 172.21.15.40:0/989390409 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba10006280 msgr2=0x7fba10165970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.680+0000 7fb9fb7fe640 1 --2- 172.21.15.40:0/989390409 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba10006280 0x7fba10165970 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fba080098f0 tx=0x7fba080046c0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.680+0000 7fb9fb7fe640 1 -- 172.21.15.40:0/989390409 shutdown_connections 2024-04-22T07:21:05.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.680+0000 7fb9fb7fe640 1 --2- 172.21.15.40:0/989390409 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fb9fc06c940 0x7fb9fc06ee00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.680+0000 7fb9fb7fe640 1 --2- 172.21.15.40:0/989390409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba100dc510 0x7fba10173a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.680+0000 7fb9fb7fe640 1 --2- 172.21.15.40:0/989390409 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fba100d5ab0 0x7fba100d4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.680+0000 7fb9fb7fe640 1 --2- 172.21.15.40:0/989390409 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba10006280 0x7fba10165970 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.680+0000 7fb9fb7fe640 1 -- 172.21.15.40:0/989390409 >> 172.21.15.40:0/989390409 conn(0x7fba10050170 msgr2=0x7fba100d2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:05.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.680+0000 7fb9fb7fe640 1 -- 172.21.15.40:0/989390409 shutdown_connections 2024-04-22T07:21:05.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.680+0000 7fb9fb7fe640 1 -- 172.21.15.40:0/989390409 wait complete. 2024-04-22T07:21:05.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.680+0000 7f71aaffd640 1 -- 172.21.15.40:0/1157882968 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f71a406c8f0 msgr2=0x7f71a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.680+0000 7f71aaffd640 1 --2- 172.21.15.40:0/1157882968 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f71a406c8f0 0x7f71a406edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f71b4009870 tx=0x7f71b4008030 comp rx=0 tx=0).stop 2024-04-22T07:21:05.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.680+0000 7f71aaffd640 1 -- 172.21.15.40:0/1157882968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71c0156b30 msgr2=0x7f71c014e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.680+0000 7f71aaffd640 1 --2- 172.21.15.40:0/1157882968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71c0156b30 0x7f71c014e780 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f71b800c760 tx=0x7f71b800cc20 comp rx=0 tx=0).stop 2024-04-22T07:21:05.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.680+0000 7f71aaffd640 1 -- 172.21.15.40:0/1157882968 shutdown_connections 2024-04-22T07:21:05.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.680+0000 7f71aaffd640 1 --2- 172.21.15.40:0/1157882968 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f71a406c8f0 0x7f71a406edb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.681+0000 7f71aaffd640 1 --2- 172.21.15.40:0/1157882968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f71c0156b30 0x7f71c014e780 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.681+0000 7f71aaffd640 1 --2- 172.21.15.40:0/1157882968 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f71c00c8c00 0x7f71c01f0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.681+0000 7f71aaffd640 1 --2- 172.21.15.40:0/1157882968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f71c00c7e50 0x7f71c013f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.681+0000 7f71aaffd640 1 -- 172.21.15.40:0/1157882968 >> 172.21.15.40:0/1157882968 conn(0x7f71c006f290 msgr2=0x7f71c0071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:05.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.681+0000 7f71aaffd640 1 -- 172.21.15.40:0/1157882968 shutdown_connections 2024-04-22T07:21:05.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.681+0000 7f71aaffd640 1 -- 172.21.15.40:0/1157882968 wait complete. 2024-04-22T07:21:05.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.6 2024-04-22T07:21:05.686 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.2 2024-04-22T07:21:05.688 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.0 2024-04-22T07:21:05.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.691+0000 7f010a5c3640 1 -- 172.21.15.40:0/4238284390 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f00fc0052c0 con 0x7f00fc0d7020 2024-04-22T07:21:05.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.692+0000 7f00f9ffb640 1 -- 172.21.15.40:0/4238284390 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f010006af80 con 0x7f00fc0d7020 2024-04-22T07:21:05.690 INFO:teuthology.orchestra.run.smithi040.stdout:64424509446 2024-04-22T07:21:05.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.693+0000 7f5f3953b640 1 -- 172.21.15.40:0/1406955461 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f5f14005850 con 0x7f5f340cb320 2024-04-22T07:21:05.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.693+0000 7f5f30ff9640 1 -- 172.21.15.40:0/1406955461 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5f3415e6d0 con 0x7f5f340cb320 2024-04-22T07:21:05.691 INFO:teuthology.orchestra.run.smithi040.stdout:64424509446 2024-04-22T07:21:05.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.5 2024-04-22T07:21:05.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.695+0000 7f010a5c3640 1 -- 172.21.15.40:0/4238284390 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f00e806c8f0 msgr2=0x7f00e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.695+0000 7f010a5c3640 1 --2- 172.21.15.40:0/4238284390 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f00e806c8f0 0x7f00e806edb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f00fc1737c0 tx=0x7f00f4008040 comp rx=0 tx=0).stop 2024-04-22T07:21:05.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.695+0000 7f010a5c3640 1 -- 172.21.15.40:0/4238284390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00fc0d7020 msgr2=0x7f00fc0df390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.695+0000 7f010a5c3640 1 --2- 172.21.15.40:0/4238284390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00fc0d7020 0x7f00fc0df390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0100009f70 tx=0x7f010000ecd0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.695+0000 7f010a5c3640 1 -- 172.21.15.40:0/4238284390 shutdown_connections 2024-04-22T07:21:05.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.695+0000 7f010a5c3640 1 --2- 172.21.15.40:0/4238284390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00fc0e0cd0 0x7f00fc0cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.695+0000 7f010a5c3640 1 --2- 172.21.15.40:0/4238284390 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f00fc0e0890 0x7f00fc0d1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.695+0000 7f010a5c3640 1 --2- 172.21.15.40:0/4238284390 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f00e806c8f0 0x7f00e806edb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.695+0000 7f010a5c3640 1 --2- 172.21.15.40:0/4238284390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00fc0d7020 0x7f00fc0df390 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.695+0000 7f010a5c3640 1 -- 172.21.15.40:0/4238284390 >> 172.21.15.40:0/4238284390 conn(0x7f00fc050180 msgr2=0x7f00fc006060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:05.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.695+0000 7f010a5c3640 1 -- 172.21.15.40:0/4238284390 shutdown_connections 2024-04-22T07:21:05.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.695+0000 7f010a5c3640 1 -- 172.21.15.40:0/4238284390 wait complete. 2024-04-22T07:21:05.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.696+0000 7f5f3953b640 1 -- 172.21.15.40:0/1406955461 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5f2006c8f0 msgr2=0x7f5f2006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.696+0000 7f5f3953b640 1 --2- 172.21.15.40:0/1406955461 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5f2006c8f0 0x7f5f2006edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5f24000f60 tx=0x7f5f24009040 comp rx=0 tx=0).stop 2024-04-22T07:21:05.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.696+0000 7f5f3953b640 1 -- 172.21.15.40:0/1406955461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f340cb320 msgr2=0x7f5f340cb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:05.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.696+0000 7f5f3953b640 1 --2- 172.21.15.40:0/1406955461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f340cb320 0x7f5f340cb7a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00e200 tx=0x7f5f2c009750 comp rx=0 tx=0).stop 2024-04-22T07:21:05.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.696+0000 7f5f3953b640 1 -- 172.21.15.40:0/1406955461 shutdown_connections 2024-04-22T07:21:05.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.696+0000 7f5f3953b640 1 --2- 172.21.15.40:0/1406955461 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5f2006c8f0 0x7f5f2006edb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.696+0000 7f5f3953b640 1 --2- 172.21.15.40:0/1406955461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f340cb320 0x7f5f340cb7a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.696+0000 7f5f3953b640 1 --2- 172.21.15.40:0/1406955461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f34159800 0x7f5f34154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.696+0000 7f5f3953b640 1 --2- 172.21.15.40:0/1406955461 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f1c0051c0 0x7f5f3415b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:05.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.696+0000 7f5f3953b640 1 -- 172.21.15.40:0/1406955461 >> 172.21.15.40:0/1406955461 conn(0x7f5f3406f210 msgr2=0x7f5f34156b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:05.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.696+0000 7f5f3953b640 1 -- 172.21.15.40:0/1406955461 shutdown_connections 2024-04-22T07:21:05.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:05.696+0000 7f5f3953b640 1 -- 172.21.15.40:0/1406955461 wait complete. 2024-04-22T07:21:05.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.7 2024-04-22T07:21:05.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2024-04-22T07:21:05.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.1 2024-04-22T07:21:05.706 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.3 2024-04-22T07:21:06.686 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-22T07:21:06.687 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-22T07:21:06.689 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-22T07:21:06.693 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-22T07:21:06.696 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-22T07:21:06.698 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-22T07:21:06.706 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-22T07:21:06.706 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-22T07:21:06.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.858+0000 7f58acd9f640 1 Processor -- start 2024-04-22T07:21:06.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.857+0000 7f54769c3640 1 Processor -- start 2024-04-22T07:21:06.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.858+0000 7f58acd9f640 1 -- start start 2024-04-22T07:21:06.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.860+0000 7f58acd9f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f58a00062c0 0x7f58a00066e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.860+0000 7f58acd9f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f58a00e6690 0x7f58a00e6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.860+0000 7f58acd9f640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58a00dd840 con 0x7f58a00dd460 2024-04-22T07:21:06.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.860+0000 7f58acd9f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f58a004ba90 con 0x7f58a00062c0 2024-04-22T07:21:06.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.860+0000 7f58acd9f640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f58a00e7600 con 0x7f58a00e6690 2024-04-22T07:21:06.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.860+0000 7f58a77fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f58a00dd460 0x7f58a004b380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.40:49410/0 (socket says 172.21.15.40:49410) 2024-04-22T07:21:06.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.860+0000 7f58a77fe640 1 -- 172.21.15.40:0/1175131469 learned_addr learned my addr 172.21.15.40:0/1175131469 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:06.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.861+0000 7f58a6ffd640 1 --2- 172.21.15.40:0/1175131469 >> v2:172.21.15.40:3300/0 conn(0x7f58a00062c0 0x7f58a00066e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.861+0000 7f58a67fc640 1 -- 172.21.15.40:0/1175131469 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2287156818 0 0) 0x7f58a00dd840 con 0x7f58a00dd460 2024-04-22T07:21:06.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.861+0000 7f58a6ffd640 1 -- 172.21.15.40:0/1175131469 >> v2:172.21.15.62:3300/0 conn(0x7f58a00e6690 msgr2=0x7f58a00e6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:06.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.861+0000 7f58a7fff640 1 --2- 172.21.15.40:0/1175131469 >> v2:172.21.15.62:3300/0 conn(0x7f58a00e6690 0x7f58a00e6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.858+0000 7f54769c3640 1 -- start start 2024-04-22T07:21:06.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.859+0000 7f54769c3640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f54700c62c0 0x7f54700c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.859+0000 7f54769c3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f54700c9300 0x7f5470162510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.861+0000 7f58a6ffd640 1 --2- 172.21.15.40:0/1175131469 >> v2:172.21.15.62:3300/0 conn(0x7f58a00e6690 0x7f58a00e6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.861+0000 7f58a6ffd640 1 -- 172.21.15.40:0/1175131469 >> v1:172.21.15.62:6789/0 conn(0x7f58a00dd460 legacy=0x7f58a004b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:06.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.861+0000 7f58a6ffd640 1 -- 172.21.15.40:0/1175131469 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a00071a0 con 0x7f58a00062c0 2024-04-22T07:21:06.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.859+0000 7f54769c3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5470072ea0 con 0x7f54701591e0 2024-04-22T07:21:06.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.859+0000 7f54769c3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f54700c7ff0 con 0x7f54700c9300 2024-04-22T07:21:06.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.863+0000 7f58a6ffd640 1 --2- 172.21.15.40:0/1175131469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58a00062c0 0x7f58a00066e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f58a0009d90 tx=0x7f589c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abafe66323bffeea server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:06.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.859+0000 7f54769c3640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f5470072c40 con 0x7f54700c62c0 2024-04-22T07:21:06.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.863+0000 7f58a7fff640 1 --2- 172.21.15.40:0/1175131469 >> v2:172.21.15.62:3300/0 conn(0x7f58a00e6690 0x7f58a00e6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:06.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.859+0000 7f54761c2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f54700c9300 0x7f5470162510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.859+0000 7f54761c2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f54700c9300 0x7f5470162510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42378/0 (socket says 172.21.15.40:42378) 2024-04-22T07:21:06.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.859+0000 7f54761c2640 1 -- 172.21.15.40:0/2558376923 learned_addr learned my addr 172.21.15.40:0/2558376923 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:06.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.860+0000 7f54751c0640 1 --2- 172.21.15.40:0/2558376923 >> v2:172.21.15.62:3300/0 conn(0x7f54700c62c0 0x7f54700c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.860+0000 7f54761c2640 1 -- 172.21.15.40:0/2558376923 >> v2:172.21.15.62:3300/0 conn(0x7f54700c62c0 msgr2=0x7f54700c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:06.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.860+0000 7f54761c2640 1 --2- 172.21.15.40:0/2558376923 >> v2:172.21.15.62:3300/0 conn(0x7f54700c62c0 0x7f54700c8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.860+0000 7f54761c2640 1 -- 172.21.15.40:0/2558376923 >> v1:172.21.15.40:6789/0 conn(0x7f54701591e0 legacy=0x7f5470072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:06.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.860+0000 7f54761c2640 1 -- 172.21.15.40:0/2558376923 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54700c76c0 con 0x7f54700c9300 2024-04-22T07:21:06.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.862+0000 7f54761c2640 1 --2- 172.21.15.40:0/2558376923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54700c9300 0x7f5470162510 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f54700713d0 tx=0x7f546802bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ca6ed6fb3ed2b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:06.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.863+0000 7f54749bf640 1 -- 172.21.15.40:0/2558376923 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546802c8e0 con 0x7f54700c9300 2024-04-22T07:21:06.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.863+0000 7f58a67fc640 1 -- 172.21.15.40:0/1175131469 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589c035020 con 0x7f58a00062c0 2024-04-22T07:21:06.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.863+0000 7f58a67fc640 1 -- 172.21.15.40:0/1175131469 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f589c031870 con 0x7f58a00062c0 2024-04-22T07:21:06.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.864+0000 7f58acd9f640 1 -- 172.21.15.40:0/1175131469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58a00062c0 msgr2=0x7f58a00066e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:06.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.864+0000 7f58acd9f640 1 --2- 172.21.15.40:0/1175131469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58a00062c0 0x7f58a00066e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f58a0009d90 tx=0x7f589c02b910 comp rx=0 tx=0).stop 2024-04-22T07:21:06.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.864+0000 7f58acd9f640 1 -- 172.21.15.40:0/1175131469 shutdown_connections 2024-04-22T07:21:06.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.864+0000 7f58acd9f640 1 --2- 172.21.15.40:0/1175131469 >> v2:172.21.15.62:3300/0 conn(0x7f58a00e6690 0x7f58a00e6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.864+0000 7f58acd9f640 1 --2- 172.21.15.40:0/1175131469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58a00062c0 0x7f58a00066e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.864+0000 7f58acd9f640 1 -- 172.21.15.40:0/1175131469 >> 172.21.15.40:0/1175131469 conn(0x7f58a0050a00 msgr2=0x7f58a0050e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:06.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.865+0000 7f58acd9f640 1 -- 172.21.15.40:0/1175131469 shutdown_connections 2024-04-22T07:21:06.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.866+0000 7f54749bf640 1 -- 172.21.15.40:0/2558376923 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f546802ca80 con 0x7f54700c9300 2024-04-22T07:21:06.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.865+0000 7f58acd9f640 1 -- 172.21.15.40:0/1175131469 wait complete. 2024-04-22T07:21:06.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.867+0000 7f58acd9f640 1 Processor -- start 2024-04-22T07:21:06.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.867+0000 7f54769c3640 1 -- 172.21.15.40:0/2558376923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54700c9300 msgr2=0x7f5470162510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:06.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.867+0000 7f54769c3640 1 --2- 172.21.15.40:0/2558376923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54700c9300 0x7f5470162510 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f54700713d0 tx=0x7f546802bdc0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.867+0000 7f54769c3640 1 -- 172.21.15.40:0/2558376923 shutdown_connections 2024-04-22T07:21:06.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.867+0000 7f54769c3640 1 --2- 172.21.15.40:0/2558376923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54700c9300 0x7f5470162510 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.867+0000 7f54769c3640 1 --2- 172.21.15.40:0/2558376923 >> v2:172.21.15.62:3300/0 conn(0x7f54700c62c0 0x7f54700c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.867+0000 7f54769c3640 1 -- 172.21.15.40:0/2558376923 >> 172.21.15.40:0/2558376923 conn(0x7f547006f290 msgr2=0x7f547006f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:06.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.867+0000 7f54769c3640 1 -- 172.21.15.40:0/2558376923 shutdown_connections 2024-04-22T07:21:06.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.868+0000 7f58acd9f640 1 -- start start 2024-04-22T07:21:06.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.868+0000 7f54769c3640 1 -- 172.21.15.40:0/2558376923 wait complete. 2024-04-22T07:21:06.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.870+0000 7f58acd9f640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58a00062c0 0x7f58a0034d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.870+0000 7f58acd9f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58a00dd460 0x7f58a004fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.870+0000 7f58acd9f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58a00e6690 0x7f58a017a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.870+0000 7f58acd9f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f58a0007760 con 0x7f58a00e6690 2024-04-22T07:21:06.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.870+0000 7f58acd9f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f58a0007db0 con 0x7f58a00dd460 2024-04-22T07:21:06.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.870+0000 7f58acd9f640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f58a0007a40 con 0x7f58a00062c0 2024-04-22T07:21:06.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.870+0000 7f54769c3640 1 Processor -- start 2024-04-22T07:21:06.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.870+0000 7f54769c3640 1 -- start start 2024-04-22T07:21:06.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.870+0000 7f58a7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58a00e6690 0x7f58a017a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.870+0000 7f58a7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58a00e6690 0x7f58a017a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42392/0 (socket says 172.21.15.40:42392) 2024-04-22T07:21:06.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.870+0000 7f58a7fff640 1 -- 172.21.15.40:0/3697184668 learned_addr learned my addr 172.21.15.40:0/3697184668 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:06.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.871+0000 7f58a7fff640 1 -- 172.21.15.40:0/3697184668 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58a00062c0 msgr2=0x7f58a0034d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:06.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.871+0000 7f58a7fff640 1 --2- 172.21.15.40:0/3697184668 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58a00062c0 0x7f58a0034d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.871+0000 7f58a7fff640 1 -- 172.21.15.40:0/3697184668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58a00dd460 msgr2=0x7f58a004fac0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-22T07:21:06.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.871+0000 7f58a7fff640 1 --2- 172.21.15.40:0/3697184668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58a00dd460 0x7f58a004fac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.871+0000 7f58a7fff640 1 -- 172.21.15.40:0/3697184668 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a0179bd0 con 0x7f58a00e6690 2024-04-22T07:21:06.870 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.871+0000 7f58a7fff640 1 --2- 172.21.15.40:0/3697184668 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58a00e6690 0x7f58a017a690 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f589400c7c0 tx=0x7f589400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:06.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.871+0000 7f54769c3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54700c62c0 0x7f547015a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.871+0000 7f5893fff640 1 -- 172.21.15.40:0/3697184668 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5894015020 con 0x7f58a00e6690 2024-04-22T07:21:06.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.872+0000 7f58acd9f640 1 -- 172.21.15.40:0/3697184668 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58a0035780 con 0x7f58a00e6690 2024-04-22T07:21:06.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.872+0000 7f58acd9f640 1 -- 172.21.15.40:0/3697184668 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58a0035d40 con 0x7f58a00e6690 2024-04-22T07:21:06.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.872+0000 7f5893fff640 1 -- 172.21.15.40:0/3697184668 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5894004230 con 0x7f58a00e6690 2024-04-22T07:21:06.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.872+0000 7f54759c1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54700c62c0 0x7f547015a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.872+0000 7f54759c1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54700c62c0 0x7f547015a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42408/0 (socket says 172.21.15.40:42408) 2024-04-22T07:21:06.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.872+0000 7f54759c1640 1 -- 172.21.15.40:0/2995067582 learned_addr learned my addr 172.21.15.40:0/2995067582 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:06.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.872+0000 7f54769c3640 1 --2- 172.21.15.40:0/2995067582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54700c9300 0x7f54700caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.872+0000 7f54769c3640 1 --2- 172.21.15.40:0/2995067582 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54701591e0 0x7f54700cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.872+0000 7f54751c0640 1 --2- 172.21.15.40:0/2995067582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54700c9300 0x7f54700caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.873+0000 7f54761c2640 1 --2- 172.21.15.40:0/2995067582 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54701591e0 0x7f54700cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.873+0000 7f54769c3640 1 -- 172.21.15.40:0/2995067582 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f54700c6700 con 0x7f54700c62c0 2024-04-22T07:21:06.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.873+0000 7f54769c3640 1 -- 172.21.15.40:0/2995067582 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f54700c7c80 con 0x7f54700c9300 2024-04-22T07:21:06.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.873+0000 7f5893fff640 1 -- 172.21.15.40:0/3697184668 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5894007620 con 0x7f58a00e6690 2024-04-22T07:21:06.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.874+0000 7f58acd9f640 1 -- 172.21.15.40:0/3697184668 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5888005290 con 0x7f58a00e6690 2024-04-22T07:21:06.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.874+0000 7f54769c3640 1 -- 172.21.15.40:0/2995067582 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f54701595c0 con 0x7f54701591e0 2024-04-22T07:21:06.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.875+0000 7f5893fff640 1 -- 172.21.15.40:0/3697184668 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5894018020 con 0x7f58a00e6690 2024-04-22T07:21:06.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.876+0000 7f5893fff640 1 --2- 172.21.15.40:0/3697184668 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f588c06c9f0 0x7f588c06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.876+0000 7f58a77fe640 1 --2- 172.21.15.40:0/3697184668 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f588c06c9f0 0x7f588c06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.876+0000 7f5893fff640 1 -- 172.21.15.40:0/3697184668 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f589408ba80 con 0x7f58a00e6690 2024-04-22T07:21:06.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.877+0000 7f58a77fe640 1 --2- 172.21.15.40:0/3697184668 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f588c06c9f0 0x7f588c06eeb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f58a8050f50 tx=0x7f58a806a450 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:06.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.875+0000 7f54759c1640 1 -- 172.21.15.40:0/2995067582 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54701591e0 msgr2=0x7f54700cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:06.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.875+0000 7f54759c1640 1 --2- 172.21.15.40:0/2995067582 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54701591e0 0x7f54700cafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.875+0000 7f54759c1640 1 -- 172.21.15.40:0/2995067582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54700c9300 msgr2=0x7f54700caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:06.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.875+0000 7f54759c1640 1 --2- 172.21.15.40:0/2995067582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54700c9300 0x7f54700caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.875+0000 7f54759c1640 1 -- 172.21.15.40:0/2995067582 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f547014b960 con 0x7f54700c62c0 2024-04-22T07:21:06.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.875+0000 7f54751c0640 1 --2- 172.21.15.40:0/2995067582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54700c9300 0x7f54700caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:06.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.877+0000 7f54761c2640 1 --2- 172.21.15.40:0/2995067582 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54701591e0 0x7f54700cafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:06.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.877+0000 7f54759c1640 1 --2- 172.21.15.40:0/2995067582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54700c62c0 0x7f547015a5b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f546000c8f0 tx=0x7f546000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:06.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.884+0000 7f5893fff640 1 -- 172.21.15.40:0/3697184668 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f589401f020 con 0x7f58a00e6690 2024-04-22T07:21:06.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.885+0000 7f54667fc640 1 -- 172.21.15.40:0/2995067582 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5460017070 con 0x7f54700c62c0 2024-04-22T07:21:06.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.885+0000 7f54667fc640 1 -- 172.21.15.40:0/2995067582 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5460005270 con 0x7f54700c62c0 2024-04-22T07:21:06.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.885+0000 7f54667fc640 1 -- 172.21.15.40:0/2995067582 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546000a640 con 0x7f54700c62c0 2024-04-22T07:21:06.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.886+0000 7f54769c3640 1 -- 172.21.15.40:0/2995067582 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54702006e0 con 0x7f54700c62c0 2024-04-22T07:21:06.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.889+0000 7f54667fc640 1 -- 172.21.15.40:0/2995067582 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f546001a070 con 0x7f54700c62c0 2024-04-22T07:21:06.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.889+0000 7f54667fc640 1 --2- 172.21.15.40:0/2995067582 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f545406c970 0x7f545406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.890+0000 7f54751c0640 1 --2- 172.21.15.40:0/2995067582 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f545406c970 0x7f545406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.891+0000 7f54751c0640 1 --2- 172.21.15.40:0/2995067582 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f545406c970 0x7f545406ee30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f547016a410 tx=0x7f546c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:06.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.891+0000 7f54769c3640 1 -- 172.21.15.40:0/2995067582 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5470200ca0 con 0x7f54700c62c0 2024-04-22T07:21:06.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.892+0000 7f54667fc640 1 -- 172.21.15.40:0/2995067582 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5460056b50 con 0x7f54700c62c0 2024-04-22T07:21:06.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.893+0000 7f54769c3640 1 -- 172.21.15.40:0/2995067582 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f547004fce0 con 0x7f54700c62c0 2024-04-22T07:21:06.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.903+0000 7f54667fc640 1 -- 172.21.15.40:0/2995067582 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f54600591b0 con 0x7f54700c62c0 2024-04-22T07:21:06.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.911+0000 7f1c44eca640 1 Processor -- start 2024-04-22T07:21:06.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.911+0000 7f1c44eca640 1 -- start start 2024-04-22T07:21:06.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.912+0000 7f1c44eca640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c380d51f0 0x7f1c3804b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.912+0000 7f1c44eca640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1c38005ed0 0x7f1c38045320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.912+0000 7f1c3ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1c38005ed0 0x7f1c38045320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.913+0000 7f1c3ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1c38005ed0 0x7f1c38045320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42424/0 (socket says 172.21.15.40:42424) 2024-04-22T07:21:06.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.913+0000 7f1c3f7fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c380d51f0 0x7f1c3804b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.913+0000 7f1c3effd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1c3804b080 0x7f1c380db820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.40:49424/0 (socket says 172.21.15.40:49424) 2024-04-22T07:21:06.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.913+0000 7f1c3ffff640 1 -- 172.21.15.40:0/501985929 learned_addr learned my addr 172.21.15.40:0/501985929 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:06.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.913+0000 7f1c44eca640 1 -- 172.21.15.40:0/501985929 --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c38045ec0 con 0x7f1c3804b080 2024-04-22T07:21:06.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.913+0000 7f1c44eca640 1 -- 172.21.15.40:0/501985929 --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f1c38046f20 con 0x7f1c38005ed0 2024-04-22T07:21:06.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.913+0000 7f1c44eca640 1 -- 172.21.15.40:0/501985929 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1c38046160 con 0x7f1c380d51f0 2024-04-22T07:21:06.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.912+0000 7fc75295b640 1 Processor -- start 2024-04-22T07:21:06.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.913+0000 7fc75295b640 1 -- start start 2024-04-22T07:21:06.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.914+0000 7f1c3e7fc640 1 -- 172.21.15.40:0/501985929 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2024360319 0 0) 0x7f1c38045ec0 con 0x7f1c3804b080 2024-04-22T07:21:06.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.914+0000 7f1c3e7fc640 1 -- 172.21.15.40:0/501985929 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c30003520 con 0x7f1c3804b080 2024-04-22T07:21:06.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.914+0000 7fc75295b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc7440fc970 0x7fc744005ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.914+0000 7fc75295b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc7440f6ad0 0x7fc74404b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.914+0000 7fc75295b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7440069d0 con 0x7fc74404b5c0 2024-04-22T07:21:06.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.914+0000 7fc75295b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fc7440075e0 con 0x7fc7440f6ad0 2024-04-22T07:21:06.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.914+0000 7fc75295b640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fc744006cb0 con 0x7fc7440fc970 2024-04-22T07:21:06.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.914+0000 7fc751959640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc7440fc970 0x7fc744005ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.914+0000 7f1c3f7fe640 1 -- 172.21.15.40:0/501985929 >> v2:172.21.15.40:3300/0 conn(0x7f1c38005ed0 msgr2=0x7f1c38045320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:06.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.914+0000 7f1c3f7fe640 1 --2- 172.21.15.40:0/501985929 >> v2:172.21.15.40:3300/0 conn(0x7f1c38005ed0 0x7f1c38045320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.914+0000 7f1c3f7fe640 1 -- 172.21.15.40:0/501985929 >> v1:172.21.15.62:6789/0 conn(0x7f1c3804b080 legacy=0x7f1c380db820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:06.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.914+0000 7f1c3f7fe640 1 -- 172.21.15.40:0/501985929 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c38046440 con 0x7f1c380d51f0 2024-04-22T07:21:06.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.914+0000 7f1c3ffff640 1 --2- 172.21.15.40:0/501985929 >> v2:172.21.15.40:3300/0 conn(0x7f1c38005ed0 0x7f1c38045320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:06.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.915+0000 7f1c3f7fe640 1 --2- 172.21.15.40:0/501985929 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c380d51f0 0x7f1c3804b610 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c009fb0 tx=0x7f1c2c02bb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99ae43d819198d9e server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:06.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.915+0000 7f1c3e7fc640 1 -- 172.21.15.40:0/501985929 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c039070 con 0x7f1c380d51f0 2024-04-22T07:21:06.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.915+0000 7f1c3e7fc640 1 -- 172.21.15.40:0/501985929 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c2c02c940 con 0x7f1c380d51f0 2024-04-22T07:21:06.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.916+0000 7f1c3e7fc640 1 -- 172.21.15.40:0/501985929 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c02ccf0 con 0x7f1c380d51f0 2024-04-22T07:21:06.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.916+0000 7f1c44eca640 1 -- 172.21.15.40:0/501985929 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c380d51f0 msgr2=0x7f1c3804b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:06.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.916+0000 7f1c44eca640 1 --2- 172.21.15.40:0/501985929 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c380d51f0 0x7f1c3804b610 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c009fb0 tx=0x7f1c2c02bb90 comp rx=0 tx=0).stop 2024-04-22T07:21:06.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.917+0000 7ff039251640 1 Processor -- start 2024-04-22T07:21:06.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.917+0000 7ff039251640 1 -- start start 2024-04-22T07:21:06.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.917+0000 7f1c44eca640 1 -- 172.21.15.40:0/501985929 shutdown_connections 2024-04-22T07:21:06.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.917+0000 7f1c44eca640 1 --2- 172.21.15.40:0/501985929 >> v2:172.21.15.40:3300/0 conn(0x7f1c38005ed0 0x7f1c38045320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.917+0000 7f1c44eca640 1 --2- 172.21.15.40:0/501985929 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c380d51f0 0x7f1c3804b610 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.917+0000 7f1c44eca640 1 -- 172.21.15.40:0/501985929 >> 172.21.15.40:0/501985929 conn(0x7f1c38050170 msgr2=0x7f1c38050580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:06.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.915+0000 7fc75215a640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc74404b5c0 0x7fc744045210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33934/0 (socket says 172.21.15.40:33934) 2024-04-22T07:21:06.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.915+0000 7fc75215a640 1 -- 172.21.15.40:0/425183447 learned_addr learned my addr 172.21.15.40:0/425183447 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:06.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.915+0000 7fc751158640 1 --2- 172.21.15.40:0/425183447 >> v2:172.21.15.40:3300/0 conn(0x7fc7440f6ad0 0x7fc74404b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.916+0000 7fc751959640 1 -- 172.21.15.40:0/425183447 >> v2:172.21.15.40:3300/0 conn(0x7fc7440f6ad0 msgr2=0x7fc74404b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:06.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.916+0000 7fc751959640 1 --2- 172.21.15.40:0/425183447 >> v2:172.21.15.40:3300/0 conn(0x7fc7440f6ad0 0x7fc74404b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.916+0000 7fc751959640 1 -- 172.21.15.40:0/425183447 >> v1:172.21.15.40:6789/0 conn(0x7fc74404b5c0 legacy=0x7fc744045210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:06.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.916+0000 7fc751959640 1 -- 172.21.15.40:0/425183447 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc744006f90 con 0x7fc7440fc970 2024-04-22T07:21:06.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.917+0000 7fc751959640 1 --2- 172.21.15.40:0/425183447 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7440fc970 0x7fc744005ed0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc74c000b60 tx=0x7fc74c09f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f06d37ef6338130 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:06.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.917+0000 7f1c44eca640 1 -- 172.21.15.40:0/501985929 shutdown_connections 2024-04-22T07:21:06.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.917+0000 7f1c44eca640 1 -- 172.21.15.40:0/501985929 wait complete. 2024-04-22T07:21:06.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.917+0000 7f5ed71f4640 1 Processor -- start 2024-04-22T07:21:06.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.918+0000 7fc750957640 1 -- 172.21.15.40:0/425183447 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74c0ac070 con 0x7fc7440fc970 2024-04-22T07:21:06.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.918+0000 7fc750957640 1 -- 172.21.15.40:0/425183447 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc74c0a7640 con 0x7fc7440fc970 2024-04-22T07:21:06.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.918+0000 7fc750957640 1 -- 172.21.15.40:0/425183447 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74c0a7ab0 con 0x7fc7440fc970 2024-04-22T07:21:06.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.919+0000 7fc75295b640 1 -- 172.21.15.40:0/425183447 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7440fc970 msgr2=0x7fc744005ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:06.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.919+0000 7fc75295b640 1 --2- 172.21.15.40:0/425183447 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7440fc970 0x7fc744005ed0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc74c000b60 tx=0x7fc74c09f230 comp rx=0 tx=0).stop 2024-04-22T07:21:06.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.919+0000 7fc75295b640 1 -- 172.21.15.40:0/425183447 shutdown_connections 2024-04-22T07:21:06.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.919+0000 7fc75295b640 1 --2- 172.21.15.40:0/425183447 >> v2:172.21.15.40:3300/0 conn(0x7fc7440f6ad0 0x7fc74404b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.919+0000 7fc75295b640 1 --2- 172.21.15.40:0/425183447 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7440fc970 0x7fc744005ed0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.919+0000 7fc75295b640 1 -- 172.21.15.40:0/425183447 >> 172.21.15.40:0/425183447 conn(0x7fc744050170 msgr2=0x7fc744050580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:06.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.918+0000 7f4329150640 1 Processor -- start 2024-04-22T07:21:06.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.918+0000 7f4329150640 1 -- start start 2024-04-22T07:21:06.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.919+0000 7f1c44eca640 1 Processor -- start 2024-04-22T07:21:06.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.917+0000 7f5ed71f4640 1 -- start start 2024-04-22T07:21:06.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.918+0000 7f5ed71f4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5ec8046c20 0x7f5ec804c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.919+0000 7f5ed4f90640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5ec80dd4d0 0x7f5ec8045560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33948/0 (socket says 172.21.15.40:33948) 2024-04-22T07:21:06.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.919+0000 7f5ed5791640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5ec8046c20 0x7f5ec804c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.919+0000 7f5ed5791640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5ec8046c20 0x7f5ec804c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42446/0 (socket says 172.21.15.40:42446) 2024-04-22T07:21:06.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.919+0000 7f5ed5791640 1 -- 172.21.15.40:0/3002289205 learned_addr learned my addr 172.21.15.40:0/3002289205 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:06.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.919+0000 7f5ed71f4640 1 -- 172.21.15.40:0/3002289205 --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ec80dd8b0 con 0x7f5ec80dd4d0 2024-04-22T07:21:06.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.919+0000 7f4329150640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f431c0dd350 0x7f431c04f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.919+0000 7f4329150640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f431c0371f0 0x7f431c007420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.919+0000 7f4329150640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f431c0063a0 con 0x7f431c0e70a0 2024-04-22T07:21:06.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.919+0000 7f4329150640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f431c006660 con 0x7f431c0371f0 2024-04-22T07:21:06.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.919+0000 7f4329150640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f431c006940 con 0x7f431c0dd350 2024-04-22T07:21:06.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.919+0000 7f432894f640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f431c0e70a0 0x7f431c050300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.40:49434/0 (socket says 172.21.15.40:49434) 2024-04-22T07:21:06.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.919+0000 7f432894f640 1 -- 172.21.15.40:0/1973071207 learned_addr learned my addr 172.21.15.40:0/1973071207 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:06.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7f43237fe640 1 --2- 172.21.15.40:0/1973071207 >> v2:172.21.15.40:3300/0 conn(0x7f431c0371f0 0x7f431c007420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7f4322ffd640 1 -- 172.21.15.40:0/1973071207 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2723601292 0 0) 0x7f431c0063a0 con 0x7f431c0e70a0 2024-04-22T07:21:06.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7f4322ffd640 1 -- 172.21.15.40:0/1973071207 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4314003520 con 0x7f431c0e70a0 2024-04-22T07:21:06.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7f4322ffd640 1 -- 172.21.15.40:0/1973071207 <== mon.1 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2445536335 0 0) 0x7f4314003520 con 0x7f431c0e70a0 2024-04-22T07:21:06.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7f4322ffd640 1 -- 172.21.15.40:0/1973071207 >> v2:172.21.15.62:3300/0 conn(0x7f431c0dd350 msgr2=0x7f431c04f600 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-22T07:21:06.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.918+0000 7ff039251640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff0341591e0 0x7ff0340c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.918+0000 7ff039251640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff034072ea0 con 0x7ff034072530 2024-04-22T07:21:06.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.918+0000 7ff039251640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0340c76c0 con 0x7ff034072970 2024-04-22T07:21:06.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.918+0000 7ff039251640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ff0340c6800 con 0x7ff0341591e0 2024-04-22T07:21:06.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.919+0000 7ff0337fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff034072530 0x7ff0340c8dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33944/0 (socket says 172.21.15.40:33944) 2024-04-22T07:21:06.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.919+0000 7f5ed71f4640 1 -- 172.21.15.40:0/3002289205 --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ec80e34d0 con 0x7f5ec804bea0 2024-04-22T07:21:06.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7f4322ffd640 1 --2- 172.21.15.40:0/1973071207 >> v2:172.21.15.62:3300/0 conn(0x7f431c0dd350 0x7f431c04f600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.919+0000 7f5ed71f4640 1 -- 172.21.15.40:0/3002289205 --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f5ec80e4050 con 0x7f5ec8046c20 2024-04-22T07:21:06.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7f5ed5791640 1 -- 172.21.15.40:0/3002289205 >> v1:172.21.15.62:6789/0 conn(0x7f5ec804bea0 legacy=0x7f5ec8046510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:06.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7f5ed5791640 1 -- 172.21.15.40:0/3002289205 >> v1:172.21.15.40:6789/0 conn(0x7f5ec80dd4d0 legacy=0x7f5ec8045560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:06.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7f5ed5791640 1 -- 172.21.15.40:0/3002289205 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec80e37b0 con 0x7f5ec8046c20 2024-04-22T07:21:06.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.921+0000 7f5ed5791640 1 --2- 172.21.15.40:0/3002289205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ec8046c20 0x7f5ec804c2e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0076430 tx=0x7f5ed00a7b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a61925bae19cfb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:06.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7f4322ffd640 1 -- 172.21.15.40:0/1973071207 >> v2:172.21.15.40:3300/0 conn(0x7f431c0371f0 msgr2=0x7f431c007420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:06.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.921+0000 7f4322ffd640 1 --2- 172.21.15.40:0/1973071207 >> v2:172.21.15.40:3300/0 conn(0x7f431c0371f0 0x7f431c007420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.921+0000 7f4322ffd640 1 -- 172.21.15.40:0/1973071207 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f431c006c20 con 0x7f431c0e70a0 2024-04-22T07:21:06.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.921+0000 7f4322ffd640 1 -- 172.21.15.40:0/1973071207 <== mon.1 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7f4324050530 con 0x7f431c0e70a0 2024-04-22T07:21:06.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.921+0000 7f4322ffd640 1 -- 172.21.15.40:0/1973071207 >> v1:172.21.15.62:6789/0 conn(0x7f431c0e70a0 legacy=0x7f431c050300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:06.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.921+0000 7f4322ffd640 1 --2- 172.21.15.40:0/1973071207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43140039b0 0x7f4314003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.921+0000 7f4322ffd640 1 --2- 172.21.15.40:0/1973071207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4314004800 0x7f4314004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.921+0000 7f4322ffd640 1 --2- 172.21.15.40:0/1973071207 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43140051c0 0x7f431400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.921+0000 7f4322ffd640 1 -- 172.21.15.40:0/1973071207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f431c006660 con 0x7f4314004800 2024-04-22T07:21:06.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.921+0000 7f4322ffd640 1 -- 172.21.15.40:0/1973071207 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f431c006940 con 0x7f43140039b0 2024-04-22T07:21:06.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.921+0000 7f4322ffd640 1 -- 172.21.15.40:0/1973071207 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f431400c090 con 0x7f43140051c0 2024-04-22T07:21:06.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.921+0000 7f43237fe640 1 --2- 172.21.15.40:0/1973071207 >> v2:172.21.15.40:3300/0 conn(0x7f431c0371f0 0x7f431c007420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:06.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.919+0000 7ff0337fe640 1 -- 172.21.15.40:0/2582602499 learned_addr learned my addr 172.21.15.40:0/2582602499 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:06.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.919+0000 7ff033fff640 1 --2- 172.21.15.40:0/2582602499 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff0341591e0 0x7ff0340c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.919+0000 7ff032ffd640 1 -- 172.21.15.40:0/2582602499 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1751412504 0 0) 0x7ff034072ea0 con 0x7ff034072530 2024-04-22T07:21:06.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7ff032ffd640 1 -- 172.21.15.40:0/2582602499 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff01c003520 con 0x7ff034072530 2024-04-22T07:21:06.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7ff032ffd640 1 -- 172.21.15.40:0/2582602499 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 957190953 0 0) 0x7ff01c003520 con 0x7ff034072530 2024-04-22T07:21:06.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7ff032ffd640 1 -- 172.21.15.40:0/2582602499 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff0341591e0 msgr2=0x7ff0340c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:06.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7ff032ffd640 1 --2- 172.21.15.40:0/2582602499 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff0341591e0 0x7ff0340c62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7ff032ffd640 1 -- 172.21.15.40:0/2582602499 >> v1:172.21.15.62:6789/0 conn(0x7ff034072970 legacy=0x7ff034162510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:06.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7ff032ffd640 1 -- 172.21.15.40:0/2582602499 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0340c79a0 con 0x7ff034072530 2024-04-22T07:21:06.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7ff032ffd640 1 -- 172.21.15.40:0/2582602499 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7ff028001670 con 0x7ff034072530 2024-04-22T07:21:06.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7ff032ffd640 1 -- 172.21.15.40:0/2582602499 >> v1:172.21.15.40:6789/0 conn(0x7ff034072530 legacy=0x7ff0340c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:06.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7ff032ffd640 1 --2- 172.21.15.40:0/2582602499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff01c003a60 0x7ff01c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7ff032ffd640 1 --2- 172.21.15.40:0/2582602499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff01c004800 0x7ff01c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7ff032ffd640 1 --2- 172.21.15.40:0/2582602499 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff01c005310 0x7ff01c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7ff032ffd640 1 -- 172.21.15.40:0/2582602499 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff0340c6800 con 0x7ff01c004800 2024-04-22T07:21:06.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7ff032ffd640 1 -- 172.21.15.40:0/2582602499 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff01c00c1e0 con 0x7ff01c003a60 2024-04-22T07:21:06.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7ff032ffd640 1 -- 172.21.15.40:0/2582602499 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ff01c00c3e0 con 0x7ff01c005310 2024-04-22T07:21:06.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7ff0337fe640 1 --2- 172.21.15.40:0/2582602499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff01c004800 0x7ff01c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.921+0000 7ff0337fe640 1 -- 172.21.15.40:0/2582602499 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff01c005310 msgr2=0x7ff01c00b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T07:21:06.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.921+0000 7ff0337fe640 1 --2- 172.21.15.40:0/2582602499 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff01c005310 0x7ff01c00b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.921+0000 7ff0337fe640 1 -- 172.21.15.40:0/2582602499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff01c003a60 msgr2=0x7ff01c003e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T07:21:06.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.921+0000 7ff0337fe640 1 --2- 172.21.15.40:0/2582602499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff01c003a60 0x7ff01c003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.921+0000 7ff0337fe640 1 -- 172.21.15.40:0/2582602499 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff01c003520 con 0x7ff01c004800 2024-04-22T07:21:06.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.922+0000 7f43237fe640 1 --2- 172.21.15.40:0/1973071207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4314004800 0x7f4314004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.922+0000 7f432894f640 1 --2- 172.21.15.40:0/1973071207 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43140051c0 0x7f431400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.919+0000 7f1c44eca640 1 -- start start 2024-04-22T07:21:06.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7f1c44eca640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c38005ed0 0x7f1c380cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.919+0000 7fc75295b640 1 -- 172.21.15.40:0/425183447 shutdown_connections 2024-04-22T07:21:06.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.919+0000 7fc75295b640 1 -- 172.21.15.40:0/425183447 wait complete. 2024-04-22T07:21:06.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.921+0000 7fc75295b640 1 Processor -- start 2024-04-22T07:21:06.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.921+0000 7fc75295b640 1 -- start start 2024-04-22T07:21:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7f1c44eca640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c3804b080 0x7f1c380cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7f1c44eca640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c380d51f0 0x7f1c38047f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7f1c44eca640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3800e290 con 0x7f1c3804b080 2024-04-22T07:21:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7f1c44eca640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1c38046a00 con 0x7f1c380d51f0 2024-04-22T07:21:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.920+0000 7f1c44eca640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1c3800e410 con 0x7f1c38005ed0 2024-04-22T07:21:06.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.921+0000 7f1c3effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c3804b080 0x7f1c380cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.921+0000 7f1c3effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c3804b080 0x7f1c380cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42476/0 (socket says 172.21.15.40:42476) 2024-04-22T07:21:06.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.921+0000 7f1c3effd640 1 -- 172.21.15.40:0/136074985 learned_addr learned my addr 172.21.15.40:0/136074985 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:06.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.921+0000 7f1c3f7fe640 1 --2- 172.21.15.40:0/136074985 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c38005ed0 0x7f1c380cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.921+0000 7f1c3f7fe640 1 -- 172.21.15.40:0/136074985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c380d51f0 msgr2=0x7f1c38047f70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T07:21:06.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.921+0000 7f1c3f7fe640 1 --2- 172.21.15.40:0/136074985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c380d51f0 0x7f1c38047f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.921+0000 7f1c3f7fe640 1 -- 172.21.15.40:0/136074985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c3804b080 msgr2=0x7f1c380cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:06.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.921+0000 7f1c3f7fe640 1 --2- 172.21.15.40:0/136074985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c3804b080 0x7f1c380cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.921+0000 7f1c3f7fe640 1 -- 172.21.15.40:0/136074985 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c380cb480 con 0x7f1c38005ed0 2024-04-22T07:21:06.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.922+0000 7f1c3f7fe640 1 --2- 172.21.15.40:0/136074985 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c38005ed0 0x7f1c380cbdf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c033000 tx=0x7f1c2c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:06.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.922+0000 7f4323fff640 1 --2- 172.21.15.40:0/1973071207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43140039b0 0x7f4314003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.922+0000 7f1c2bfff640 1 -- 172.21.15.40:0/136074985 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c065020 con 0x7f1c38005ed0 2024-04-22T07:21:06.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.922+0000 7f1c2bfff640 1 -- 172.21.15.40:0/136074985 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c2c034e00 con 0x7f1c38005ed0 2024-04-22T07:21:06.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.922+0000 7ff0337fe640 1 --2- 172.21.15.40:0/2582602499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff01c004800 0x7ff01c004c80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff028004ed0 tx=0x7ff01c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ef9b71cbcf9f99 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:06.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.922+0000 7f432894f640 1 -- 172.21.15.40:0/1973071207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43140039b0 msgr2=0x7f4314003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:06.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.922+0000 7f432894f640 1 --2- 172.21.15.40:0/1973071207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43140039b0 0x7f4314003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.922+0000 7f432894f640 1 -- 172.21.15.40:0/1973071207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4314004800 msgr2=0x7f4314004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:06.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.922+0000 7f432894f640 1 --2- 172.21.15.40:0/1973071207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4314004800 0x7f4314004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.922+0000 7f1c44eca640 1 -- 172.21.15.40:0/136074985 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c380cf790 con 0x7f1c38005ed0 2024-04-22T07:21:06.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.922+0000 7f1c44eca640 1 -- 172.21.15.40:0/136074985 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c380cb1a0 con 0x7f1c38005ed0 2024-04-22T07:21:06.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.922+0000 7f1c2bfff640 1 -- 172.21.15.40:0/136074985 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c039040 con 0x7f1c38005ed0 2024-04-22T07:21:06.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.923+0000 7f5ecf7fe640 1 -- 172.21.15.40:0/3002289205 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed00b5070 con 0x7f5ec8046c20 2024-04-22T07:21:06.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.923+0000 7f432894f640 1 -- 172.21.15.40:0/1973071207 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f431c006c20 con 0x7f43140051c0 2024-04-22T07:21:06.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.923+0000 7f43237fe640 1 --2- 172.21.15.40:0/1973071207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4314004800 0x7f4314004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:06.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.923+0000 7f5ecf7fe640 1 -- 172.21.15.40:0/3002289205 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ed00a89e0 con 0x7f5ec8046c20 2024-04-22T07:21:06.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.923+0000 7f4323fff640 1 --2- 172.21.15.40:0/1973071207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43140039b0 0x7f4314003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:06.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.923+0000 7f5ecf7fe640 1 -- 172.21.15.40:0/3002289205 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed00a8e50 con 0x7f5ec8046c20 2024-04-22T07:21:06.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.922+0000 7ff032ffd640 1 -- 172.21.15.40:0/2582602499 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028004b20 con 0x7ff01c004800 2024-04-22T07:21:06.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.922+0000 7ff032ffd640 1 -- 172.21.15.40:0/2582602499 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff028005af0 con 0x7ff01c004800 2024-04-22T07:21:06.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.922+0000 7ff032ffd640 1 -- 172.21.15.40:0/2582602499 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0280080d0 con 0x7ff01c004800 2024-04-22T07:21:06.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.922+0000 7fc75295b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc74404b5c0 0x7fc744195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.922+0000 7fc75295b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7440f6ad0 0x7fc7441878a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.923+0000 7fc751959640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc74404b5c0 0x7fc744195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.923+0000 7fc751959640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc74404b5c0 0x7fc744195ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42500/0 (socket says 172.21.15.40:42500) 2024-04-22T07:21:06.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.923+0000 7fc751959640 1 -- 172.21.15.40:0/1898279608 learned_addr learned my addr 172.21.15.40:0/1898279608 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:06.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.923+0000 7fc75295b640 1 --2- 172.21.15.40:0/1898279608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7440fc970 0x7fc74404df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.923+0000 7ff039251640 1 -- 172.21.15.40:0/2582602499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff01c004800 msgr2=0x7ff01c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:06.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.923+0000 7fc75295b640 1 -- 172.21.15.40:0/1898279608 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc74404c710 con 0x7fc74404b5c0 2024-04-22T07:21:06.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.923+0000 7fc75295b640 1 -- 172.21.15.40:0/1898279608 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc744006410 con 0x7fc7440fc970 2024-04-22T07:21:06.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.923+0000 7fc75295b640 1 -- 172.21.15.40:0/1898279608 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc74404c890 con 0x7fc7440f6ad0 2024-04-22T07:21:06.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.923+0000 7ff039251640 1 --2- 172.21.15.40:0/2582602499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff01c004800 0x7ff01c004c80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff028004ed0 tx=0x7ff01c005830 comp rx=0 tx=0).stop 2024-04-22T07:21:06.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.923+0000 7ff038a50640 1 -- 172.21.15.40:0/2582602499 reap_dead start 2024-04-22T07:21:06.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.924+0000 7ff033fff640 1 --2- 172.21.15.40:0/2582602499 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff0341591e0 0x7ff0340c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:06.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.924+0000 7ff039251640 1 -- 172.21.15.40:0/2582602499 shutdown_connections 2024-04-22T07:21:06.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.924+0000 7ff039251640 1 -- 172.21.15.40:0/2582602499 >> 172.21.15.40:0/2582602499 conn(0x7ff03406f290 msgr2=0x7ff03406f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:06.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.924+0000 7f5ed71f4640 1 -- 172.21.15.40:0/3002289205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ec8046c20 msgr2=0x7f5ec804c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:06.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.924+0000 7f5ed71f4640 1 --2- 172.21.15.40:0/3002289205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ec8046c20 0x7f5ec804c2e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0076430 tx=0x7f5ed00a7b70 comp rx=0 tx=0).stop 2024-04-22T07:21:06.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.924+0000 7fa39759e640 1 Processor -- start 2024-04-22T07:21:06.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.924+0000 7f5ed71f4640 1 -- 172.21.15.40:0/3002289205 shutdown_connections 2024-04-22T07:21:06.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.924+0000 7f5ed71f4640 1 --2- 172.21.15.40:0/3002289205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ec8046c20 0x7f5ec804c2e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.924+0000 7f5ed71f4640 1 -- 172.21.15.40:0/3002289205 >> 172.21.15.40:0/3002289205 conn(0x7f5ec80505c0 msgr2=0x7f5ec80509d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:06.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.924+0000 7fc751959640 1 -- 172.21.15.40:0/1898279608 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7440f6ad0 msgr2=0x7fc7441878a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-22T07:21:06.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.924+0000 7f5ed71f4640 1 -- 172.21.15.40:0/3002289205 shutdown_connections 2024-04-22T07:21:06.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.924+0000 7fc751158640 1 --2- 172.21.15.40:0/1898279608 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7440f6ad0 0x7fc7441878a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.924+0000 7fc75215a640 1 --2- 172.21.15.40:0/1898279608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7440fc970 0x7fc74404df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.924+0000 7f5ed71f4640 1 -- 172.21.15.40:0/3002289205 wait complete. 2024-04-22T07:21:06.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.924+0000 7fc751959640 1 --2- 172.21.15.40:0/1898279608 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7440f6ad0 0x7fc7441878a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.924+0000 7fc751959640 1 -- 172.21.15.40:0/1898279608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7440fc970 msgr2=0x7fc74404df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:06.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.924+0000 7fc751959640 1 --2- 172.21.15.40:0/1898279608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7440fc970 0x7fc74404df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.924+0000 7fc751959640 1 -- 172.21.15.40:0/1898279608 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc744185f00 con 0x7fc74404b5c0 2024-04-22T07:21:06.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.924+0000 7f432894f640 1 -- 172.21.15.40:0/1973071207 reap_dead start 2024-04-22T07:21:06.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.924+0000 7f432894f640 1 --2- 172.21.15.40:0/1973071207 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43140051c0 0x7f431400b9c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4324065470 tx=0x7f4314005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d7901eef0f94290 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:06.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.924+0000 7fc751959640 1 --2- 172.21.15.40:0/1898279608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc74404b5c0 0x7fc744195ee0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc74c050f50 tx=0x7fc74c0698a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:06.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.924+0000 7f1c2bfff640 1 -- 172.21.15.40:0/136074985 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1c2c068070 con 0x7f1c38005ed0 2024-04-22T07:21:06.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.925+0000 7fc7427fc640 1 -- 172.21.15.40:0/1898279608 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74c0ac070 con 0x7fc74404b5c0 2024-04-22T07:21:06.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.925+0000 7fc75295b640 1 -- 172.21.15.40:0/1898279608 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc74404f230 con 0x7fc74404b5c0 2024-04-22T07:21:06.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.925+0000 7fc75295b640 1 -- 172.21.15.40:0/1898279608 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc74404f4d0 con 0x7fc74404b5c0 2024-04-22T07:21:06.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.925+0000 7fc7427fc640 1 -- 172.21.15.40:0/1898279608 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc74c084630 con 0x7fc74404b5c0 2024-04-22T07:21:06.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.925+0000 7fc7427fc640 1 -- 172.21.15.40:0/1898279608 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74c0b6060 con 0x7fc74404b5c0 2024-04-22T07:21:06.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.925+0000 7f1c2bfff640 1 --2- 172.21.15.40:0/136074985 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f1c2406c920 0x7f1c2406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.925+0000 7f1c2bfff640 1 -- 172.21.15.40:0/136074985 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1c2c0cf140 con 0x7f1c38005ed0 2024-04-22T07:21:06.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.925+0000 7f1c44eca640 1 -- 172.21.15.40:0/136074985 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c20005290 con 0x7f1c38005ed0 2024-04-22T07:21:06.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.925+0000 7ff039251640 1 -- 172.21.15.40:0/2582602499 shutdown_connections 2024-04-22T07:21:06.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.925+0000 7fa39759e640 1 -- start start 2024-04-22T07:21:06.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.925+0000 7f4322ffd640 1 -- 172.21.15.40:0/1973071207 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43240b5070 con 0x7f43140051c0 2024-04-22T07:21:06.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.925+0000 7f4322ffd640 1 -- 172.21.15.40:0/1973071207 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43240b0440 con 0x7f43140051c0 2024-04-22T07:21:06.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.925+0000 7f4322ffd640 1 -- 172.21.15.40:0/1973071207 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432404fce0 con 0x7f43140051c0 2024-04-22T07:21:06.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.926+0000 7f1c3effd640 1 --2- 172.21.15.40:0/136074985 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f1c2406c920 0x7f1c2406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.926+0000 7f5ed71f4640 1 Processor -- start 2024-04-22T07:21:06.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.926+0000 7f5ed71f4640 1 -- start start 2024-04-22T07:21:06.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.926+0000 7f4329150640 1 -- 172.21.15.40:0/1973071207 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43140051c0 msgr2=0x7f431400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:06.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.926+0000 7f4329150640 1 --2- 172.21.15.40:0/1973071207 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43140051c0 0x7f431400b9c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4324065470 tx=0x7f4314005830 comp rx=0 tx=0).stop 2024-04-22T07:21:06.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.926+0000 7f4329150640 1 -- 172.21.15.40:0/1973071207 shutdown_connections 2024-04-22T07:21:06.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.926+0000 7f4329150640 1 --2- 172.21.15.40:0/1973071207 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f43140051c0 0x7f431400b9c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.926+0000 7f4329150640 1 -- 172.21.15.40:0/1973071207 >> 172.21.15.40:0/1973071207 conn(0x7f431c0545a0 msgr2=0x7f431c0549b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:06.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.926+0000 7f1c3effd640 1 --2- 172.21.15.40:0/136074985 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f1c2406c920 0x7f1c2406ede0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1c40074960 tx=0x7f1c4006e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:06.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.927+0000 7fa39759e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3900e37a0 0x7fa39004be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.927+0000 7fa39759e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa390046b70 con 0x7fa3900dd3c0 2024-04-22T07:21:06.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.927+0000 7fa39759e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3900dd7a0 con 0x7fa39004ba60 2024-04-22T07:21:06.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.927+0000 7fa39759e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa390045450 con 0x7fa3900e37a0 2024-04-22T07:21:06.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.927+0000 7fa395d9b640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa39004ba60 0x7fa3900e3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.40:49442/0 (socket says 172.21.15.40:49442) 2024-04-22T07:21:06.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.927+0000 7fa395d9b640 1 -- 172.21.15.40:0/108156698 learned_addr learned my addr 172.21.15.40:0/108156698 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:06.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.927+0000 7fc75295b640 1 -- 172.21.15.40:0/1898279608 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc734005290 con 0x7fc74404b5c0 2024-04-22T07:21:06.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.927+0000 7f4329150640 1 -- 172.21.15.40:0/1973071207 shutdown_connections 2024-04-22T07:21:06.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.927+0000 7f4329150640 1 -- 172.21.15.40:0/1973071207 wait complete. 2024-04-22T07:21:06.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.927+0000 7ff039251640 1 -- 172.21.15.40:0/2582602499 wait complete. 2024-04-22T07:21:06.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.927+0000 7f5ed71f4640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ec8046c20 0x7f5ec804a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.927+0000 7f5ed71f4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ec804bea0 0x7f5ec817d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.927+0000 7f5ed71f4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ec80dd4d0 0x7f5ec816e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.927+0000 7f5ed71f4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec8045ff0 con 0x7f5ec80dd4d0 2024-04-22T07:21:06.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.927+0000 7f5ed71f4640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec80e3d70 con 0x7f5ec804bea0 2024-04-22T07:21:06.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.927+0000 7f5ed71f4640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5ec8045c70 con 0x7f5ec8046c20 2024-04-22T07:21:06.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.928+0000 7f5ecffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ec804bea0 0x7f5ec817d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.928+0000 7f5ecffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ec804bea0 0x7f5ec817d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.40:42300/0 (socket says 172.21.15.40:42300) 2024-04-22T07:21:06.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.928+0000 7f5ecffff640 1 -- 172.21.15.40:0/1573279447 learned_addr learned my addr 172.21.15.40:0/1573279447 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:06.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.928+0000 7fc7427fc640 1 -- 172.21.15.40:0/1898279608 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc74c0af070 con 0x7fc74404b5c0 2024-04-22T07:21:06.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.928+0000 7f5ecffff640 1 -- 172.21.15.40:0/1573279447 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ec8046c20 msgr2=0x7f5ec804a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:06.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.928+0000 7f5ecffff640 1 --2- 172.21.15.40:0/1573279447 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ec8046c20 0x7f5ec804a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.928+0000 7f5ecffff640 1 -- 172.21.15.40:0/1573279447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ec80dd4d0 msgr2=0x7f5ec816e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:06.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.928+0000 7f5ecffff640 1 --2- 172.21.15.40:0/1573279447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ec80dd4d0 0x7f5ec816e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.928+0000 7f5ecffff640 1 -- 172.21.15.40:0/1573279447 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec804a850 con 0x7f5ec804bea0 2024-04-22T07:21:06.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.928+0000 7fc7427fc640 1 --2- 172.21.15.40:0/1898279608 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc73006c8f0 0x7fc73006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.927+0000 7fa39559a640 1 -- 172.21.15.40:0/108156698 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 697200041 0 0) 0x7fa398050bd0 con 0x7fa39004ba60 2024-04-22T07:21:06.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.927+0000 7fa39559a640 1 -- 172.21.15.40:0/108156698 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa380003520 con 0x7fa39004ba60 2024-04-22T07:21:06.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.927+0000 7fa39559a640 1 -- 172.21.15.40:0/108156698 <== mon.1 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 258958669 0 0) 0x7fa380003520 con 0x7fa39004ba60 2024-04-22T07:21:06.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.928+0000 7fa39559a640 1 -- 172.21.15.40:0/108156698 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3900e37a0 msgr2=0x7fa39004be80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-22T07:21:06.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.928+0000 7fa39559a640 1 --2- 172.21.15.40:0/108156698 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3900e37a0 0x7fa39004be80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.928+0000 7fa39559a640 1 -- 172.21.15.40:0/108156698 >> v1:172.21.15.40:6789/0 conn(0x7fa3900dd3c0 legacy=0x7fa390046460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:06.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.928+0000 7fa39559a640 1 -- 172.21.15.40:0/108156698 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3900e3c10 con 0x7fa39004ba60 2024-04-22T07:21:06.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.928+0000 7fa39559a640 1 -- 172.21.15.40:0/108156698 <== mon.1 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7fa398050530 con 0x7fa39004ba60 2024-04-22T07:21:06.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.928+0000 7fa39559a640 1 -- 172.21.15.40:0/108156698 >> v1:172.21.15.62:6789/0 conn(0x7fa39004ba60 legacy=0x7fa3900e3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:06.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.928+0000 7fa39559a640 1 --2- 172.21.15.40:0/108156698 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3800039b0 0x7fa380003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.928+0000 7fa39559a640 1 --2- 172.21.15.40:0/108156698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa380004800 0x7fa380004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.928+0000 7fa39559a640 1 --2- 172.21.15.40:0/108156698 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3800051c0 0x7fa38000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.928+0000 7fa39559a640 1 -- 172.21.15.40:0/108156698 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa390045450 con 0x7fa380004800 2024-04-22T07:21:06.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.928+0000 7fa39559a640 1 -- 172.21.15.40:0/108156698 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa38000c090 con 0x7fa3800039b0 2024-04-22T07:21:06.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.928+0000 7fa39559a640 1 -- 172.21.15.40:0/108156698 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa38000c210 con 0x7fa3800051c0 2024-04-22T07:21:06.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.928+0000 7fa39659c640 1 --2- 172.21.15.40:0/108156698 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3800039b0 0x7fa380003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.929+0000 7fc7427fc640 1 -- 172.21.15.40:0/1898279608 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc74c118590 con 0x7fc74404b5c0 2024-04-22T07:21:06.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.929+0000 7f5ecffff640 1 --2- 172.21.15.40:0/1573279447 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ec804bea0 0x7f5ec817d430 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400c460 tx=0x7f5ec400c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:06.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.929+0000 7fa395d9b640 1 --2- 172.21.15.40:0/108156698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa380004800 0x7fa380004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.929+0000 7f5ecd7fa640 1 -- 172.21.15.40:0/1573279447 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4016020 con 0x7f5ec804bea0 2024-04-22T07:21:06.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.929+0000 7f5ecd7fa640 1 -- 172.21.15.40:0/1573279447 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ec4012850 con 0x7f5ec804bea0 2024-04-22T07:21:06.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.929+0000 7ff039251640 1 Processor -- start 2024-04-22T07:21:06.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.929+0000 7fa395d9b640 1 -- 172.21.15.40:0/108156698 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3800051c0 msgr2=0x7fa38000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:06.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.929+0000 7fa395d9b640 1 --2- 172.21.15.40:0/108156698 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa3800051c0 0x7fa38000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.929+0000 7fa395d9b640 1 -- 172.21.15.40:0/108156698 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3800039b0 msgr2=0x7fa380003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:06.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.929+0000 7fa395d9b640 1 --2- 172.21.15.40:0/108156698 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3800039b0 0x7fa380003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.929+0000 7fa395d9b640 1 -- 172.21.15.40:0/108156698 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa380003520 con 0x7fa380004800 2024-04-22T07:21:06.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.929+0000 7f4329150640 1 Processor -- start 2024-04-22T07:21:06.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.930+0000 7f4329150640 1 -- start start 2024-04-22T07:21:06.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.930+0000 7f5ecd7fa640 1 -- 172.21.15.40:0/1573279447 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4012c40 con 0x7f5ec804bea0 2024-04-22T07:21:06.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.930+0000 7f5ed71f4640 1 -- 172.21.15.40:0/1573279447 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ec8179800 con 0x7f5ec804bea0 2024-04-22T07:21:06.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.930+0000 7f5ed71f4640 1 -- 172.21.15.40:0/1573279447 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ec8179dc0 con 0x7f5ec804bea0 2024-04-22T07:21:06.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.930+0000 7fa395d9b640 1 --2- 172.21.15.40:0/108156698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa380004800 0x7fa380004c80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa398065470 tx=0x7fa380005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c503f059f73e05 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:06.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.929+0000 7ff039251640 1 -- start start 2024-04-22T07:21:06.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.931+0000 7ff039251640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff01c004800 0x7ff034151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.931+0000 7ff039251640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0341f7a70 0x7ff034157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.931+0000 7f4329150640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43140051c0 0x7f431c039690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.931+0000 7fc751158640 1 --2- 172.21.15.40:0/1898279608 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc73006c8f0 0x7fc73006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.931+0000 7f4329150640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f431c0ded50 0x7f431c039bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.931+0000 7f4329150640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f431c04e600 0x7f431c17b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.931+0000 7ff033fff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff01c004800 0x7ff034151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.931+0000 7ff033fff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff01c004800 0x7ff034151160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.40:50544/0 (socket says 172.21.15.40:50544) 2024-04-22T07:21:06.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.931+0000 7ff0337fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0341f7a70 0x7ff034157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.931+0000 7ff0337fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0341f7a70 0x7ff034157200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.40:42326/0 (socket says 172.21.15.40:42326) 2024-04-22T07:21:06.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.931+0000 7ff033fff640 1 -- 172.21.15.40:0/2344573293 learned_addr learned my addr 172.21.15.40:0/2344573293 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:06.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.931+0000 7f4329150640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f431c0dd730 con 0x7f43140051c0 2024-04-22T07:21:06.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.931+0000 7f4329150640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f431c04fbd0 con 0x7f431c04e600 2024-04-22T07:21:06.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.931+0000 7ff039251640 1 --2- 172.21.15.40:0/2344573293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff034157740 0x7ff03415a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.931+0000 7f4323fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43140051c0 0x7f431c039690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.931+0000 7f4329150640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f431c0dd8b0 con 0x7f431c0ded50 2024-04-22T07:21:06.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.931+0000 7f432894f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f431c04e600 0x7f431c17b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.931+0000 7f4323fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43140051c0 0x7f431c039690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42528/0 (socket says 172.21.15.40:42528) 2024-04-22T07:21:06.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.931+0000 7f432894f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f431c04e600 0x7f431c17b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.40:42332/0 (socket says 172.21.15.40:42332) 2024-04-22T07:21:06.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.931+0000 7f4323fff640 1 -- 172.21.15.40:0/3222306924 learned_addr learned my addr 172.21.15.40:0/3222306924 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:06.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.931+0000 7f43237fe640 1 --2- 172.21.15.40:0/3222306924 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f431c0ded50 0x7f431c039bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.932+0000 7ff038a50640 1 --2- 172.21.15.40:0/2344573293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff034157740 0x7ff03415a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.932+0000 7f1c2bfff640 1 -- 172.21.15.40:0/136074985 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1c2c09d560 con 0x7f1c38005ed0 2024-04-22T07:21:06.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.932+0000 7f5ed71f4640 1 -- 172.21.15.40:0/1573279447 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ec8005700 con 0x7f5ec804bea0 2024-04-22T07:21:06.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.932+0000 7f432894f640 1 -- 172.21.15.40:0/3222306924 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f431c0ded50 msgr2=0x7f431c039bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:06.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.932+0000 7ff039251640 1 -- 172.21.15.40:0/2344573293 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff0341595c0 con 0x7ff034157740 2024-04-22T07:21:06.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.932+0000 7ff039251640 1 -- 172.21.15.40:0/2344573293 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff0340c7ff0 con 0x7ff0341f7a70 2024-04-22T07:21:06.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.932+0000 7ff039251640 1 -- 172.21.15.40:0/2344573293 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ff034159740 con 0x7ff01c004800 2024-04-22T07:21:06.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.932+0000 7f432894f640 1 --2- 172.21.15.40:0/3222306924 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f431c0ded50 0x7f431c039bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.932+0000 7f432894f640 1 -- 172.21.15.40:0/3222306924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43140051c0 msgr2=0x7f431c039690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:06.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.932+0000 7f432894f640 1 --2- 172.21.15.40:0/3222306924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43140051c0 0x7f431c039690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.932+0000 7f432894f640 1 -- 172.21.15.40:0/3222306924 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f431c16f0f0 con 0x7f431c04e600 2024-04-22T07:21:06.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.932+0000 7f43237fe640 1 --2- 172.21.15.40:0/3222306924 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f431c0ded50 0x7f431c039bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:06.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.932+0000 7f5ecd7fa640 1 -- 172.21.15.40:0/1573279447 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5ec4019020 con 0x7f5ec804bea0 2024-04-22T07:21:06.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.932+0000 7f4323fff640 1 --2- 172.21.15.40:0/3222306924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43140051c0 0x7f431c039690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:21:06.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.933+0000 7f432894f640 1 --2- 172.21.15.40:0/3222306924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f431c04e600 0x7f431c17b7a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4324074a80 tx=0x7f43240698a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:06.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.933+0000 7f5ecd7fa640 1 --2- 172.21.15.40:0/1573279447 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5eb406c940 0x7f5eb406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.933+0000 7fc751158640 1 --2- 172.21.15.40:0/1898279608 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc73006c8f0 0x7fc73006edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc7440fbdb0 tx=0x7fc73c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:06.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.933+0000 7f5ecd7fa640 1 -- 172.21.15.40:0/1573279447 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5ec408b570 con 0x7f5ec804bea0 2024-04-22T07:21:06.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.933+0000 7f5ed4f90640 1 --2- 172.21.15.40:0/1573279447 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5eb406c940 0x7f5eb406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.932+0000 7ff038a50640 1 -- 172.21.15.40:0/2344573293 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff01c004800 msgr2=0x7ff034151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:06.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.932+0000 7ff038a50640 1 --2- 172.21.15.40:0/2344573293 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff01c004800 0x7ff034151160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.932+0000 7ff038a50640 1 -- 172.21.15.40:0/2344573293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0341f7a70 msgr2=0x7ff034157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:06.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.932+0000 7ff038a50640 1 --2- 172.21.15.40:0/2344573293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0341f7a70 0x7ff034157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.932+0000 7ff038a50640 1 -- 172.21.15.40:0/2344573293 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0341f4810 con 0x7ff034157740 2024-04-22T07:21:06.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.933+0000 7ff038a50640 1 --2- 172.21.15.40:0/2344573293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff034157740 0x7ff03415a040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff034071690 tx=0x7ff02400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:06.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.934+0000 7f5ed4f90640 1 --2- 172.21.15.40:0/1573279447 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5eb406c940 0x7f5eb406ee00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc006fd0 tx=0x7f5ebc006bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:06.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.935+0000 7fa39559a640 1 -- 172.21.15.40:0/108156698 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3980b4070 con 0x7fa380004800 2024-04-22T07:21:06.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.935+0000 7fa39559a640 1 -- 172.21.15.40:0/108156698 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3980af600 con 0x7fa380004800 2024-04-22T07:21:06.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.935+0000 7ff030ff9640 1 -- 172.21.15.40:0/2344573293 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff024017070 con 0x7ff034157740 2024-04-22T07:21:06.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.935+0000 7fc7427fc640 1 -- 172.21.15.40:0/1898279608 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc74c09fe20 con 0x7fc74404b5c0 2024-04-22T07:21:06.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.935+0000 7fa39559a640 1 -- 172.21.15.40:0/108156698 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa398069d40 con 0x7fa380004800 2024-04-22T07:21:06.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.935+0000 7ff030ff9640 1 -- 172.21.15.40:0/2344573293 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0240074e0 con 0x7ff034157740 2024-04-22T07:21:06.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.935+0000 7ff030ff9640 1 -- 172.21.15.40:0/2344573293 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0240059e0 con 0x7ff034157740 2024-04-22T07:21:06.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.935+0000 7ff039251640 1 -- 172.21.15.40:0/2344573293 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0341f4ad0 con 0x7ff034157740 2024-04-22T07:21:06.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.935+0000 7ff039251640 1 -- 172.21.15.40:0/2344573293 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0341f5090 con 0x7ff034157740 2024-04-22T07:21:06.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.935+0000 7fa39759e640 1 -- 172.21.15.40:0/108156698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa380004800 msgr2=0x7fa380004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:06.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.935+0000 7fa39759e640 1 --2- 172.21.15.40:0/108156698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa380004800 0x7fa380004c80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa398065470 tx=0x7fa380005830 comp rx=0 tx=0).stop 2024-04-22T07:21:06.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.935+0000 7fa396d9d640 1 -- 172.21.15.40:0/108156698 reap_dead start 2024-04-22T07:21:06.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.936+0000 7fa39759e640 1 -- 172.21.15.40:0/108156698 shutdown_connections 2024-04-22T07:21:06.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.936+0000 7fa39759e640 1 -- 172.21.15.40:0/108156698 >> 172.21.15.40:0/108156698 conn(0x7fa390050180 msgr2=0x7fa390050590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:06.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.936+0000 7ff039251640 1 -- 172.21.15.40:0/2344573293 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff03404fce0 con 0x7ff034157740 2024-04-22T07:21:06.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.937+0000 7fa39759e640 1 -- 172.21.15.40:0/108156698 shutdown_connections 2024-04-22T07:21:06.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.937+0000 7fa39759e640 1 -- 172.21.15.40:0/108156698 wait complete. 2024-04-22T07:21:06.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.937+0000 7f4320ff9640 1 -- 172.21.15.40:0/3222306924 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43240b5040 con 0x7f431c04e600 2024-04-22T07:21:06.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.938+0000 7f5ecd7fa640 1 -- 172.21.15.40:0/1573279447 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5ec4020070 con 0x7f5ec804bea0 2024-04-22T07:21:06.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.938+0000 7f4320ff9640 1 -- 172.21.15.40:0/3222306924 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4324050530 con 0x7f431c04e600 2024-04-22T07:21:06.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.938+0000 7f4320ff9640 1 -- 172.21.15.40:0/3222306924 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432404fce0 con 0x7f431c04e600 2024-04-22T07:21:06.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.938+0000 7f4329150640 1 -- 172.21.15.40:0/3222306924 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f431c0e0640 con 0x7f431c04e600 2024-04-22T07:21:06.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.938+0000 7f4329150640 1 -- 172.21.15.40:0/3222306924 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f431c17a4b0 con 0x7f431c04e600 2024-04-22T07:21:06.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.939+0000 7fa39759e640 1 Processor -- start 2024-04-22T07:21:06.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.939+0000 7fa39759e640 1 -- start start 2024-04-22T07:21:06.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.940+0000 7fa39759e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa380004800 0x7fa3900dba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.939+0000 7ff030ff9640 1 -- 172.21.15.40:0/2344573293 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff024005b80 con 0x7ff034157740 2024-04-22T07:21:06.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.940+0000 7ff030ff9640 1 --2- 172.21.15.40:0/2344573293 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ff02006c920 0x7ff02006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.940+0000 7ff030ff9640 1 -- 172.21.15.40:0/2344573293 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff02408aee0 con 0x7ff034157740 2024-04-22T07:21:06.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.940+0000 7ff033fff640 1 --2- 172.21.15.40:0/2344573293 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ff02006c920 0x7ff02006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.941+0000 7ff033fff640 1 --2- 172.21.15.40:0/2344573293 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ff02006c920 0x7ff02006ede0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff02c007f40 tx=0x7ff02c007660 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:06.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.941+0000 7fa39759e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa390049470 0x7fa390049b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.941+0000 7fa39759e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa39016f7c0 0x7fa390047500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.941+0000 7fa39759e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa3900456a0 con 0x7fa39016f7c0 2024-04-22T07:21:06.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.941+0000 7fa39759e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa390045fd0 con 0x7fa390049470 2024-04-22T07:21:06.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.941+0000 7fa39759e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa390045980 con 0x7fa380004800 2024-04-22T07:21:06.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.942+0000 7fa396d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa39016f7c0 0x7fa390047500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.942+0000 7fa396d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa39016f7c0 0x7fa390047500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42548/0 (socket says 172.21.15.40:42548) 2024-04-22T07:21:06.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.942+0000 7fa396d9d640 1 -- 172.21.15.40:0/1850732115 learned_addr learned my addr 172.21.15.40:0/1850732115 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:06.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.941+0000 7f4320ff9640 1 -- 172.21.15.40:0/3222306924 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f43240c0060 con 0x7f431c04e600 2024-04-22T07:21:06.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.942+0000 7f4320ff9640 1 --2- 172.21.15.40:0/3222306924 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f430806c9c0 0x7f430806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.942+0000 7f4320ff9640 1 -- 172.21.15.40:0/3222306924 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4324128190 con 0x7f431c04e600 2024-04-22T07:21:06.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.942+0000 7fa39659c640 1 --2- 172.21.15.40:0/1850732115 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa380004800 0x7fa3900dba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.942+0000 7fa396d9d640 1 -- 172.21.15.40:0/1850732115 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa380004800 msgr2=0x7fa3900dba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:06.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.942+0000 7fa395d9b640 1 --2- 172.21.15.40:0/1850732115 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa390049470 0x7fa390049b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.942+0000 7fa396d9d640 1 --2- 172.21.15.40:0/1850732115 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa380004800 0x7fa3900dba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.942+0000 7fa396d9d640 1 -- 172.21.15.40:0/1850732115 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa390049470 msgr2=0x7fa390049b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:06.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.942+0000 7f4329150640 1 -- 172.21.15.40:0/3222306924 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4304005290 con 0x7f431c04e600 2024-04-22T07:21:06.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.942+0000 7f4323fff640 1 --2- 172.21.15.40:0/3222306924 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f430806c9c0 0x7f430806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.942+0000 7fa396d9d640 1 --2- 172.21.15.40:0/1850732115 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa390049470 0x7fa390049b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:06.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.942+0000 7fa396d9d640 1 -- 172.21.15.40:0/1850732115 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa39004a050 con 0x7fa39016f7c0 2024-04-22T07:21:06.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.942+0000 7fa39659c640 1 --2- 172.21.15.40:0/1850732115 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa380004800 0x7fa3900dba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:06.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.942+0000 7fa395d9b640 1 --2- 172.21.15.40:0/1850732115 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa390049470 0x7fa390049b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:06.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.943+0000 7fa396d9d640 1 --2- 172.21.15.40:0/1850732115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa39016f7c0 0x7fa390047500 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa390036450 tx=0x7fa38c00c5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:06.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.943+0000 7f4323fff640 1 --2- 172.21.15.40:0/3222306924 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f430806c9c0 0x7f430806ee80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f431800af40 tx=0x7f4318008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:06.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.947+0000 7ff030ff9640 1 -- 172.21.15.40:0/2344573293 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff024021020 con 0x7ff034157740 2024-04-22T07:21:06.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.947+0000 7fa386ffd640 1 -- 172.21.15.40:0/1850732115 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38c017070 con 0x7fa39016f7c0 2024-04-22T07:21:06.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.948+0000 7f4320ff9640 1 -- 172.21.15.40:0/3222306924 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f43240f5ec0 con 0x7f431c04e600 2024-04-22T07:21:06.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.948+0000 7fa39759e640 1 -- 172.21.15.40:0/1850732115 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa39004a2c0 con 0x7fa39016f7c0 2024-04-22T07:21:06.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.948+0000 7fa39759e640 1 -- 172.21.15.40:0/1850732115 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa390178d70 con 0x7fa39016f7c0 2024-04-22T07:21:06.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.949+0000 7fa384ff9640 1 -- 172.21.15.40:0/1850732115 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa37c005290 con 0x7fa39016f7c0 2024-04-22T07:21:06.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.960+0000 7fa386ffd640 1 -- 172.21.15.40:0/1850732115 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa38c005af0 con 0x7fa39016f7c0 2024-04-22T07:21:06.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.960+0000 7fa386ffd640 1 -- 172.21.15.40:0/1850732115 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38c0070d0 con 0x7fa39016f7c0 2024-04-22T07:21:06.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.961+0000 7fa386ffd640 1 -- 172.21.15.40:0/1850732115 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa38c01a070 con 0x7fa39016f7c0 2024-04-22T07:21:06.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.961+0000 7fa386ffd640 1 --2- 172.21.15.40:0/1850732115 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fa37806c9f0 0x7fa37806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:06.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.962+0000 7fa386ffd640 1 -- 172.21.15.40:0/1850732115 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa38c08ac40 con 0x7fa39016f7c0 2024-04-22T07:21:06.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.962+0000 7fa386ffd640 1 -- 172.21.15.40:0/1850732115 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa38c08e2a0 con 0x7fa39016f7c0 2024-04-22T07:21:06.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.964+0000 7fa39659c640 1 --2- 172.21.15.40:0/1850732115 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fa37806c9f0 0x7fa37806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:06.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:06.965+0000 7fa39659c640 1 --2- 172.21.15.40:0/1850732115 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fa37806c9f0 0x7fa37806eeb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa388005040 tx=0x7fa388009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:07.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.307+0000 7f58acd9f640 1 -- 172.21.15.40:0/3697184668 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f5888005580 con 0x7f58a00e6690 2024-04-22T07:21:07.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.308+0000 7f5893fff640 1 -- 172.21.15.40:0/3697184668 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5894059f20 con 0x7f58a00e6690 2024-04-22T07:21:07.306 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-04-22T07:21:07.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.311+0000 7f5891ffb640 1 -- 172.21.15.40:0/3697184668 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f588c06c9f0 msgr2=0x7f588c06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:07.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.311+0000 7f5891ffb640 1 --2- 172.21.15.40:0/3697184668 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f588c06c9f0 0x7f588c06eeb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f58a8050f50 tx=0x7f58a806a450 comp rx=0 tx=0).stop 2024-04-22T07:21:07.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.311+0000 7f5891ffb640 1 -- 172.21.15.40:0/3697184668 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58a00e6690 msgr2=0x7f58a017a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:07.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.311+0000 7f5891ffb640 1 --2- 172.21.15.40:0/3697184668 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58a00e6690 0x7f58a017a690 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f589400c7c0 tx=0x7f589400cc80 comp rx=0 tx=0).stop 2024-04-22T07:21:07.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.312+0000 7f5891ffb640 1 -- 172.21.15.40:0/3697184668 shutdown_connections 2024-04-22T07:21:07.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.312+0000 7f5891ffb640 1 --2- 172.21.15.40:0/3697184668 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f588c06c9f0 0x7f588c06eeb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.312+0000 7f5891ffb640 1 --2- 172.21.15.40:0/3697184668 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58a00e6690 0x7f58a017a690 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.312+0000 7f5891ffb640 1 --2- 172.21.15.40:0/3697184668 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58a00dd460 0x7f58a004fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.312+0000 7f5891ffb640 1 --2- 172.21.15.40:0/3697184668 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f58a00062c0 0x7f58a0034d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.312+0000 7f5891ffb640 1 -- 172.21.15.40:0/3697184668 >> 172.21.15.40:0/3697184668 conn(0x7f58a0050a00 msgr2=0x7f58a00dc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:07.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.312+0000 7f5891ffb640 1 -- 172.21.15.40:0/3697184668 shutdown_connections 2024-04-22T07:21:07.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.312+0000 7f5891ffb640 1 -- 172.21.15.40:0/3697184668 wait complete. 2024-04-22T07:21:07.328 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.6 2024-04-22T07:21:07.328 DEBUG:teuthology.parallel:result is None 2024-04-22T07:21:07.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.349+0000 7ff039251640 1 -- 172.21.15.40:0/2344573293 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff034151d50 con 0x7ff034157740 2024-04-22T07:21:07.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.349+0000 7ff030ff9640 1 -- 172.21.15.40:0/2344573293 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff024058c10 con 0x7ff034157740 2024-04-22T07:21:07.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.349+0000 7f54769c3640 1 -- 172.21.15.40:0/2995067582 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f5470072990 con 0x7f54700c62c0 2024-04-22T07:21:07.348 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-04-22T07:21:07.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.349+0000 7f54667fc640 1 -- 172.21.15.40:0/2995067582 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5460058ab0 con 0x7f54700c62c0 2024-04-22T07:21:07.349 INFO:teuthology.orchestra.run.smithi040.stdout:64424509448 2024-04-22T07:21:07.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.351+0000 7ff039251640 1 -- 172.21.15.40:0/2344573293 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ff02006c920 msgr2=0x7ff02006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:07.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.351+0000 7ff039251640 1 --2- 172.21.15.40:0/2344573293 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ff02006c920 0x7ff02006ede0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff02c007f40 tx=0x7ff02c007660 comp rx=0 tx=0).stop 2024-04-22T07:21:07.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.351+0000 7ff039251640 1 -- 172.21.15.40:0/2344573293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff034157740 msgr2=0x7ff03415a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:07.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.351+0000 7ff039251640 1 --2- 172.21.15.40:0/2344573293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff034157740 0x7ff03415a040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff034071690 tx=0x7ff02400c820 comp rx=0 tx=0).stop 2024-04-22T07:21:07.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.352+0000 7ff039251640 1 -- 172.21.15.40:0/2344573293 shutdown_connections 2024-04-22T07:21:07.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.352+0000 7ff039251640 1 --2- 172.21.15.40:0/2344573293 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ff02006c920 0x7ff02006ede0 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff02c007f40 tx=0x7ff02c007660 comp rx=0 tx=0).stop 2024-04-22T07:21:07.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.352+0000 7ff039251640 1 --2- 172.21.15.40:0/2344573293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff034157740 0x7ff03415a040 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.352+0000 7ff039251640 1 --2- 172.21.15.40:0/2344573293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0341f7a70 0x7ff034157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.352+0000 7ff039251640 1 --2- 172.21.15.40:0/2344573293 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff01c004800 0x7ff034151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.352+0000 7ff039251640 1 -- 172.21.15.40:0/2344573293 >> 172.21.15.40:0/2344573293 conn(0x7ff03406f290 msgr2=0x7ff03406e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:07.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.352+0000 7ff039251640 1 -- 172.21.15.40:0/2344573293 shutdown_connections 2024-04-22T07:21:07.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.352+0000 7ff039251640 1 -- 172.21.15.40:0/2344573293 wait complete. 2024-04-22T07:21:07.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.352+0000 7f54769c3640 1 -- 172.21.15.40:0/2995067582 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f545406c970 msgr2=0x7f545406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:07.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.353+0000 7f54769c3640 1 --2- 172.21.15.40:0/2995067582 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f545406c970 0x7f545406ee30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f547016a410 tx=0x7f546c008040 comp rx=0 tx=0).stop 2024-04-22T07:21:07.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.353+0000 7f54769c3640 1 -- 172.21.15.40:0/2995067582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54700c62c0 msgr2=0x7f547015a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:07.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.353+0000 7f54769c3640 1 --2- 172.21.15.40:0/2995067582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54700c62c0 0x7f547015a5b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f546000c8f0 tx=0x7f546000cdb0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.353+0000 7f54769c3640 1 -- 172.21.15.40:0/2995067582 shutdown_connections 2024-04-22T07:21:07.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.353+0000 7f54769c3640 1 --2- 172.21.15.40:0/2995067582 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f54701591e0 0x7f54700cafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.353+0000 7f54769c3640 1 --2- 172.21.15.40:0/2995067582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54700c9300 0x7f54700caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.353+0000 7f54769c3640 1 --2- 172.21.15.40:0/2995067582 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f545406c970 0x7f545406ee30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.353+0000 7f54769c3640 1 --2- 172.21.15.40:0/2995067582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54700c62c0 0x7f547015a5b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.353+0000 7f54769c3640 1 -- 172.21.15.40:0/2995067582 >> 172.21.15.40:0/2995067582 conn(0x7f547006f290 msgr2=0x7f547006d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:07.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.353+0000 7f54769c3640 1 -- 172.21.15.40:0/2995067582 shutdown_connections 2024-04-22T07:21:07.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.353+0000 7f54769c3640 1 -- 172.21.15.40:0/2995067582 wait complete. 2024-04-22T07:21:07.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.362+0000 7fc75295b640 1 -- 172.21.15.40:0/1898279608 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc734005580 con 0x7fc74404b5c0 2024-04-22T07:21:07.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.363+0000 7fc7427fc640 1 -- 172.21.15.40:0/1898279608 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc74c0e69b0 con 0x7fc74404b5c0 2024-04-22T07:21:07.361 INFO:teuthology.orchestra.run.smithi040.stdout:64424509449 2024-04-22T07:21:07.363 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.1 2024-04-22T07:21:07.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.365+0000 7f1c44eca640 1 -- 172.21.15.40:0/136074985 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f1c20005580 con 0x7f1c38005ed0 2024-04-22T07:21:07.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.365+0000 7f1c2bfff640 1 -- 172.21.15.40:0/136074985 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1c2c09ce60 con 0x7f1c38005ed0 2024-04-22T07:21:07.363 DEBUG:teuthology.parallel:result is None 2024-04-22T07:21:07.364 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-04-22T07:21:07.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.366+0000 7fc75295b640 1 -- 172.21.15.40:0/1898279608 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc73006c8f0 msgr2=0x7fc73006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:07.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.366+0000 7fc75295b640 1 --2- 172.21.15.40:0/1898279608 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc73006c8f0 0x7fc73006edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc7440fbdb0 tx=0x7fc73c008040 comp rx=0 tx=0).stop 2024-04-22T07:21:07.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.366+0000 7fc75295b640 1 -- 172.21.15.40:0/1898279608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc74404b5c0 msgr2=0x7fc744195ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:07.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.366+0000 7fc75295b640 1 --2- 172.21.15.40:0/1898279608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc74404b5c0 0x7fc744195ee0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc74c050f50 tx=0x7fc74c0698a0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.366+0000 7fc75295b640 1 -- 172.21.15.40:0/1898279608 shutdown_connections 2024-04-22T07:21:07.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.366+0000 7fc75295b640 1 --2- 172.21.15.40:0/1898279608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7440fc970 0x7fc74404df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.366+0000 7fc75295b640 1 --2- 172.21.15.40:0/1898279608 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7440f6ad0 0x7fc7441878a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.366+0000 7fc75295b640 1 --2- 172.21.15.40:0/1898279608 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc73006c8f0 0x7fc73006edb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.366+0000 7fc75295b640 1 --2- 172.21.15.40:0/1898279608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc74404b5c0 0x7fc744195ee0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.366+0000 7fc75295b640 1 -- 172.21.15.40:0/1898279608 >> 172.21.15.40:0/1898279608 conn(0x7fc744050170 msgr2=0x7fc744046970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:07.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.367+0000 7fc75295b640 1 -- 172.21.15.40:0/1898279608 shutdown_connections 2024-04-22T07:21:07.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.367+0000 7fc75295b640 1 -- 172.21.15.40:0/1898279608 wait complete. 2024-04-22T07:21:07.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.368+0000 7f1c44eca640 1 -- 172.21.15.40:0/136074985 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f1c2406c920 msgr2=0x7f1c2406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:07.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.368+0000 7f1c44eca640 1 --2- 172.21.15.40:0/136074985 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f1c2406c920 0x7f1c2406ede0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1c40074960 tx=0x7f1c4006e040 comp rx=0 tx=0).stop 2024-04-22T07:21:07.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.368+0000 7f1c44eca640 1 -- 172.21.15.40:0/136074985 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c38005ed0 msgr2=0x7f1c380cbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:07.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.368+0000 7f1c44eca640 1 --2- 172.21.15.40:0/136074985 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c38005ed0 0x7f1c380cbdf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c033000 tx=0x7f1c2c0046c0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.368+0000 7f1c44eca640 1 -- 172.21.15.40:0/136074985 shutdown_connections 2024-04-22T07:21:07.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.368+0000 7f1c44eca640 1 --2- 172.21.15.40:0/136074985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c380d51f0 0x7f1c38047f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.368+0000 7f1c44eca640 1 --2- 172.21.15.40:0/136074985 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f1c2406c920 0x7f1c2406ede0 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1c40074960 tx=0x7f1c4006e040 comp rx=0 tx=0).stop 2024-04-22T07:21:07.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.368+0000 7f1c44eca640 1 --2- 172.21.15.40:0/136074985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c3804b080 0x7f1c380cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.368+0000 7f1c44eca640 1 --2- 172.21.15.40:0/136074985 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c38005ed0 0x7f1c380cbdf0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.368+0000 7f1c44eca640 1 -- 172.21.15.40:0/136074985 >> 172.21.15.40:0/136074985 conn(0x7f1c38050170 msgr2=0x7f1c380d37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:07.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.369+0000 7f1c44eca640 1 -- 172.21.15.40:0/136074985 shutdown_connections 2024-04-22T07:21:07.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.369+0000 7f1c44eca640 1 -- 172.21.15.40:0/136074985 wait complete. 2024-04-22T07:21:07.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.2 2024-04-22T07:21:07.369 DEBUG:teuthology.parallel:result is None 2024-04-22T07:21:07.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.375+0000 7f5ed71f4640 1 -- 172.21.15.40:0/1573279447 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f5ec8033e90 con 0x7f5ec804bea0 2024-04-22T07:21:07.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.376+0000 7f5ecd7fa640 1 -- 172.21.15.40:0/1573279447 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5ec4019310 con 0x7f5ec804bea0 2024-04-22T07:21:07.374 INFO:teuthology.orchestra.run.smithi040.stdout:55834574855 2024-04-22T07:21:07.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.379+0000 7f5ed71f4640 1 -- 172.21.15.40:0/1573279447 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5eb406c940 msgr2=0x7f5eb406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:07.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.379+0000 7f5ed71f4640 1 --2- 172.21.15.40:0/1573279447 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5eb406c940 0x7f5eb406ee00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc006fd0 tx=0x7f5ebc006bc0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.379+0000 7f5ed71f4640 1 -- 172.21.15.40:0/1573279447 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ec804bea0 msgr2=0x7f5ec817d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:07.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.379+0000 7f5ed71f4640 1 --2- 172.21.15.40:0/1573279447 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ec804bea0 0x7f5ec817d430 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400c460 tx=0x7f5ec400c920 comp rx=0 tx=0).stop 2024-04-22T07:21:07.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.379+0000 7f5ed71f4640 1 -- 172.21.15.40:0/1573279447 shutdown_connections 2024-04-22T07:21:07.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.379+0000 7f5ed71f4640 1 --2- 172.21.15.40:0/1573279447 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5eb406c940 0x7f5eb406ee00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.379+0000 7f5ed71f4640 1 --2- 172.21.15.40:0/1573279447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5ec80dd4d0 0x7f5ec816e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.379+0000 7f5ed71f4640 1 --2- 172.21.15.40:0/1573279447 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5ec804bea0 0x7f5ec817d430 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.379+0000 7f5ed71f4640 1 --2- 172.21.15.40:0/1573279447 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5ec8046c20 0x7f5ec804a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.379+0000 7f5ed71f4640 1 -- 172.21.15.40:0/1573279447 >> 172.21.15.40:0/1573279447 conn(0x7f5ec80505c0 msgr2=0x7f5ec8005ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:07.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.0 2024-04-22T07:21:07.379 DEBUG:teuthology.parallel:result is None 2024-04-22T07:21:07.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.379+0000 7f5ed71f4640 1 -- 172.21.15.40:0/1573279447 shutdown_connections 2024-04-22T07:21:07.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.379+0000 7f5ed71f4640 1 -- 172.21.15.40:0/1573279447 wait complete. 2024-04-22T07:21:07.380 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.7 2024-04-22T07:21:07.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.382+0000 7f4329150640 1 -- 172.21.15.40:0/3222306924 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f4304005580 con 0x7f431c04e600 2024-04-22T07:21:07.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.383+0000 7fa384ff9640 1 -- 172.21.15.40:0/1850732115 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa37c005580 con 0x7fa39016f7c0 2024-04-22T07:21:07.381 DEBUG:teuthology.parallel:result is None 2024-04-22T07:21:07.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.383+0000 7f4320ff9640 1 -- 172.21.15.40:0/3222306924 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f43240fa1c0 con 0x7f431c04e600 2024-04-22T07:21:07.381 INFO:teuthology.orchestra.run.smithi040.stdout:64424509446 2024-04-22T07:21:07.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.383+0000 7fa386ffd640 1 -- 172.21.15.40:0/1850732115 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa38c0590e0 con 0x7fa39016f7c0 2024-04-22T07:21:07.382 INFO:teuthology.orchestra.run.smithi040.stdout:64424509447 2024-04-22T07:21:07.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.385+0000 7fa384ff9640 1 -- 172.21.15.40:0/1850732115 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fa37806c9f0 msgr2=0x7fa37806eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:07.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.385+0000 7fa384ff9640 1 --2- 172.21.15.40:0/1850732115 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fa37806c9f0 0x7fa37806eeb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa388005040 tx=0x7fa388009040 comp rx=0 tx=0).stop 2024-04-22T07:21:07.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.385+0000 7fa384ff9640 1 -- 172.21.15.40:0/1850732115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa39016f7c0 msgr2=0x7fa390047500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:07.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.385+0000 7fa384ff9640 1 --2- 172.21.15.40:0/1850732115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa39016f7c0 0x7fa390047500 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa390036450 tx=0x7fa38c00c5f0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.385+0000 7fa384ff9640 1 -- 172.21.15.40:0/1850732115 shutdown_connections 2024-04-22T07:21:07.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.385+0000 7fa384ff9640 1 --2- 172.21.15.40:0/1850732115 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fa37806c9f0 0x7fa37806eeb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.385+0000 7fa384ff9640 1 --2- 172.21.15.40:0/1850732115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa39016f7c0 0x7fa390047500 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.385+0000 7fa384ff9640 1 --2- 172.21.15.40:0/1850732115 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa390049470 0x7fa390049b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.385+0000 7fa384ff9640 1 --2- 172.21.15.40:0/1850732115 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa380004800 0x7fa3900dba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.385+0000 7fa384ff9640 1 -- 172.21.15.40:0/1850732115 >> 172.21.15.40:0/1850732115 conn(0x7fa390050180 msgr2=0x7fa39004f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:07.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.385+0000 7fa384ff9640 1 -- 172.21.15.40:0/1850732115 shutdown_connections 2024-04-22T07:21:07.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.385+0000 7fa384ff9640 1 -- 172.21.15.40:0/1850732115 wait complete. 2024-04-22T07:21:07.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.386+0000 7f4329150640 1 -- 172.21.15.40:0/3222306924 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f430806c9c0 msgr2=0x7f430806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:07.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.386+0000 7f4329150640 1 --2- 172.21.15.40:0/3222306924 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f430806c9c0 0x7f430806ee80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f431800af40 tx=0x7f4318008040 comp rx=0 tx=0).stop 2024-04-22T07:21:07.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.386+0000 7f4329150640 1 -- 172.21.15.40:0/3222306924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f431c04e600 msgr2=0x7f431c17b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:07.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.386+0000 7f4329150640 1 --2- 172.21.15.40:0/3222306924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f431c04e600 0x7f431c17b7a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4324074a80 tx=0x7f43240698a0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.386+0000 7f4329150640 1 -- 172.21.15.40:0/3222306924 shutdown_connections 2024-04-22T07:21:07.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.386+0000 7f4329150640 1 --2- 172.21.15.40:0/3222306924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f431c04e600 0x7f431c17b7a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.386+0000 7f4329150640 1 --2- 172.21.15.40:0/3222306924 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f431c0ded50 0x7f431c039bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.386+0000 7f4329150640 1 --2- 172.21.15.40:0/3222306924 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f430806c9c0 0x7f430806ee80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.386+0000 7f4329150640 1 --2- 172.21.15.40:0/3222306924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43140051c0 0x7f431c039690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.386+0000 7f4329150640 1 -- 172.21.15.40:0/3222306924 >> 172.21.15.40:0/3222306924 conn(0x7f431c0545a0 msgr2=0x7f431c0048f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:07.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.386+0000 7f4329150640 1 -- 172.21.15.40:0/3222306924 shutdown_connections 2024-04-22T07:21:07.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.386+0000 7f4329150640 1 -- 172.21.15.40:0/3222306924 wait complete. 2024-04-22T07:21:07.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2024-04-22T07:21:07.394 DEBUG:teuthology.parallel:result is None 2024-04-22T07:21:07.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.3 2024-04-22T07:21:07.396 DEBUG:teuthology.parallel:result is None 2024-04-22T07:21:07.398 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.5 2024-04-22T07:21:07.398 DEBUG:teuthology.parallel:result is None 2024-04-22T07:21:07.398 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-22T07:21:07.398 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T07:21:07.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.542+0000 7f4617ef2640 1 Processor -- start 2024-04-22T07:21:07.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.542+0000 7f4617ef2640 1 -- start start 2024-04-22T07:21:07.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.542+0000 7f4617ef2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4610154f50 0x7f46100cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:07.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.543+0000 7f4617ef2640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f461015e6e0 con 0x7f46100cc5a0 2024-04-22T07:21:07.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.543+0000 7f4617ef2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f461015e9c0 con 0x7f461015b3e0 2024-04-22T07:21:07.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.543+0000 7f4617ef2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f461015af50 con 0x7f4610154f50 2024-04-22T07:21:07.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.543+0000 7f461548d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f46100cc5a0 0x7f46100d0590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33970/0 (socket says 172.21.15.40:33970) 2024-04-22T07:21:07.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.543+0000 7f461548d640 1 -- 172.21.15.40:0/2758917608 learned_addr learned my addr 172.21.15.40:0/2758917608 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:07.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.543+0000 7f4615c8e640 1 --2- 172.21.15.40:0/2758917608 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4610154f50 0x7f46100cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:07.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.543+0000 7f4614c8c640 1 -- 172.21.15.40:0/2758917608 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1709655664 0 0) 0x7f461015e6e0 con 0x7f46100cc5a0 2024-04-22T07:21:07.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.543+0000 7f4614c8c640 1 -- 172.21.15.40:0/2758917608 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45fc003520 con 0x7f46100cc5a0 2024-04-22T07:21:07.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.543+0000 7f4614c8c640 1 -- 172.21.15.40:0/2758917608 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4137334245 0 0) 0x7f461015e9c0 con 0x7f461015b3e0 2024-04-22T07:21:07.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.543+0000 7f4614c8c640 1 -- 172.21.15.40:0/2758917608 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f461015e6e0 con 0x7f461015b3e0 2024-04-22T07:21:07.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.543+0000 7f4614c8c640 1 -- 172.21.15.40:0/2758917608 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 689767011 0 0) 0x7f45fc003520 con 0x7f46100cc5a0 2024-04-22T07:21:07.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.543+0000 7f4614c8c640 1 -- 172.21.15.40:0/2758917608 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4610154f50 msgr2=0x7f46100cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:07.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.543+0000 7f4614c8c640 1 --2- 172.21.15.40:0/2758917608 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4610154f50 0x7f46100cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.543+0000 7f4614c8c640 1 -- 172.21.15.40:0/2758917608 >> v1:172.21.15.62:6789/0 conn(0x7f461015b3e0 legacy=0x7f461015b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:07.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.543+0000 7f4614c8c640 1 -- 172.21.15.40:0/2758917608 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461015eca0 con 0x7f46100cc5a0 2024-04-22T07:21:07.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.543+0000 7f4614c8c640 1 -- 172.21.15.40:0/2758917608 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7f4600001670 con 0x7f46100cc5a0 2024-04-22T07:21:07.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.543+0000 7f4614c8c640 1 -- 172.21.15.40:0/2758917608 >> v1:172.21.15.40:6789/0 conn(0x7f46100cc5a0 legacy=0x7f46100d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:07.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.543+0000 7f4614c8c640 1 --2- 172.21.15.40:0/2758917608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc003b70 0x7f45fc003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:07.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.543+0000 7f4614c8c640 1 --2- 172.21.15.40:0/2758917608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45fc004800 0x7f45fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:07.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.543+0000 7f4614c8c640 1 --2- 172.21.15.40:0/2758917608 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4610154f50 0x7f45fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:07.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.543+0000 7f4614c8c640 1 -- 172.21.15.40:0/2758917608 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f461015af50 con 0x7f45fc004800 2024-04-22T07:21:07.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.543+0000 7f4614c8c640 1 -- 172.21.15.40:0/2758917608 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc00ba70 con 0x7f45fc003b70 2024-04-22T07:21:07.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.543+0000 7f4614c8c640 1 -- 172.21.15.40:0/2758917608 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f45fc00bc70 con 0x7f4610154f50 2024-04-22T07:21:07.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.543+0000 7f461548d640 1 --2- 172.21.15.40:0/2758917608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45fc004800 0x7f45fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:07.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.543+0000 7f4615c8e640 1 --2- 172.21.15.40:0/2758917608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc003b70 0x7f45fc003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:07.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.544+0000 7f461648f640 1 --2- 172.21.15.40:0/2758917608 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4610154f50 0x7f45fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:07.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.544+0000 7f461548d640 1 -- 172.21.15.40:0/2758917608 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4610154f50 msgr2=0x7f45fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:07.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.544+0000 7f461548d640 1 --2- 172.21.15.40:0/2758917608 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4610154f50 0x7f45fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.544+0000 7f461548d640 1 -- 172.21.15.40:0/2758917608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc003b70 msgr2=0x7f45fc003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:07.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.544+0000 7f461548d640 1 --2- 172.21.15.40:0/2758917608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc003b70 0x7f45fc003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.544+0000 7f461548d640 1 -- 172.21.15.40:0/2758917608 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45fc003520 con 0x7f45fc004800 2024-04-22T07:21:07.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.544+0000 7f4615c8e640 1 --2- 172.21.15.40:0/2758917608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc003b70 0x7f45fc003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:07.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.544+0000 7f461548d640 1 --2- 172.21.15.40:0/2758917608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45fc004800 0x7f45fc004c80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4600007fc0 tx=0x7f45fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a1cd8af4f44998 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:07.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.544+0000 7f4614c8c640 1 -- 172.21.15.40:0/2758917608 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4600007be0 con 0x7f45fc004800 2024-04-22T07:21:07.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.544+0000 7f4614c8c640 1 -- 172.21.15.40:0/2758917608 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4600030070 con 0x7f45fc004800 2024-04-22T07:21:07.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.544+0000 7f4614c8c640 1 -- 172.21.15.40:0/2758917608 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4600005d30 con 0x7f45fc004800 2024-04-22T07:21:07.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.545+0000 7f4617ef2640 1 -- 172.21.15.40:0/2758917608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45fc004800 msgr2=0x7f45fc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:07.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.545+0000 7f4617ef2640 1 --2- 172.21.15.40:0/2758917608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45fc004800 0x7f45fc004c80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4600007fc0 tx=0x7f45fc005830 comp rx=0 tx=0).stop 2024-04-22T07:21:07.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.545+0000 7f461648f640 1 -- 172.21.15.40:0/2758917608 reap_dead start 2024-04-22T07:21:07.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.545+0000 7f4617ef2640 1 -- 172.21.15.40:0/2758917608 shutdown_connections 2024-04-22T07:21:07.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.545+0000 7f4617ef2640 1 -- 172.21.15.40:0/2758917608 >> 172.21.15.40:0/2758917608 conn(0x7f46100676b0 msgr2=0x7f4610067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:07.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.545+0000 7f4617ef2640 1 -- 172.21.15.40:0/2758917608 shutdown_connections 2024-04-22T07:21:07.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.545+0000 7f4617ef2640 1 -- 172.21.15.40:0/2758917608 wait complete. 2024-04-22T07:21:07.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.546+0000 7f4617ef2640 1 Processor -- start 2024-04-22T07:21:07.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.546+0000 7f4617ef2640 1 -- start start 2024-04-22T07:21:07.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.547+0000 7f4617ef2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc004800 0x7f4610153fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:07.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.547+0000 7f4617ef2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46101e6b80 0x7f461014a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:07.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.547+0000 7f4617ef2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4610148d20 0x7f46101f0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:07.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.547+0000 7f4617ef2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f461015e3a0 con 0x7f4610148d20 2024-04-22T07:21:07.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.547+0000 7f4617ef2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f461015f260 con 0x7f45fc004800 2024-04-22T07:21:07.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.547+0000 7f4617ef2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f4610155330 con 0x7f46101e6b80 2024-04-22T07:21:07.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.547+0000 7f461648f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4610148d20 0x7f46101f0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:07.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.547+0000 7f461648f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4610148d20 0x7f46101f0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42556/0 (socket says 172.21.15.40:42556) 2024-04-22T07:21:07.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.547+0000 7f461648f640 1 -- 172.21.15.40:0/1746233045 learned_addr learned my addr 172.21.15.40:0/1746233045 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:07.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.547+0000 7f4615c8e640 1 --2- 172.21.15.40:0/1746233045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc004800 0x7f4610153fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:07.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.547+0000 7f461648f640 1 -- 172.21.15.40:0/1746233045 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46101e6b80 msgr2=0x7f461014a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.547+0000 7f461648f640 1 --2- 172.21.15.40:0/1746233045 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46101e6b80 0x7f461014a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.547+0000 7f461648f640 1 -- 172.21.15.40:0/1746233045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc004800 msgr2=0x7f4610153fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.547+0000 7f461648f640 1 --2- 172.21.15.40:0/1746233045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc004800 0x7f4610153fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.547+0000 7f461648f640 1 -- 172.21.15.40:0/1746233045 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46101480b0 con 0x7f4610148d20 2024-04-22T07:21:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.547+0000 7f4615c8e640 1 --2- 172.21.15.40:0/1746233045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc004800 0x7f4610153fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.548+0000 7f461648f640 1 --2- 172.21.15.40:0/1746233045 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4610148d20 0x7f46101f0f50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f45fc003b40 tx=0x7f460800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.548+0000 7f46067fc640 1 -- 172.21.15.40:0/1746233045 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460800ee50 con 0x7f4610148d20 2024-04-22T07:21:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.548+0000 7f46067fc640 1 -- 172.21.15.40:0/1746233045 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4608003b80 con 0x7f4610148d20 2024-04-22T07:21:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.548+0000 7f4617ef2640 1 -- 172.21.15.40:0/1746233045 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4610148320 con 0x7f4610148d20 2024-04-22T07:21:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.548+0000 7f46067fc640 1 -- 172.21.15.40:0/1746233045 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4608003d70 con 0x7f4610148d20 2024-04-22T07:21:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.548+0000 7f4617ef2640 1 -- 172.21.15.40:0/1746233045 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46101488e0 con 0x7f4610148d20 2024-04-22T07:21:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.549+0000 7f4617ef2640 1 -- 172.21.15.40:0/1746233045 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4610069d40 con 0x7f4610148d20 2024-04-22T07:21:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.549+0000 7f46067fc640 1 -- 172.21.15.40:0/1746233045 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f460801a020 con 0x7f4610148d20 2024-04-22T07:21:07.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.549+0000 7f46067fc640 1 --2- 172.21.15.40:0/1746233045 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f45f406c920 0x7f45f406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:07.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.550+0000 7f46067fc640 1 -- 172.21.15.40:0/1746233045 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f460808b040 con 0x7f4610148d20 2024-04-22T07:21:07.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.550+0000 7f4615c8e640 1 --2- 172.21.15.40:0/1746233045 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f45f406c920 0x7f45f406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:07.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.550+0000 7f4615c8e640 1 --2- 172.21.15.40:0/1746233045 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f45f406c920 0x7f45f406ede0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f460c006d40 tx=0x7f460c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:07.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.555+0000 7f46067fc640 1 -- 172.21.15.40:0/1746233045 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4608021020 con 0x7f4610148d20 2024-04-22T07:21:07.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.738+0000 7f4617ef2640 1 -- 172.21.15.40:0/1746233045 --> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f46100d0e20 con 0x7f45f406c920 2024-04-22T07:21:07.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.744+0000 7f46067fc640 1 -- 172.21.15.40:0/1746233045 <== mgr.4107 v2:172.21.15.40:6832/91163869 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251833 (secure 0 0 0) 0x7f46100d0e20 con 0x7f45f406c920 2024-04-22T07:21:07.744 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:21:07.745 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-22T07:21:07.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.747+0000 7f4617ef2640 1 -- 172.21.15.40:0/1746233045 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f45f406c920 msgr2=0x7f45f406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:07.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.747+0000 7f4617ef2640 1 --2- 172.21.15.40:0/1746233045 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f45f406c920 0x7f45f406ede0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f460c006d40 tx=0x7f460c008040 comp rx=0 tx=0).stop 2024-04-22T07:21:07.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.747+0000 7f4617ef2640 1 -- 172.21.15.40:0/1746233045 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4610148d20 msgr2=0x7f46101f0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:07.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.747+0000 7f4617ef2640 1 --2- 172.21.15.40:0/1746233045 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4610148d20 0x7f46101f0f50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f45fc003b40 tx=0x7f460800ec00 comp rx=0 tx=0).stop 2024-04-22T07:21:07.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.747+0000 7f4617ef2640 1 -- 172.21.15.40:0/1746233045 shutdown_connections 2024-04-22T07:21:07.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.747+0000 7f4617ef2640 1 --2- 172.21.15.40:0/1746233045 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f45f406c920 0x7f45f406ede0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.747+0000 7f4617ef2640 1 --2- 172.21.15.40:0/1746233045 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4610148d20 0x7f46101f0f50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.747+0000 7f4617ef2640 1 --2- 172.21.15.40:0/1746233045 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f46101e6b80 0x7f461014a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.747+0000 7f4617ef2640 1 --2- 172.21.15.40:0/1746233045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45fc004800 0x7f4610153fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.747+0000 7f4617ef2640 1 -- 172.21.15.40:0/1746233045 >> 172.21.15.40:0/1746233045 conn(0x7f46100676b0 msgr2=0x7f461006d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:07.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.747+0000 7f4617ef2640 1 -- 172.21.15.40:0/1746233045 shutdown_connections 2024-04-22T07:21:07.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.747+0000 7f4617ef2640 1 -- 172.21.15.40:0/1746233045 wait complete. 2024-04-22T07:21:07.755 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-04-22T07:21:05.779133+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219180,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755540,"statfs":{"total":773094113280,"available":772869672960,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.919334"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977886+0000","last_change":"2024-04-22T07:20:53.873662+0000","last_active":"2024-04-22T07:20:54.977886+0000","last_peered":"2024-04-22T07:20:54.977886+0000","last_clean":"2024-04-22T07:20:54.977886+0000","last_became_active":"2024-04-22T07:20:53.873384+0000","last_became_peered":"2024-04-22T07:20:53.873384+0000","last_unstale":"2024-04-22T07:20:54.977886+0000","last_undegraded":"2024-04-22T07:20:54.977886+0000","last_fullsized":"2024-04-22T07:20:54.977886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980006+0000","last_change":"2024-04-22T07:20:53.870454+0000","last_active":"2024-04-22T07:20:54.980006+0000","last_peered":"2024-04-22T07:20:54.980006+0000","last_clean":"2024-04-22T07:20:54.980006+0000","last_became_active":"2024-04-22T07:20:53.869964+0000","last_became_peered":"2024-04-22T07:20:53.869964+0000","last_unstale":"2024-04-22T07:20:54.980006+0000","last_undegraded":"2024-04-22T07:20:54.980006+0000","last_fullsized":"2024-04-22T07:20:54.980006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979125+0000","last_change":"2024-04-22T07:20:53.871145+0000","last_active":"2024-04-22T07:20:54.979125+0000","last_peered":"2024-04-22T07:20:54.979125+0000","last_clean":"2024-04-22T07:20:54.979125+0000","last_became_active":"2024-04-22T07:20:53.870819+0000","last_became_peered":"2024-04-22T07:20:53.870819+0000","last_unstale":"2024-04-22T07:20:54.979125+0000","last_undegraded":"2024-04-22T07:20:54.979125+0000","last_fullsized":"2024-04-22T07:20:54.979125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:02:16.373202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861622+0000","last_change":"2024-04-22T07:20:53.870458+0000","last_active":"2024-04-22T07:20:54.861622+0000","last_peered":"2024-04-22T07:20:54.861622+0000","last_clean":"2024-04-22T07:20:54.861622+0000","last_became_active":"2024-04-22T07:20:53.870125+0000","last_became_peered":"2024-04-22T07:20:53.870125+0000","last_unstale":"2024-04-22T07:20:54.861622+0000","last_undegraded":"2024-04-22T07:20:54.861622+0000","last_fullsized":"2024-04-22T07:20:54.861622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977801+0000","last_change":"2024-04-22T07:20:53.877301+0000","last_active":"2024-04-22T07:20:54.977801+0000","last_peered":"2024-04-22T07:20:54.977801+0000","last_clean":"2024-04-22T07:20:54.977801+0000","last_became_active":"2024-04-22T07:20:53.874941+0000","last_became_peered":"2024-04-22T07:20:53.874941+0000","last_unstale":"2024-04-22T07:20:54.977801+0000","last_undegraded":"2024-04-22T07:20:54.977801+0000","last_fullsized":"2024-04-22T07:20:54.977801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:52.686229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861484+0000","last_change":"2024-04-22T07:20:53.869735+0000","last_active":"2024-04-22T07:20:54.861484+0000","last_peered":"2024-04-22T07:20:54.861484+0000","last_clean":"2024-04-22T07:20:54.861484+0000","last_became_active":"2024-04-22T07:20:53.869369+0000","last_became_peered":"2024-04-22T07:20:53.869369+0000","last_unstale":"2024-04-22T07:20:54.861484+0000","last_undegraded":"2024-04-22T07:20:54.861484+0000","last_fullsized":"2024-04-22T07:20:54.861484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:27.624819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977494+0000","last_change":"2024-04-22T07:20:53.873492+0000","last_active":"2024-04-22T07:20:54.977494+0000","last_peered":"2024-04-22T07:20:54.977494+0000","last_clean":"2024-04-22T07:20:54.977494+0000","last_became_active":"2024-04-22T07:20:53.873220+0000","last_became_peered":"2024-04-22T07:20:53.873220+0000","last_unstale":"2024-04-22T07:20:54.977494+0000","last_undegraded":"2024-04-22T07:20:54.977494+0000","last_fullsized":"2024-04-22T07:20:54.977494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:35:26.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979018+0000","last_change":"2024-04-22T07:20:53.875847+0000","last_active":"2024-04-22T07:20:54.979018+0000","last_peered":"2024-04-22T07:20:54.979018+0000","last_clean":"2024-04-22T07:20:54.979018+0000","last_became_active":"2024-04-22T07:20:53.875017+0000","last_became_peered":"2024-04-22T07:20:53.875017+0000","last_unstale":"2024-04-22T07:20:54.979018+0000","last_undegraded":"2024-04-22T07:20:54.979018+0000","last_fullsized":"2024-04-22T07:20:54.979018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:07.080135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863086+0000","last_change":"2024-04-22T07:20:53.869174+0000","last_active":"2024-04-22T07:20:54.863086+0000","last_peered":"2024-04-22T07:20:54.863086+0000","last_clean":"2024-04-22T07:20:54.863086+0000","last_became_active":"2024-04-22T07:20:53.868906+0000","last_became_peered":"2024-04-22T07:20:53.868906+0000","last_unstale":"2024-04-22T07:20:54.863086+0000","last_undegraded":"2024-04-22T07:20:54.863086+0000","last_fullsized":"2024-04-22T07:20:54.863086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977893+0000","last_change":"2024-04-22T07:20:53.874933+0000","last_active":"2024-04-22T07:20:54.977893+0000","last_peered":"2024-04-22T07:20:54.977893+0000","last_clean":"2024-04-22T07:20:54.977893+0000","last_became_active":"2024-04-22T07:20:53.874673+0000","last_became_peered":"2024-04-22T07:20:53.874673+0000","last_unstale":"2024-04-22T07:20:54.977893+0000","last_undegraded":"2024-04-22T07:20:54.977893+0000","last_fullsized":"2024-04-22T07:20:54.977893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977684+0000","last_change":"2024-04-22T07:20:53.874909+0000","last_active":"2024-04-22T07:20:54.977684+0000","last_peered":"2024-04-22T07:20:54.977684+0000","last_clean":"2024-04-22T07:20:54.977684+0000","last_became_active":"2024-04-22T07:20:53.873945+0000","last_became_peered":"2024-04-22T07:20:53.873945+0000","last_unstale":"2024-04-22T07:20:54.977684+0000","last_undegraded":"2024-04-22T07:20:54.977684+0000","last_fullsized":"2024-04-22T07:20:54.977684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:53.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977652+0000","last_change":"2024-04-22T07:20:53.878344+0000","last_active":"2024-04-22T07:20:54.977652+0000","last_peered":"2024-04-22T07:20:54.977652+0000","last_clean":"2024-04-22T07:20:54.977652+0000","last_became_active":"2024-04-22T07:20:53.877192+0000","last_became_peered":"2024-04-22T07:20:53.877192+0000","last_unstale":"2024-04-22T07:20:54.977652+0000","last_undegraded":"2024-04-22T07:20:54.977652+0000","last_fullsized":"2024-04-22T07:20:54.977652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:42:03.637655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979583+0000","last_change":"2024-04-22T07:20:53.879419+0000","last_active":"2024-04-22T07:20:54.979583+0000","last_peered":"2024-04-22T07:20:54.979583+0000","last_clean":"2024-04-22T07:20:54.979583+0000","last_became_active":"2024-04-22T07:20:53.879070+0000","last_became_peered":"2024-04-22T07:20:53.879070+0000","last_unstale":"2024-04-22T07:20:54.979583+0000","last_undegraded":"2024-04-22T07:20:54.979583+0000","last_fullsized":"2024-04-22T07:20:54.979583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979592+0000","last_change":"2024-04-22T07:20:53.877395+0000","last_active":"2024-04-22T07:20:54.979592+0000","last_peered":"2024-04-22T07:20:54.979592+0000","last_clean":"2024-04-22T07:20:54.979592+0000","last_became_active":"2024-04-22T07:20:53.877116+0000","last_became_peered":"2024-04-22T07:20:53.877116+0000","last_unstale":"2024-04-22T07:20:54.979592+0000","last_undegraded":"2024-04-22T07:20:54.979592+0000","last_fullsized":"2024-04-22T07:20:54.979592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:21:25.001413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979310+0000","last_change":"2024-04-22T07:20:53.875156+0000","last_active":"2024-04-22T07:20:54.979310+0000","last_peered":"2024-04-22T07:20:54.979310+0000","last_clean":"2024-04-22T07:20:54.979310+0000","last_became_active":"2024-04-22T07:20:53.874468+0000","last_became_peered":"2024-04-22T07:20:53.874468+0000","last_unstale":"2024-04-22T07:20:54.979310+0000","last_undegraded":"2024-04-22T07:20:54.979310+0000","last_fullsized":"2024-04-22T07:20:54.979310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:42:03.637655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862585+0000","last_change":"2024-04-22T07:20:53.867178+0000","last_active":"2024-04-22T07:20:54.862585+0000","last_peered":"2024-04-22T07:20:54.862585+0000","last_clean":"2024-04-22T07:20:54.862585+0000","last_became_active":"2024-04-22T07:20:53.865491+0000","last_became_peered":"2024-04-22T07:20:53.865491+0000","last_unstale":"2024-04-22T07:20:54.862585+0000","last_undegraded":"2024-04-22T07:20:54.862585+0000","last_fullsized":"2024-04-22T07:20:54.862585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863583+0000","last_change":"2024-04-22T07:20:53.876797+0000","last_active":"2024-04-22T07:20:54.863583+0000","last_peered":"2024-04-22T07:20:54.863583+0000","last_clean":"2024-04-22T07:20:54.863583+0000","last_became_active":"2024-04-22T07:20:53.876321+0000","last_became_peered":"2024-04-22T07:20:53.876321+0000","last_unstale":"2024-04-22T07:20:54.863583+0000","last_undegraded":"2024-04-22T07:20:54.863583+0000","last_fullsized":"2024-04-22T07:20:54.863583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:22:45.699676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980360+0000","last_change":"2024-04-22T07:20:53.868760+0000","last_active":"2024-04-22T07:20:54.980360+0000","last_peered":"2024-04-22T07:20:54.980360+0000","last_clean":"2024-04-22T07:20:54.980360+0000","last_became_active":"2024-04-22T07:20:53.868441+0000","last_became_peered":"2024-04-22T07:20:53.868441+0000","last_unstale":"2024-04-22T07:20:54.980360+0000","last_undegraded":"2024-04-22T07:20:54.980360+0000","last_fullsized":"2024-04-22T07:20:54.980360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863503+0000","last_change":"2024-04-22T07:20:53.864806+0000","last_active":"2024-04-22T07:20:54.863503+0000","last_peered":"2024-04-22T07:20:54.863503+0000","last_clean":"2024-04-22T07:20:54.863503+0000","last_became_active":"2024-04-22T07:20:53.864535+0000","last_became_peered":"2024-04-22T07:20:53.864535+0000","last_unstale":"2024-04-22T07:20:54.863503+0000","last_undegraded":"2024-04-22T07:20:54.863503+0000","last_fullsized":"2024-04-22T07:20:54.863503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:22:07.227993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977721+0000","last_change":"2024-04-22T07:20:53.878013+0000","last_active":"2024-04-22T07:20:54.977721+0000","last_peered":"2024-04-22T07:20:54.977721+0000","last_clean":"2024-04-22T07:20:54.977721+0000","last_became_active":"2024-04-22T07:20:53.876641+0000","last_became_peered":"2024-04-22T07:20:53.876641+0000","last_unstale":"2024-04-22T07:20:54.977721+0000","last_undegraded":"2024-04-22T07:20:54.977721+0000","last_fullsized":"2024-04-22T07:20:54.977721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:45:15.519469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978885+0000","last_change":"2024-04-22T07:20:53.868319+0000","last_active":"2024-04-22T07:20:54.978885+0000","last_peered":"2024-04-22T07:20:54.978885+0000","last_clean":"2024-04-22T07:20:54.978885+0000","last_became_active":"2024-04-22T07:20:53.868014+0000","last_became_peered":"2024-04-22T07:20:53.868014+0000","last_unstale":"2024-04-22T07:20:54.978885+0000","last_undegraded":"2024-04-22T07:20:54.978885+0000","last_fullsized":"2024-04-22T07:20:54.978885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:09:27.178992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862823+0000","last_change":"2024-04-22T07:20:53.867684+0000","last_active":"2024-04-22T07:20:54.862823+0000","last_peered":"2024-04-22T07:20:54.862823+0000","last_clean":"2024-04-22T07:20:54.862823+0000","last_became_active":"2024-04-22T07:20:53.867403+0000","last_became_peered":"2024-04-22T07:20:53.867403+0000","last_unstale":"2024-04-22T07:20:54.862823+0000","last_undegraded":"2024-04-22T07:20:54.862823+0000","last_fullsized":"2024-04-22T07:20:54.862823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979253+0000","last_change":"2024-04-22T07:20:53.869595+0000","last_active":"2024-04-22T07:20:54.979253+0000","last_peered":"2024-04-22T07:20:54.979253+0000","last_clean":"2024-04-22T07:20:54.979253+0000","last_became_active":"2024-04-22T07:20:53.868519+0000","last_became_peered":"2024-04-22T07:20:53.868519+0000","last_unstale":"2024-04-22T07:20:54.979253+0000","last_undegraded":"2024-04-22T07:20:54.979253+0000","last_fullsized":"2024-04-22T07:20:54.979253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:35:26.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862610+0000","last_change":"2024-04-22T07:20:53.865275+0000","last_active":"2024-04-22T07:20:54.862610+0000","last_peered":"2024-04-22T07:20:54.862610+0000","last_clean":"2024-04-22T07:20:54.862610+0000","last_became_active":"2024-04-22T07:20:53.865026+0000","last_became_peered":"2024-04-22T07:20:53.865026+0000","last_unstale":"2024-04-22T07:20:54.862610+0000","last_undegraded":"2024-04-22T07:20:54.862610+0000","last_fullsized":"2024-04-22T07:20:54.862610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:48:40.630407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979451+0000","last_change":"2024-04-22T07:20:53.873457+0000","last_active":"2024-04-22T07:20:54.979451+0000","last_peered":"2024-04-22T07:20:54.979451+0000","last_clean":"2024-04-22T07:20:54.979451+0000","last_became_active":"2024-04-22T07:20:53.873147+0000","last_became_peered":"2024-04-22T07:20:53.873147+0000","last_unstale":"2024-04-22T07:20:54.979451+0000","last_undegraded":"2024-04-22T07:20:54.979451+0000","last_fullsized":"2024-04-22T07:20:54.979451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:53.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861933+0000","last_change":"2024-04-22T07:20:53.865327+0000","last_active":"2024-04-22T07:20:54.861933+0000","last_peered":"2024-04-22T07:20:54.861933+0000","last_clean":"2024-04-22T07:20:54.861933+0000","last_became_active":"2024-04-22T07:20:53.865030+0000","last_became_peered":"2024-04-22T07:20:53.865030+0000","last_unstale":"2024-04-22T07:20:54.861933+0000","last_undegraded":"2024-04-22T07:20:54.861933+0000","last_fullsized":"2024-04-22T07:20:54.861933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979550+0000","last_change":"2024-04-22T07:20:53.876792+0000","last_active":"2024-04-22T07:20:54.979550+0000","last_peered":"2024-04-22T07:20:54.979550+0000","last_clean":"2024-04-22T07:20:54.979550+0000","last_became_active":"2024-04-22T07:20:53.876446+0000","last_became_peered":"2024-04-22T07:20:53.876446+0000","last_unstale":"2024-04-22T07:20:54.979550+0000","last_undegraded":"2024-04-22T07:20:54.979550+0000","last_fullsized":"2024-04-22T07:20:54.979550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:34.943561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979292+0000","last_change":"2024-04-22T07:20:53.878147+0000","last_active":"2024-04-22T07:20:54.979292+0000","last_peered":"2024-04-22T07:20:54.979292+0000","last_clean":"2024-04-22T07:20:54.979292+0000","last_became_active":"2024-04-22T07:20:53.877867+0000","last_became_peered":"2024-04-22T07:20:53.877867+0000","last_unstale":"2024-04-22T07:20:54.979292+0000","last_undegraded":"2024-04-22T07:20:54.979292+0000","last_fullsized":"2024-04-22T07:20:54.979292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979201+0000","last_change":"2024-04-22T07:20:53.872447+0000","last_active":"2024-04-22T07:20:54.979201+0000","last_peered":"2024-04-22T07:20:54.979201+0000","last_clean":"2024-04-22T07:20:54.979201+0000","last_became_active":"2024-04-22T07:20:53.871862+0000","last_became_peered":"2024-04-22T07:20:53.871862+0000","last_unstale":"2024-04-22T07:20:54.979201+0000","last_undegraded":"2024-04-22T07:20:54.979201+0000","last_fullsized":"2024-04-22T07:20:54.979201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:08:33.063318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862747+0000","last_change":"2024-04-22T07:20:53.862483+0000","last_active":"2024-04-22T07:20:54.862747+0000","last_peered":"2024-04-22T07:20:54.862747+0000","last_clean":"2024-04-22T07:20:54.862747+0000","last_became_active":"2024-04-22T07:20:53.862199+0000","last_became_peered":"2024-04-22T07:20:53.862199+0000","last_unstale":"2024-04-22T07:20:54.862747+0000","last_undegraded":"2024-04-22T07:20:54.862747+0000","last_fullsized":"2024-04-22T07:20:54.862747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:10:12.276510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979743+0000","last_change":"2024-04-22T07:20:53.872507+0000","last_active":"2024-04-22T07:20:54.979743+0000","last_peered":"2024-04-22T07:20:54.979743+0000","last_clean":"2024-04-22T07:20:54.979743+0000","last_became_active":"2024-04-22T07:20:53.872199+0000","last_became_peered":"2024-04-22T07:20:53.872199+0000","last_unstale":"2024-04-22T07:20:54.979743+0000","last_undegraded":"2024-04-22T07:20:54.979743+0000","last_fullsized":"2024-04-22T07:20:54.979743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:09.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861399+0000","last_change":"2024-04-22T07:20:53.863946+0000","last_active":"2024-04-22T07:20:54.861399+0000","last_peered":"2024-04-22T07:20:54.861399+0000","last_clean":"2024-04-22T07:20:54.861399+0000","last_became_active":"2024-04-22T07:20:53.863688+0000","last_became_peered":"2024-04-22T07:20:53.863688+0000","last_unstale":"2024-04-22T07:20:54.861399+0000","last_undegraded":"2024-04-22T07:20:54.861399+0000","last_fullsized":"2024-04-22T07:20:54.861399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862947+0000","last_change":"2024-04-22T07:20:53.874785+0000","last_active":"2024-04-22T07:20:54.862947+0000","last_peered":"2024-04-22T07:20:54.862947+0000","last_clean":"2024-04-22T07:20:54.862947+0000","last_became_active":"2024-04-22T07:20:53.874524+0000","last_became_peered":"2024-04-22T07:20:53.874524+0000","last_unstale":"2024-04-22T07:20:54.862947+0000","last_undegraded":"2024-04-22T07:20:54.862947+0000","last_fullsized":"2024-04-22T07:20:54.862947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.787613+0000","last_change":"2024-04-22T07:20:52.860712+0000","last_active":"2024-04-22T07:20:55.787613+0000","last_peered":"2024-04-22T07:20:55.787613+0000","last_clean":"2024-04-22T07:20:55.787613+0000","last_became_active":"2024-04-22T07:20:52.860015+0000","last_became_peered":"2024-04-22T07:20:52.860015+0000","last_unstale":"2024-04-22T07:20:55.787613+0000","last_undegraded":"2024-04-22T07:20:55.787613+0000","last_fullsized":"2024-04-22T07:20:55.787613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:59:32.487127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980495+0000","last_change":"2024-04-22T07:20:53.879570+0000","last_active":"2024-04-22T07:20:54.980495+0000","last_peered":"2024-04-22T07:20:54.980495+0000","last_clean":"2024-04-22T07:20:54.980495+0000","last_became_active":"2024-04-22T07:20:53.879191+0000","last_became_peered":"2024-04-22T07:20:53.879191+0000","last_unstale":"2024-04-22T07:20:54.980495+0000","last_undegraded":"2024-04-22T07:20:54.980495+0000","last_fullsized":"2024-04-22T07:20:54.980495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:34:52.306691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.787136+0000","last_change":"2024-04-22T07:20:52.862510+0000","last_active":"2024-04-22T07:20:55.787136+0000","last_peered":"2024-04-22T07:20:55.787136+0000","last_clean":"2024-04-22T07:20:55.787136+0000","last_became_active":"2024-04-22T07:20:52.862228+0000","last_became_peered":"2024-04-22T07:20:52.862228+0000","last_unstale":"2024-04-22T07:20:55.787136+0000","last_undegraded":"2024-04-22T07:20:55.787136+0000","last_fullsized":"2024-04-22T07:20:55.787136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:51.683021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979012+0000","last_change":"2024-04-22T07:20:52.856651+0000","last_active":"2024-04-22T07:20:54.979012+0000","last_peered":"2024-04-22T07:20:54.979012+0000","last_clean":"2024-04-22T07:20:54.979012+0000","last_became_active":"2024-04-22T07:20:52.856096+0000","last_became_peered":"2024-04-22T07:20:52.856096+0000","last_unstale":"2024-04-22T07:20:54.979012+0000","last_undegraded":"2024-04-22T07:20:54.979012+0000","last_fullsized":"2024-04-22T07:20:54.979012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:04.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979658+0000","last_change":"2024-04-22T07:20:53.873708+0000","last_active":"2024-04-22T07:20:54.979658+0000","last_peered":"2024-04-22T07:20:54.979658+0000","last_clean":"2024-04-22T07:20:54.979658+0000","last_became_active":"2024-04-22T07:20:53.872793+0000","last_became_peered":"2024-04-22T07:20:53.872793+0000","last_unstale":"2024-04-22T07:20:54.979658+0000","last_undegraded":"2024-04-22T07:20:54.979658+0000","last_fullsized":"2024-04-22T07:20:54.979658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:52.686229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862729+0000","last_change":"2024-04-22T07:20:52.861133+0000","last_active":"2024-04-22T07:20:54.862729+0000","last_peered":"2024-04-22T07:20:54.862729+0000","last_clean":"2024-04-22T07:20:54.862729+0000","last_became_active":"2024-04-22T07:20:52.860736+0000","last_became_peered":"2024-04-22T07:20:52.860736+0000","last_unstale":"2024-04-22T07:20:54.862729+0000","last_undegraded":"2024-04-22T07:20:54.862729+0000","last_fullsized":"2024-04-22T07:20:54.862729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:06.123308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980308+0000","last_change":"2024-04-22T07:20:53.867477+0000","last_active":"2024-04-22T07:20:54.980308+0000","last_peered":"2024-04-22T07:20:54.980308+0000","last_clean":"2024-04-22T07:20:54.980308+0000","last_became_active":"2024-04-22T07:20:53.867086+0000","last_became_peered":"2024-04-22T07:20:53.867086+0000","last_unstale":"2024-04-22T07:20:54.980308+0000","last_undegraded":"2024-04-22T07:20:54.980308+0000","last_fullsized":"2024-04-22T07:20:54.980308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:56:55.644168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863067+0000","last_change":"2024-04-22T07:20:52.863567+0000","last_active":"2024-04-22T07:20:54.863067+0000","last_peered":"2024-04-22T07:20:54.863067+0000","last_clean":"2024-04-22T07:20:54.863067+0000","last_became_active":"2024-04-22T07:20:52.863285+0000","last_became_peered":"2024-04-22T07:20:52.863285+0000","last_unstale":"2024-04-22T07:20:54.863067+0000","last_undegraded":"2024-04-22T07:20:54.863067+0000","last_fullsized":"2024-04-22T07:20:54.863067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861976+0000","last_change":"2024-04-22T07:20:53.864955+0000","last_active":"2024-04-22T07:20:54.861976+0000","last_peered":"2024-04-22T07:20:54.861976+0000","last_clean":"2024-04-22T07:20:54.861976+0000","last_became_active":"2024-04-22T07:20:53.864694+0000","last_became_peered":"2024-04-22T07:20:53.864694+0000","last_unstale":"2024-04-22T07:20:54.861976+0000","last_undegraded":"2024-04-22T07:20:54.861976+0000","last_fullsized":"2024-04-22T07:20:54.861976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977898+0000","last_change":"2024-04-22T07:20:52.858761+0000","last_active":"2024-04-22T07:20:54.977898+0000","last_peered":"2024-04-22T07:20:54.977898+0000","last_clean":"2024-04-22T07:20:54.977898+0000","last_became_active":"2024-04-22T07:20:52.856815+0000","last_became_peered":"2024-04-22T07:20:52.856815+0000","last_unstale":"2024-04-22T07:20:54.977898+0000","last_undegraded":"2024-04-22T07:20:54.977898+0000","last_fullsized":"2024-04-22T07:20:54.977898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:06.123308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979798+0000","last_change":"2024-04-22T07:20:53.867290+0000","last_active":"2024-04-22T07:20:54.979798+0000","last_peered":"2024-04-22T07:20:54.979798+0000","last_clean":"2024-04-22T07:20:54.979798+0000","last_became_active":"2024-04-22T07:20:53.866955+0000","last_became_peered":"2024-04-22T07:20:53.866955+0000","last_unstale":"2024-04-22T07:20:54.979798+0000","last_undegraded":"2024-04-22T07:20:54.979798+0000","last_fullsized":"2024-04-22T07:20:54.979798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:43.442316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.870244+0000","last_change":"2024-04-22T07:20:52.863670+0000","last_active":"2024-04-22T07:20:58.870244+0000","last_peered":"2024-04-22T07:20:58.870244+0000","last_clean":"2024-04-22T07:20:58.870244+0000","last_became_active":"2024-04-22T07:20:52.863320+0000","last_became_peered":"2024-04-22T07:20:52.863320+0000","last_unstale":"2024-04-22T07:20:58.870244+0000","last_undegraded":"2024-04-22T07:20:58.870244+0000","last_fullsized":"2024-04-22T07:20:58.870244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:04.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862589+0000","last_change":"2024-04-22T07:20:53.868286+0000","last_active":"2024-04-22T07:20:54.862589+0000","last_peered":"2024-04-22T07:20:54.862589+0000","last_clean":"2024-04-22T07:20:54.862589+0000","last_became_active":"2024-04-22T07:20:53.862811+0000","last_became_peered":"2024-04-22T07:20:53.862811+0000","last_unstale":"2024-04-22T07:20:54.862589+0000","last_undegraded":"2024-04-22T07:20:54.862589+0000","last_fullsized":"2024-04-22T07:20:54.862589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.870351+0000","last_change":"2024-04-22T07:20:52.863638+0000","last_active":"2024-04-22T07:20:58.870351+0000","last_peered":"2024-04-22T07:20:58.870351+0000","last_clean":"2024-04-22T07:20:58.870351+0000","last_became_active":"2024-04-22T07:20:52.863244+0000","last_became_peered":"2024-04-22T07:20:52.863244+0000","last_unstale":"2024-04-22T07:20:58.870351+0000","last_undegraded":"2024-04-22T07:20:58.870351+0000","last_fullsized":"2024-04-22T07:20:58.870351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:36:49.017537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977713+0000","last_change":"2024-04-22T07:20:53.875162+0000","last_active":"2024-04-22T07:20:54.977713+0000","last_peered":"2024-04-22T07:20:54.977713+0000","last_clean":"2024-04-22T07:20:54.977713+0000","last_became_active":"2024-04-22T07:20:53.874612+0000","last_became_peered":"2024-04-22T07:20:53.874612+0000","last_unstale":"2024-04-22T07:20:54.977713+0000","last_undegraded":"2024-04-22T07:20:54.977713+0000","last_fullsized":"2024-04-22T07:20:54.977713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:13:12.303505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.869961+0000","last_change":"2024-04-22T07:20:52.855194+0000","last_active":"2024-04-22T07:20:58.869961+0000","last_peered":"2024-04-22T07:20:58.869961+0000","last_clean":"2024-04-22T07:20:58.869961+0000","last_became_active":"2024-04-22T07:20:52.854915+0000","last_became_peered":"2024-04-22T07:20:52.854915+0000","last_unstale":"2024-04-22T07:20:58.869961+0000","last_undegraded":"2024-04-22T07:20:58.869961+0000","last_fullsized":"2024-04-22T07:20:58.869961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979725+0000","last_change":"2024-04-22T07:20:53.868695+0000","last_active":"2024-04-22T07:20:54.979725+0000","last_peered":"2024-04-22T07:20:54.979725+0000","last_clean":"2024-04-22T07:20:54.979725+0000","last_became_active":"2024-04-22T07:20:53.868400+0000","last_became_peered":"2024-04-22T07:20:53.868400+0000","last_unstale":"2024-04-22T07:20:54.979725+0000","last_undegraded":"2024-04-22T07:20:54.979725+0000","last_fullsized":"2024-04-22T07:20:54.979725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:30:23.352871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863163+0000","last_change":"2024-04-22T07:20:52.861884+0000","last_active":"2024-04-22T07:20:54.863163+0000","last_peered":"2024-04-22T07:20:54.863163+0000","last_clean":"2024-04-22T07:20:54.863163+0000","last_became_active":"2024-04-22T07:20:52.861546+0000","last_became_peered":"2024-04-22T07:20:52.861546+0000","last_unstale":"2024-04-22T07:20:54.863163+0000","last_undegraded":"2024-04-22T07:20:54.863163+0000","last_fullsized":"2024-04-22T07:20:54.863163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:37.283262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862882+0000","last_change":"2024-04-22T07:20:53.863071+0000","last_active":"2024-04-22T07:20:54.862882+0000","last_peered":"2024-04-22T07:20:54.862882+0000","last_clean":"2024-04-22T07:20:54.862882+0000","last_became_active":"2024-04-22T07:20:53.862763+0000","last_became_peered":"2024-04-22T07:20:53.862763+0000","last_unstale":"2024-04-22T07:20:54.862882+0000","last_undegraded":"2024-04-22T07:20:54.862882+0000","last_fullsized":"2024-04-22T07:20:54.862882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:19:57.432323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977415+0000","last_change":"2024-04-22T07:20:52.865285+0000","last_active":"2024-04-22T07:20:54.977415+0000","last_peered":"2024-04-22T07:20:54.977415+0000","last_clean":"2024-04-22T07:20:54.977415+0000","last_became_active":"2024-04-22T07:20:52.864725+0000","last_became_peered":"2024-04-22T07:20:52.864725+0000","last_unstale":"2024-04-22T07:20:54.977415+0000","last_undegraded":"2024-04-22T07:20:54.977415+0000","last_fullsized":"2024-04-22T07:20:54.977415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:23:28.850031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862533+0000","last_change":"2024-04-22T07:20:53.875479+0000","last_active":"2024-04-22T07:20:54.862533+0000","last_peered":"2024-04-22T07:20:54.862533+0000","last_clean":"2024-04-22T07:20:54.862533+0000","last_became_active":"2024-04-22T07:20:53.874567+0000","last_became_peered":"2024-04-22T07:20:53.874567+0000","last_unstale":"2024-04-22T07:20:54.862533+0000","last_undegraded":"2024-04-22T07:20:54.862533+0000","last_fullsized":"2024-04-22T07:20:54.862533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.871647+0000","last_change":"2024-04-22T07:20:52.860646+0000","last_active":"2024-04-22T07:20:58.871647+0000","last_peered":"2024-04-22T07:20:58.871647+0000","last_clean":"2024-04-22T07:20:58.871647+0000","last_became_active":"2024-04-22T07:20:52.860347+0000","last_became_peered":"2024-04-22T07:20:52.860347+0000","last_unstale":"2024-04-22T07:20:58.871647+0000","last_undegraded":"2024-04-22T07:20:58.871647+0000","last_fullsized":"2024-04-22T07:20:58.871647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:53:20.912264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862635+0000","last_change":"2024-04-22T07:20:53.859641+0000","last_active":"2024-04-22T07:20:54.862635+0000","last_peered":"2024-04-22T07:20:54.862635+0000","last_clean":"2024-04-22T07:20:54.862635+0000","last_became_active":"2024-04-22T07:20:53.859365+0000","last_became_peered":"2024-04-22T07:20:53.859365+0000","last_unstale":"2024-04-22T07:20:54.862635+0000","last_undegraded":"2024-04-22T07:20:54.862635+0000","last_fullsized":"2024-04-22T07:20:54.862635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:46:50.322722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.788730+0000","last_change":"2024-04-22T07:20:52.866960+0000","last_active":"2024-04-22T07:20:55.788730+0000","last_peered":"2024-04-22T07:20:55.788730+0000","last_clean":"2024-04-22T07:20:55.788730+0000","last_became_active":"2024-04-22T07:20:52.866654+0000","last_became_peered":"2024-04-22T07:20:52.866654+0000","last_unstale":"2024-04-22T07:20:55.788730+0000","last_undegraded":"2024-04-22T07:20:55.788730+0000","last_fullsized":"2024-04-22T07:20:55.788730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:51.683021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862087+0000","last_change":"2024-04-22T07:20:53.874775+0000","last_active":"2024-04-22T07:20:54.862087+0000","last_peered":"2024-04-22T07:20:54.862087+0000","last_clean":"2024-04-22T07:20:54.862087+0000","last_became_active":"2024-04-22T07:20:53.874499+0000","last_became_peered":"2024-04-22T07:20:53.874499+0000","last_unstale":"2024-04-22T07:20:54.862087+0000","last_undegraded":"2024-04-22T07:20:54.862087+0000","last_fullsized":"2024-04-22T07:20:54.862087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:23.268067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.871021+0000","last_change":"2024-04-22T07:20:52.867201+0000","last_active":"2024-04-22T07:20:58.871021+0000","last_peered":"2024-04-22T07:20:58.871021+0000","last_clean":"2024-04-22T07:20:58.871021+0000","last_became_active":"2024-04-22T07:20:52.866627+0000","last_became_peered":"2024-04-22T07:20:52.866627+0000","last_unstale":"2024-04-22T07:20:58.871021+0000","last_undegraded":"2024-04-22T07:20:58.871021+0000","last_fullsized":"2024-04-22T07:20:58.871021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:09:08.908298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977901+0000","last_change":"2024-04-22T07:20:53.871645+0000","last_active":"2024-04-22T07:20:54.977901+0000","last_peered":"2024-04-22T07:20:54.977901+0000","last_clean":"2024-04-22T07:20:54.977901+0000","last_became_active":"2024-04-22T07:20:53.871353+0000","last_became_peered":"2024-04-22T07:20:53.871353+0000","last_unstale":"2024-04-22T07:20:54.977901+0000","last_undegraded":"2024-04-22T07:20:54.977901+0000","last_fullsized":"2024-04-22T07:20:54.977901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:48:40.630407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.787667+0000","last_change":"2024-04-22T07:20:52.866996+0000","last_active":"2024-04-22T07:20:55.787667+0000","last_peered":"2024-04-22T07:20:55.787667+0000","last_clean":"2024-04-22T07:20:55.787667+0000","last_became_active":"2024-04-22T07:20:52.866677+0000","last_became_peered":"2024-04-22T07:20:52.866677+0000","last_unstale":"2024-04-22T07:20:55.787667+0000","last_undegraded":"2024-04-22T07:20:55.787667+0000","last_fullsized":"2024-04-22T07:20:55.787667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977832+0000","last_change":"2024-04-22T07:20:53.871064+0000","last_active":"2024-04-22T07:20:54.977832+0000","last_peered":"2024-04-22T07:20:54.977832+0000","last_clean":"2024-04-22T07:20:54.977832+0000","last_became_active":"2024-04-22T07:20:53.866968+0000","last_became_peered":"2024-04-22T07:20:53.866968+0000","last_unstale":"2024-04-22T07:20:54.977832+0000","last_undegraded":"2024-04-22T07:20:54.977832+0000","last_fullsized":"2024-04-22T07:20:54.977832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:43.442316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979659+0000","last_change":"2024-04-22T07:20:52.856958+0000","last_active":"2024-04-22T07:20:54.979659+0000","last_peered":"2024-04-22T07:20:54.979659+0000","last_clean":"2024-04-22T07:20:54.979659+0000","last_became_active":"2024-04-22T07:20:52.856289+0000","last_became_peered":"2024-04-22T07:20:52.856289+0000","last_unstale":"2024-04-22T07:20:54.979659+0000","last_undegraded":"2024-04-22T07:20:54.979659+0000","last_fullsized":"2024-04-22T07:20:54.979659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863352+0000","last_change":"2024-04-22T07:20:53.872915+0000","last_active":"2024-04-22T07:20:54.863352+0000","last_peered":"2024-04-22T07:20:54.863352+0000","last_clean":"2024-04-22T07:20:54.863352+0000","last_became_active":"2024-04-22T07:20:53.872005+0000","last_became_peered":"2024-04-22T07:20:53.872005+0000","last_unstale":"2024-04-22T07:20:54.863352+0000","last_undegraded":"2024-04-22T07:20:54.863352+0000","last_fullsized":"2024-04-22T07:20:54.863352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:53:29.242632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862549+0000","last_change":"2024-04-22T07:20:43.747396+0000","last_active":"2024-04-22T07:20:54.862549+0000","last_peered":"2024-04-22T07:20:54.862549+0000","last_clean":"2024-04-22T07:20:54.862549+0000","last_became_active":"2024-04-22T07:20:43.746332+0000","last_became_peered":"2024-04-22T07:20:43.746332+0000","last_unstale":"2024-04-22T07:20:54.862549+0000","last_undegraded":"2024-04-22T07:20:54.862549+0000","last_fullsized":"2024-04-22T07:20:54.862549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:42.732916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:42.732916+0000","last_clean_scrub_stamp":"2024-04-22T07:20:42.732916+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:02:55.086445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863049+0000","last_change":"2024-04-22T07:20:52.862492+0000","last_active":"2024-04-22T07:20:54.863049+0000","last_peered":"2024-04-22T07:20:54.863049+0000","last_clean":"2024-04-22T07:20:54.863049+0000","last_became_active":"2024-04-22T07:20:52.862201+0000","last_became_peered":"2024-04-22T07:20:52.862201+0000","last_unstale":"2024-04-22T07:20:54.863049+0000","last_undegraded":"2024-04-22T07:20:54.863049+0000","last_fullsized":"2024-04-22T07:20:54.863049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:52.015227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979807+0000","last_change":"2024-04-22T07:20:53.868797+0000","last_active":"2024-04-22T07:20:54.979807+0000","last_peered":"2024-04-22T07:20:54.979807+0000","last_clean":"2024-04-22T07:20:54.979807+0000","last_became_active":"2024-04-22T07:20:53.868335+0000","last_became_peered":"2024-04-22T07:20:53.868335+0000","last_unstale":"2024-04-22T07:20:54.979807+0000","last_undegraded":"2024-04-22T07:20:54.979807+0000","last_fullsized":"2024-04-22T07:20:54.979807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:43:02.116289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862731+0000","last_change":"2024-04-22T07:20:52.867622+0000","last_active":"2024-04-22T07:20:54.862731+0000","last_peered":"2024-04-22T07:20:54.862731+0000","last_clean":"2024-04-22T07:20:54.862731+0000","last_became_active":"2024-04-22T07:20:52.866996+0000","last_became_peered":"2024-04-22T07:20:52.866996+0000","last_unstale":"2024-04-22T07:20:54.862731+0000","last_undegraded":"2024-04-22T07:20:54.862731+0000","last_fullsized":"2024-04-22T07:20:54.862731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:08.286530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978392+0000","last_change":"2024-04-22T07:20:53.871576+0000","last_active":"2024-04-22T07:20:54.978392+0000","last_peered":"2024-04-22T07:20:54.978392+0000","last_clean":"2024-04-22T07:20:54.978392+0000","last_became_active":"2024-04-22T07:20:53.871239+0000","last_became_peered":"2024-04-22T07:20:53.871239+0000","last_unstale":"2024-04-22T07:20:54.978392+0000","last_undegraded":"2024-04-22T07:20:54.978392+0000","last_fullsized":"2024-04-22T07:20:54.978392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979845+0000","last_change":"2024-04-22T07:20:52.866974+0000","last_active":"2024-04-22T07:20:54.979845+0000","last_peered":"2024-04-22T07:20:54.979845+0000","last_clean":"2024-04-22T07:20:54.979845+0000","last_became_active":"2024-04-22T07:20:52.866581+0000","last_became_peered":"2024-04-22T07:20:52.866581+0000","last_unstale":"2024-04-22T07:20:54.979845+0000","last_undegraded":"2024-04-22T07:20:54.979845+0000","last_fullsized":"2024-04-22T07:20:54.979845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979503+0000","last_change":"2024-04-22T07:20:53.865035+0000","last_active":"2024-04-22T07:20:54.979503+0000","last_peered":"2024-04-22T07:20:54.979503+0000","last_clean":"2024-04-22T07:20:54.979503+0000","last_became_active":"2024-04-22T07:20:53.864523+0000","last_became_peered":"2024-04-22T07:20:53.864523+0000","last_unstale":"2024-04-22T07:20:54.979503+0000","last_undegraded":"2024-04-22T07:20:54.979503+0000","last_fullsized":"2024-04-22T07:20:54.979503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:13:12.303505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863169+0000","last_change":"2024-04-22T07:20:52.858498+0000","last_active":"2024-04-22T07:20:54.863169+0000","last_peered":"2024-04-22T07:20:54.863169+0000","last_clean":"2024-04-22T07:20:54.863169+0000","last_became_active":"2024-04-22T07:20:52.858139+0000","last_became_peered":"2024-04-22T07:20:52.858139+0000","last_unstale":"2024-04-22T07:20:54.863169+0000","last_undegraded":"2024-04-22T07:20:54.863169+0000","last_fullsized":"2024-04-22T07:20:54.863169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:45.382709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977943+0000","last_change":"2024-04-22T07:20:53.877595+0000","last_active":"2024-04-22T07:20:54.977943+0000","last_peered":"2024-04-22T07:20:54.977943+0000","last_clean":"2024-04-22T07:20:54.977943+0000","last_became_active":"2024-04-22T07:20:53.877208+0000","last_became_peered":"2024-04-22T07:20:53.877208+0000","last_unstale":"2024-04-22T07:20:54.977943+0000","last_undegraded":"2024-04-22T07:20:54.977943+0000","last_fullsized":"2024-04-22T07:20:54.977943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:46:50.322722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979001+0000","last_change":"2024-04-22T07:20:52.866224+0000","last_active":"2024-04-22T07:20:54.979001+0000","last_peered":"2024-04-22T07:20:54.979001+0000","last_clean":"2024-04-22T07:20:54.979001+0000","last_became_active":"2024-04-22T07:20:52.865903+0000","last_became_peered":"2024-04-22T07:20:52.865903+0000","last_unstale":"2024-04-22T07:20:54.979001+0000","last_undegraded":"2024-04-22T07:20:54.979001+0000","last_fullsized":"2024-04-22T07:20:54.979001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861395+0000","last_change":"2024-04-22T07:20:53.873266+0000","last_active":"2024-04-22T07:20:54.861395+0000","last_peered":"2024-04-22T07:20:54.861395+0000","last_clean":"2024-04-22T07:20:54.861395+0000","last_became_active":"2024-04-22T07:20:53.872915+0000","last_became_peered":"2024-04-22T07:20:53.872915+0000","last_unstale":"2024-04-22T07:20:54.861395+0000","last_undegraded":"2024-04-22T07:20:54.861395+0000","last_fullsized":"2024-04-22T07:20:54.861395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:09.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863471+0000","last_change":"2024-04-22T07:20:52.863593+0000","last_active":"2024-04-22T07:20:54.863471+0000","last_peered":"2024-04-22T07:20:54.863471+0000","last_clean":"2024-04-22T07:20:54.863471+0000","last_became_active":"2024-04-22T07:20:52.863296+0000","last_became_peered":"2024-04-22T07:20:52.863296+0000","last_unstale":"2024-04-22T07:20:54.863471+0000","last_undegraded":"2024-04-22T07:20:54.863471+0000","last_fullsized":"2024-04-22T07:20:54.863471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:22.261683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979540+0000","last_change":"2024-04-22T07:20:53.874491+0000","last_active":"2024-04-22T07:20:54.979540+0000","last_peered":"2024-04-22T07:20:54.979540+0000","last_clean":"2024-04-22T07:20:54.979540+0000","last_became_active":"2024-04-22T07:20:53.874202+0000","last_became_peered":"2024-04-22T07:20:53.874202+0000","last_unstale":"2024-04-22T07:20:54.979540+0000","last_undegraded":"2024-04-22T07:20:54.979540+0000","last_fullsized":"2024-04-22T07:20:54.979540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:23.268067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980655+0000","last_change":"2024-04-22T07:20:52.865905+0000","last_active":"2024-04-22T07:20:54.980655+0000","last_peered":"2024-04-22T07:20:54.980655+0000","last_clean":"2024-04-22T07:20:54.980655+0000","last_became_active":"2024-04-22T07:20:52.865566+0000","last_became_peered":"2024-04-22T07:20:52.865566+0000","last_unstale":"2024-04-22T07:20:54.980655+0000","last_undegraded":"2024-04-22T07:20:54.980655+0000","last_fullsized":"2024-04-22T07:20:54.980655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:38:31.271879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980566+0000","last_change":"2024-04-22T07:20:53.869951+0000","last_active":"2024-04-22T07:20:54.980566+0000","last_peered":"2024-04-22T07:20:54.980566+0000","last_clean":"2024-04-22T07:20:54.980566+0000","last_became_active":"2024-04-22T07:20:53.869613+0000","last_became_peered":"2024-04-22T07:20:53.869613+0000","last_unstale":"2024-04-22T07:20:54.980566+0000","last_undegraded":"2024-04-22T07:20:54.980566+0000","last_fullsized":"2024-04-22T07:20:54.980566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:14:09.372107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.867345+0000","last_change":"2024-04-22T07:20:52.864740+0000","last_active":"2024-04-22T07:20:58.867345+0000","last_peered":"2024-04-22T07:20:58.867345+0000","last_clean":"2024-04-22T07:20:58.867345+0000","last_became_active":"2024-04-22T07:20:52.864434+0000","last_became_peered":"2024-04-22T07:20:52.864434+0000","last_unstale":"2024-04-22T07:20:58.867345+0000","last_undegraded":"2024-04-22T07:20:58.867345+0000","last_fullsized":"2024-04-22T07:20:58.867345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:33.937176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980498+0000","last_change":"2024-04-22T07:20:53.871156+0000","last_active":"2024-04-22T07:20:54.980498+0000","last_peered":"2024-04-22T07:20:54.980498+0000","last_clean":"2024-04-22T07:20:54.980498+0000","last_became_active":"2024-04-22T07:20:53.870664+0000","last_became_peered":"2024-04-22T07:20:53.870664+0000","last_unstale":"2024-04-22T07:20:54.980498+0000","last_undegraded":"2024-04-22T07:20:54.980498+0000","last_fullsized":"2024-04-22T07:20:54.980498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:01:02.139458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977319+0000","last_change":"2024-04-22T07:20:52.854668+0000","last_active":"2024-04-22T07:20:54.977319+0000","last_peered":"2024-04-22T07:20:54.977319+0000","last_clean":"2024-04-22T07:20:54.977319+0000","last_became_active":"2024-04-22T07:20:52.854395+0000","last_became_peered":"2024-04-22T07:20:52.854395+0000","last_unstale":"2024-04-22T07:20:54.977319+0000","last_undegraded":"2024-04-22T07:20:54.977319+0000","last_fullsized":"2024-04-22T07:20:54.977319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:59:32.487127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862797+0000","last_change":"2024-04-22T07:20:53.870972+0000","last_active":"2024-04-22T07:20:54.862797+0000","last_peered":"2024-04-22T07:20:54.862797+0000","last_clean":"2024-04-22T07:20:54.862797+0000","last_became_active":"2024-04-22T07:20:53.870674+0000","last_became_peered":"2024-04-22T07:20:53.870674+0000","last_unstale":"2024-04-22T07:20:54.862797+0000","last_undegraded":"2024-04-22T07:20:54.862797+0000","last_fullsized":"2024-04-22T07:20:54.862797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:10.431906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980374+0000","last_change":"2024-04-22T07:20:52.866003+0000","last_active":"2024-04-22T07:20:54.980374+0000","last_peered":"2024-04-22T07:20:54.980374+0000","last_clean":"2024-04-22T07:20:54.980374+0000","last_became_active":"2024-04-22T07:20:52.865606+0000","last_became_peered":"2024-04-22T07:20:52.865606+0000","last_unstale":"2024-04-22T07:20:54.980374+0000","last_undegraded":"2024-04-22T07:20:54.980374+0000","last_fullsized":"2024-04-22T07:20:54.980374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:58:06.713204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978351+0000","last_change":"2024-04-22T07:20:53.870737+0000","last_active":"2024-04-22T07:20:54.978351+0000","last_peered":"2024-04-22T07:20:54.978351+0000","last_clean":"2024-04-22T07:20:54.978351+0000","last_became_active":"2024-04-22T07:20:53.870402+0000","last_became_peered":"2024-04-22T07:20:53.870402+0000","last_unstale":"2024-04-22T07:20:54.978351+0000","last_undegraded":"2024-04-22T07:20:54.978351+0000","last_fullsized":"2024-04-22T07:20:54.978351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:30:17.845591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979784+0000","last_change":"2024-04-22T07:20:52.861048+0000","last_active":"2024-04-22T07:20:54.979784+0000","last_peered":"2024-04-22T07:20:54.979784+0000","last_clean":"2024-04-22T07:20:54.979784+0000","last_became_active":"2024-04-22T07:20:52.860702+0000","last_became_peered":"2024-04-22T07:20:52.860702+0000","last_unstale":"2024-04-22T07:20:54.979784+0000","last_undegraded":"2024-04-22T07:20:54.979784+0000","last_fullsized":"2024-04-22T07:20:54.979784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979324+0000","last_change":"2024-04-22T07:20:53.868782+0000","last_active":"2024-04-22T07:20:54.979324+0000","last_peered":"2024-04-22T07:20:54.979324+0000","last_clean":"2024-04-22T07:20:54.979324+0000","last_became_active":"2024-04-22T07:20:53.868509+0000","last_became_peered":"2024-04-22T07:20:53.868509+0000","last_unstale":"2024-04-22T07:20:54.979324+0000","last_undegraded":"2024-04-22T07:20:54.979324+0000","last_fullsized":"2024-04-22T07:20:54.979324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:07.129692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.867515+0000","last_change":"2024-04-22T07:20:52.858508+0000","last_active":"2024-04-22T07:20:58.867515+0000","last_peered":"2024-04-22T07:20:58.867515+0000","last_clean":"2024-04-22T07:20:58.867515+0000","last_became_active":"2024-04-22T07:20:52.858215+0000","last_became_peered":"2024-04-22T07:20:52.858215+0000","last_unstale":"2024-04-22T07:20:58.867515+0000","last_undegraded":"2024-04-22T07:20:58.867515+0000","last_fullsized":"2024-04-22T07:20:58.867515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:26.618434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862971+0000","last_change":"2024-04-22T07:20:53.867977+0000","last_active":"2024-04-22T07:20:54.862971+0000","last_peered":"2024-04-22T07:20:54.862971+0000","last_clean":"2024-04-22T07:20:54.862971+0000","last_became_active":"2024-04-22T07:20:53.867447+0000","last_became_peered":"2024-04-22T07:20:53.867447+0000","last_unstale":"2024-04-22T07:20:54.862971+0000","last_undegraded":"2024-04-22T07:20:54.862971+0000","last_fullsized":"2024-04-22T07:20:54.862971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:48:52.934171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863377+0000","last_change":"2024-04-22T07:20:53.875681+0000","last_active":"2024-04-22T07:20:54.863377+0000","last_peered":"2024-04-22T07:20:54.863377+0000","last_clean":"2024-04-22T07:20:54.863377+0000","last_became_active":"2024-04-22T07:20:53.875305+0000","last_became_peered":"2024-04-22T07:20:53.875305+0000","last_unstale":"2024-04-22T07:20:54.863377+0000","last_undegraded":"2024-04-22T07:20:54.863377+0000","last_fullsized":"2024-04-22T07:20:54.863377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:22:34.452869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.866736+0000","last_change":"2024-04-22T07:20:52.857445+0000","last_active":"2024-04-22T07:20:58.866736+0000","last_peered":"2024-04-22T07:20:58.866736+0000","last_clean":"2024-04-22T07:20:58.866736+0000","last_became_active":"2024-04-22T07:20:52.856293+0000","last_became_peered":"2024-04-22T07:20:52.856293+0000","last_unstale":"2024-04-22T07:20:58.866736+0000","last_undegraded":"2024-04-22T07:20:58.866736+0000","last_fullsized":"2024-04-22T07:20:58.866736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:10.640191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862780+0000","last_change":"2024-04-22T07:20:53.870827+0000","last_active":"2024-04-22T07:20:54.862780+0000","last_peered":"2024-04-22T07:20:54.862780+0000","last_clean":"2024-04-22T07:20:54.862780+0000","last_became_active":"2024-04-22T07:20:53.870548+0000","last_became_peered":"2024-04-22T07:20:53.870548+0000","last_unstale":"2024-04-22T07:20:54.862780+0000","last_undegraded":"2024-04-22T07:20:54.862780+0000","last_fullsized":"2024-04-22T07:20:54.862780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:27.624819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.867037+0000","last_change":"2024-04-22T07:20:52.856933+0000","last_active":"2024-04-22T07:20:58.867037+0000","last_peered":"2024-04-22T07:20:58.867037+0000","last_clean":"2024-04-22T07:20:58.867037+0000","last_became_active":"2024-04-22T07:20:52.856617+0000","last_became_peered":"2024-04-22T07:20:52.856617+0000","last_unstale":"2024-04-22T07:20:58.867037+0000","last_undegraded":"2024-04-22T07:20:58.867037+0000","last_fullsized":"2024-04-22T07:20:58.867037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:08.286530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979619+0000","last_change":"2024-04-22T07:20:53.866552+0000","last_active":"2024-04-22T07:20:54.979619+0000","last_peered":"2024-04-22T07:20:54.979619+0000","last_clean":"2024-04-22T07:20:54.979619+0000","last_became_active":"2024-04-22T07:20:53.866286+0000","last_became_peered":"2024-04-22T07:20:53.866286+0000","last_unstale":"2024-04-22T07:20:54.979619+0000","last_undegraded":"2024-04-22T07:20:54.979619+0000","last_fullsized":"2024-04-22T07:20:54.979619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:45:15.519469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.787690+0000","last_change":"2024-04-22T07:20:52.863291+0000","last_active":"2024-04-22T07:20:55.787690+0000","last_peered":"2024-04-22T07:20:55.787690+0000","last_clean":"2024-04-22T07:20:55.787690+0000","last_became_active":"2024-04-22T07:20:52.862967+0000","last_became_peered":"2024-04-22T07:20:52.862967+0000","last_unstale":"2024-04-22T07:20:55.787690+0000","last_undegraded":"2024-04-22T07:20:55.787690+0000","last_fullsized":"2024-04-22T07:20:55.787690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:10.640191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980150+0000","last_change":"2024-04-22T07:20:53.871045+0000","last_active":"2024-04-22T07:20:54.980150+0000","last_peered":"2024-04-22T07:20:54.980150+0000","last_clean":"2024-04-22T07:20:54.980150+0000","last_became_active":"2024-04-22T07:20:53.870715+0000","last_became_peered":"2024-04-22T07:20:53.870715+0000","last_unstale":"2024-04-22T07:20:54.980150+0000","last_undegraded":"2024-04-22T07:20:54.980150+0000","last_fullsized":"2024-04-22T07:20:54.980150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.870910+0000","last_change":"2024-04-22T07:20:52.869553+0000","last_active":"2024-04-22T07:20:58.870910+0000","last_peered":"2024-04-22T07:20:58.870910+0000","last_clean":"2024-04-22T07:20:58.870910+0000","last_became_active":"2024-04-22T07:20:52.869300+0000","last_became_peered":"2024-04-22T07:20:52.869300+0000","last_unstale":"2024-04-22T07:20:58.870910+0000","last_undegraded":"2024-04-22T07:20:58.870910+0000","last_fullsized":"2024-04-22T07:20:58.870910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:27.709073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":81359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":835584,"data_stored":671695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":831488,"data_stored":671673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":81291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":253952,"data_stored":83519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T07:21:07.759 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T07:21:07.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.900+0000 7f59dc681640 1 Processor -- start 2024-04-22T07:21:07.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.900+0000 7f59dc681640 1 -- start start 2024-04-22T07:21:07.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.901+0000 7f59dc681640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f59d40cc650 0x7f59d40cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:07.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.901+0000 7f59dc681640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59d40ccfd0 0x7f59d40cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:07.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.901+0000 7f59dc681640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59d40c5960 con 0x7f59d4154ed0 2024-04-22T07:21:07.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.901+0000 7f59dc681640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f59d415e260 con 0x7f59d40cc650 2024-04-22T07:21:07.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.901+0000 7f59dc681640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f59d415b7b0 con 0x7f59d40ccfd0 2024-04-22T07:21:07.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.901+0000 7f59d9c1c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f59d40cc650 0x7f59d40cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:07.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.901+0000 7f59d9c1c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f59d40cc650 0x7f59d40cb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42564/0 (socket says 172.21.15.40:42564) 2024-04-22T07:21:07.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.901+0000 7f59d9c1c640 1 -- 172.21.15.40:0/2241125602 learned_addr learned my addr 172.21.15.40:0/2241125602 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:07.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.901+0000 7f59dac1e640 1 --2- 172.21.15.40:0/2241125602 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59d40ccfd0 0x7f59d40cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:07.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.902+0000 7f59d9c1c640 1 -- 172.21.15.40:0/2241125602 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59d40ccfd0 msgr2=0x7f59d40cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:07.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.902+0000 7f59d9c1c640 1 --2- 172.21.15.40:0/2241125602 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59d40ccfd0 0x7f59d40cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.902+0000 7f59d9c1c640 1 -- 172.21.15.40:0/2241125602 >> v1:172.21.15.62:6789/0 conn(0x7f59d4154ed0 legacy=0x7f59d415e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:07.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.902+0000 7f59d9c1c640 1 -- 172.21.15.40:0/2241125602 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d40cc0f0 con 0x7f59d40cc650 2024-04-22T07:21:07.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.902+0000 7f59dac1e640 1 --2- 172.21.15.40:0/2241125602 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59d40ccfd0 0x7f59d40cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:07.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.902+0000 7f59d9c1c640 1 --2- 172.21.15.40:0/2241125602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59d40cc650 0x7f59d40cb490 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f59c4009870 tx=0x7f59c402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1998950e7a9ee5f server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:07.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.902+0000 7f59d941b640 1 -- 172.21.15.40:0/2241125602 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c4034070 con 0x7f59d40cc650 2024-04-22T07:21:07.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.903+0000 7f59d941b640 1 -- 172.21.15.40:0/2241125602 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59c4030840 con 0x7f59d40cc650 2024-04-22T07:21:07.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.903+0000 7f59d941b640 1 -- 172.21.15.40:0/2241125602 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c4030c10 con 0x7f59d40cc650 2024-04-22T07:21:07.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.903+0000 7f59dc681640 1 -- 172.21.15.40:0/2241125602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59d40cc650 msgr2=0x7f59d40cb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:07.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.903+0000 7f59dc681640 1 --2- 172.21.15.40:0/2241125602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59d40cc650 0x7f59d40cb490 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f59c4009870 tx=0x7f59c402b980 comp rx=0 tx=0).stop 2024-04-22T07:21:07.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.903+0000 7f59dc681640 1 -- 172.21.15.40:0/2241125602 shutdown_connections 2024-04-22T07:21:07.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.903+0000 7f59dc681640 1 --2- 172.21.15.40:0/2241125602 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59d40ccfd0 0x7f59d40cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.903+0000 7f59dc681640 1 --2- 172.21.15.40:0/2241125602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59d40cc650 0x7f59d40cb490 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.903+0000 7f59dc681640 1 -- 172.21.15.40:0/2241125602 >> 172.21.15.40:0/2241125602 conn(0x7f59d4073d10 msgr2=0x7f59d406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:07.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.903+0000 7f59dc681640 1 -- 172.21.15.40:0/2241125602 shutdown_connections 2024-04-22T07:21:07.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.903+0000 7f59dc681640 1 -- 172.21.15.40:0/2241125602 wait complete. 2024-04-22T07:21:07.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.904+0000 7f59dc681640 1 Processor -- start 2024-04-22T07:21:07.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.904+0000 7f59dc681640 1 -- start start 2024-04-22T07:21:07.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.905+0000 7f59dc681640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59d40cc650 0x7f59d41f3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:07.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.905+0000 7f59dc681640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59d40ccfd0 0x7f59d41f10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:07.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.905+0000 7f59dc681640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59d4154ed0 0x7f59d415d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:07.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.905+0000 7f59dc681640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f59d40cc3b0 con 0x7f59d40cc650 2024-04-22T07:21:07.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.905+0000 7f59dc681640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f59d415e4b0 con 0x7f59d40ccfd0 2024-04-22T07:21:07.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.905+0000 7f59dc681640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f59d40cbb20 con 0x7f59d4154ed0 2024-04-22T07:21:07.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.905+0000 7f59da41d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59d40cc650 0x7f59d41f3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:07.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.905+0000 7f59da41d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59d40cc650 0x7f59d41f3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42578/0 (socket says 172.21.15.40:42578) 2024-04-22T07:21:07.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.905+0000 7f59da41d640 1 -- 172.21.15.40:0/2292518605 learned_addr learned my addr 172.21.15.40:0/2292518605 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:07.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.905+0000 7f59da41d640 1 -- 172.21.15.40:0/2292518605 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59d4154ed0 msgr2=0x7f59d415d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:07.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.905+0000 7f59da41d640 1 --2- 172.21.15.40:0/2292518605 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59d4154ed0 0x7f59d415d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.905+0000 7f59da41d640 1 -- 172.21.15.40:0/2292518605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59d40ccfd0 msgr2=0x7f59d41f10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:07.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.905+0000 7f59da41d640 1 --2- 172.21.15.40:0/2292518605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59d40ccfd0 0x7f59d41f10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:07.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.905+0000 7f59da41d640 1 -- 172.21.15.40:0/2292518605 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d40cf800 con 0x7f59d40cc650 2024-04-22T07:21:07.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.905+0000 7f59da41d640 1 --2- 172.21.15.40:0/2292518605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59d40cc650 0x7f59d41f3c90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f59cc00c3c0 tx=0x7f59cc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:07.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.906+0000 7f59caffd640 1 -- 172.21.15.40:0/2292518605 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59cc0052d0 con 0x7f59d40cc650 2024-04-22T07:21:07.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.906+0000 7f59caffd640 1 -- 172.21.15.40:0/2292518605 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59cc005490 con 0x7f59d40cc650 2024-04-22T07:21:07.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.906+0000 7f59dc681640 1 -- 172.21.15.40:0/2292518605 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59d41f4b70 con 0x7f59d40cc650 2024-04-22T07:21:07.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.906+0000 7f59caffd640 1 -- 172.21.15.40:0/2292518605 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59cc007260 con 0x7f59d40cc650 2024-04-22T07:21:07.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.906+0000 7f59dc681640 1 -- 172.21.15.40:0/2292518605 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59d41f45b0 con 0x7f59d40cc650 2024-04-22T07:21:07.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.906+0000 7f59dc681640 1 -- 172.21.15.40:0/2292518605 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59d4069d40 con 0x7f59d40cc650 2024-04-22T07:21:07.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.907+0000 7f59caffd640 1 -- 172.21.15.40:0/2292518605 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f59cc007400 con 0x7f59d40cc650 2024-04-22T07:21:07.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.907+0000 7f59caffd640 1 --2- 172.21.15.40:0/2292518605 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f59b806c8f0 0x7f59b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:07.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.907+0000 7f59caffd640 1 -- 172.21.15.40:0/2292518605 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f59cc08b0e0 con 0x7f59d40cc650 2024-04-22T07:21:07.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.908+0000 7f59d9c1c640 1 --2- 172.21.15.40:0/2292518605 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f59b806c8f0 0x7f59b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:07.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.908+0000 7f59d9c1c640 1 --2- 172.21.15.40:0/2292518605 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f59b806c8f0 0x7f59b806edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f59c4036000 tx=0x7f59c403b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:07.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:07.912+0000 7f59caffd640 1 -- 172.21.15.40:0/2292518605 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f59d40cf800 con 0x7f59d40cc650 2024-04-22T07:21:08.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.094+0000 7f59dc681640 1 -- 172.21.15.40:0/2292518605 --> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f59d40cbe30 con 0x7f59b806c8f0 2024-04-22T07:21:08.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.100+0000 7f59caffd640 1 -- 172.21.15.40:0/2292518605 <== mgr.4107 v2:172.21.15.40:6832/91163869 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251833 (secure 0 0 0) 0x7f59d40cbe30 con 0x7f59b806c8f0 2024-04-22T07:21:08.100 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:21:08.101 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-22T07:21:08.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.103+0000 7f59dc681640 1 -- 172.21.15.40:0/2292518605 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f59b806c8f0 msgr2=0x7f59b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:08.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.103+0000 7f59dc681640 1 --2- 172.21.15.40:0/2292518605 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f59b806c8f0 0x7f59b806edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f59c4036000 tx=0x7f59c403b040 comp rx=0 tx=0).stop 2024-04-22T07:21:08.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.103+0000 7f59dc681640 1 -- 172.21.15.40:0/2292518605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59d40cc650 msgr2=0x7f59d41f3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:08.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.103+0000 7f59dc681640 1 --2- 172.21.15.40:0/2292518605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59d40cc650 0x7f59d41f3c90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f59cc00c3c0 tx=0x7f59cc00c880 comp rx=0 tx=0).stop 2024-04-22T07:21:08.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.103+0000 7f59dc681640 1 -- 172.21.15.40:0/2292518605 shutdown_connections 2024-04-22T07:21:08.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.103+0000 7f59dc681640 1 --2- 172.21.15.40:0/2292518605 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f59d4154ed0 0x7f59d415d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.103+0000 7f59dc681640 1 --2- 172.21.15.40:0/2292518605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f59d40ccfd0 0x7f59d41f10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.103+0000 7f59dc681640 1 --2- 172.21.15.40:0/2292518605 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f59b806c8f0 0x7f59b806edb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.103+0000 7f59dc681640 1 --2- 172.21.15.40:0/2292518605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59d40cc650 0x7f59d41f3c90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.103+0000 7f59dc681640 1 -- 172.21.15.40:0/2292518605 >> 172.21.15.40:0/2292518605 conn(0x7f59d4073d10 msgr2=0x7f59d4152600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:08.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.103+0000 7f59dc681640 1 -- 172.21.15.40:0/2292518605 shutdown_connections 2024-04-22T07:21:08.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.103+0000 7f59dc681640 1 -- 172.21.15.40:0/2292518605 wait complete. 2024-04-22T07:21:08.111 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-04-22T07:21:07.779779+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219180,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755540,"statfs":{"total":773094113280,"available":772869672960,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002559"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977886+0000","last_change":"2024-04-22T07:20:53.873662+0000","last_active":"2024-04-22T07:20:54.977886+0000","last_peered":"2024-04-22T07:20:54.977886+0000","last_clean":"2024-04-22T07:20:54.977886+0000","last_became_active":"2024-04-22T07:20:53.873384+0000","last_became_peered":"2024-04-22T07:20:53.873384+0000","last_unstale":"2024-04-22T07:20:54.977886+0000","last_undegraded":"2024-04-22T07:20:54.977886+0000","last_fullsized":"2024-04-22T07:20:54.977886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980006+0000","last_change":"2024-04-22T07:20:53.870454+0000","last_active":"2024-04-22T07:20:54.980006+0000","last_peered":"2024-04-22T07:20:54.980006+0000","last_clean":"2024-04-22T07:20:54.980006+0000","last_became_active":"2024-04-22T07:20:53.869964+0000","last_became_peered":"2024-04-22T07:20:53.869964+0000","last_unstale":"2024-04-22T07:20:54.980006+0000","last_undegraded":"2024-04-22T07:20:54.980006+0000","last_fullsized":"2024-04-22T07:20:54.980006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979125+0000","last_change":"2024-04-22T07:20:53.871145+0000","last_active":"2024-04-22T07:20:54.979125+0000","last_peered":"2024-04-22T07:20:54.979125+0000","last_clean":"2024-04-22T07:20:54.979125+0000","last_became_active":"2024-04-22T07:20:53.870819+0000","last_became_peered":"2024-04-22T07:20:53.870819+0000","last_unstale":"2024-04-22T07:20:54.979125+0000","last_undegraded":"2024-04-22T07:20:54.979125+0000","last_fullsized":"2024-04-22T07:20:54.979125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:02:16.373202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861622+0000","last_change":"2024-04-22T07:20:53.870458+0000","last_active":"2024-04-22T07:20:54.861622+0000","last_peered":"2024-04-22T07:20:54.861622+0000","last_clean":"2024-04-22T07:20:54.861622+0000","last_became_active":"2024-04-22T07:20:53.870125+0000","last_became_peered":"2024-04-22T07:20:53.870125+0000","last_unstale":"2024-04-22T07:20:54.861622+0000","last_undegraded":"2024-04-22T07:20:54.861622+0000","last_fullsized":"2024-04-22T07:20:54.861622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977801+0000","last_change":"2024-04-22T07:20:53.877301+0000","last_active":"2024-04-22T07:20:54.977801+0000","last_peered":"2024-04-22T07:20:54.977801+0000","last_clean":"2024-04-22T07:20:54.977801+0000","last_became_active":"2024-04-22T07:20:53.874941+0000","last_became_peered":"2024-04-22T07:20:53.874941+0000","last_unstale":"2024-04-22T07:20:54.977801+0000","last_undegraded":"2024-04-22T07:20:54.977801+0000","last_fullsized":"2024-04-22T07:20:54.977801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:52.686229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861484+0000","last_change":"2024-04-22T07:20:53.869735+0000","last_active":"2024-04-22T07:20:54.861484+0000","last_peered":"2024-04-22T07:20:54.861484+0000","last_clean":"2024-04-22T07:20:54.861484+0000","last_became_active":"2024-04-22T07:20:53.869369+0000","last_became_peered":"2024-04-22T07:20:53.869369+0000","last_unstale":"2024-04-22T07:20:54.861484+0000","last_undegraded":"2024-04-22T07:20:54.861484+0000","last_fullsized":"2024-04-22T07:20:54.861484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:27.624819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977494+0000","last_change":"2024-04-22T07:20:53.873492+0000","last_active":"2024-04-22T07:20:54.977494+0000","last_peered":"2024-04-22T07:20:54.977494+0000","last_clean":"2024-04-22T07:20:54.977494+0000","last_became_active":"2024-04-22T07:20:53.873220+0000","last_became_peered":"2024-04-22T07:20:53.873220+0000","last_unstale":"2024-04-22T07:20:54.977494+0000","last_undegraded":"2024-04-22T07:20:54.977494+0000","last_fullsized":"2024-04-22T07:20:54.977494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:35:26.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979018+0000","last_change":"2024-04-22T07:20:53.875847+0000","last_active":"2024-04-22T07:20:54.979018+0000","last_peered":"2024-04-22T07:20:54.979018+0000","last_clean":"2024-04-22T07:20:54.979018+0000","last_became_active":"2024-04-22T07:20:53.875017+0000","last_became_peered":"2024-04-22T07:20:53.875017+0000","last_unstale":"2024-04-22T07:20:54.979018+0000","last_undegraded":"2024-04-22T07:20:54.979018+0000","last_fullsized":"2024-04-22T07:20:54.979018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:07.080135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863086+0000","last_change":"2024-04-22T07:20:53.869174+0000","last_active":"2024-04-22T07:20:54.863086+0000","last_peered":"2024-04-22T07:20:54.863086+0000","last_clean":"2024-04-22T07:20:54.863086+0000","last_became_active":"2024-04-22T07:20:53.868906+0000","last_became_peered":"2024-04-22T07:20:53.868906+0000","last_unstale":"2024-04-22T07:20:54.863086+0000","last_undegraded":"2024-04-22T07:20:54.863086+0000","last_fullsized":"2024-04-22T07:20:54.863086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977893+0000","last_change":"2024-04-22T07:20:53.874933+0000","last_active":"2024-04-22T07:20:54.977893+0000","last_peered":"2024-04-22T07:20:54.977893+0000","last_clean":"2024-04-22T07:20:54.977893+0000","last_became_active":"2024-04-22T07:20:53.874673+0000","last_became_peered":"2024-04-22T07:20:53.874673+0000","last_unstale":"2024-04-22T07:20:54.977893+0000","last_undegraded":"2024-04-22T07:20:54.977893+0000","last_fullsized":"2024-04-22T07:20:54.977893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977684+0000","last_change":"2024-04-22T07:20:53.874909+0000","last_active":"2024-04-22T07:20:54.977684+0000","last_peered":"2024-04-22T07:20:54.977684+0000","last_clean":"2024-04-22T07:20:54.977684+0000","last_became_active":"2024-04-22T07:20:53.873945+0000","last_became_peered":"2024-04-22T07:20:53.873945+0000","last_unstale":"2024-04-22T07:20:54.977684+0000","last_undegraded":"2024-04-22T07:20:54.977684+0000","last_fullsized":"2024-04-22T07:20:54.977684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:53.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977652+0000","last_change":"2024-04-22T07:20:53.878344+0000","last_active":"2024-04-22T07:20:54.977652+0000","last_peered":"2024-04-22T07:20:54.977652+0000","last_clean":"2024-04-22T07:20:54.977652+0000","last_became_active":"2024-04-22T07:20:53.877192+0000","last_became_peered":"2024-04-22T07:20:53.877192+0000","last_unstale":"2024-04-22T07:20:54.977652+0000","last_undegraded":"2024-04-22T07:20:54.977652+0000","last_fullsized":"2024-04-22T07:20:54.977652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:42:03.637655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979583+0000","last_change":"2024-04-22T07:20:53.879419+0000","last_active":"2024-04-22T07:20:54.979583+0000","last_peered":"2024-04-22T07:20:54.979583+0000","last_clean":"2024-04-22T07:20:54.979583+0000","last_became_active":"2024-04-22T07:20:53.879070+0000","last_became_peered":"2024-04-22T07:20:53.879070+0000","last_unstale":"2024-04-22T07:20:54.979583+0000","last_undegraded":"2024-04-22T07:20:54.979583+0000","last_fullsized":"2024-04-22T07:20:54.979583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979592+0000","last_change":"2024-04-22T07:20:53.877395+0000","last_active":"2024-04-22T07:20:54.979592+0000","last_peered":"2024-04-22T07:20:54.979592+0000","last_clean":"2024-04-22T07:20:54.979592+0000","last_became_active":"2024-04-22T07:20:53.877116+0000","last_became_peered":"2024-04-22T07:20:53.877116+0000","last_unstale":"2024-04-22T07:20:54.979592+0000","last_undegraded":"2024-04-22T07:20:54.979592+0000","last_fullsized":"2024-04-22T07:20:54.979592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:21:25.001413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979310+0000","last_change":"2024-04-22T07:20:53.875156+0000","last_active":"2024-04-22T07:20:54.979310+0000","last_peered":"2024-04-22T07:20:54.979310+0000","last_clean":"2024-04-22T07:20:54.979310+0000","last_became_active":"2024-04-22T07:20:53.874468+0000","last_became_peered":"2024-04-22T07:20:53.874468+0000","last_unstale":"2024-04-22T07:20:54.979310+0000","last_undegraded":"2024-04-22T07:20:54.979310+0000","last_fullsized":"2024-04-22T07:20:54.979310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:42:03.637655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862585+0000","last_change":"2024-04-22T07:20:53.867178+0000","last_active":"2024-04-22T07:20:54.862585+0000","last_peered":"2024-04-22T07:20:54.862585+0000","last_clean":"2024-04-22T07:20:54.862585+0000","last_became_active":"2024-04-22T07:20:53.865491+0000","last_became_peered":"2024-04-22T07:20:53.865491+0000","last_unstale":"2024-04-22T07:20:54.862585+0000","last_undegraded":"2024-04-22T07:20:54.862585+0000","last_fullsized":"2024-04-22T07:20:54.862585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863583+0000","last_change":"2024-04-22T07:20:53.876797+0000","last_active":"2024-04-22T07:20:54.863583+0000","last_peered":"2024-04-22T07:20:54.863583+0000","last_clean":"2024-04-22T07:20:54.863583+0000","last_became_active":"2024-04-22T07:20:53.876321+0000","last_became_peered":"2024-04-22T07:20:53.876321+0000","last_unstale":"2024-04-22T07:20:54.863583+0000","last_undegraded":"2024-04-22T07:20:54.863583+0000","last_fullsized":"2024-04-22T07:20:54.863583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:22:45.699676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980360+0000","last_change":"2024-04-22T07:20:53.868760+0000","last_active":"2024-04-22T07:20:54.980360+0000","last_peered":"2024-04-22T07:20:54.980360+0000","last_clean":"2024-04-22T07:20:54.980360+0000","last_became_active":"2024-04-22T07:20:53.868441+0000","last_became_peered":"2024-04-22T07:20:53.868441+0000","last_unstale":"2024-04-22T07:20:54.980360+0000","last_undegraded":"2024-04-22T07:20:54.980360+0000","last_fullsized":"2024-04-22T07:20:54.980360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863503+0000","last_change":"2024-04-22T07:20:53.864806+0000","last_active":"2024-04-22T07:20:54.863503+0000","last_peered":"2024-04-22T07:20:54.863503+0000","last_clean":"2024-04-22T07:20:54.863503+0000","last_became_active":"2024-04-22T07:20:53.864535+0000","last_became_peered":"2024-04-22T07:20:53.864535+0000","last_unstale":"2024-04-22T07:20:54.863503+0000","last_undegraded":"2024-04-22T07:20:54.863503+0000","last_fullsized":"2024-04-22T07:20:54.863503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:22:07.227993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977721+0000","last_change":"2024-04-22T07:20:53.878013+0000","last_active":"2024-04-22T07:20:54.977721+0000","last_peered":"2024-04-22T07:20:54.977721+0000","last_clean":"2024-04-22T07:20:54.977721+0000","last_became_active":"2024-04-22T07:20:53.876641+0000","last_became_peered":"2024-04-22T07:20:53.876641+0000","last_unstale":"2024-04-22T07:20:54.977721+0000","last_undegraded":"2024-04-22T07:20:54.977721+0000","last_fullsized":"2024-04-22T07:20:54.977721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:45:15.519469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978885+0000","last_change":"2024-04-22T07:20:53.868319+0000","last_active":"2024-04-22T07:20:54.978885+0000","last_peered":"2024-04-22T07:20:54.978885+0000","last_clean":"2024-04-22T07:20:54.978885+0000","last_became_active":"2024-04-22T07:20:53.868014+0000","last_became_peered":"2024-04-22T07:20:53.868014+0000","last_unstale":"2024-04-22T07:20:54.978885+0000","last_undegraded":"2024-04-22T07:20:54.978885+0000","last_fullsized":"2024-04-22T07:20:54.978885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:09:27.178992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862823+0000","last_change":"2024-04-22T07:20:53.867684+0000","last_active":"2024-04-22T07:20:54.862823+0000","last_peered":"2024-04-22T07:20:54.862823+0000","last_clean":"2024-04-22T07:20:54.862823+0000","last_became_active":"2024-04-22T07:20:53.867403+0000","last_became_peered":"2024-04-22T07:20:53.867403+0000","last_unstale":"2024-04-22T07:20:54.862823+0000","last_undegraded":"2024-04-22T07:20:54.862823+0000","last_fullsized":"2024-04-22T07:20:54.862823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979253+0000","last_change":"2024-04-22T07:20:53.869595+0000","last_active":"2024-04-22T07:20:54.979253+0000","last_peered":"2024-04-22T07:20:54.979253+0000","last_clean":"2024-04-22T07:20:54.979253+0000","last_became_active":"2024-04-22T07:20:53.868519+0000","last_became_peered":"2024-04-22T07:20:53.868519+0000","last_unstale":"2024-04-22T07:20:54.979253+0000","last_undegraded":"2024-04-22T07:20:54.979253+0000","last_fullsized":"2024-04-22T07:20:54.979253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:35:26.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862610+0000","last_change":"2024-04-22T07:20:53.865275+0000","last_active":"2024-04-22T07:20:54.862610+0000","last_peered":"2024-04-22T07:20:54.862610+0000","last_clean":"2024-04-22T07:20:54.862610+0000","last_became_active":"2024-04-22T07:20:53.865026+0000","last_became_peered":"2024-04-22T07:20:53.865026+0000","last_unstale":"2024-04-22T07:20:54.862610+0000","last_undegraded":"2024-04-22T07:20:54.862610+0000","last_fullsized":"2024-04-22T07:20:54.862610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:48:40.630407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979451+0000","last_change":"2024-04-22T07:20:53.873457+0000","last_active":"2024-04-22T07:20:54.979451+0000","last_peered":"2024-04-22T07:20:54.979451+0000","last_clean":"2024-04-22T07:20:54.979451+0000","last_became_active":"2024-04-22T07:20:53.873147+0000","last_became_peered":"2024-04-22T07:20:53.873147+0000","last_unstale":"2024-04-22T07:20:54.979451+0000","last_undegraded":"2024-04-22T07:20:54.979451+0000","last_fullsized":"2024-04-22T07:20:54.979451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:53.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861933+0000","last_change":"2024-04-22T07:20:53.865327+0000","last_active":"2024-04-22T07:20:54.861933+0000","last_peered":"2024-04-22T07:20:54.861933+0000","last_clean":"2024-04-22T07:20:54.861933+0000","last_became_active":"2024-04-22T07:20:53.865030+0000","last_became_peered":"2024-04-22T07:20:53.865030+0000","last_unstale":"2024-04-22T07:20:54.861933+0000","last_undegraded":"2024-04-22T07:20:54.861933+0000","last_fullsized":"2024-04-22T07:20:54.861933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979550+0000","last_change":"2024-04-22T07:20:53.876792+0000","last_active":"2024-04-22T07:20:54.979550+0000","last_peered":"2024-04-22T07:20:54.979550+0000","last_clean":"2024-04-22T07:20:54.979550+0000","last_became_active":"2024-04-22T07:20:53.876446+0000","last_became_peered":"2024-04-22T07:20:53.876446+0000","last_unstale":"2024-04-22T07:20:54.979550+0000","last_undegraded":"2024-04-22T07:20:54.979550+0000","last_fullsized":"2024-04-22T07:20:54.979550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:34.943561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979292+0000","last_change":"2024-04-22T07:20:53.878147+0000","last_active":"2024-04-22T07:20:54.979292+0000","last_peered":"2024-04-22T07:20:54.979292+0000","last_clean":"2024-04-22T07:20:54.979292+0000","last_became_active":"2024-04-22T07:20:53.877867+0000","last_became_peered":"2024-04-22T07:20:53.877867+0000","last_unstale":"2024-04-22T07:20:54.979292+0000","last_undegraded":"2024-04-22T07:20:54.979292+0000","last_fullsized":"2024-04-22T07:20:54.979292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979201+0000","last_change":"2024-04-22T07:20:53.872447+0000","last_active":"2024-04-22T07:20:54.979201+0000","last_peered":"2024-04-22T07:20:54.979201+0000","last_clean":"2024-04-22T07:20:54.979201+0000","last_became_active":"2024-04-22T07:20:53.871862+0000","last_became_peered":"2024-04-22T07:20:53.871862+0000","last_unstale":"2024-04-22T07:20:54.979201+0000","last_undegraded":"2024-04-22T07:20:54.979201+0000","last_fullsized":"2024-04-22T07:20:54.979201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:08:33.063318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862747+0000","last_change":"2024-04-22T07:20:53.862483+0000","last_active":"2024-04-22T07:20:54.862747+0000","last_peered":"2024-04-22T07:20:54.862747+0000","last_clean":"2024-04-22T07:20:54.862747+0000","last_became_active":"2024-04-22T07:20:53.862199+0000","last_became_peered":"2024-04-22T07:20:53.862199+0000","last_unstale":"2024-04-22T07:20:54.862747+0000","last_undegraded":"2024-04-22T07:20:54.862747+0000","last_fullsized":"2024-04-22T07:20:54.862747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:10:12.276510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979743+0000","last_change":"2024-04-22T07:20:53.872507+0000","last_active":"2024-04-22T07:20:54.979743+0000","last_peered":"2024-04-22T07:20:54.979743+0000","last_clean":"2024-04-22T07:20:54.979743+0000","last_became_active":"2024-04-22T07:20:53.872199+0000","last_became_peered":"2024-04-22T07:20:53.872199+0000","last_unstale":"2024-04-22T07:20:54.979743+0000","last_undegraded":"2024-04-22T07:20:54.979743+0000","last_fullsized":"2024-04-22T07:20:54.979743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:09.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861399+0000","last_change":"2024-04-22T07:20:53.863946+0000","last_active":"2024-04-22T07:20:54.861399+0000","last_peered":"2024-04-22T07:20:54.861399+0000","last_clean":"2024-04-22T07:20:54.861399+0000","last_became_active":"2024-04-22T07:20:53.863688+0000","last_became_peered":"2024-04-22T07:20:53.863688+0000","last_unstale":"2024-04-22T07:20:54.861399+0000","last_undegraded":"2024-04-22T07:20:54.861399+0000","last_fullsized":"2024-04-22T07:20:54.861399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862947+0000","last_change":"2024-04-22T07:20:53.874785+0000","last_active":"2024-04-22T07:20:54.862947+0000","last_peered":"2024-04-22T07:20:54.862947+0000","last_clean":"2024-04-22T07:20:54.862947+0000","last_became_active":"2024-04-22T07:20:53.874524+0000","last_became_peered":"2024-04-22T07:20:53.874524+0000","last_unstale":"2024-04-22T07:20:54.862947+0000","last_undegraded":"2024-04-22T07:20:54.862947+0000","last_fullsized":"2024-04-22T07:20:54.862947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.787613+0000","last_change":"2024-04-22T07:20:52.860712+0000","last_active":"2024-04-22T07:20:55.787613+0000","last_peered":"2024-04-22T07:20:55.787613+0000","last_clean":"2024-04-22T07:20:55.787613+0000","last_became_active":"2024-04-22T07:20:52.860015+0000","last_became_peered":"2024-04-22T07:20:52.860015+0000","last_unstale":"2024-04-22T07:20:55.787613+0000","last_undegraded":"2024-04-22T07:20:55.787613+0000","last_fullsized":"2024-04-22T07:20:55.787613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:59:32.487127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980495+0000","last_change":"2024-04-22T07:20:53.879570+0000","last_active":"2024-04-22T07:20:54.980495+0000","last_peered":"2024-04-22T07:20:54.980495+0000","last_clean":"2024-04-22T07:20:54.980495+0000","last_became_active":"2024-04-22T07:20:53.879191+0000","last_became_peered":"2024-04-22T07:20:53.879191+0000","last_unstale":"2024-04-22T07:20:54.980495+0000","last_undegraded":"2024-04-22T07:20:54.980495+0000","last_fullsized":"2024-04-22T07:20:54.980495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:34:52.306691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.787136+0000","last_change":"2024-04-22T07:20:52.862510+0000","last_active":"2024-04-22T07:20:55.787136+0000","last_peered":"2024-04-22T07:20:55.787136+0000","last_clean":"2024-04-22T07:20:55.787136+0000","last_became_active":"2024-04-22T07:20:52.862228+0000","last_became_peered":"2024-04-22T07:20:52.862228+0000","last_unstale":"2024-04-22T07:20:55.787136+0000","last_undegraded":"2024-04-22T07:20:55.787136+0000","last_fullsized":"2024-04-22T07:20:55.787136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:51.683021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979012+0000","last_change":"2024-04-22T07:20:52.856651+0000","last_active":"2024-04-22T07:20:54.979012+0000","last_peered":"2024-04-22T07:20:54.979012+0000","last_clean":"2024-04-22T07:20:54.979012+0000","last_became_active":"2024-04-22T07:20:52.856096+0000","last_became_peered":"2024-04-22T07:20:52.856096+0000","last_unstale":"2024-04-22T07:20:54.979012+0000","last_undegraded":"2024-04-22T07:20:54.979012+0000","last_fullsized":"2024-04-22T07:20:54.979012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:04.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979658+0000","last_change":"2024-04-22T07:20:53.873708+0000","last_active":"2024-04-22T07:20:54.979658+0000","last_peered":"2024-04-22T07:20:54.979658+0000","last_clean":"2024-04-22T07:20:54.979658+0000","last_became_active":"2024-04-22T07:20:53.872793+0000","last_became_peered":"2024-04-22T07:20:53.872793+0000","last_unstale":"2024-04-22T07:20:54.979658+0000","last_undegraded":"2024-04-22T07:20:54.979658+0000","last_fullsized":"2024-04-22T07:20:54.979658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:52.686229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862729+0000","last_change":"2024-04-22T07:20:52.861133+0000","last_active":"2024-04-22T07:20:54.862729+0000","last_peered":"2024-04-22T07:20:54.862729+0000","last_clean":"2024-04-22T07:20:54.862729+0000","last_became_active":"2024-04-22T07:20:52.860736+0000","last_became_peered":"2024-04-22T07:20:52.860736+0000","last_unstale":"2024-04-22T07:20:54.862729+0000","last_undegraded":"2024-04-22T07:20:54.862729+0000","last_fullsized":"2024-04-22T07:20:54.862729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:06.123308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980308+0000","last_change":"2024-04-22T07:20:53.867477+0000","last_active":"2024-04-22T07:20:54.980308+0000","last_peered":"2024-04-22T07:20:54.980308+0000","last_clean":"2024-04-22T07:20:54.980308+0000","last_became_active":"2024-04-22T07:20:53.867086+0000","last_became_peered":"2024-04-22T07:20:53.867086+0000","last_unstale":"2024-04-22T07:20:54.980308+0000","last_undegraded":"2024-04-22T07:20:54.980308+0000","last_fullsized":"2024-04-22T07:20:54.980308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:56:55.644168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863067+0000","last_change":"2024-04-22T07:20:52.863567+0000","last_active":"2024-04-22T07:20:54.863067+0000","last_peered":"2024-04-22T07:20:54.863067+0000","last_clean":"2024-04-22T07:20:54.863067+0000","last_became_active":"2024-04-22T07:20:52.863285+0000","last_became_peered":"2024-04-22T07:20:52.863285+0000","last_unstale":"2024-04-22T07:20:54.863067+0000","last_undegraded":"2024-04-22T07:20:54.863067+0000","last_fullsized":"2024-04-22T07:20:54.863067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861976+0000","last_change":"2024-04-22T07:20:53.864955+0000","last_active":"2024-04-22T07:20:54.861976+0000","last_peered":"2024-04-22T07:20:54.861976+0000","last_clean":"2024-04-22T07:20:54.861976+0000","last_became_active":"2024-04-22T07:20:53.864694+0000","last_became_peered":"2024-04-22T07:20:53.864694+0000","last_unstale":"2024-04-22T07:20:54.861976+0000","last_undegraded":"2024-04-22T07:20:54.861976+0000","last_fullsized":"2024-04-22T07:20:54.861976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977898+0000","last_change":"2024-04-22T07:20:52.858761+0000","last_active":"2024-04-22T07:20:54.977898+0000","last_peered":"2024-04-22T07:20:54.977898+0000","last_clean":"2024-04-22T07:20:54.977898+0000","last_became_active":"2024-04-22T07:20:52.856815+0000","last_became_peered":"2024-04-22T07:20:52.856815+0000","last_unstale":"2024-04-22T07:20:54.977898+0000","last_undegraded":"2024-04-22T07:20:54.977898+0000","last_fullsized":"2024-04-22T07:20:54.977898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:06.123308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979798+0000","last_change":"2024-04-22T07:20:53.867290+0000","last_active":"2024-04-22T07:20:54.979798+0000","last_peered":"2024-04-22T07:20:54.979798+0000","last_clean":"2024-04-22T07:20:54.979798+0000","last_became_active":"2024-04-22T07:20:53.866955+0000","last_became_peered":"2024-04-22T07:20:53.866955+0000","last_unstale":"2024-04-22T07:20:54.979798+0000","last_undegraded":"2024-04-22T07:20:54.979798+0000","last_fullsized":"2024-04-22T07:20:54.979798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:43.442316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.870244+0000","last_change":"2024-04-22T07:20:52.863670+0000","last_active":"2024-04-22T07:20:58.870244+0000","last_peered":"2024-04-22T07:20:58.870244+0000","last_clean":"2024-04-22T07:20:58.870244+0000","last_became_active":"2024-04-22T07:20:52.863320+0000","last_became_peered":"2024-04-22T07:20:52.863320+0000","last_unstale":"2024-04-22T07:20:58.870244+0000","last_undegraded":"2024-04-22T07:20:58.870244+0000","last_fullsized":"2024-04-22T07:20:58.870244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:04.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862589+0000","last_change":"2024-04-22T07:20:53.868286+0000","last_active":"2024-04-22T07:20:54.862589+0000","last_peered":"2024-04-22T07:20:54.862589+0000","last_clean":"2024-04-22T07:20:54.862589+0000","last_became_active":"2024-04-22T07:20:53.862811+0000","last_became_peered":"2024-04-22T07:20:53.862811+0000","last_unstale":"2024-04-22T07:20:54.862589+0000","last_undegraded":"2024-04-22T07:20:54.862589+0000","last_fullsized":"2024-04-22T07:20:54.862589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.870351+0000","last_change":"2024-04-22T07:20:52.863638+0000","last_active":"2024-04-22T07:20:58.870351+0000","last_peered":"2024-04-22T07:20:58.870351+0000","last_clean":"2024-04-22T07:20:58.870351+0000","last_became_active":"2024-04-22T07:20:52.863244+0000","last_became_peered":"2024-04-22T07:20:52.863244+0000","last_unstale":"2024-04-22T07:20:58.870351+0000","last_undegraded":"2024-04-22T07:20:58.870351+0000","last_fullsized":"2024-04-22T07:20:58.870351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:36:49.017537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977713+0000","last_change":"2024-04-22T07:20:53.875162+0000","last_active":"2024-04-22T07:20:54.977713+0000","last_peered":"2024-04-22T07:20:54.977713+0000","last_clean":"2024-04-22T07:20:54.977713+0000","last_became_active":"2024-04-22T07:20:53.874612+0000","last_became_peered":"2024-04-22T07:20:53.874612+0000","last_unstale":"2024-04-22T07:20:54.977713+0000","last_undegraded":"2024-04-22T07:20:54.977713+0000","last_fullsized":"2024-04-22T07:20:54.977713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:13:12.303505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.869961+0000","last_change":"2024-04-22T07:20:52.855194+0000","last_active":"2024-04-22T07:20:58.869961+0000","last_peered":"2024-04-22T07:20:58.869961+0000","last_clean":"2024-04-22T07:20:58.869961+0000","last_became_active":"2024-04-22T07:20:52.854915+0000","last_became_peered":"2024-04-22T07:20:52.854915+0000","last_unstale":"2024-04-22T07:20:58.869961+0000","last_undegraded":"2024-04-22T07:20:58.869961+0000","last_fullsized":"2024-04-22T07:20:58.869961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979725+0000","last_change":"2024-04-22T07:20:53.868695+0000","last_active":"2024-04-22T07:20:54.979725+0000","last_peered":"2024-04-22T07:20:54.979725+0000","last_clean":"2024-04-22T07:20:54.979725+0000","last_became_active":"2024-04-22T07:20:53.868400+0000","last_became_peered":"2024-04-22T07:20:53.868400+0000","last_unstale":"2024-04-22T07:20:54.979725+0000","last_undegraded":"2024-04-22T07:20:54.979725+0000","last_fullsized":"2024-04-22T07:20:54.979725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:30:23.352871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863163+0000","last_change":"2024-04-22T07:20:52.861884+0000","last_active":"2024-04-22T07:20:54.863163+0000","last_peered":"2024-04-22T07:20:54.863163+0000","last_clean":"2024-04-22T07:20:54.863163+0000","last_became_active":"2024-04-22T07:20:52.861546+0000","last_became_peered":"2024-04-22T07:20:52.861546+0000","last_unstale":"2024-04-22T07:20:54.863163+0000","last_undegraded":"2024-04-22T07:20:54.863163+0000","last_fullsized":"2024-04-22T07:20:54.863163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:37.283262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862882+0000","last_change":"2024-04-22T07:20:53.863071+0000","last_active":"2024-04-22T07:20:54.862882+0000","last_peered":"2024-04-22T07:20:54.862882+0000","last_clean":"2024-04-22T07:20:54.862882+0000","last_became_active":"2024-04-22T07:20:53.862763+0000","last_became_peered":"2024-04-22T07:20:53.862763+0000","last_unstale":"2024-04-22T07:20:54.862882+0000","last_undegraded":"2024-04-22T07:20:54.862882+0000","last_fullsized":"2024-04-22T07:20:54.862882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:19:57.432323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977415+0000","last_change":"2024-04-22T07:20:52.865285+0000","last_active":"2024-04-22T07:20:54.977415+0000","last_peered":"2024-04-22T07:20:54.977415+0000","last_clean":"2024-04-22T07:20:54.977415+0000","last_became_active":"2024-04-22T07:20:52.864725+0000","last_became_peered":"2024-04-22T07:20:52.864725+0000","last_unstale":"2024-04-22T07:20:54.977415+0000","last_undegraded":"2024-04-22T07:20:54.977415+0000","last_fullsized":"2024-04-22T07:20:54.977415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:23:28.850031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862533+0000","last_change":"2024-04-22T07:20:53.875479+0000","last_active":"2024-04-22T07:20:54.862533+0000","last_peered":"2024-04-22T07:20:54.862533+0000","last_clean":"2024-04-22T07:20:54.862533+0000","last_became_active":"2024-04-22T07:20:53.874567+0000","last_became_peered":"2024-04-22T07:20:53.874567+0000","last_unstale":"2024-04-22T07:20:54.862533+0000","last_undegraded":"2024-04-22T07:20:54.862533+0000","last_fullsized":"2024-04-22T07:20:54.862533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.871647+0000","last_change":"2024-04-22T07:20:52.860646+0000","last_active":"2024-04-22T07:20:58.871647+0000","last_peered":"2024-04-22T07:20:58.871647+0000","last_clean":"2024-04-22T07:20:58.871647+0000","last_became_active":"2024-04-22T07:20:52.860347+0000","last_became_peered":"2024-04-22T07:20:52.860347+0000","last_unstale":"2024-04-22T07:20:58.871647+0000","last_undegraded":"2024-04-22T07:20:58.871647+0000","last_fullsized":"2024-04-22T07:20:58.871647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:53:20.912264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862635+0000","last_change":"2024-04-22T07:20:53.859641+0000","last_active":"2024-04-22T07:20:54.862635+0000","last_peered":"2024-04-22T07:20:54.862635+0000","last_clean":"2024-04-22T07:20:54.862635+0000","last_became_active":"2024-04-22T07:20:53.859365+0000","last_became_peered":"2024-04-22T07:20:53.859365+0000","last_unstale":"2024-04-22T07:20:54.862635+0000","last_undegraded":"2024-04-22T07:20:54.862635+0000","last_fullsized":"2024-04-22T07:20:54.862635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:46:50.322722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.788730+0000","last_change":"2024-04-22T07:20:52.866960+0000","last_active":"2024-04-22T07:20:55.788730+0000","last_peered":"2024-04-22T07:20:55.788730+0000","last_clean":"2024-04-22T07:20:55.788730+0000","last_became_active":"2024-04-22T07:20:52.866654+0000","last_became_peered":"2024-04-22T07:20:52.866654+0000","last_unstale":"2024-04-22T07:20:55.788730+0000","last_undegraded":"2024-04-22T07:20:55.788730+0000","last_fullsized":"2024-04-22T07:20:55.788730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:51.683021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862087+0000","last_change":"2024-04-22T07:20:53.874775+0000","last_active":"2024-04-22T07:20:54.862087+0000","last_peered":"2024-04-22T07:20:54.862087+0000","last_clean":"2024-04-22T07:20:54.862087+0000","last_became_active":"2024-04-22T07:20:53.874499+0000","last_became_peered":"2024-04-22T07:20:53.874499+0000","last_unstale":"2024-04-22T07:20:54.862087+0000","last_undegraded":"2024-04-22T07:20:54.862087+0000","last_fullsized":"2024-04-22T07:20:54.862087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:23.268067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.871021+0000","last_change":"2024-04-22T07:20:52.867201+0000","last_active":"2024-04-22T07:20:58.871021+0000","last_peered":"2024-04-22T07:20:58.871021+0000","last_clean":"2024-04-22T07:20:58.871021+0000","last_became_active":"2024-04-22T07:20:52.866627+0000","last_became_peered":"2024-04-22T07:20:52.866627+0000","last_unstale":"2024-04-22T07:20:58.871021+0000","last_undegraded":"2024-04-22T07:20:58.871021+0000","last_fullsized":"2024-04-22T07:20:58.871021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:09:08.908298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977901+0000","last_change":"2024-04-22T07:20:53.871645+0000","last_active":"2024-04-22T07:20:54.977901+0000","last_peered":"2024-04-22T07:20:54.977901+0000","last_clean":"2024-04-22T07:20:54.977901+0000","last_became_active":"2024-04-22T07:20:53.871353+0000","last_became_peered":"2024-04-22T07:20:53.871353+0000","last_unstale":"2024-04-22T07:20:54.977901+0000","last_undegraded":"2024-04-22T07:20:54.977901+0000","last_fullsized":"2024-04-22T07:20:54.977901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:48:40.630407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.787667+0000","last_change":"2024-04-22T07:20:52.866996+0000","last_active":"2024-04-22T07:20:55.787667+0000","last_peered":"2024-04-22T07:20:55.787667+0000","last_clean":"2024-04-22T07:20:55.787667+0000","last_became_active":"2024-04-22T07:20:52.866677+0000","last_became_peered":"2024-04-22T07:20:52.866677+0000","last_unstale":"2024-04-22T07:20:55.787667+0000","last_undegraded":"2024-04-22T07:20:55.787667+0000","last_fullsized":"2024-04-22T07:20:55.787667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977832+0000","last_change":"2024-04-22T07:20:53.871064+0000","last_active":"2024-04-22T07:20:54.977832+0000","last_peered":"2024-04-22T07:20:54.977832+0000","last_clean":"2024-04-22T07:20:54.977832+0000","last_became_active":"2024-04-22T07:20:53.866968+0000","last_became_peered":"2024-04-22T07:20:53.866968+0000","last_unstale":"2024-04-22T07:20:54.977832+0000","last_undegraded":"2024-04-22T07:20:54.977832+0000","last_fullsized":"2024-04-22T07:20:54.977832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:43.442316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979659+0000","last_change":"2024-04-22T07:20:52.856958+0000","last_active":"2024-04-22T07:20:54.979659+0000","last_peered":"2024-04-22T07:20:54.979659+0000","last_clean":"2024-04-22T07:20:54.979659+0000","last_became_active":"2024-04-22T07:20:52.856289+0000","last_became_peered":"2024-04-22T07:20:52.856289+0000","last_unstale":"2024-04-22T07:20:54.979659+0000","last_undegraded":"2024-04-22T07:20:54.979659+0000","last_fullsized":"2024-04-22T07:20:54.979659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863352+0000","last_change":"2024-04-22T07:20:53.872915+0000","last_active":"2024-04-22T07:20:54.863352+0000","last_peered":"2024-04-22T07:20:54.863352+0000","last_clean":"2024-04-22T07:20:54.863352+0000","last_became_active":"2024-04-22T07:20:53.872005+0000","last_became_peered":"2024-04-22T07:20:53.872005+0000","last_unstale":"2024-04-22T07:20:54.863352+0000","last_undegraded":"2024-04-22T07:20:54.863352+0000","last_fullsized":"2024-04-22T07:20:54.863352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:53:29.242632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862549+0000","last_change":"2024-04-22T07:20:43.747396+0000","last_active":"2024-04-22T07:20:54.862549+0000","last_peered":"2024-04-22T07:20:54.862549+0000","last_clean":"2024-04-22T07:20:54.862549+0000","last_became_active":"2024-04-22T07:20:43.746332+0000","last_became_peered":"2024-04-22T07:20:43.746332+0000","last_unstale":"2024-04-22T07:20:54.862549+0000","last_undegraded":"2024-04-22T07:20:54.862549+0000","last_fullsized":"2024-04-22T07:20:54.862549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:42.732916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:42.732916+0000","last_clean_scrub_stamp":"2024-04-22T07:20:42.732916+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:02:55.086445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863049+0000","last_change":"2024-04-22T07:20:52.862492+0000","last_active":"2024-04-22T07:20:54.863049+0000","last_peered":"2024-04-22T07:20:54.863049+0000","last_clean":"2024-04-22T07:20:54.863049+0000","last_became_active":"2024-04-22T07:20:52.862201+0000","last_became_peered":"2024-04-22T07:20:52.862201+0000","last_unstale":"2024-04-22T07:20:54.863049+0000","last_undegraded":"2024-04-22T07:20:54.863049+0000","last_fullsized":"2024-04-22T07:20:54.863049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:52.015227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979807+0000","last_change":"2024-04-22T07:20:53.868797+0000","last_active":"2024-04-22T07:20:54.979807+0000","last_peered":"2024-04-22T07:20:54.979807+0000","last_clean":"2024-04-22T07:20:54.979807+0000","last_became_active":"2024-04-22T07:20:53.868335+0000","last_became_peered":"2024-04-22T07:20:53.868335+0000","last_unstale":"2024-04-22T07:20:54.979807+0000","last_undegraded":"2024-04-22T07:20:54.979807+0000","last_fullsized":"2024-04-22T07:20:54.979807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:43:02.116289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862731+0000","last_change":"2024-04-22T07:20:52.867622+0000","last_active":"2024-04-22T07:20:54.862731+0000","last_peered":"2024-04-22T07:20:54.862731+0000","last_clean":"2024-04-22T07:20:54.862731+0000","last_became_active":"2024-04-22T07:20:52.866996+0000","last_became_peered":"2024-04-22T07:20:52.866996+0000","last_unstale":"2024-04-22T07:20:54.862731+0000","last_undegraded":"2024-04-22T07:20:54.862731+0000","last_fullsized":"2024-04-22T07:20:54.862731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:08.286530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978392+0000","last_change":"2024-04-22T07:20:53.871576+0000","last_active":"2024-04-22T07:20:54.978392+0000","last_peered":"2024-04-22T07:20:54.978392+0000","last_clean":"2024-04-22T07:20:54.978392+0000","last_became_active":"2024-04-22T07:20:53.871239+0000","last_became_peered":"2024-04-22T07:20:53.871239+0000","last_unstale":"2024-04-22T07:20:54.978392+0000","last_undegraded":"2024-04-22T07:20:54.978392+0000","last_fullsized":"2024-04-22T07:20:54.978392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979845+0000","last_change":"2024-04-22T07:20:52.866974+0000","last_active":"2024-04-22T07:20:54.979845+0000","last_peered":"2024-04-22T07:20:54.979845+0000","last_clean":"2024-04-22T07:20:54.979845+0000","last_became_active":"2024-04-22T07:20:52.866581+0000","last_became_peered":"2024-04-22T07:20:52.866581+0000","last_unstale":"2024-04-22T07:20:54.979845+0000","last_undegraded":"2024-04-22T07:20:54.979845+0000","last_fullsized":"2024-04-22T07:20:54.979845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979503+0000","last_change":"2024-04-22T07:20:53.865035+0000","last_active":"2024-04-22T07:20:54.979503+0000","last_peered":"2024-04-22T07:20:54.979503+0000","last_clean":"2024-04-22T07:20:54.979503+0000","last_became_active":"2024-04-22T07:20:53.864523+0000","last_became_peered":"2024-04-22T07:20:53.864523+0000","last_unstale":"2024-04-22T07:20:54.979503+0000","last_undegraded":"2024-04-22T07:20:54.979503+0000","last_fullsized":"2024-04-22T07:20:54.979503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:13:12.303505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863169+0000","last_change":"2024-04-22T07:20:52.858498+0000","last_active":"2024-04-22T07:20:54.863169+0000","last_peered":"2024-04-22T07:20:54.863169+0000","last_clean":"2024-04-22T07:20:54.863169+0000","last_became_active":"2024-04-22T07:20:52.858139+0000","last_became_peered":"2024-04-22T07:20:52.858139+0000","last_unstale":"2024-04-22T07:20:54.863169+0000","last_undegraded":"2024-04-22T07:20:54.863169+0000","last_fullsized":"2024-04-22T07:20:54.863169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:45.382709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977943+0000","last_change":"2024-04-22T07:20:53.877595+0000","last_active":"2024-04-22T07:20:54.977943+0000","last_peered":"2024-04-22T07:20:54.977943+0000","last_clean":"2024-04-22T07:20:54.977943+0000","last_became_active":"2024-04-22T07:20:53.877208+0000","last_became_peered":"2024-04-22T07:20:53.877208+0000","last_unstale":"2024-04-22T07:20:54.977943+0000","last_undegraded":"2024-04-22T07:20:54.977943+0000","last_fullsized":"2024-04-22T07:20:54.977943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:46:50.322722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979001+0000","last_change":"2024-04-22T07:20:52.866224+0000","last_active":"2024-04-22T07:20:54.979001+0000","last_peered":"2024-04-22T07:20:54.979001+0000","last_clean":"2024-04-22T07:20:54.979001+0000","last_became_active":"2024-04-22T07:20:52.865903+0000","last_became_peered":"2024-04-22T07:20:52.865903+0000","last_unstale":"2024-04-22T07:20:54.979001+0000","last_undegraded":"2024-04-22T07:20:54.979001+0000","last_fullsized":"2024-04-22T07:20:54.979001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861395+0000","last_change":"2024-04-22T07:20:53.873266+0000","last_active":"2024-04-22T07:20:54.861395+0000","last_peered":"2024-04-22T07:20:54.861395+0000","last_clean":"2024-04-22T07:20:54.861395+0000","last_became_active":"2024-04-22T07:20:53.872915+0000","last_became_peered":"2024-04-22T07:20:53.872915+0000","last_unstale":"2024-04-22T07:20:54.861395+0000","last_undegraded":"2024-04-22T07:20:54.861395+0000","last_fullsized":"2024-04-22T07:20:54.861395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:09.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863471+0000","last_change":"2024-04-22T07:20:52.863593+0000","last_active":"2024-04-22T07:20:54.863471+0000","last_peered":"2024-04-22T07:20:54.863471+0000","last_clean":"2024-04-22T07:20:54.863471+0000","last_became_active":"2024-04-22T07:20:52.863296+0000","last_became_peered":"2024-04-22T07:20:52.863296+0000","last_unstale":"2024-04-22T07:20:54.863471+0000","last_undegraded":"2024-04-22T07:20:54.863471+0000","last_fullsized":"2024-04-22T07:20:54.863471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:22.261683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979540+0000","last_change":"2024-04-22T07:20:53.874491+0000","last_active":"2024-04-22T07:20:54.979540+0000","last_peered":"2024-04-22T07:20:54.979540+0000","last_clean":"2024-04-22T07:20:54.979540+0000","last_became_active":"2024-04-22T07:20:53.874202+0000","last_became_peered":"2024-04-22T07:20:53.874202+0000","last_unstale":"2024-04-22T07:20:54.979540+0000","last_undegraded":"2024-04-22T07:20:54.979540+0000","last_fullsized":"2024-04-22T07:20:54.979540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:23.268067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980655+0000","last_change":"2024-04-22T07:20:52.865905+0000","last_active":"2024-04-22T07:20:54.980655+0000","last_peered":"2024-04-22T07:20:54.980655+0000","last_clean":"2024-04-22T07:20:54.980655+0000","last_became_active":"2024-04-22T07:20:52.865566+0000","last_became_peered":"2024-04-22T07:20:52.865566+0000","last_unstale":"2024-04-22T07:20:54.980655+0000","last_undegraded":"2024-04-22T07:20:54.980655+0000","last_fullsized":"2024-04-22T07:20:54.980655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:38:31.271879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980566+0000","last_change":"2024-04-22T07:20:53.869951+0000","last_active":"2024-04-22T07:20:54.980566+0000","last_peered":"2024-04-22T07:20:54.980566+0000","last_clean":"2024-04-22T07:20:54.980566+0000","last_became_active":"2024-04-22T07:20:53.869613+0000","last_became_peered":"2024-04-22T07:20:53.869613+0000","last_unstale":"2024-04-22T07:20:54.980566+0000","last_undegraded":"2024-04-22T07:20:54.980566+0000","last_fullsized":"2024-04-22T07:20:54.980566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:14:09.372107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.867345+0000","last_change":"2024-04-22T07:20:52.864740+0000","last_active":"2024-04-22T07:20:58.867345+0000","last_peered":"2024-04-22T07:20:58.867345+0000","last_clean":"2024-04-22T07:20:58.867345+0000","last_became_active":"2024-04-22T07:20:52.864434+0000","last_became_peered":"2024-04-22T07:20:52.864434+0000","last_unstale":"2024-04-22T07:20:58.867345+0000","last_undegraded":"2024-04-22T07:20:58.867345+0000","last_fullsized":"2024-04-22T07:20:58.867345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:33.937176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980498+0000","last_change":"2024-04-22T07:20:53.871156+0000","last_active":"2024-04-22T07:20:54.980498+0000","last_peered":"2024-04-22T07:20:54.980498+0000","last_clean":"2024-04-22T07:20:54.980498+0000","last_became_active":"2024-04-22T07:20:53.870664+0000","last_became_peered":"2024-04-22T07:20:53.870664+0000","last_unstale":"2024-04-22T07:20:54.980498+0000","last_undegraded":"2024-04-22T07:20:54.980498+0000","last_fullsized":"2024-04-22T07:20:54.980498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:01:02.139458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977319+0000","last_change":"2024-04-22T07:20:52.854668+0000","last_active":"2024-04-22T07:20:54.977319+0000","last_peered":"2024-04-22T07:20:54.977319+0000","last_clean":"2024-04-22T07:20:54.977319+0000","last_became_active":"2024-04-22T07:20:52.854395+0000","last_became_peered":"2024-04-22T07:20:52.854395+0000","last_unstale":"2024-04-22T07:20:54.977319+0000","last_undegraded":"2024-04-22T07:20:54.977319+0000","last_fullsized":"2024-04-22T07:20:54.977319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:59:32.487127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862797+0000","last_change":"2024-04-22T07:20:53.870972+0000","last_active":"2024-04-22T07:20:54.862797+0000","last_peered":"2024-04-22T07:20:54.862797+0000","last_clean":"2024-04-22T07:20:54.862797+0000","last_became_active":"2024-04-22T07:20:53.870674+0000","last_became_peered":"2024-04-22T07:20:53.870674+0000","last_unstale":"2024-04-22T07:20:54.862797+0000","last_undegraded":"2024-04-22T07:20:54.862797+0000","last_fullsized":"2024-04-22T07:20:54.862797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:10.431906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980374+0000","last_change":"2024-04-22T07:20:52.866003+0000","last_active":"2024-04-22T07:20:54.980374+0000","last_peered":"2024-04-22T07:20:54.980374+0000","last_clean":"2024-04-22T07:20:54.980374+0000","last_became_active":"2024-04-22T07:20:52.865606+0000","last_became_peered":"2024-04-22T07:20:52.865606+0000","last_unstale":"2024-04-22T07:20:54.980374+0000","last_undegraded":"2024-04-22T07:20:54.980374+0000","last_fullsized":"2024-04-22T07:20:54.980374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:58:06.713204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978351+0000","last_change":"2024-04-22T07:20:53.870737+0000","last_active":"2024-04-22T07:20:54.978351+0000","last_peered":"2024-04-22T07:20:54.978351+0000","last_clean":"2024-04-22T07:20:54.978351+0000","last_became_active":"2024-04-22T07:20:53.870402+0000","last_became_peered":"2024-04-22T07:20:53.870402+0000","last_unstale":"2024-04-22T07:20:54.978351+0000","last_undegraded":"2024-04-22T07:20:54.978351+0000","last_fullsized":"2024-04-22T07:20:54.978351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:30:17.845591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979784+0000","last_change":"2024-04-22T07:20:52.861048+0000","last_active":"2024-04-22T07:20:54.979784+0000","last_peered":"2024-04-22T07:20:54.979784+0000","last_clean":"2024-04-22T07:20:54.979784+0000","last_became_active":"2024-04-22T07:20:52.860702+0000","last_became_peered":"2024-04-22T07:20:52.860702+0000","last_unstale":"2024-04-22T07:20:54.979784+0000","last_undegraded":"2024-04-22T07:20:54.979784+0000","last_fullsized":"2024-04-22T07:20:54.979784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979324+0000","last_change":"2024-04-22T07:20:53.868782+0000","last_active":"2024-04-22T07:20:54.979324+0000","last_peered":"2024-04-22T07:20:54.979324+0000","last_clean":"2024-04-22T07:20:54.979324+0000","last_became_active":"2024-04-22T07:20:53.868509+0000","last_became_peered":"2024-04-22T07:20:53.868509+0000","last_unstale":"2024-04-22T07:20:54.979324+0000","last_undegraded":"2024-04-22T07:20:54.979324+0000","last_fullsized":"2024-04-22T07:20:54.979324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:07.129692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.867515+0000","last_change":"2024-04-22T07:20:52.858508+0000","last_active":"2024-04-22T07:20:58.867515+0000","last_peered":"2024-04-22T07:20:58.867515+0000","last_clean":"2024-04-22T07:20:58.867515+0000","last_became_active":"2024-04-22T07:20:52.858215+0000","last_became_peered":"2024-04-22T07:20:52.858215+0000","last_unstale":"2024-04-22T07:20:58.867515+0000","last_undegraded":"2024-04-22T07:20:58.867515+0000","last_fullsized":"2024-04-22T07:20:58.867515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:26.618434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862971+0000","last_change":"2024-04-22T07:20:53.867977+0000","last_active":"2024-04-22T07:20:54.862971+0000","last_peered":"2024-04-22T07:20:54.862971+0000","last_clean":"2024-04-22T07:20:54.862971+0000","last_became_active":"2024-04-22T07:20:53.867447+0000","last_became_peered":"2024-04-22T07:20:53.867447+0000","last_unstale":"2024-04-22T07:20:54.862971+0000","last_undegraded":"2024-04-22T07:20:54.862971+0000","last_fullsized":"2024-04-22T07:20:54.862971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:48:52.934171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863377+0000","last_change":"2024-04-22T07:20:53.875681+0000","last_active":"2024-04-22T07:20:54.863377+0000","last_peered":"2024-04-22T07:20:54.863377+0000","last_clean":"2024-04-22T07:20:54.863377+0000","last_became_active":"2024-04-22T07:20:53.875305+0000","last_became_peered":"2024-04-22T07:20:53.875305+0000","last_unstale":"2024-04-22T07:20:54.863377+0000","last_undegraded":"2024-04-22T07:20:54.863377+0000","last_fullsized":"2024-04-22T07:20:54.863377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:22:34.452869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.866736+0000","last_change":"2024-04-22T07:20:52.857445+0000","last_active":"2024-04-22T07:20:58.866736+0000","last_peered":"2024-04-22T07:20:58.866736+0000","last_clean":"2024-04-22T07:20:58.866736+0000","last_became_active":"2024-04-22T07:20:52.856293+0000","last_became_peered":"2024-04-22T07:20:52.856293+0000","last_unstale":"2024-04-22T07:20:58.866736+0000","last_undegraded":"2024-04-22T07:20:58.866736+0000","last_fullsized":"2024-04-22T07:20:58.866736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:10.640191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862780+0000","last_change":"2024-04-22T07:20:53.870827+0000","last_active":"2024-04-22T07:20:54.862780+0000","last_peered":"2024-04-22T07:20:54.862780+0000","last_clean":"2024-04-22T07:20:54.862780+0000","last_became_active":"2024-04-22T07:20:53.870548+0000","last_became_peered":"2024-04-22T07:20:53.870548+0000","last_unstale":"2024-04-22T07:20:54.862780+0000","last_undegraded":"2024-04-22T07:20:54.862780+0000","last_fullsized":"2024-04-22T07:20:54.862780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:27.624819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.867037+0000","last_change":"2024-04-22T07:20:52.856933+0000","last_active":"2024-04-22T07:20:58.867037+0000","last_peered":"2024-04-22T07:20:58.867037+0000","last_clean":"2024-04-22T07:20:58.867037+0000","last_became_active":"2024-04-22T07:20:52.856617+0000","last_became_peered":"2024-04-22T07:20:52.856617+0000","last_unstale":"2024-04-22T07:20:58.867037+0000","last_undegraded":"2024-04-22T07:20:58.867037+0000","last_fullsized":"2024-04-22T07:20:58.867037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:08.286530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979619+0000","last_change":"2024-04-22T07:20:53.866552+0000","last_active":"2024-04-22T07:20:54.979619+0000","last_peered":"2024-04-22T07:20:54.979619+0000","last_clean":"2024-04-22T07:20:54.979619+0000","last_became_active":"2024-04-22T07:20:53.866286+0000","last_became_peered":"2024-04-22T07:20:53.866286+0000","last_unstale":"2024-04-22T07:20:54.979619+0000","last_undegraded":"2024-04-22T07:20:54.979619+0000","last_fullsized":"2024-04-22T07:20:54.979619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:45:15.519469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.787690+0000","last_change":"2024-04-22T07:20:52.863291+0000","last_active":"2024-04-22T07:20:55.787690+0000","last_peered":"2024-04-22T07:20:55.787690+0000","last_clean":"2024-04-22T07:20:55.787690+0000","last_became_active":"2024-04-22T07:20:52.862967+0000","last_became_peered":"2024-04-22T07:20:52.862967+0000","last_unstale":"2024-04-22T07:20:55.787690+0000","last_undegraded":"2024-04-22T07:20:55.787690+0000","last_fullsized":"2024-04-22T07:20:55.787690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:10.640191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980150+0000","last_change":"2024-04-22T07:20:53.871045+0000","last_active":"2024-04-22T07:20:54.980150+0000","last_peered":"2024-04-22T07:20:54.980150+0000","last_clean":"2024-04-22T07:20:54.980150+0000","last_became_active":"2024-04-22T07:20:53.870715+0000","last_became_peered":"2024-04-22T07:20:53.870715+0000","last_unstale":"2024-04-22T07:20:54.980150+0000","last_undegraded":"2024-04-22T07:20:54.980150+0000","last_fullsized":"2024-04-22T07:20:54.980150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.870910+0000","last_change":"2024-04-22T07:20:52.869553+0000","last_active":"2024-04-22T07:20:58.870910+0000","last_peered":"2024-04-22T07:20:58.870910+0000","last_clean":"2024-04-22T07:20:58.870910+0000","last_became_active":"2024-04-22T07:20:52.869300+0000","last_became_peered":"2024-04-22T07:20:52.869300+0000","last_unstale":"2024-04-22T07:20:58.870910+0000","last_undegraded":"2024-04-22T07:20:58.870910+0000","last_fullsized":"2024-04-22T07:20:58.870910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:27.709073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":81359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":835584,"data_stored":671695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":831488,"data_stored":671673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":81291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":253952,"data_stored":83519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T07:21:08.115 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-22T07:21:08.115 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-22T07:21:08.115 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-22T07:21:08.115 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-22T07:21:08.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.254+0000 7f948bc31640 1 Processor -- start 2024-04-22T07:21:08.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.254+0000 7f948bc31640 1 -- start start 2024-04-22T07:21:08.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.255+0000 7f948bc31640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9484158470 0x7f948406b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:08.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.255+0000 7f948bc31640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9484070cc0 0x7f94840cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:08.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.255+0000 7f948bc31640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f948415b0b0 con 0x7f94840cb540 2024-04-22T07:21:08.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.255+0000 7f948bc31640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f9484158850 con 0x7f9484070cc0 2024-04-22T07:21:08.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.255+0000 7f948bc31640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f948415b390 con 0x7f9484158470 2024-04-22T07:21:08.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.255+0000 7f948a1ce640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f94840cb540 0x7f948415e8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33976/0 (socket says 172.21.15.40:33976) 2024-04-22T07:21:08.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.255+0000 7f948a1ce640 1 -- 172.21.15.40:0/2833128505 learned_addr learned my addr 172.21.15.40:0/2833128505 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:08.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.256+0000 7f94891cc640 1 --2- 172.21.15.40:0/2833128505 >> v2:172.21.15.62:3300/0 conn(0x7f9484070cc0 0x7f94840cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:08.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.256+0000 7f94889cb640 1 -- 172.21.15.40:0/2833128505 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4199486432 0 0) 0x7f948415b0b0 con 0x7f94840cb540 2024-04-22T07:21:08.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.256+0000 7f94889cb640 1 -- 172.21.15.40:0/2833128505 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f946c003520 con 0x7f94840cb540 2024-04-22T07:21:08.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.256+0000 7f94899cd640 1 --2- 172.21.15.40:0/2833128505 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9484158470 0x7f948406b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:08.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.256+0000 7f94889cb640 1 -- 172.21.15.40:0/2833128505 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3045556683 0 0) 0x7f946c003520 con 0x7f94840cb540 2024-04-22T07:21:08.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.256+0000 7f94889cb640 1 -- 172.21.15.40:0/2833128505 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9484158470 msgr2=0x7f948406b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:08.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.256+0000 7f94889cb640 1 --2- 172.21.15.40:0/2833128505 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9484158470 0x7f948406b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.256+0000 7f94889cb640 1 -- 172.21.15.40:0/2833128505 >> v2:172.21.15.62:3300/0 conn(0x7f9484070cc0 msgr2=0x7f94840cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:08.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.256+0000 7f94889cb640 1 --2- 172.21.15.40:0/2833128505 >> v2:172.21.15.62:3300/0 conn(0x7f9484070cc0 0x7f94840cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.256+0000 7f94889cb640 1 -- 172.21.15.40:0/2833128505 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948415b670 con 0x7f94840cb540 2024-04-22T07:21:08.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.256+0000 7f94889cb640 1 -- 172.21.15.40:0/2833128505 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7f94740019f0 con 0x7f94840cb540 2024-04-22T07:21:08.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.256+0000 7f94889cb640 1 -- 172.21.15.40:0/2833128505 >> v1:172.21.15.40:6789/0 conn(0x7f94840cb540 legacy=0x7f948415e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:08.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.256+0000 7f94889cb640 1 --2- 172.21.15.40:0/2833128505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f946c0039b0 0x7f946c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:08.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.256+0000 7f94889cb640 1 --2- 172.21.15.40:0/2833128505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f946c004800 0x7f946c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:08.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.256+0000 7f94889cb640 1 --2- 172.21.15.40:0/2833128505 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9484158470 0x7f946c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:08.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.256+0000 7f94889cb640 1 -- 172.21.15.40:0/2833128505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9484158850 con 0x7f946c004800 2024-04-22T07:21:08.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.256+0000 7f94889cb640 1 -- 172.21.15.40:0/2833128505 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f948415b390 con 0x7f946c0039b0 2024-04-22T07:21:08.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.256+0000 7f94889cb640 1 -- 172.21.15.40:0/2833128505 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f946c00b9c0 con 0x7f9484158470 2024-04-22T07:21:08.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.256+0000 7f94891cc640 1 --2- 172.21.15.40:0/2833128505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f946c004800 0x7f946c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:08.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.256+0000 7f94899cd640 1 --2- 172.21.15.40:0/2833128505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f946c0039b0 0x7f946c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:08.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.256+0000 7f948a1ce640 1 --2- 172.21.15.40:0/2833128505 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9484158470 0x7f946c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:08.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.256+0000 7f94891cc640 1 -- 172.21.15.40:0/2833128505 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9484158470 msgr2=0x7f946c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:08.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.256+0000 7f94891cc640 1 --2- 172.21.15.40:0/2833128505 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9484158470 0x7f946c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.256+0000 7f94891cc640 1 -- 172.21.15.40:0/2833128505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f946c0039b0 msgr2=0x7f946c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:08.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.256+0000 7f94891cc640 1 --2- 172.21.15.40:0/2833128505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f946c0039b0 0x7f946c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.256+0000 7f94891cc640 1 -- 172.21.15.40:0/2833128505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f946c003520 con 0x7f946c004800 2024-04-22T07:21:08.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.257+0000 7f94891cc640 1 --2- 172.21.15.40:0/2833128505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f946c004800 0x7f946c004c80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9478009ac0 tx=0x7f946c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9d9b440c056be8 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:08.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.257+0000 7f94889cb640 1 -- 172.21.15.40:0/2833128505 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9478039070 con 0x7f946c004800 2024-04-22T07:21:08.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.257+0000 7f94889cb640 1 -- 172.21.15.40:0/2833128505 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f947802c710 con 0x7f946c004800 2024-04-22T07:21:08.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.257+0000 7f94889cb640 1 -- 172.21.15.40:0/2833128505 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9478009690 con 0x7f946c004800 2024-04-22T07:21:08.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.258+0000 7f948bc31640 1 -- 172.21.15.40:0/2833128505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f946c004800 msgr2=0x7f946c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:08.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.258+0000 7f948bc31640 1 --2- 172.21.15.40:0/2833128505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f946c004800 0x7f946c004c80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9478009ac0 tx=0x7f946c005830 comp rx=0 tx=0).stop 2024-04-22T07:21:08.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.258+0000 7f948a1ce640 1 -- 172.21.15.40:0/2833128505 reap_dead start 2024-04-22T07:21:08.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.258+0000 7f948bc31640 1 -- 172.21.15.40:0/2833128505 shutdown_connections 2024-04-22T07:21:08.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.258+0000 7f948bc31640 1 -- 172.21.15.40:0/2833128505 >> 172.21.15.40:0/2833128505 conn(0x7f948406db30 msgr2=0x7f948406df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:08.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.258+0000 7f948bc31640 1 -- 172.21.15.40:0/2833128505 shutdown_connections 2024-04-22T07:21:08.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.258+0000 7f948bc31640 1 -- 172.21.15.40:0/2833128505 wait complete. 2024-04-22T07:21:08.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.259+0000 7f948bc31640 1 Processor -- start 2024-04-22T07:21:08.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.259+0000 7f948bc31640 1 -- start start 2024-04-22T07:21:08.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.260+0000 7f948bc31640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f946c004800 0x7f948415d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:08.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.260+0000 7f948bc31640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94841f0550 0x7f94840afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:08.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.260+0000 7f948bc31640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94840b06d0 0x7f9484151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:08.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.260+0000 7f948bc31640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f948415bc30 con 0x7f94841f0550 2024-04-22T07:21:08.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.260+0000 7f948bc31640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f948415ada0 con 0x7f946c004800 2024-04-22T07:21:08.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.260+0000 7f948bc31640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f94840c8f70 con 0x7f94840b06d0 2024-04-22T07:21:08.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.260+0000 7f94891cc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94841f0550 0x7f94840afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:08.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.260+0000 7f94891cc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94841f0550 0x7f94840afbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42604/0 (socket says 172.21.15.40:42604) 2024-04-22T07:21:08.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.260+0000 7f94891cc640 1 -- 172.21.15.40:0/1231886473 learned_addr learned my addr 172.21.15.40:0/1231886473 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:08.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.260+0000 7f94891cc640 1 -- 172.21.15.40:0/1231886473 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94840b06d0 msgr2=0x7f9484151f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:08.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.260+0000 7f94891cc640 1 --2- 172.21.15.40:0/1231886473 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94840b06d0 0x7f9484151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.260+0000 7f94891cc640 1 -- 172.21.15.40:0/1231886473 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f946c004800 msgr2=0x7f948415d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:08.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.260+0000 7f94891cc640 1 --2- 172.21.15.40:0/1231886473 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f946c004800 0x7f948415d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.260+0000 7f94891cc640 1 -- 172.21.15.40:0/1231886473 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94840aeb30 con 0x7f94841f0550 2024-04-22T07:21:08.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.260+0000 7f94891cc640 1 --2- 172.21.15.40:0/1231886473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94841f0550 0x7f94840afbd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9478000c00 tx=0x7f9478004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:08.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.260+0000 7f94827fc640 1 -- 172.21.15.40:0/1231886473 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9478039050 con 0x7f94841f0550 2024-04-22T07:21:08.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.260+0000 7f94827fc640 1 -- 172.21.15.40:0/1231886473 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9478045070 con 0x7f94841f0550 2024-04-22T07:21:08.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.260+0000 7f948bc31640 1 -- 172.21.15.40:0/1231886473 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94840aee10 con 0x7f94841f0550 2024-04-22T07:21:08.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.260+0000 7f94827fc640 1 -- 172.21.15.40:0/1231886473 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94780044e0 con 0x7f94841f0550 2024-04-22T07:21:08.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.261+0000 7f948bc31640 1 -- 172.21.15.40:0/1231886473 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94840af3d0 con 0x7f94841f0550 2024-04-22T07:21:08.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.262+0000 7f948bc31640 1 -- 172.21.15.40:0/1231886473 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9484068b20 con 0x7f94841f0550 2024-04-22T07:21:08.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.262+0000 7f94827fc640 1 -- 172.21.15.40:0/1231886473 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9478003a50 con 0x7f94841f0550 2024-04-22T07:21:08.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.262+0000 7f94827fc640 1 --2- 172.21.15.40:0/1231886473 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f947006c8f0 0x7f947006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:08.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.263+0000 7f94827fc640 1 -- 172.21.15.40:0/1231886473 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f94780ad6d0 con 0x7f94841f0550 2024-04-22T07:21:08.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.263+0000 7f94899cd640 1 --2- 172.21.15.40:0/1231886473 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f947006c8f0 0x7f947006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:08.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.263+0000 7f94899cd640 1 --2- 172.21.15.40:0/1231886473 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f947006c8f0 0x7f947006edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f947c0099e0 tx=0x7f947c006c30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:08.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.267+0000 7f94827fc640 1 -- 172.21.15.40:0/1231886473 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f947804e020 con 0x7f94841f0550 2024-04-22T07:21:08.306 INFO:tasks.ceph.mds.b.smithi062.stderr:2024-04-22T07:21:08.308+0000 7f482a85c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-22T07:21:08.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.492+0000 7f948bc31640 1 -- 172.21.15.40:0/1231886473 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f948406bca0 con 0x7f94841f0550 2024-04-22T07:21:08.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.492+0000 7f94827fc640 1 -- 172.21.15.40:0/1231886473 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f947807bb90 con 0x7f94841f0550 2024-04-22T07:21:08.489 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:21:08.489 INFO:teuthology.orchestra.run.smithi040.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-22T07:21:08.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.494+0000 7f948bc31640 1 -- 172.21.15.40:0/1231886473 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f947006c8f0 msgr2=0x7f947006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:08.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.494+0000 7f948bc31640 1 --2- 172.21.15.40:0/1231886473 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f947006c8f0 0x7f947006edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f947c0099e0 tx=0x7f947c006c30 comp rx=0 tx=0).stop 2024-04-22T07:21:08.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.494+0000 7f948bc31640 1 -- 172.21.15.40:0/1231886473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94841f0550 msgr2=0x7f94840afbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:08.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.494+0000 7f948bc31640 1 --2- 172.21.15.40:0/1231886473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94841f0550 0x7f94840afbd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9478000c00 tx=0x7f9478004730 comp rx=0 tx=0).stop 2024-04-22T07:21:08.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.494+0000 7f948bc31640 1 -- 172.21.15.40:0/1231886473 shutdown_connections 2024-04-22T07:21:08.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.494+0000 7f948bc31640 1 --2- 172.21.15.40:0/1231886473 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94840b06d0 0x7f9484151f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.494+0000 7f948bc31640 1 --2- 172.21.15.40:0/1231886473 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f947006c8f0 0x7f947006edb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.494+0000 7f948bc31640 1 --2- 172.21.15.40:0/1231886473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94841f0550 0x7f94840afbd0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.494+0000 7f948bc31640 1 --2- 172.21.15.40:0/1231886473 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f946c004800 0x7f948415d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.494+0000 7f948bc31640 1 -- 172.21.15.40:0/1231886473 >> 172.21.15.40:0/1231886473 conn(0x7f948406db30 msgr2=0x7f94840c4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:08.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.494+0000 7f948bc31640 1 -- 172.21.15.40:0/1231886473 shutdown_connections 2024-04-22T07:21:08.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.494+0000 7f948bc31640 1 -- 172.21.15.40:0/1231886473 wait complete. 2024-04-22T07:21:08.502 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-22T07:21:08.503 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:21:08.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.607+0000 7ffbd2d52640 1 Processor -- start 2024-04-22T07:21:08.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.607+0000 7ffbd2d52640 1 -- start start 2024-04-22T07:21:08.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.608+0000 7ffbd2d52640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffbcc15ece0 0x7ffbcc0cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:08.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.608+0000 7ffbd2d52640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ffbcc15f0c0 0x7ffbcc0cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:08.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.608+0000 7ffbd2d52640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbcc0caa90 con 0x7ffbcc0c53d0 2024-04-22T07:21:08.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.608+0000 7ffbd2d52640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7ffbcc0c9940 con 0x7ffbcc15ece0 2024-04-22T07:21:08.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.608+0000 7ffbd2d52640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7ffbcc0c9c20 con 0x7ffbcc15f0c0 2024-04-22T07:21:08.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.608+0000 7ffbd0aee640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffbcc15ece0 0x7ffbcc0cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:08.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.608+0000 7ffbd0aee640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffbcc15ece0 0x7ffbcc0cd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42614/0 (socket says 172.21.15.40:42614) 2024-04-22T07:21:08.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.608+0000 7ffbd0aee640 1 -- 172.21.15.40:0/1792372616 learned_addr learned my addr 172.21.15.40:0/1792372616 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:08.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.608+0000 7ffbcbfff640 1 --2- 172.21.15.40:0/1792372616 >> v2:172.21.15.62:3300/0 conn(0x7ffbcc15f0c0 0x7ffbcc0cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:08.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.608+0000 7ffbd0aee640 1 -- 172.21.15.40:0/1792372616 >> v2:172.21.15.62:3300/0 conn(0x7ffbcc15f0c0 msgr2=0x7ffbcc0cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:08.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.608+0000 7ffbd0aee640 1 --2- 172.21.15.40:0/1792372616 >> v2:172.21.15.62:3300/0 conn(0x7ffbcc15f0c0 0x7ffbcc0cea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.608+0000 7ffbd0aee640 1 -- 172.21.15.40:0/1792372616 >> v1:172.21.15.62:6789/0 conn(0x7ffbcc0c53d0 legacy=0x7ffbcc0cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:08.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.608+0000 7ffbd0aee640 1 -- 172.21.15.40:0/1792372616 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbcc0c9f00 con 0x7ffbcc15ece0 2024-04-22T07:21:08.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.609+0000 7ffbd0aee640 1 --2- 172.21.15.40:0/1792372616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbcc15ece0 0x7ffbcc0cd7f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0714e0 tx=0x7ffbc002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a2d548d2381827 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:08.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.609+0000 7ffbcb7fe640 1 -- 172.21.15.40:0/1792372616 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc002f850 con 0x7ffbcc15ece0 2024-04-22T07:21:08.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.609+0000 7ffbcb7fe640 1 -- 172.21.15.40:0/1792372616 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbc002f9f0 con 0x7ffbcc15ece0 2024-04-22T07:21:08.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.609+0000 7ffbcb7fe640 1 -- 172.21.15.40:0/1792372616 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc002fdc0 con 0x7ffbcc15ece0 2024-04-22T07:21:08.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.610+0000 7ffbd2d52640 1 -- 172.21.15.40:0/1792372616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbcc15ece0 msgr2=0x7ffbcc0cd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:08.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.610+0000 7ffbd2d52640 1 --2- 172.21.15.40:0/1792372616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbcc15ece0 0x7ffbcc0cd7f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0714e0 tx=0x7ffbc002ba30 comp rx=0 tx=0).stop 2024-04-22T07:21:08.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.610+0000 7ffbd2d52640 1 -- 172.21.15.40:0/1792372616 shutdown_connections 2024-04-22T07:21:08.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.610+0000 7ffbd2d52640 1 --2- 172.21.15.40:0/1792372616 >> v2:172.21.15.62:3300/0 conn(0x7ffbcc15f0c0 0x7ffbcc0cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.610+0000 7ffbd2d52640 1 --2- 172.21.15.40:0/1792372616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbcc15ece0 0x7ffbcc0cd7f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.610+0000 7ffbd2d52640 1 -- 172.21.15.40:0/1792372616 >> 172.21.15.40:0/1792372616 conn(0x7ffbcc06df50 msgr2=0x7ffbcc06e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:08.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.610+0000 7ffbd2d52640 1 -- 172.21.15.40:0/1792372616 shutdown_connections 2024-04-22T07:21:08.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.610+0000 7ffbd2d52640 1 -- 172.21.15.40:0/1792372616 wait complete. 2024-04-22T07:21:08.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.611+0000 7ffbd2d52640 1 Processor -- start 2024-04-22T07:21:08.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.611+0000 7ffbd2d52640 1 -- start start 2024-04-22T07:21:08.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.612+0000 7ffbd2d52640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffbcc0c53d0 0x7ffbcc06eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:08.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.612+0000 7ffbd2d52640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbcc15ece0 0x7ffbcc0cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:08.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.612+0000 7ffbd2d52640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffbcc15f0c0 0x7ffbcc155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:08.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.612+0000 7ffbd2d52640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc15e570 con 0x7ffbcc15ece0 2024-04-22T07:21:08.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.612+0000 7ffbd2d52640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc15e3f0 con 0x7ffbcc15f0c0 2024-04-22T07:21:08.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.612+0000 7ffbd2d52640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ffbcc0c8fe0 con 0x7ffbcc0c53d0 2024-04-22T07:21:08.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.612+0000 7ffbcbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbcc15ece0 0x7ffbcc0cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:08.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.612+0000 7ffbcbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbcc15ece0 0x7ffbcc0cecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42616/0 (socket says 172.21.15.40:42616) 2024-04-22T07:21:08.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.612+0000 7ffbcbfff640 1 -- 172.21.15.40:0/2532104852 learned_addr learned my addr 172.21.15.40:0/2532104852 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:08.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.612+0000 7ffbd0aee640 1 --2- 172.21.15.40:0/2532104852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffbcc0c53d0 0x7ffbcc06eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:08.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.612+0000 7ffbd12ef640 1 --2- 172.21.15.40:0/2532104852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffbcc15f0c0 0x7ffbcc155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:08.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.612+0000 7ffbcbfff640 1 -- 172.21.15.40:0/2532104852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffbcc0c53d0 msgr2=0x7ffbcc06eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:08.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.612+0000 7ffbcbfff640 1 --2- 172.21.15.40:0/2532104852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffbcc0c53d0 0x7ffbcc06eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.612+0000 7ffbcbfff640 1 -- 172.21.15.40:0/2532104852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffbcc15f0c0 msgr2=0x7ffbcc155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:08.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.612+0000 7ffbcbfff640 1 --2- 172.21.15.40:0/2532104852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffbcc15f0c0 0x7ffbcc155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.612+0000 7ffbcbfff640 1 -- 172.21.15.40:0/2532104852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbcc06f530 con 0x7ffbcc15ece0 2024-04-22T07:21:08.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.612+0000 7ffbcbfff640 1 --2- 172.21.15.40:0/2532104852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbcc15ece0 0x7ffbcc0cecf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800e8a0 tx=0x7ffbb800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:08.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.612+0000 7ffbc97fa640 1 -- 172.21.15.40:0/2532104852 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8017070 con 0x7ffbcc15ece0 2024-04-22T07:21:08.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.612+0000 7ffbc97fa640 1 -- 172.21.15.40:0/2532104852 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb800c940 con 0x7ffbcc15ece0 2024-04-22T07:21:08.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.612+0000 7ffbd2d52640 1 -- 172.21.15.40:0/2532104852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbcc15c180 con 0x7ffbcc15ece0 2024-04-22T07:21:08.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.612+0000 7ffbc97fa640 1 -- 172.21.15.40:0/2532104852 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb800cd30 con 0x7ffbcc15ece0 2024-04-22T07:21:08.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.613+0000 7ffbd2d52640 1 -- 172.21.15.40:0/2532104852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbcc15dbc0 con 0x7ffbcc15ece0 2024-04-22T07:21:08.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.613+0000 7ffbd2d52640 1 -- 172.21.15.40:0/2532104852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbcc0b0c30 con 0x7ffbcc15ece0 2024-04-22T07:21:08.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.614+0000 7ffbc97fa640 1 -- 172.21.15.40:0/2532104852 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffbb801a070 con 0x7ffbcc15ece0 2024-04-22T07:21:08.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.614+0000 7ffbc97fa640 1 --2- 172.21.15.40:0/2532104852 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ffbb006c8f0 0x7ffbb006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:08.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.614+0000 7ffbc97fa640 1 -- 172.21.15.40:0/2532104852 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ffbb808bd70 con 0x7ffbcc15ece0 2024-04-22T07:21:08.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.614+0000 7ffbd0aee640 1 --2- 172.21.15.40:0/2532104852 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ffbb006c8f0 0x7ffbb006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:08.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.615+0000 7ffbd0aee640 1 --2- 172.21.15.40:0/2532104852 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ffbb006c8f0 0x7ffbb006edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0036000 tx=0x7ffbc0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:08.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.619+0000 7ffbc97fa640 1 -- 172.21.15.40:0/2532104852 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffbb8059ac0 con 0x7ffbcc15ece0 2024-04-22T07:21:08.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.804+0000 7ffbd2d52640 1 -- 172.21.15.40:0/2532104852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffbcc0cdb10 con 0x7ffbcc15ece0 2024-04-22T07:21:08.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.805+0000 7ffbc97fa640 1 -- 172.21.15.40:0/2532104852 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16537 (secure 0 0 0) 0x7ffbb805ddc0 con 0x7ffbcc15ece0 2024-04-22T07:21:08.802 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:21:08.803 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":23,"fsid":"dd5b16e4-89fe-4602-b37f-062846793158","created":"2024-04-22T07:20:29.488892+0000","modified":"2024-04-22T07:20:54.858120+0000","last_up_change":"2024-04-22T07:20:40.397383+0000","last_in_change":"2024-04-22T07:20:31.702551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:20:41.793179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:20:51.815779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:20:52.164265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32238b7e-228b-4a67-bfca-16e8f0020a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6801","nonce":1526385055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6803","nonce":1526385055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6807","nonce":1526385055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6805","nonce":1526385055}]},"public_addr":"172.21.15.40:6801/1526385055","cluster_addr":"172.21.15.40:6803/1526385055","heartbeat_back_addr":"172.21.15.40:6807/1526385055","heartbeat_front_addr":"172.21.15.40:6805/1526385055","state":["exists","up"]},{"osd":1,"uuid":"5ad8da43-39b1-4295-b4d1-0f1e1d06fc0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6809","nonce":623026645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6811","nonce":623026645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6815","nonce":623026645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6813","nonce":623026645}]},"public_addr":"172.21.15.40:6809/623026645","cluster_addr":"172.21.15.40:6811/623026645","heartbeat_back_addr":"172.21.15.40:6815/623026645","heartbeat_front_addr":"172.21.15.40:6813/623026645","state":["exists","up"]},{"osd":2,"uuid":"7d2c6d50-719d-4232-ad47-f04dcf1a8bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6820","nonce":1885686505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6824","nonce":1885686505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6831","nonce":1885686505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6828","nonce":1885686505}]},"public_addr":"172.21.15.40:6820/1885686505","cluster_addr":"172.21.15.40:6824/1885686505","heartbeat_back_addr":"172.21.15.40:6831/1885686505","heartbeat_front_addr":"172.21.15.40:6828/1885686505","state":["exists","up"]},{"osd":3,"uuid":"af42e7d6-a6bf-403e-92e7-162d7c4fbf0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6817","nonce":130276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6819","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6821","nonce":130276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6829","nonce":130276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6823","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6825","nonce":130276746}]},"public_addr":"172.21.15.40:6817/130276746","cluster_addr":"172.21.15.40:6821/130276746","heartbeat_back_addr":"172.21.15.40:6829/130276746","heartbeat_front_addr":"172.21.15.40:6825/130276746","state":["exists","up"]},{"osd":4,"uuid":"f8e89e0d-be96-4f19-88c0-69c408df7d98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6801","nonce":2251435758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6803","nonce":2251435758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6807","nonce":2251435758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6805","nonce":2251435758}]},"public_addr":"172.21.15.62:6801/2251435758","cluster_addr":"172.21.15.62:6803/2251435758","heartbeat_back_addr":"172.21.15.62:6807/2251435758","heartbeat_front_addr":"172.21.15.62:6805/2251435758","state":["exists","up"]},{"osd":5,"uuid":"ba6dc1bc-272b-4f80-b55f-40bc4a0c3ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6809","nonce":3509322231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6811","nonce":3509322231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6815","nonce":3509322231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6813","nonce":3509322231}]},"public_addr":"172.21.15.62:6809/3509322231","cluster_addr":"172.21.15.62:6811/3509322231","heartbeat_back_addr":"172.21.15.62:6815/3509322231","heartbeat_front_addr":"172.21.15.62:6813/3509322231","state":["exists","up"]},{"osd":6,"uuid":"834fcd74-14bf-45ec-a10a-0374f4ce9bf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6825","nonce":3094315954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6827","nonce":3094315954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6831","nonce":3094315954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6829","nonce":3094315954}]},"public_addr":"172.21.15.62:6825/3094315954","cluster_addr":"172.21.15.62:6827/3094315954","heartbeat_back_addr":"172.21.15.62:6831/3094315954","heartbeat_front_addr":"172.21.15.62:6829/3094315954","state":["exists","up"]},{"osd":7,"uuid":"831c9a73-960e-4d2e-b86a-33a6916be059","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6817","nonce":147453972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6819","nonce":147453972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6823","nonce":147453972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6821","nonce":147453972}]},"public_addr":"172.21.15.62:6817/147453972","cluster_addr":"172.21.15.62:6819/147453972","heartbeat_back_addr":"172.21.15.62:6823/147453972","heartbeat_front_addr":"172.21.15.62:6821/147453972","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.828738+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.873471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.908090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.894782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:37.686796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.801123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.852323+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.812139+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:21:08.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.807+0000 7ffbd2d52640 1 -- 172.21.15.40:0/2532104852 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ffbb006c8f0 msgr2=0x7ffbb006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:08.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.807+0000 7ffbd2d52640 1 --2- 172.21.15.40:0/2532104852 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ffbb006c8f0 0x7ffbb006edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0036000 tx=0x7ffbc0008030 comp rx=0 tx=0).stop 2024-04-22T07:21:08.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.807+0000 7ffbd2d52640 1 -- 172.21.15.40:0/2532104852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbcc15ece0 msgr2=0x7ffbcc0cecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:08.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.807+0000 7ffbd2d52640 1 --2- 172.21.15.40:0/2532104852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbcc15ece0 0x7ffbcc0cecf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800e8a0 tx=0x7ffbb800ed60 comp rx=0 tx=0).stop 2024-04-22T07:21:08.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.807+0000 7ffbd2d52640 1 -- 172.21.15.40:0/2532104852 shutdown_connections 2024-04-22T07:21:08.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.807+0000 7ffbd2d52640 1 --2- 172.21.15.40:0/2532104852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffbcc15f0c0 0x7ffbcc155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.807+0000 7ffbd2d52640 1 --2- 172.21.15.40:0/2532104852 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ffbb006c8f0 0x7ffbb006edb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.807+0000 7ffbd2d52640 1 --2- 172.21.15.40:0/2532104852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbcc15ece0 0x7ffbcc0cecf0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.807+0000 7ffbd2d52640 1 --2- 172.21.15.40:0/2532104852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffbcc0c53d0 0x7ffbcc06eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.807+0000 7ffbd2d52640 1 -- 172.21.15.40:0/2532104852 >> 172.21.15.40:0/2532104852 conn(0x7ffbcc06df50 msgr2=0x7ffbcc156f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:08.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.807+0000 7ffbd2d52640 1 -- 172.21.15.40:0/2532104852 shutdown_connections 2024-04-22T07:21:08.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.807+0000 7ffbd2d52640 1 -- 172.21.15.40:0/2532104852 wait complete. 2024-04-22T07:21:08.815 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T07:20:41.793179+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-22T07:20:51.815779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-22T07:20:52.164265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-22T07:21:08.816 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T07:21:08.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.924+0000 7f44834c0640 1 Processor -- start 2024-04-22T07:21:08.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.924+0000 7f44834c0640 1 -- start start 2024-04-22T07:21:08.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.925+0000 7f44834c0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f447c1550f0 0x7f447c15ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:08.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.925+0000 7f44834c0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f447c0cb5b0 0x7f447c0cba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:08.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.925+0000 7f44834c0640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f447c0cd040 0x7f447c0cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:08.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.925+0000 7f44834c0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f447c15afd0 con 0x7f447c0cb5b0 2024-04-22T07:21:08.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.925+0000 7f44834c0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f447c15b290 con 0x7f447c1550f0 2024-04-22T07:21:08.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.925+0000 7f44834c0640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f447c15b570 con 0x7f447c0cd040 2024-04-22T07:21:08.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.925+0000 7f4480a5b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f447c0cb5b0 0x7f447c0cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.925+0000 7f4480a5b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f447c0cb5b0 0x7f447c0cba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42630/0 (socket says 172.21.15.40:42630) 2024-04-22T07:21:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.925+0000 7f4480a5b640 1 -- 172.21.15.40:0/3635553632 learned_addr learned my addr 172.21.15.40:0/3635553632 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.925+0000 7f448125c640 1 --2- 172.21.15.40:0/3635553632 >> v2:172.21.15.62:3300/0 conn(0x7f447c1550f0 0x7f447c15ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.925+0000 7f4481a5d640 1 --2- 172.21.15.40:0/3635553632 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f447c0cd040 0x7f447c0cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.925+0000 7f4480a5b640 1 -- 172.21.15.40:0/3635553632 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f447c0cd040 msgr2=0x7f447c0cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.925+0000 7f4480a5b640 1 --2- 172.21.15.40:0/3635553632 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f447c0cd040 0x7f447c0cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.926+0000 7f4480a5b640 1 -- 172.21.15.40:0/3635553632 >> v2:172.21.15.62:3300/0 conn(0x7f447c1550f0 msgr2=0x7f447c15ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.926+0000 7f4480a5b640 1 --2- 172.21.15.40:0/3635553632 >> v2:172.21.15.62:3300/0 conn(0x7f447c1550f0 0x7f447c15ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.926+0000 7f4480a5b640 1 -- 172.21.15.40:0/3635553632 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f447c15b850 con 0x7f447c0cb5b0 2024-04-22T07:21:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.926+0000 7f4480a5b640 1 --2- 172.21.15.40:0/3635553632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f447c0cb5b0 0x7f447c0cba00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f447c06c8d0 tx=0x7f446c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc9fe6f0f969770c server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.926+0000 7f4473fff640 1 -- 172.21.15.40:0/3635553632 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446c02e070 con 0x7f447c0cb5b0 2024-04-22T07:21:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.926+0000 7f4473fff640 1 -- 172.21.15.40:0/3635553632 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f446c037070 con 0x7f447c0cb5b0 2024-04-22T07:21:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.926+0000 7f4473fff640 1 -- 172.21.15.40:0/3635553632 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446c031a00 con 0x7f447c0cb5b0 2024-04-22T07:21:08.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.927+0000 7f44834c0640 1 -- 172.21.15.40:0/3635553632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f447c0cb5b0 msgr2=0x7f447c0cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:08.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.927+0000 7f44834c0640 1 --2- 172.21.15.40:0/3635553632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f447c0cb5b0 0x7f447c0cba00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f447c06c8d0 tx=0x7f446c02b880 comp rx=0 tx=0).stop 2024-04-22T07:21:08.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.927+0000 7f44834c0640 1 -- 172.21.15.40:0/3635553632 shutdown_connections 2024-04-22T07:21:08.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.927+0000 7f44834c0640 1 --2- 172.21.15.40:0/3635553632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f447c0cb5b0 0x7f447c0cba00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.927+0000 7f44834c0640 1 --2- 172.21.15.40:0/3635553632 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f447c0cd040 0x7f447c0cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.927+0000 7f44834c0640 1 --2- 172.21.15.40:0/3635553632 >> v2:172.21.15.62:3300/0 conn(0x7f447c1550f0 0x7f447c15ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.927+0000 7f44834c0640 1 -- 172.21.15.40:0/3635553632 >> 172.21.15.40:0/3635553632 conn(0x7f447c06b920 msgr2=0x7f447c06bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:08.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.927+0000 7f44834c0640 1 -- 172.21.15.40:0/3635553632 shutdown_connections 2024-04-22T07:21:08.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.927+0000 7f44834c0640 1 -- 172.21.15.40:0/3635553632 wait complete. 2024-04-22T07:21:08.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.928+0000 7f44834c0640 1 Processor -- start 2024-04-22T07:21:08.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.928+0000 7f44834c0640 1 -- start start 2024-04-22T07:21:08.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.929+0000 7f44834c0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f447c0cb5b0 0x7f447c072630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:08.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.929+0000 7f44834c0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f447c0cd040 0x7f447c0b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:08.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.929+0000 7f44834c0640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f447c1550f0 0x7f447c0b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:08.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.929+0000 7f44834c0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f447c0c5630 con 0x7f447c0cd040 2024-04-22T07:21:08.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.929+0000 7f44834c0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f447c1554d0 con 0x7f447c0cb5b0 2024-04-22T07:21:08.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.929+0000 7f44834c0640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f447c0c57b0 con 0x7f447c1550f0 2024-04-22T07:21:08.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.929+0000 7f4480a5b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f447c0cd040 0x7f447c0b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:08.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.929+0000 7f4480a5b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f447c0cd040 0x7f447c0b4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42638/0 (socket says 172.21.15.40:42638) 2024-04-22T07:21:08.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.929+0000 7f4480a5b640 1 -- 172.21.15.40:0/2524251079 learned_addr learned my addr 172.21.15.40:0/2524251079 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:08.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.929+0000 7f4481a5d640 1 --2- 172.21.15.40:0/2524251079 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f447c1550f0 0x7f447c0b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:08.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.929+0000 7f448125c640 1 --2- 172.21.15.40:0/2524251079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f447c0cb5b0 0x7f447c072630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:08.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.929+0000 7f4480a5b640 1 -- 172.21.15.40:0/2524251079 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f447c1550f0 msgr2=0x7f447c0b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:08.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.929+0000 7f4480a5b640 1 --2- 172.21.15.40:0/2524251079 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f447c1550f0 0x7f447c0b52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.929+0000 7f4480a5b640 1 -- 172.21.15.40:0/2524251079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f447c0cb5b0 msgr2=0x7f447c072630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:08.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.929+0000 7f4480a5b640 1 --2- 172.21.15.40:0/2524251079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f447c0cb5b0 0x7f447c072630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:08.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.929+0000 7f4480a5b640 1 -- 172.21.15.40:0/2524251079 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f447c151400 con 0x7f447c0cd040 2024-04-22T07:21:08.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.929+0000 7f4481a5d640 1 --2- 172.21.15.40:0/2524251079 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f447c1550f0 0x7f447c0b52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:08.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.930+0000 7f4480a5b640 1 --2- 172.21.15.40:0/2524251079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f447c0cd040 0x7f447c0b4d80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f446c02b8c0 tx=0x7f446c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:08.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.930+0000 7f4471ffb640 1 -- 172.21.15.40:0/2524251079 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446c032880 con 0x7f447c0cd040 2024-04-22T07:21:08.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.930+0000 7f4471ffb640 1 -- 172.21.15.40:0/2524251079 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f446c032a40 con 0x7f447c0cd040 2024-04-22T07:21:08.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.930+0000 7f44834c0640 1 -- 172.21.15.40:0/2524251079 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f447c1f14a0 con 0x7f447c0cd040 2024-04-22T07:21:08.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.930+0000 7f4471ffb640 1 -- 172.21.15.40:0/2524251079 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446c032e30 con 0x7f447c0cd040 2024-04-22T07:21:08.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.930+0000 7f44834c0640 1 -- 172.21.15.40:0/2524251079 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f447c1f1760 con 0x7f447c0cd040 2024-04-22T07:21:08.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.931+0000 7f44834c0640 1 -- 172.21.15.40:0/2524251079 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f447c069d40 con 0x7f447c0cd040 2024-04-22T07:21:08.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.932+0000 7f4471ffb640 1 -- 172.21.15.40:0/2524251079 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f446c0453f0 con 0x7f447c0cd040 2024-04-22T07:21:08.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.932+0000 7f4471ffb640 1 --2- 172.21.15.40:0/2524251079 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f446006c920 0x7f446006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:08.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.932+0000 7f4471ffb640 1 -- 172.21.15.40:0/2524251079 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f446c0ad830 con 0x7f447c0cd040 2024-04-22T07:21:08.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.932+0000 7f448125c640 1 --2- 172.21.15.40:0/2524251079 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f446006c920 0x7f446006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:08.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.932+0000 7f448125c640 1 --2- 172.21.15.40:0/2524251079 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f446006c920 0x7f446006ede0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f44780039e0 tx=0x7f4478009830 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:08.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:08.936+0000 7f4471ffb640 1 -- 172.21.15.40:0/2524251079 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f447c069d40 con 0x7f447c0cd040 2024-04-22T07:21:09.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.119+0000 7f44834c0640 1 -- 172.21.15.40:0/2524251079 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f447c1f2420 con 0x7f447c0cd040 2024-04-22T07:21:09.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.120+0000 7f4471ffb640 1 -- 172.21.15.40:0/2524251079 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f447c1f2420 con 0x7f447c0cd040 2024-04-22T07:21:09.117 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-04-22T07:21:09.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.121+0000 7f44834c0640 1 -- 172.21.15.40:0/2524251079 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f446006c920 msgr2=0x7f446006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:09.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.121+0000 7f44834c0640 1 --2- 172.21.15.40:0/2524251079 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f446006c920 0x7f446006ede0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f44780039e0 tx=0x7f4478009830 comp rx=0 tx=0).stop 2024-04-22T07:21:09.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.121+0000 7f44834c0640 1 -- 172.21.15.40:0/2524251079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f447c0cd040 msgr2=0x7f447c0b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:09.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.121+0000 7f44834c0640 1 --2- 172.21.15.40:0/2524251079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f447c0cd040 0x7f447c0b4d80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f446c02b8c0 tx=0x7f446c0046c0 comp rx=0 tx=0).stop 2024-04-22T07:21:09.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.122+0000 7f44834c0640 1 -- 172.21.15.40:0/2524251079 shutdown_connections 2024-04-22T07:21:09.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.122+0000 7f44834c0640 1 --2- 172.21.15.40:0/2524251079 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f447c1550f0 0x7f447c0b52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:09.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.122+0000 7f44834c0640 1 --2- 172.21.15.40:0/2524251079 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f446006c920 0x7f446006ede0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:09.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.122+0000 7f44834c0640 1 --2- 172.21.15.40:0/2524251079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f447c0cd040 0x7f447c0b4d80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:09.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.122+0000 7f44834c0640 1 --2- 172.21.15.40:0/2524251079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f447c0cb5b0 0x7f447c072630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:09.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.122+0000 7f44834c0640 1 -- 172.21.15.40:0/2524251079 >> 172.21.15.40:0/2524251079 conn(0x7f447c06b920 msgr2=0x7f447c152e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:09.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.122+0000 7f44834c0640 1 -- 172.21.15.40:0/2524251079 shutdown_connections 2024-04-22T07:21:09.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.122+0000 7f44834c0640 1 -- 172.21.15.40:0/2524251079 wait complete. 2024-04-22T07:21:09.130 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-22T07:21:09.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.237+0000 7fbba3c43640 1 Processor -- start 2024-04-22T07:21:09.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.237+0000 7fbba3c43640 1 -- start start 2024-04-22T07:21:09.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.238+0000 7fbba3c43640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbb9c06fd10 0x7fbb9c0c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:09.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.238+0000 7fbba3c43640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbb9c06b920 0x7fbb9c15b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:09.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.238+0000 7fbba3c43640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb9c0c9520 con 0x7fbb9c0c3e40 2024-04-22T07:21:09.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.238+0000 7fbba3c43640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fbb9c15b370 con 0x7fbb9c06fd10 2024-04-22T07:21:09.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.238+0000 7fbba3c43640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fbb9c0700f0 con 0x7fbb9c06b920 2024-04-22T07:21:09.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.238+0000 7fbba19df640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbb9c06fd10 0x7fbb9c0c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:09.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.238+0000 7fbba19df640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbb9c06fd10 0x7fbb9c0c8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42644/0 (socket says 172.21.15.40:42644) 2024-04-22T07:21:09.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.238+0000 7fbba19df640 1 -- 172.21.15.40:0/1392111191 learned_addr learned my addr 172.21.15.40:0/1392111191 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:09.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.238+0000 7fbba11de640 1 --2- 172.21.15.40:0/1392111191 >> v2:172.21.15.62:3300/0 conn(0x7fbb9c06b920 0x7fbb9c15b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:09.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.238+0000 7fbba19df640 1 -- 172.21.15.40:0/1392111191 >> v2:172.21.15.62:3300/0 conn(0x7fbb9c06b920 msgr2=0x7fbb9c15b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:09.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.238+0000 7fbba19df640 1 --2- 172.21.15.40:0/1392111191 >> v2:172.21.15.62:3300/0 conn(0x7fbb9c06b920 0x7fbb9c15b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:09.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.238+0000 7fbba19df640 1 -- 172.21.15.40:0/1392111191 >> v1:172.21.15.62:6789/0 conn(0x7fbb9c0c3e40 legacy=0x7fbb9c15e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:09.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.238+0000 7fbba19df640 1 -- 172.21.15.40:0/1392111191 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb9c06c500 con 0x7fbb9c06fd10 2024-04-22T07:21:09.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.239+0000 7fbba19df640 1 --2- 172.21.15.40:0/1392111191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb9c06fd10 0x7fbb9c0c8fe0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c068340 tx=0x7fbb9802ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8295443c250666 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:09.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.239+0000 7fbba09dd640 1 -- 172.21.15.40:0/1392111191 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9802f850 con 0x7fbb9c06fd10 2024-04-22T07:21:09.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.239+0000 7fbba09dd640 1 -- 172.21.15.40:0/1392111191 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb9802f9f0 con 0x7fbb9c06fd10 2024-04-22T07:21:09.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.239+0000 7fbba09dd640 1 -- 172.21.15.40:0/1392111191 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9802fdc0 con 0x7fbb9c06fd10 2024-04-22T07:21:09.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.240+0000 7fbba3c43640 1 -- 172.21.15.40:0/1392111191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb9c06fd10 msgr2=0x7fbb9c0c8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:09.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.240+0000 7fbba3c43640 1 --2- 172.21.15.40:0/1392111191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb9c06fd10 0x7fbb9c0c8fe0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c068340 tx=0x7fbb9802ba30 comp rx=0 tx=0).stop 2024-04-22T07:21:09.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.240+0000 7fbba3c43640 1 -- 172.21.15.40:0/1392111191 shutdown_connections 2024-04-22T07:21:09.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.240+0000 7fbba3c43640 1 --2- 172.21.15.40:0/1392111191 >> v2:172.21.15.62:3300/0 conn(0x7fbb9c06b920 0x7fbb9c15b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:09.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.240+0000 7fbba3c43640 1 --2- 172.21.15.40:0/1392111191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb9c06fd10 0x7fbb9c0c8fe0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:09.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.240+0000 7fbba3c43640 1 -- 172.21.15.40:0/1392111191 >> 172.21.15.40:0/1392111191 conn(0x7fbb9c071530 msgr2=0x7fbb9c071910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:09.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.240+0000 7fbba3c43640 1 -- 172.21.15.40:0/1392111191 shutdown_connections 2024-04-22T07:21:09.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.240+0000 7fbba3c43640 1 -- 172.21.15.40:0/1392111191 wait complete. 2024-04-22T07:21:09.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.241+0000 7fbba3c43640 1 Processor -- start 2024-04-22T07:21:09.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.241+0000 7fbba3c43640 1 -- start start 2024-04-22T07:21:09.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.242+0000 7fbba3c43640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb9c06b920 0x7fbb9c158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:09.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.242+0000 7fbba3c43640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb9c06fd10 0x7fbb9c0ca060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:09.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.242+0000 7fbba3c43640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb9c0c3e40 0x7fbb9c1f0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:09.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.242+0000 7fbba3c43640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9c15b000 con 0x7fbb9c06fd10 2024-04-22T07:21:09.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.242+0000 7fbba3c43640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9c06cac0 con 0x7fbb9c06b920 2024-04-22T07:21:09.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.242+0000 7fbba3c43640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fbb9c06cda0 con 0x7fbb9c0c3e40 2024-04-22T07:21:09.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.242+0000 7fbba11de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb9c06fd10 0x7fbb9c0ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:09.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.242+0000 7fbba11de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb9c06fd10 0x7fbb9c0ca060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42660/0 (socket says 172.21.15.40:42660) 2024-04-22T07:21:09.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.242+0000 7fbba11de640 1 -- 172.21.15.40:0/3067448312 learned_addr learned my addr 172.21.15.40:0/3067448312 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:09.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.242+0000 7fbba19df640 1 --2- 172.21.15.40:0/3067448312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb9c06b920 0x7fbb9c158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:09.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.242+0000 7fbba21e0640 1 --2- 172.21.15.40:0/3067448312 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb9c0c3e40 0x7fbb9c1f0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:09.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.242+0000 7fbba11de640 1 -- 172.21.15.40:0/3067448312 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb9c0c3e40 msgr2=0x7fbb9c1f0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:09.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.242+0000 7fbba11de640 1 --2- 172.21.15.40:0/3067448312 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb9c0c3e40 0x7fbb9c1f0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:09.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.242+0000 7fbba11de640 1 -- 172.21.15.40:0/3067448312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb9c06b920 msgr2=0x7fbb9c158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:09.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.242+0000 7fbba11de640 1 --2- 172.21.15.40:0/3067448312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb9c06b920 0x7fbb9c158090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:09.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.242+0000 7fbba11de640 1 -- 172.21.15.40:0/3067448312 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb9c0af000 con 0x7fbb9c06fd10 2024-04-22T07:21:09.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.242+0000 7fbba11de640 1 --2- 172.21.15.40:0/3067448312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb9c06fd10 0x7fbb9c0ca060 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c00e9e0 tx=0x7fbb8c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:09.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.242+0000 7fbb927fc640 1 -- 172.21.15.40:0/3067448312 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c017070 con 0x7fbb9c06fd10 2024-04-22T07:21:09.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.242+0000 7fbb927fc640 1 -- 172.21.15.40:0/3067448312 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb8c00c9d0 con 0x7fbb9c06fd10 2024-04-22T07:21:09.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.242+0000 7fbba3c43640 1 -- 172.21.15.40:0/3067448312 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb9c0c7850 con 0x7fbb9c06fd10 2024-04-22T07:21:09.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.242+0000 7fbb927fc640 1 -- 172.21.15.40:0/3067448312 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c00cda0 con 0x7fbb9c06fd10 2024-04-22T07:21:09.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.243+0000 7fbba3c43640 1 -- 172.21.15.40:0/3067448312 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb9c0aed20 con 0x7fbb9c06fd10 2024-04-22T07:21:09.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.243+0000 7fbba3c43640 1 -- 172.21.15.40:0/3067448312 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb9c069550 con 0x7fbb9c06fd10 2024-04-22T07:21:09.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.244+0000 7fbb927fc640 1 -- 172.21.15.40:0/3067448312 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbb8c01a070 con 0x7fbb9c06fd10 2024-04-22T07:21:09.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.244+0000 7fbb927fc640 1 --2- 172.21.15.40:0/3067448312 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fbb8006c920 0x7fbb8006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:09.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.245+0000 7fbba19df640 1 --2- 172.21.15.40:0/3067448312 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fbb8006c920 0x7fbb8006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:09.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.245+0000 7fbb927fc640 1 -- 172.21.15.40:0/3067448312 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fbb8c08be10 con 0x7fbb9c06fd10 2024-04-22T07:21:09.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.245+0000 7fbba19df640 1 --2- 172.21.15.40:0/3067448312 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fbb8006c920 0x7fbb8006ede0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbb98036000 tx=0x7fbb98008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:09.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.249+0000 7fbb927fc640 1 -- 172.21.15.40:0/3067448312 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbb8c05a2d0 con 0x7fbb9c06fd10 2024-04-22T07:21:09.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.435+0000 7fbba3c43640 1 -- 172.21.15.40:0/3067448312 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbb9c0c9710 con 0x7fbb9c06fd10 2024-04-22T07:21:09.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.435+0000 7fbb927fc640 1 -- 172.21.15.40:0/3067448312 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7fbb8c059bd0 con 0x7fbb9c06fd10 2024-04-22T07:21:09.432 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-22T07:21:09.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.437+0000 7fbba3c43640 1 -- 172.21.15.40:0/3067448312 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fbb8006c920 msgr2=0x7fbb8006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:09.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.437+0000 7fbba3c43640 1 --2- 172.21.15.40:0/3067448312 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fbb8006c920 0x7fbb8006ede0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbb98036000 tx=0x7fbb98008030 comp rx=0 tx=0).stop 2024-04-22T07:21:09.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.437+0000 7fbba3c43640 1 -- 172.21.15.40:0/3067448312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb9c06fd10 msgr2=0x7fbb9c0ca060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:09.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.437+0000 7fbba3c43640 1 --2- 172.21.15.40:0/3067448312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb9c06fd10 0x7fbb9c0ca060 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c00e9e0 tx=0x7fbb8c00eea0 comp rx=0 tx=0).stop 2024-04-22T07:21:09.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.438+0000 7fbba3c43640 1 -- 172.21.15.40:0/3067448312 shutdown_connections 2024-04-22T07:21:09.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.438+0000 7fbba3c43640 1 --2- 172.21.15.40:0/3067448312 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb9c0c3e40 0x7fbb9c1f0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:09.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.438+0000 7fbba3c43640 1 --2- 172.21.15.40:0/3067448312 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fbb8006c920 0x7fbb8006ede0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:09.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.438+0000 7fbba3c43640 1 --2- 172.21.15.40:0/3067448312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb9c06fd10 0x7fbb9c0ca060 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:09.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.438+0000 7fbba3c43640 1 --2- 172.21.15.40:0/3067448312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb9c06b920 0x7fbb9c158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:09.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.438+0000 7fbba3c43640 1 -- 172.21.15.40:0/3067448312 >> 172.21.15.40:0/3067448312 conn(0x7fbb9c071530 msgr2=0x7fbb9c0caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:09.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.438+0000 7fbba3c43640 1 -- 172.21.15.40:0/3067448312 shutdown_connections 2024-04-22T07:21:09.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.438+0000 7fbba3c43640 1 -- 172.21.15.40:0/3067448312 wait complete. 2024-04-22T07:21:09.445 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-22T07:21:09.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.552+0000 7fb9283f4640 1 Processor -- start 2024-04-22T07:21:09.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.552+0000 7fb9283f4640 1 -- start start 2024-04-22T07:21:09.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.553+0000 7fb9283f4640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb920154fb0 0x7fb920072d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:09.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.553+0000 7fb9283f4640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9200ccd80 con 0x7fb9200caee0 2024-04-22T07:21:09.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.553+0000 7fb9283f4640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9200cc7e0 con 0x7fb9200d09f0 2024-04-22T07:21:09.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.553+0000 7fb9283f4640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb9200c5c50 con 0x7fb920154fb0 2024-04-22T07:21:09.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.553+0000 7fb92598f640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb9200caee0 0x7fb92015e2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33980/0 (socket says 172.21.15.40:33980) 2024-04-22T07:21:09.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.553+0000 7fb92598f640 1 -- 172.21.15.40:0/3545802654 learned_addr learned my addr 172.21.15.40:0/3545802654 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:09.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.553+0000 7fb926190640 1 --2- 172.21.15.40:0/3545802654 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb920154fb0 0x7fb920072d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:09.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.553+0000 7fb92518e640 1 -- 172.21.15.40:0/3545802654 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1268210450 0 0) 0x7fb9200ccd80 con 0x7fb9200caee0 2024-04-22T07:21:09.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.553+0000 7fb92518e640 1 -- 172.21.15.40:0/3545802654 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb90c003520 con 0x7fb9200caee0 2024-04-22T07:21:09.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.553+0000 7fb92518e640 1 -- 172.21.15.40:0/3545802654 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1596104114 0 0) 0x7fb9200cc7e0 con 0x7fb9200d09f0 2024-04-22T07:21:09.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.553+0000 7fb92518e640 1 -- 172.21.15.40:0/3545802654 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9200ccd80 con 0x7fb9200d09f0 2024-04-22T07:21:09.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.553+0000 7fb926190640 1 -- 172.21.15.40:0/3545802654 >> v1:172.21.15.62:6789/0 conn(0x7fb9200d09f0 legacy=0x7fb920165640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:09.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.553+0000 7fb926190640 1 -- 172.21.15.40:0/3545802654 >> v1:172.21.15.40:6789/0 conn(0x7fb9200caee0 legacy=0x7fb92015e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:09.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.553+0000 7fb92518e640 1 -- 172.21.15.40:0/3545802654 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1365541637 0 0) 0x7fb90c003520 con 0x7fb9200caee0 2024-04-22T07:21:09.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.553+0000 7fb926190640 1 -- 172.21.15.40:0/3545802654 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9200ccaa0 con 0x7fb920154fb0 2024-04-22T07:21:09.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.554+0000 7fb926190640 1 --2- 172.21.15.40:0/3545802654 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb920154fb0 0x7fb920072d40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0097d0 tx=0x7fb91c02b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3095f293c67a8feb server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:09.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.554+0000 7fb92518e640 1 -- 172.21.15.40:0/3545802654 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c037070 con 0x7fb920154fb0 2024-04-22T07:21:09.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.554+0000 7fb92518e640 1 -- 172.21.15.40:0/3545802654 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb91c030510 con 0x7fb920154fb0 2024-04-22T07:21:09.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.554+0000 7fb92518e640 1 -- 172.21.15.40:0/3545802654 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb910001670 con 0x7fb920154fb0 2024-04-22T07:21:09.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.555+0000 7fb9283f4640 1 -- 172.21.15.40:0/3545802654 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb920154fb0 msgr2=0x7fb920072d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:09.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.555+0000 7fb9283f4640 1 --2- 172.21.15.40:0/3545802654 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb920154fb0 0x7fb920072d40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0097d0 tx=0x7fb91c02b800 comp rx=0 tx=0).stop 2024-04-22T07:21:09.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.555+0000 7fb9283f4640 1 -- 172.21.15.40:0/3545802654 shutdown_connections 2024-04-22T07:21:09.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.555+0000 7fb9283f4640 1 --2- 172.21.15.40:0/3545802654 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb920154fb0 0x7fb920072d40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:09.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.555+0000 7fb9283f4640 1 -- 172.21.15.40:0/3545802654 >> 172.21.15.40:0/3545802654 conn(0x7fb9200676b0 msgr2=0x7fb920067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:09.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.555+0000 7fb9283f4640 1 -- 172.21.15.40:0/3545802654 shutdown_connections 2024-04-22T07:21:09.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.555+0000 7fb9283f4640 1 -- 172.21.15.40:0/3545802654 wait complete. 2024-04-22T07:21:09.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.556+0000 7fb9283f4640 1 Processor -- start 2024-04-22T07:21:09.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.556+0000 7fb9283f4640 1 -- start start 2024-04-22T07:21:09.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.557+0000 7fb9283f4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9200caee0 0x7fb92014ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:09.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.557+0000 7fb9283f4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9200d09f0 0x7fb920152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:09.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.557+0000 7fb9283f4640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb920154fb0 0x7fb9201f3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.557+0000 7fb9283f4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb9200cbe90 con 0x7fb9200caee0 2024-04-22T07:21:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.557+0000 7fb9283f4640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb9200cbbb0 con 0x7fb9200d09f0 2024-04-22T07:21:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.557+0000 7fb9283f4640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb9200cc170 con 0x7fb920154fb0 2024-04-22T07:21:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.557+0000 7fb926190640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9200caee0 0x7fb92014ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.557+0000 7fb926190640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9200caee0 0x7fb92014ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42668/0 (socket says 172.21.15.40:42668) 2024-04-22T07:21:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.557+0000 7fb926190640 1 -- 172.21.15.40:0/3229848442 learned_addr learned my addr 172.21.15.40:0/3229848442 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.557+0000 7fb92598f640 1 --2- 172.21.15.40:0/3229848442 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9200d09f0 0x7fb920152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.557+0000 7fb926991640 1 --2- 172.21.15.40:0/3229848442 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb920154fb0 0x7fb9201f3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.557+0000 7fb926190640 1 -- 172.21.15.40:0/3229848442 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb920154fb0 msgr2=0x7fb9201f3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.557+0000 7fb926190640 1 --2- 172.21.15.40:0/3229848442 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb920154fb0 0x7fb9201f3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.557+0000 7fb926190640 1 -- 172.21.15.40:0/3229848442 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9200d09f0 msgr2=0x7fb920152140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.557+0000 7fb926190640 1 --2- 172.21.15.40:0/3229848442 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9200d09f0 0x7fb920152140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.557+0000 7fb926190640 1 -- 172.21.15.40:0/3229848442 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb92014f690 con 0x7fb9200caee0 2024-04-22T07:21:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.557+0000 7fb92598f640 1 --2- 172.21.15.40:0/3229848442 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9200d09f0 0x7fb920152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.557+0000 7fb926190640 1 --2- 172.21.15.40:0/3229848442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9200caee0 0x7fb92014ede0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb91c02b840 tx=0x7fb91c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.558+0000 7fb916ffd640 1 -- 172.21.15.40:0/3229848442 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c040020 con 0x7fb9200caee0 2024-04-22T07:21:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.558+0000 7fb916ffd640 1 -- 172.21.15.40:0/3229848442 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb91c038040 con 0x7fb9200caee0 2024-04-22T07:21:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.558+0000 7fb9283f4640 1 -- 172.21.15.40:0/3229848442 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb92014f990 con 0x7fb9200caee0 2024-04-22T07:21:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.558+0000 7fb916ffd640 1 -- 172.21.15.40:0/3229848442 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c037070 con 0x7fb9200caee0 2024-04-22T07:21:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.558+0000 7fb9283f4640 1 -- 172.21.15.40:0/3229848442 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb92014ff50 con 0x7fb9200caee0 2024-04-22T07:21:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.559+0000 7fb9283f4640 1 -- 172.21.15.40:0/3229848442 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb92004fdc0 con 0x7fb9200caee0 2024-04-22T07:21:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.559+0000 7fb916ffd640 1 -- 172.21.15.40:0/3229848442 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb91c043020 con 0x7fb9200caee0 2024-04-22T07:21:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.559+0000 7fb916ffd640 1 --2- 172.21.15.40:0/3229848442 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fb90406c920 0x7fb90406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.560+0000 7fb92598f640 1 --2- 172.21.15.40:0/3229848442 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fb90406c920 0x7fb90406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.560+0000 7fb916ffd640 1 -- 172.21.15.40:0/3229848442 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb91c0acfa0 con 0x7fb9200caee0 2024-04-22T07:21:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.560+0000 7fb92598f640 1 --2- 172.21.15.40:0/3229848442 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fb90406c920 0x7fb90406ede0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb920072800 tx=0x7fb910009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:09.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.564+0000 7fb916ffd640 1 -- 172.21.15.40:0/3229848442 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb91c04a030 con 0x7fb9200caee0 2024-04-22T07:21:09.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.753+0000 7fb9283f4640 1 -- 172.21.15.40:0/3229848442 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb9200cb5a0 con 0x7fb9200caee0 2024-04-22T07:21:09.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.754+0000 7fb916ffd640 1 -- 172.21.15.40:0/3229848442 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7fb91c07ae10 con 0x7fb9200caee0 2024-04-22T07:21:09.751 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-04-22T07:21:09.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.756+0000 7fb9283f4640 1 -- 172.21.15.40:0/3229848442 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fb90406c920 msgr2=0x7fb90406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:09.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.756+0000 7fb9283f4640 1 --2- 172.21.15.40:0/3229848442 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fb90406c920 0x7fb90406ede0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb920072800 tx=0x7fb910009040 comp rx=0 tx=0).stop 2024-04-22T07:21:09.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.756+0000 7fb9283f4640 1 -- 172.21.15.40:0/3229848442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9200caee0 msgr2=0x7fb92014ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:09.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.756+0000 7fb9283f4640 1 --2- 172.21.15.40:0/3229848442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9200caee0 0x7fb92014ede0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb91c02b840 tx=0x7fb91c0046c0 comp rx=0 tx=0).stop 2024-04-22T07:21:09.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.756+0000 7fb9283f4640 1 -- 172.21.15.40:0/3229848442 shutdown_connections 2024-04-22T07:21:09.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.756+0000 7fb9283f4640 1 --2- 172.21.15.40:0/3229848442 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb920154fb0 0x7fb9201f3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:09.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.756+0000 7fb9283f4640 1 --2- 172.21.15.40:0/3229848442 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9200d09f0 0x7fb920152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:09.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.756+0000 7fb9283f4640 1 --2- 172.21.15.40:0/3229848442 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fb90406c920 0x7fb90406ede0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:09.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.756+0000 7fb9283f4640 1 --2- 172.21.15.40:0/3229848442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9200caee0 0x7fb92014ede0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:09.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.756+0000 7fb9283f4640 1 -- 172.21.15.40:0/3229848442 >> 172.21.15.40:0/3229848442 conn(0x7fb9200676b0 msgr2=0x7fb9200cf760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:09.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.756+0000 7fb9283f4640 1 -- 172.21.15.40:0/3229848442 shutdown_connections 2024-04-22T07:21:09.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.756+0000 7fb9283f4640 1 -- 172.21.15.40:0/3229848442 wait complete. 2024-04-22T07:21:09.764 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:21:09.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.868+0000 7fec60281640 1 Processor -- start 2024-04-22T07:21:09.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.868+0000 7fec60281640 1 -- start start 2024-04-22T07:21:09.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.869+0000 7fec60281640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fec58154fd0 0x7fec5806c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:09.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.869+0000 7fec60281640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec5806b920 0x7fec5806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:09.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.869+0000 7fec60281640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec5815af40 con 0x7fec580c9260 2024-04-22T07:21:09.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.869+0000 7fec60281640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fec5815b220 con 0x7fec58154fd0 2024-04-22T07:21:09.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.869+0000 7fec60281640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fec5815b500 con 0x7fec5806b920 2024-04-22T07:21:09.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.869+0000 7fec5e01d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fec58154fd0 0x7fec5806c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:09.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.869+0000 7fec5e01d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fec58154fd0 0x7fec5806c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55530/0 (socket says 172.21.15.40:55530) 2024-04-22T07:21:09.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.869+0000 7fec5e01d640 1 -- 172.21.15.40:0/3593486384 learned_addr learned my addr 172.21.15.40:0/3593486384 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:09.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.869+0000 7fec5e81e640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fec580c9260 0x7fec58067860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.40:56490/0 (socket says 172.21.15.40:56490) 2024-04-22T07:21:09.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.869+0000 7fec5d81c640 1 --2- 172.21.15.40:0/3593486384 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec5806b920 0x7fec5806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:09.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.869+0000 7fec5e01d640 1 -- 172.21.15.40:0/3593486384 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec5806b920 msgr2=0x7fec5806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:09.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.869+0000 7fec5e01d640 1 --2- 172.21.15.40:0/3593486384 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec5806b920 0x7fec5806cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:09.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.869+0000 7fec5d01b640 1 -- 172.21.15.40:0/3593486384 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1121518806 0 0) 0x7fec5815af40 con 0x7fec580c9260 2024-04-22T07:21:09.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.869+0000 7fec5e01d640 1 -- 172.21.15.40:0/3593486384 >> v1:172.21.15.62:6789/0 conn(0x7fec580c9260 legacy=0x7fec58067860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:09.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.869+0000 7fec5e01d640 1 -- 172.21.15.40:0/3593486384 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5815b7e0 con 0x7fec58154fd0 2024-04-22T07:21:09.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.870+0000 7fec5e01d640 1 --2- 172.21.15.40:0/3593486384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec58154fd0 0x7fec5806c7e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fec54009870 tx=0x7fec5402ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1862c4ad99c9a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:09.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.870+0000 7fec5d01b640 1 -- 172.21.15.40:0/3593486384 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5402f830 con 0x7fec58154fd0 2024-04-22T07:21:09.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.870+0000 7fec5d01b640 1 -- 172.21.15.40:0/3593486384 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec5402f9d0 con 0x7fec58154fd0 2024-04-22T07:21:09.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.870+0000 7fec5d01b640 1 -- 172.21.15.40:0/3593486384 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5402fda0 con 0x7fec58154fd0 2024-04-22T07:21:09.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.871+0000 7fec60281640 1 -- 172.21.15.40:0/3593486384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec58154fd0 msgr2=0x7fec5806c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:09.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.871+0000 7fec60281640 1 --2- 172.21.15.40:0/3593486384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec58154fd0 0x7fec5806c7e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fec54009870 tx=0x7fec5402ba10 comp rx=0 tx=0).stop 2024-04-22T07:21:09.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.871+0000 7fec60281640 1 -- 172.21.15.40:0/3593486384 shutdown_connections 2024-04-22T07:21:09.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.871+0000 7fec60281640 1 --2- 172.21.15.40:0/3593486384 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec5806b920 0x7fec5806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:09.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.871+0000 7fec60281640 1 --2- 172.21.15.40:0/3593486384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec58154fd0 0x7fec5806c7e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:09.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.871+0000 7fec60281640 1 -- 172.21.15.40:0/3593486384 >> 172.21.15.40:0/3593486384 conn(0x7fec580cd440 msgr2=0x7fec580cd850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:09.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.871+0000 7fec60281640 1 -- 172.21.15.40:0/3593486384 shutdown_connections 2024-04-22T07:21:09.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.871+0000 7fec60281640 1 -- 172.21.15.40:0/3593486384 wait complete. 2024-04-22T07:21:09.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.872+0000 7fec60281640 1 Processor -- start 2024-04-22T07:21:09.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.872+0000 7fec60281640 1 -- start start 2024-04-22T07:21:09.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.873+0000 7fec60281640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec5806b920 0x7fec580c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:09.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.873+0000 7fec60281640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec580c9260 0x7fec580c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:09.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.873+0000 7fec60281640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec58154fd0 0x7fec581f15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:09.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.873+0000 7fec60281640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fec5806c290 con 0x7fec58154fd0 2024-04-22T07:21:09.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.873+0000 7fec60281640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fec581553b0 con 0x7fec5806b920 2024-04-22T07:21:09.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.873+0000 7fec60281640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fec5806c410 con 0x7fec580c9260 2024-04-22T07:21:09.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.873+0000 7fec5e81e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec58154fd0 0x7fec581f15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:09.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.873+0000 7fec5e81e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec58154fd0 0x7fec581f15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55532/0 (socket says 172.21.15.40:55532) 2024-04-22T07:21:09.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.873+0000 7fec5e81e640 1 -- 172.21.15.40:0/3547009611 learned_addr learned my addr 172.21.15.40:0/3547009611 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:09.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.873+0000 7fec5e01d640 1 --2- 172.21.15.40:0/3547009611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec5806b920 0x7fec580c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:09.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.873+0000 7fec5d81c640 1 --2- 172.21.15.40:0/3547009611 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec580c9260 0x7fec580c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:09.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.873+0000 7fec5e81e640 1 -- 172.21.15.40:0/3547009611 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec580c9260 msgr2=0x7fec580c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:09.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.874+0000 7fec5e81e640 1 --2- 172.21.15.40:0/3547009611 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec580c9260 0x7fec580c6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:09.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.874+0000 7fec5e81e640 1 -- 172.21.15.40:0/3547009611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec5806b920 msgr2=0x7fec580c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:09.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.874+0000 7fec5e81e640 1 --2- 172.21.15.40:0/3547009611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec5806b920 0x7fec580c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:09.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.874+0000 7fec5e81e640 1 -- 172.21.15.40:0/3547009611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec58149c30 con 0x7fec58154fd0 2024-04-22T07:21:09.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.874+0000 7fec5e81e640 1 --2- 172.21.15.40:0/3547009611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec58154fd0 0x7fec581f15f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fec5000c7a0 tx=0x7fec5000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:09.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.874+0000 7fec4effd640 1 -- 172.21.15.40:0/3547009611 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec50018070 con 0x7fec58154fd0 2024-04-22T07:21:09.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.874+0000 7fec4effd640 1 -- 172.21.15.40:0/3547009611 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec5000a640 con 0x7fec58154fd0 2024-04-22T07:21:09.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.874+0000 7fec60281640 1 -- 172.21.15.40:0/3547009611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec581f0e10 con 0x7fec58154fd0 2024-04-22T07:21:09.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.874+0000 7fec4effd640 1 -- 172.21.15.40:0/3547009611 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5000aab0 con 0x7fec58154fd0 2024-04-22T07:21:09.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.874+0000 7fec60281640 1 -- 172.21.15.40:0/3547009611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec581492e0 con 0x7fec58154fd0 2024-04-22T07:21:09.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.875+0000 7fec60281640 1 -- 172.21.15.40:0/3547009611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec58068b20 con 0x7fec58154fd0 2024-04-22T07:21:09.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.876+0000 7fec4effd640 1 -- 172.21.15.40:0/3547009611 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fec5001b070 con 0x7fec58154fd0 2024-04-22T07:21:09.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.876+0000 7fec4effd640 1 --2- 172.21.15.40:0/3547009611 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fec3c06c8f0 0x7fec3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:09.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.876+0000 7fec4effd640 1 -- 172.21.15.40:0/3547009611 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fec5008b000 con 0x7fec58154fd0 2024-04-22T07:21:09.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.876+0000 7fec5e01d640 1 --2- 172.21.15.40:0/3547009611 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fec3c06c8f0 0x7fec3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:09.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.877+0000 7fec5e01d640 1 --2- 172.21.15.40:0/3547009611 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fec3c06c8f0 0x7fec3c06edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fec54036000 tx=0x7fec54008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:09.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:09.881+0000 7fec4effd640 1 -- 172.21.15.40:0/3547009611 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fec58149c30 con 0x7fec58154fd0 2024-04-22T07:21:10.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.107+0000 7fec60281640 1 -- 172.21.15.40:0/3547009611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec5814b660 con 0x7fec58154fd0 2024-04-22T07:21:10.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.108+0000 7fec4effd640 1 -- 172.21.15.40:0/3547009611 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6821 (secure 0 0 0) 0x7fec50058e70 con 0x7fec58154fd0 2024-04-22T07:21:10.105 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:21:10.105 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1193926607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1193926607},{"type":"v1","addr":"172.21.15.62:6835","nonce":1193926607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/602167189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":602167189},{"type":"v1","addr":"172.21.15.62:6837","nonce":602167189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2062933254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2062933254},{"type":"v1","addr":"172.21.15.40:6835","nonce":2062933254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3873524978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3873524978},{"type":"v1","addr":"172.21.15.40:6837","nonce":3873524978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/1922761385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":1922761385},{"type":"v1","addr":"172.21.15.40:6839","nonce":1922761385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:20:53.216204+0000","modified":"2024-04-22T07:20:58.875393+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.62:6836/2884673656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2884673656},{"type":"v1","addr":"172.21.15.62:6836","nonce":2884673656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4305]},"id":1}]} 2024-04-22T07:21:10.105 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-04-22T07:21:10.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.109+0000 7fec60281640 1 -- 172.21.15.40:0/3547009611 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fec3c06c8f0 msgr2=0x7fec3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:10.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.109+0000 7fec60281640 1 --2- 172.21.15.40:0/3547009611 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fec3c06c8f0 0x7fec3c06edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fec54036000 tx=0x7fec54008030 comp rx=0 tx=0).stop 2024-04-22T07:21:10.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.109+0000 7fec60281640 1 -- 172.21.15.40:0/3547009611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec58154fd0 msgr2=0x7fec581f15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:10.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.109+0000 7fec60281640 1 --2- 172.21.15.40:0/3547009611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec58154fd0 0x7fec581f15f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fec5000c7a0 tx=0x7fec5000cc60 comp rx=0 tx=0).stop 2024-04-22T07:21:10.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.110+0000 7fec60281640 1 -- 172.21.15.40:0/3547009611 shutdown_connections 2024-04-22T07:21:10.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.110+0000 7fec60281640 1 --2- 172.21.15.40:0/3547009611 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fec3c06c8f0 0x7fec3c06edb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:10.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.110+0000 7fec60281640 1 --2- 172.21.15.40:0/3547009611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec58154fd0 0x7fec581f15f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:10.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.110+0000 7fec60281640 1 --2- 172.21.15.40:0/3547009611 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec580c9260 0x7fec580c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:10.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.110+0000 7fec60281640 1 --2- 172.21.15.40:0/3547009611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec5806b920 0x7fec580c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:10.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.110+0000 7fec60281640 1 -- 172.21.15.40:0/3547009611 >> 172.21.15.40:0/3547009611 conn(0x7fec580cd440 msgr2=0x7fec58153fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:10.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.110+0000 7fec60281640 1 -- 172.21.15.40:0/3547009611 shutdown_connections 2024-04-22T07:21:10.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.110+0000 7fec60281640 1 -- 172.21.15.40:0/3547009611 wait complete. 2024-04-22T07:21:10.118 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:21:10.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.221+0000 7f9e9aa6d640 1 Processor -- start 2024-04-22T07:21:10.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.221+0000 7f9e9aa6d640 1 -- start start 2024-04-22T07:21:10.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.222+0000 7f9e9aa6d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9e94154f50 0x7f9e940cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:10.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.222+0000 7f9e9aa6d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9e9415b3e0 0x7f9e9415b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:10.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.222+0000 7f9e9aa6d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e9415e6e0 con 0x7f9e940cc5a0 2024-04-22T07:21:10.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.222+0000 7f9e9aa6d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f9e9415af50 con 0x7f9e9415b3e0 2024-04-22T07:21:10.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.222+0000 7f9e9aa6d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f9e9415bdb0 con 0x7f9e94154f50 2024-04-22T07:21:10.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.222+0000 7f9e93fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9e940cc5a0 0x7f9e940d0590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37668/0 (socket says 172.21.15.40:37668) 2024-04-22T07:21:10.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.222+0000 7f9e93fff640 1 -- 172.21.15.40:0/969639113 learned_addr learned my addr 172.21.15.40:0/969639113 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:10.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.222+0000 7f9e9900a640 1 --2- 172.21.15.40:0/969639113 >> v2:172.21.15.40:3300/0 conn(0x7f9e9415b3e0 0x7f9e9415b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:10.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.222+0000 7f9e98809640 1 --2- 172.21.15.40:0/969639113 >> v2:172.21.15.62:3300/0 conn(0x7f9e94154f50 0x7f9e940cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:10.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.222+0000 7f9e937fe640 1 -- 172.21.15.40:0/969639113 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 483516734 0 0) 0x7f9e9415e6e0 con 0x7f9e940cc5a0 2024-04-22T07:21:10.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.222+0000 7f9e937fe640 1 -- 172.21.15.40:0/969639113 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e84003520 con 0x7f9e940cc5a0 2024-04-22T07:21:10.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.222+0000 7f9e9900a640 1 -- 172.21.15.40:0/969639113 >> v2:172.21.15.62:3300/0 conn(0x7f9e94154f50 msgr2=0x7f9e940cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:10.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.222+0000 7f9e9900a640 1 --2- 172.21.15.40:0/969639113 >> v2:172.21.15.62:3300/0 conn(0x7f9e94154f50 0x7f9e940cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:10.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.222+0000 7f9e9900a640 1 -- 172.21.15.40:0/969639113 >> v1:172.21.15.40:6789/0 conn(0x7f9e940cc5a0 legacy=0x7f9e940d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:10.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.222+0000 7f9e9900a640 1 -- 172.21.15.40:0/969639113 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e9415e9c0 con 0x7f9e9415b3e0 2024-04-22T07:21:10.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.223+0000 7f9e9900a640 1 --2- 172.21.15.40:0/969639113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e9415b3e0 0x7f9e9415b870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9e940d1320 tx=0x7f9e8c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd8051f3710a1a75 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:10.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.223+0000 7f9e937fe640 1 -- 172.21.15.40:0/969639113 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c039070 con 0x7f9e9415b3e0 2024-04-22T07:21:10.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.223+0000 7f9e937fe640 1 -- 172.21.15.40:0/969639113 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e8c02cd00 con 0x7f9e9415b3e0 2024-04-22T07:21:10.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.223+0000 7f9e937fe640 1 -- 172.21.15.40:0/969639113 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c034660 con 0x7f9e9415b3e0 2024-04-22T07:21:10.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.224+0000 7f9e9aa6d640 1 -- 172.21.15.40:0/969639113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e9415b3e0 msgr2=0x7f9e9415b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:10.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.224+0000 7f9e9aa6d640 1 --2- 172.21.15.40:0/969639113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e9415b3e0 0x7f9e9415b870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9e940d1320 tx=0x7f9e8c02bf50 comp rx=0 tx=0).stop 2024-04-22T07:21:10.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.224+0000 7f9e9aa6d640 1 -- 172.21.15.40:0/969639113 shutdown_connections 2024-04-22T07:21:10.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.224+0000 7f9e9aa6d640 1 --2- 172.21.15.40:0/969639113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e9415b3e0 0x7f9e9415b870 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:10.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.224+0000 7f9e9aa6d640 1 --2- 172.21.15.40:0/969639113 >> v2:172.21.15.62:3300/0 conn(0x7f9e94154f50 0x7f9e940cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:10.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.224+0000 7f9e9aa6d640 1 -- 172.21.15.40:0/969639113 >> 172.21.15.40:0/969639113 conn(0x7f9e940676b0 msgr2=0x7f9e94067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:10.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.224+0000 7f9e9aa6d640 1 -- 172.21.15.40:0/969639113 shutdown_connections 2024-04-22T07:21:10.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.224+0000 7f9e9aa6d640 1 -- 172.21.15.40:0/969639113 wait complete. 2024-04-22T07:21:10.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.225+0000 7f9e9aa6d640 1 Processor -- start 2024-04-22T07:21:10.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.225+0000 7f9e9aa6d640 1 -- start start 2024-04-22T07:21:10.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.226+0000 7f9e9aa6d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e940cc5a0 0x7f9e941556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:10.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.226+0000 7f9e9aa6d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e94154f50 0x7f9e94156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:10.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.226+0000 7f9e9aa6d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e9415b3e0 0x7f9e940b5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:10.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.226+0000 7f9e9aa6d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9415f260 con 0x7f9e9415b3e0 2024-04-22T07:21:10.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.226+0000 7f9e9aa6d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9415ef80 con 0x7f9e94154f50 2024-04-22T07:21:10.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.226+0000 7f9e9aa6d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9e9415e3a0 con 0x7f9e940cc5a0 2024-04-22T07:21:10.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.226+0000 7f9e9900a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e9415b3e0 0x7f9e940b5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:10.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.226+0000 7f9e9900a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e9415b3e0 0x7f9e940b5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55546/0 (socket says 172.21.15.40:55546) 2024-04-22T07:21:10.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.226+0000 7f9e9900a640 1 -- 172.21.15.40:0/1268783450 learned_addr learned my addr 172.21.15.40:0/1268783450 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:10.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.226+0000 7f9e9900a640 1 -- 172.21.15.40:0/1268783450 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e940cc5a0 msgr2=0x7f9e941556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:10.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.226+0000 7f9e9900a640 1 --2- 172.21.15.40:0/1268783450 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e940cc5a0 0x7f9e941556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:10.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.226+0000 7f9e9900a640 1 -- 172.21.15.40:0/1268783450 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e94154f50 msgr2=0x7f9e94156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:10.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.226+0000 7f9e9900a640 1 --2- 172.21.15.40:0/1268783450 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e94154f50 0x7f9e94156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:10.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.226+0000 7f9e9900a640 1 -- 172.21.15.40:0/1268783450 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e941491f0 con 0x7f9e9415b3e0 2024-04-22T07:21:10.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.226+0000 7f9e9900a640 1 --2- 172.21.15.40:0/1268783450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e9415b3e0 0x7f9e940b5bc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c02c560 tx=0x7f9e8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:10.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.226+0000 7f9e917fa640 1 -- 172.21.15.40:0/1268783450 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c039050 con 0x7f9e9415b3e0 2024-04-22T07:21:10.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.226+0000 7f9e917fa640 1 -- 172.21.15.40:0/1268783450 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e8c045070 con 0x7f9e9415b3e0 2024-04-22T07:21:10.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.226+0000 7f9e9aa6d640 1 -- 172.21.15.40:0/1268783450 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e941494b0 con 0x7f9e9415b3e0 2024-04-22T07:21:10.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.226+0000 7f9e917fa640 1 -- 172.21.15.40:0/1268783450 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c009450 con 0x7f9e9415b3e0 2024-04-22T07:21:10.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.226+0000 7f9e9aa6d640 1 -- 172.21.15.40:0/1268783450 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e940cf800 con 0x7f9e9415b3e0 2024-04-22T07:21:10.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.227+0000 7f9e9aa6d640 1 -- 172.21.15.40:0/1268783450 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e94069d40 con 0x7f9e9415b3e0 2024-04-22T07:21:10.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.228+0000 7f9e917fa640 1 -- 172.21.15.40:0/1268783450 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9e8c03e850 con 0x7f9e9415b3e0 2024-04-22T07:21:10.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.228+0000 7f9e917fa640 1 --2- 172.21.15.40:0/1268783450 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9e7806c920 0x7f9e7806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:10.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.228+0000 7f9e917fa640 1 -- 172.21.15.40:0/1268783450 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9e8c0ae0e0 con 0x7f9e9415b3e0 2024-04-22T07:21:10.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.228+0000 7f9e98809640 1 --2- 172.21.15.40:0/1268783450 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9e7806c920 0x7f9e7806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:10.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.229+0000 7f9e98809640 1 --2- 172.21.15.40:0/1268783450 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9e7806c920 0x7f9e7806ede0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9e88006a90 tx=0x7f9e88006a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:10.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.233+0000 7f9e917fa640 1 -- 172.21.15.40:0/1268783450 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9e8c04e020 con 0x7f9e9415b3e0 2024-04-22T07:21:10.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.417+0000 7f9e9aa6d640 1 -- 172.21.15.40:0/1268783450 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e940d0440 con 0x7f9e9415b3e0 2024-04-22T07:21:10.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.418+0000 7f9e917fa640 1 -- 172.21.15.40:0/1268783450 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16537 (secure 0 0 0) 0x7f9e8c032e20 con 0x7f9e9415b3e0 2024-04-22T07:21:10.415 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:21:10.415 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":23,"fsid":"dd5b16e4-89fe-4602-b37f-062846793158","created":"2024-04-22T07:20:29.488892+0000","modified":"2024-04-22T07:20:54.858120+0000","last_up_change":"2024-04-22T07:20:40.397383+0000","last_in_change":"2024-04-22T07:20:31.702551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:20:41.793179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:20:51.815779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:20:52.164265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32238b7e-228b-4a67-bfca-16e8f0020a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6801","nonce":1526385055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6803","nonce":1526385055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6807","nonce":1526385055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6805","nonce":1526385055}]},"public_addr":"172.21.15.40:6801/1526385055","cluster_addr":"172.21.15.40:6803/1526385055","heartbeat_back_addr":"172.21.15.40:6807/1526385055","heartbeat_front_addr":"172.21.15.40:6805/1526385055","state":["exists","up"]},{"osd":1,"uuid":"5ad8da43-39b1-4295-b4d1-0f1e1d06fc0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6809","nonce":623026645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6811","nonce":623026645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6815","nonce":623026645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6813","nonce":623026645}]},"public_addr":"172.21.15.40:6809/623026645","cluster_addr":"172.21.15.40:6811/623026645","heartbeat_back_addr":"172.21.15.40:6815/623026645","heartbeat_front_addr":"172.21.15.40:6813/623026645","state":["exists","up"]},{"osd":2,"uuid":"7d2c6d50-719d-4232-ad47-f04dcf1a8bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6820","nonce":1885686505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6824","nonce":1885686505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6831","nonce":1885686505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6828","nonce":1885686505}]},"public_addr":"172.21.15.40:6820/1885686505","cluster_addr":"172.21.15.40:6824/1885686505","heartbeat_back_addr":"172.21.15.40:6831/1885686505","heartbeat_front_addr":"172.21.15.40:6828/1885686505","state":["exists","up"]},{"osd":3,"uuid":"af42e7d6-a6bf-403e-92e7-162d7c4fbf0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6817","nonce":130276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6819","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6821","nonce":130276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6829","nonce":130276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6823","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6825","nonce":130276746}]},"public_addr":"172.21.15.40:6817/130276746","cluster_addr":"172.21.15.40:6821/130276746","heartbeat_back_addr":"172.21.15.40:6829/130276746","heartbeat_front_addr":"172.21.15.40:6825/130276746","state":["exists","up"]},{"osd":4,"uuid":"f8e89e0d-be96-4f19-88c0-69c408df7d98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6801","nonce":2251435758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6803","nonce":2251435758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6807","nonce":2251435758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6805","nonce":2251435758}]},"public_addr":"172.21.15.62:6801/2251435758","cluster_addr":"172.21.15.62:6803/2251435758","heartbeat_back_addr":"172.21.15.62:6807/2251435758","heartbeat_front_addr":"172.21.15.62:6805/2251435758","state":["exists","up"]},{"osd":5,"uuid":"ba6dc1bc-272b-4f80-b55f-40bc4a0c3ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6809","nonce":3509322231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6811","nonce":3509322231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6815","nonce":3509322231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6813","nonce":3509322231}]},"public_addr":"172.21.15.62:6809/3509322231","cluster_addr":"172.21.15.62:6811/3509322231","heartbeat_back_addr":"172.21.15.62:6815/3509322231","heartbeat_front_addr":"172.21.15.62:6813/3509322231","state":["exists","up"]},{"osd":6,"uuid":"834fcd74-14bf-45ec-a10a-0374f4ce9bf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6825","nonce":3094315954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6827","nonce":3094315954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6831","nonce":3094315954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6829","nonce":3094315954}]},"public_addr":"172.21.15.62:6825/3094315954","cluster_addr":"172.21.15.62:6827/3094315954","heartbeat_back_addr":"172.21.15.62:6831/3094315954","heartbeat_front_addr":"172.21.15.62:6829/3094315954","state":["exists","up"]},{"osd":7,"uuid":"831c9a73-960e-4d2e-b86a-33a6916be059","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6817","nonce":147453972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6819","nonce":147453972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6823","nonce":147453972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6821","nonce":147453972}]},"public_addr":"172.21.15.62:6817/147453972","cluster_addr":"172.21.15.62:6819/147453972","heartbeat_back_addr":"172.21.15.62:6823/147453972","heartbeat_front_addr":"172.21.15.62:6821/147453972","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.828738+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.873471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.908090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.894782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:37.686796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.801123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.852323+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.812139+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:21:10.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.420+0000 7f9e9aa6d640 1 -- 172.21.15.40:0/1268783450 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9e7806c920 msgr2=0x7f9e7806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:10.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.420+0000 7f9e9aa6d640 1 --2- 172.21.15.40:0/1268783450 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9e7806c920 0x7f9e7806ede0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9e88006a90 tx=0x7f9e88006a20 comp rx=0 tx=0).stop 2024-04-22T07:21:10.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.420+0000 7f9e9aa6d640 1 -- 172.21.15.40:0/1268783450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e9415b3e0 msgr2=0x7f9e940b5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:10.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.420+0000 7f9e9aa6d640 1 --2- 172.21.15.40:0/1268783450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e9415b3e0 0x7f9e940b5bc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c02c560 tx=0x7f9e8c004a40 comp rx=0 tx=0).stop 2024-04-22T07:21:10.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.420+0000 7f9e9aa6d640 1 -- 172.21.15.40:0/1268783450 shutdown_connections 2024-04-22T07:21:10.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.420+0000 7f9e9aa6d640 1 --2- 172.21.15.40:0/1268783450 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9e7806c920 0x7f9e7806ede0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:10.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.420+0000 7f9e9aa6d640 1 --2- 172.21.15.40:0/1268783450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e9415b3e0 0x7f9e940b5bc0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:10.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.420+0000 7f9e9aa6d640 1 --2- 172.21.15.40:0/1268783450 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9e94154f50 0x7f9e94156750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:10.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.420+0000 7f9e9aa6d640 1 --2- 172.21.15.40:0/1268783450 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9e940cc5a0 0x7f9e941556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:10.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.420+0000 7f9e9aa6d640 1 -- 172.21.15.40:0/1268783450 >> 172.21.15.40:0/1268783450 conn(0x7f9e940676b0 msgr2=0x7f9e940c6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:10.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.420+0000 7f9e9aa6d640 1 -- 172.21.15.40:0/1268783450 shutdown_connections 2024-04-22T07:21:10.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.420+0000 7f9e9aa6d640 1 -- 172.21.15.40:0/1268783450 wait complete. 2024-04-22T07:21:10.428 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T07:20:41.793179+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-22T07:20:51.815779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-22T07:20:52.164265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-22T07:21:10.429 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T07:21:10.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.535+0000 7f3131e81640 1 Processor -- start 2024-04-22T07:21:10.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.535+0000 7f3131e81640 1 -- start start 2024-04-22T07:21:10.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.536+0000 7f3131e81640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f312c15ed20 0x7f312c0c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:10.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.536+0000 7f3131e81640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f312c06b920 0x7f312c06f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:10.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.536+0000 7f3131e81640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f312c15f1f0 con 0x7f312c070290 2024-04-22T07:21:10.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.536+0000 7f3131e81640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f312c15ada0 con 0x7f312c06b920 2024-04-22T07:21:10.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.536+0000 7f3131e81640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f312c0c90a0 con 0x7f312c15ed20 2024-04-22T07:21:10.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.536+0000 7f312bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f312c06b920 0x7f312c06f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:10.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.536+0000 7f312b7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f312c070290 0x7f312c06c330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37676/0 (socket says 172.21.15.40:37676) 2024-04-22T07:21:10.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.536+0000 7f312b7fe640 1 -- 172.21.15.40:0/1577211464 learned_addr learned my addr 172.21.15.40:0/1577211464 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:10.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.536+0000 7f312affd640 1 --2- 172.21.15.40:0/1577211464 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f312c15ed20 0x7f312c0c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:10.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.537+0000 7f312bfff640 1 -- 172.21.15.40:0/1577211464 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f312c15ed20 msgr2=0x7f312c0c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:10.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.537+0000 7f312bfff640 1 --2- 172.21.15.40:0/1577211464 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f312c15ed20 0x7f312c0c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:10.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.537+0000 7f312bfff640 1 -- 172.21.15.40:0/1577211464 >> v1:172.21.15.40:6789/0 conn(0x7f312c070290 legacy=0x7f312c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:10.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.537+0000 7f312bfff640 1 -- 172.21.15.40:0/1577211464 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f312c0c9380 con 0x7f312c06b920 2024-04-22T07:21:10.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.537+0000 7f312a7fc640 1 -- 172.21.15.40:0/1577211464 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 289864698 0 0) 0x7f312c15f1f0 con 0x7f312c070290 2024-04-22T07:21:10.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.537+0000 7f312bfff640 1 --2- 172.21.15.40:0/1577211464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f312c06b920 0x7f312c06f4b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3124009d90 tx=0x7f312402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8377824228a4ca server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:10.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.537+0000 7f312a7fc640 1 -- 172.21.15.40:0/1577211464 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3124039070 con 0x7f312c06b920 2024-04-22T07:21:10.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.537+0000 7f312a7fc640 1 -- 172.21.15.40:0/1577211464 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f312402cbc0 con 0x7f312c06b920 2024-04-22T07:21:10.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.537+0000 7f312a7fc640 1 -- 172.21.15.40:0/1577211464 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3124034440 con 0x7f312c06b920 2024-04-22T07:21:10.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.538+0000 7f3131e81640 1 -- 172.21.15.40:0/1577211464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f312c06b920 msgr2=0x7f312c06f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:10.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.538+0000 7f3131e81640 1 --2- 172.21.15.40:0/1577211464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f312c06b920 0x7f312c06f4b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3124009d90 tx=0x7f312402be10 comp rx=0 tx=0).stop 2024-04-22T07:21:10.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.538+0000 7f3131e81640 1 -- 172.21.15.40:0/1577211464 shutdown_connections 2024-04-22T07:21:10.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.538+0000 7f3131e81640 1 --2- 172.21.15.40:0/1577211464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f312c06b920 0x7f312c06f4b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:10.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.538+0000 7f3131e81640 1 --2- 172.21.15.40:0/1577211464 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f312c15ed20 0x7f312c0c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:10.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.538+0000 7f3131e81640 1 -- 172.21.15.40:0/1577211464 >> 172.21.15.40:0/1577211464 conn(0x7f312c06db30 msgr2=0x7f312c06df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:10.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.538+0000 7f3131e81640 1 -- 172.21.15.40:0/1577211464 shutdown_connections 2024-04-22T07:21:10.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.538+0000 7f3131e81640 1 -- 172.21.15.40:0/1577211464 wait complete. 2024-04-22T07:21:10.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.539+0000 7f3131e81640 1 Processor -- start 2024-04-22T07:21:10.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.539+0000 7f3131e81640 1 -- start start 2024-04-22T07:21:10.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.540+0000 7f3131e81640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f312c06b920 0x7f312c15d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:10.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.540+0000 7f3131e81640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f312c070290 0x7f312c15bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:10.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.540+0000 7f3131e81640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f312c15ed20 0x7f312c0afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:10.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.540+0000 7f3131e81640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f312c06ca40 con 0x7f312c070290 2024-04-22T07:21:10.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.540+0000 7f3131e81640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f312c15b340 con 0x7f312c15ed20 2024-04-22T07:21:10.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.540+0000 7f3131e81640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f312c06cbc0 con 0x7f312c06b920 2024-04-22T07:21:10.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.540+0000 7f312affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f312c070290 0x7f312c15bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:10.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.540+0000 7f312affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f312c070290 0x7f312c15bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55572/0 (socket says 172.21.15.40:55572) 2024-04-22T07:21:10.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.540+0000 7f312affd640 1 -- 172.21.15.40:0/3499632511 learned_addr learned my addr 172.21.15.40:0/3499632511 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:10.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.540+0000 7f312bfff640 1 --2- 172.21.15.40:0/3499632511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f312c15ed20 0x7f312c0afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:10.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.540+0000 7f312b7fe640 1 --2- 172.21.15.40:0/3499632511 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f312c06b920 0x7f312c15d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:10.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.540+0000 7f312affd640 1 -- 172.21.15.40:0/3499632511 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f312c06b920 msgr2=0x7f312c15d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:10.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.540+0000 7f312affd640 1 --2- 172.21.15.40:0/3499632511 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f312c06b920 0x7f312c15d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:10.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.540+0000 7f312affd640 1 -- 172.21.15.40:0/3499632511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f312c15ed20 msgr2=0x7f312c0afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:10.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.540+0000 7f312affd640 1 --2- 172.21.15.40:0/3499632511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f312c15ed20 0x7f312c0afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:10.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.540+0000 7f312affd640 1 -- 172.21.15.40:0/3499632511 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f312c0b0410 con 0x7f312c070290 2024-04-22T07:21:10.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.540+0000 7f312bfff640 1 --2- 172.21.15.40:0/3499632511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f312c15ed20 0x7f312c0afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:10.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.541+0000 7f312affd640 1 --2- 172.21.15.40:0/3499632511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f312c070290 0x7f312c15bf00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f312000e980 tx=0x7f312000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:10.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.541+0000 7f3113fff640 1 -- 172.21.15.40:0/3499632511 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3120017070 con 0x7f312c070290 2024-04-22T07:21:10.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.541+0000 7f3113fff640 1 -- 172.21.15.40:0/3499632511 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f312000ca00 con 0x7f312c070290 2024-04-22T07:21:10.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.541+0000 7f3113fff640 1 -- 172.21.15.40:0/3499632511 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312000cdd0 con 0x7f312c070290 2024-04-22T07:21:10.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.541+0000 7f3131e81640 1 -- 172.21.15.40:0/3499632511 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f312c1f4140 con 0x7f312c070290 2024-04-22T07:21:10.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.541+0000 7f3131e81640 1 -- 172.21.15.40:0/3499632511 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f312c1f4700 con 0x7f312c070290 2024-04-22T07:21:10.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.542+0000 7f3131e81640 1 -- 172.21.15.40:0/3499632511 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f312c069f50 con 0x7f312c070290 2024-04-22T07:21:10.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.542+0000 7f3113fff640 1 -- 172.21.15.40:0/3499632511 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f312001a070 con 0x7f312c070290 2024-04-22T07:21:10.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.543+0000 7f3113fff640 1 --2- 172.21.15.40:0/3499632511 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f311806c920 0x7f311806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:10.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.543+0000 7f3113fff640 1 -- 172.21.15.40:0/3499632511 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f312008bea0 con 0x7f312c070290 2024-04-22T07:21:10.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.543+0000 7f312b7fe640 1 --2- 172.21.15.40:0/3499632511 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f311806c920 0x7f311806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:10.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.543+0000 7f312b7fe640 1 --2- 172.21.15.40:0/3499632511 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f311806c920 0x7f311806ede0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f311c000f60 tx=0x7f311c007c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:10.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.547+0000 7f3113fff640 1 -- 172.21.15.40:0/3499632511 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f312c0b0410 con 0x7f312c070290 2024-04-22T07:21:10.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.730+0000 7f3131e81640 1 -- 172.21.15.40:0/3499632511 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f312c0c9a60 con 0x7f312c070290 2024-04-22T07:21:10.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.730+0000 7f3113fff640 1 -- 172.21.15.40:0/3499632511 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f312005a2d0 con 0x7f312c070290 2024-04-22T07:21:10.727 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-04-22T07:21:10.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.732+0000 7f3131e81640 1 -- 172.21.15.40:0/3499632511 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f311806c920 msgr2=0x7f311806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:10.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.732+0000 7f3131e81640 1 --2- 172.21.15.40:0/3499632511 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f311806c920 0x7f311806ede0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f311c000f60 tx=0x7f311c007c00 comp rx=0 tx=0).stop 2024-04-22T07:21:10.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.732+0000 7f3131e81640 1 -- 172.21.15.40:0/3499632511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f312c070290 msgr2=0x7f312c15bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:10.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.732+0000 7f3131e81640 1 --2- 172.21.15.40:0/3499632511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f312c070290 0x7f312c15bf00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f312000e980 tx=0x7f312000ee40 comp rx=0 tx=0).stop 2024-04-22T07:21:10.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.732+0000 7f3131e81640 1 -- 172.21.15.40:0/3499632511 shutdown_connections 2024-04-22T07:21:10.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.732+0000 7f3131e81640 1 --2- 172.21.15.40:0/3499632511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f312c15ed20 0x7f312c0afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:10.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.732+0000 7f3131e81640 1 --2- 172.21.15.40:0/3499632511 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f311806c920 0x7f311806ede0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:10.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.732+0000 7f3131e81640 1 --2- 172.21.15.40:0/3499632511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f312c070290 0x7f312c15bf00 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:10.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.732+0000 7f3131e81640 1 --2- 172.21.15.40:0/3499632511 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f312c06b920 0x7f312c15d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:10.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.732+0000 7f3131e81640 1 -- 172.21.15.40:0/3499632511 >> 172.21.15.40:0/3499632511 conn(0x7f312c06db30 msgr2=0x7f312c06df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:10.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.732+0000 7f3131e81640 1 -- 172.21.15.40:0/3499632511 shutdown_connections 2024-04-22T07:21:10.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.732+0000 7f3131e81640 1 -- 172.21.15.40:0/3499632511 wait complete. 2024-04-22T07:21:10.740 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-22T07:21:10.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.847+0000 7f3d9a0a7640 1 Processor -- start 2024-04-22T07:21:10.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.847+0000 7f3d9a0a7640 1 -- start start 2024-04-22T07:21:10.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.848+0000 7f3d9a0a7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3d94154fb0 0x7f3d94072d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:10.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.848+0000 7f3d9a0a7640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d940d09f0 0x7f3d940d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:10.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.848+0000 7f3d9a0a7640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d940ccd80 con 0x7f3d940caee0 2024-04-22T07:21:10.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.848+0000 7f3d9a0a7640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f3d940c5c50 con 0x7f3d94154fb0 2024-04-22T07:21:10.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.848+0000 7f3d9a0a7640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f3d940cc7e0 con 0x7f3d940d09f0 2024-04-22T07:21:10.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.848+0000 7f3d93fff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d940d09f0 0x7f3d940d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:10.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.848+0000 7f3d937fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3d94154fb0 0x7f3d94072d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:10.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.848+0000 7f3d92ffd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f3d940caee0 0x7f3d9415e2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.40:56492/0 (socket says 172.21.15.40:56492) 2024-04-22T07:21:10.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.848+0000 7f3d93fff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d940d09f0 0x7f3d940d0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.40:55234/0 (socket says 172.21.15.40:55234) 2024-04-22T07:21:10.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.848+0000 7f3d92ffd640 1 -- 172.21.15.40:0/3679775026 learned_addr learned my addr 172.21.15.40:0/3679775026 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:10.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.848+0000 7f3d937fe640 1 -- 172.21.15.40:0/3679775026 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d940d09f0 msgr2=0x7f3d940d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:10.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.849+0000 7f3d937fe640 1 --2- 172.21.15.40:0/3679775026 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d940d09f0 0x7f3d940d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:10.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.849+0000 7f3d937fe640 1 -- 172.21.15.40:0/3679775026 >> v1:172.21.15.62:6789/0 conn(0x7f3d940caee0 legacy=0x7f3d9415e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:10.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.849+0000 7f3d927fc640 1 -- 172.21.15.40:0/3679775026 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1287671321 0 0) 0x7f3d940ccd80 con 0x7f3d940caee0 2024-04-22T07:21:10.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.849+0000 7f3d937fe640 1 -- 172.21.15.40:0/3679775026 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d940ccaa0 con 0x7f3d94154fb0 2024-04-22T07:21:10.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.849+0000 7f3d93fff640 1 --2- 172.21.15.40:0/3679775026 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d940d09f0 0x7f3d940d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:21:10.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.849+0000 7f3d937fe640 1 --2- 172.21.15.40:0/3679775026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d94154fb0 0x7f3d94072d40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3d840097a0 tx=0x7f3d8402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71bbc115f415cf44 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:10.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.850+0000 7f3d927fc640 1 -- 172.21.15.40:0/3679775026 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d84035020 con 0x7f3d94154fb0 2024-04-22T07:21:10.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.850+0000 7f3d927fc640 1 -- 172.21.15.40:0/3679775026 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d84031830 con 0x7f3d94154fb0 2024-04-22T07:21:10.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.850+0000 7f3d927fc640 1 -- 172.21.15.40:0/3679775026 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d84031c00 con 0x7f3d94154fb0 2024-04-22T07:21:10.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.850+0000 7f3d9a0a7640 1 -- 172.21.15.40:0/3679775026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d94154fb0 msgr2=0x7f3d94072d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:10.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.850+0000 7f3d9a0a7640 1 --2- 172.21.15.40:0/3679775026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d94154fb0 0x7f3d94072d40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3d840097a0 tx=0x7f3d8402b8d0 comp rx=0 tx=0).stop 2024-04-22T07:21:10.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.850+0000 7f3d9a0a7640 1 -- 172.21.15.40:0/3679775026 shutdown_connections 2024-04-22T07:21:10.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.850+0000 7f3d9a0a7640 1 --2- 172.21.15.40:0/3679775026 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d940d09f0 0x7f3d940d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:10.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.850+0000 7f3d9a0a7640 1 --2- 172.21.15.40:0/3679775026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d94154fb0 0x7f3d94072d40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:10.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.850+0000 7f3d9a0a7640 1 -- 172.21.15.40:0/3679775026 >> 172.21.15.40:0/3679775026 conn(0x7f3d940676b0 msgr2=0x7f3d94067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:10.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.850+0000 7f3d9a0a7640 1 -- 172.21.15.40:0/3679775026 shutdown_connections 2024-04-22T07:21:10.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.850+0000 7f3d9a0a7640 1 -- 172.21.15.40:0/3679775026 wait complete. 2024-04-22T07:21:10.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.851+0000 7f3d9a0a7640 1 Processor -- start 2024-04-22T07:21:10.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.851+0000 7f3d9a0a7640 1 -- start start 2024-04-22T07:21:10.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.852+0000 7f3d9a0a7640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d940caee0 0x7f3d9415a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:10.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.852+0000 7f3d9a0a7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d940d09f0 0x7f3d9414beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:10.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.852+0000 7f3d9a0a7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d94154fb0 0x7f3d9414c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:10.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.852+0000 7f3d9a0a7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3d940cbe90 con 0x7f3d94154fb0 2024-04-22T07:21:10.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.852+0000 7f3d9a0a7640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3d940cbbb0 con 0x7f3d940d09f0 2024-04-22T07:21:10.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.852+0000 7f3d9a0a7640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f3d940cc170 con 0x7f3d940caee0 2024-04-22T07:21:10.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.852+0000 7f3d93fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d94154fb0 0x7f3d9414c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:10.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.852+0000 7f3d93fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d94154fb0 0x7f3d9414c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55584/0 (socket says 172.21.15.40:55584) 2024-04-22T07:21:10.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.852+0000 7f3d93fff640 1 -- 172.21.15.40:0/3992495953 learned_addr learned my addr 172.21.15.40:0/3992495953 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:10.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.852+0000 7f3d937fe640 1 --2- 172.21.15.40:0/3992495953 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d940caee0 0x7f3d9415a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:10.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.852+0000 7f3d92ffd640 1 --2- 172.21.15.40:0/3992495953 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d940d09f0 0x7f3d9414beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:10.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.853+0000 7f3d93fff640 1 -- 172.21.15.40:0/3992495953 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d940caee0 msgr2=0x7f3d9415a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:10.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.853+0000 7f3d93fff640 1 --2- 172.21.15.40:0/3992495953 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d940caee0 0x7f3d9415a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:10.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.853+0000 7f3d93fff640 1 -- 172.21.15.40:0/3992495953 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d940d09f0 msgr2=0x7f3d9414beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:10.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.853+0000 7f3d93fff640 1 --2- 172.21.15.40:0/3992495953 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d940d09f0 0x7f3d9414beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:10.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.853+0000 7f3d93fff640 1 -- 172.21.15.40:0/3992495953 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d941f1660 con 0x7f3d94154fb0 2024-04-22T07:21:10.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.853+0000 7f3d92ffd640 1 --2- 172.21.15.40:0/3992495953 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d940d09f0 0x7f3d9414beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:10.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.853+0000 7f3d93fff640 1 --2- 172.21.15.40:0/3992495953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d94154fb0 0x7f3d9414c3f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c00efc0 tx=0x7f3d8c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:10.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.853+0000 7f3d7bfff640 1 -- 172.21.15.40:0/3992495953 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c018030 con 0x7f3d94154fb0 2024-04-22T07:21:10.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.853+0000 7f3d7bfff640 1 -- 172.21.15.40:0/3992495953 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d8c00cde0 con 0x7f3d94154fb0 2024-04-22T07:21:10.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.853+0000 7f3d9a0a7640 1 -- 172.21.15.40:0/3992495953 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d941f3d20 con 0x7f3d94154fb0 2024-04-22T07:21:10.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.853+0000 7f3d7bfff640 1 -- 172.21.15.40:0/3992495953 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c003bb0 con 0x7f3d94154fb0 2024-04-22T07:21:10.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.853+0000 7f3d9a0a7640 1 -- 172.21.15.40:0/3992495953 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d941f42e0 con 0x7f3d94154fb0 2024-04-22T07:21:10.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.854+0000 7f3d9a0a7640 1 -- 172.21.15.40:0/3992495953 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d940b3640 con 0x7f3d94154fb0 2024-04-22T07:21:10.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.855+0000 7f3d7bfff640 1 -- 172.21.15.40:0/3992495953 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3d8c01b070 con 0x7f3d94154fb0 2024-04-22T07:21:10.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.855+0000 7f3d7bfff640 1 --2- 172.21.15.40:0/3992495953 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f3d8006c920 0x7f3d8006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:10.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.855+0000 7f3d7bfff640 1 -- 172.21.15.40:0/3992495953 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f3d8c08c610 con 0x7f3d94154fb0 2024-04-22T07:21:10.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.855+0000 7f3d937fe640 1 --2- 172.21.15.40:0/3992495953 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f3d8006c920 0x7f3d8006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:10.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.855+0000 7f3d937fe640 1 --2- 172.21.15.40:0/3992495953 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f3d8006c920 0x7f3d8006ede0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3d84036000 tx=0x7f3d84008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:10.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:10.859+0000 7f3d7bfff640 1 -- 172.21.15.40:0/3992495953 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3d8c010040 con 0x7f3d94154fb0 2024-04-22T07:21:11.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.044+0000 7f3d9a0a7640 1 -- 172.21.15.40:0/3992495953 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3d9404fdc0 con 0x7f3d94154fb0 2024-04-22T07:21:11.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.045+0000 7f3d7bfff640 1 -- 172.21.15.40:0/3992495953 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f3d8c012340 con 0x7f3d94154fb0 2024-04-22T07:21:11.042 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-22T07:21:11.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.047+0000 7f3d9a0a7640 1 -- 172.21.15.40:0/3992495953 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f3d8006c920 msgr2=0x7f3d8006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:11.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.047+0000 7f3d9a0a7640 1 --2- 172.21.15.40:0/3992495953 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f3d8006c920 0x7f3d8006ede0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3d84036000 tx=0x7f3d84008030 comp rx=0 tx=0).stop 2024-04-22T07:21:11.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.047+0000 7f3d9a0a7640 1 -- 172.21.15.40:0/3992495953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d94154fb0 msgr2=0x7f3d9414c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:11.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.047+0000 7f3d9a0a7640 1 --2- 172.21.15.40:0/3992495953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d94154fb0 0x7f3d9414c3f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c00efc0 tx=0x7f3d8c009f90 comp rx=0 tx=0).stop 2024-04-22T07:21:11.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.047+0000 7f3d9a0a7640 1 -- 172.21.15.40:0/3992495953 shutdown_connections 2024-04-22T07:21:11.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.047+0000 7f3d9a0a7640 1 --2- 172.21.15.40:0/3992495953 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f3d8006c920 0x7f3d8006ede0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.047+0000 7f3d9a0a7640 1 --2- 172.21.15.40:0/3992495953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d94154fb0 0x7f3d9414c3f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.047+0000 7f3d9a0a7640 1 --2- 172.21.15.40:0/3992495953 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d940d09f0 0x7f3d9414beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.047+0000 7f3d9a0a7640 1 --2- 172.21.15.40:0/3992495953 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d940caee0 0x7f3d9415a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.047+0000 7f3d9a0a7640 1 -- 172.21.15.40:0/3992495953 >> 172.21.15.40:0/3992495953 conn(0x7f3d940676b0 msgr2=0x7f3d9415acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:11.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.047+0000 7f3d9a0a7640 1 -- 172.21.15.40:0/3992495953 shutdown_connections 2024-04-22T07:21:11.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.047+0000 7f3d9a0a7640 1 -- 172.21.15.40:0/3992495953 wait complete. 2024-04-22T07:21:11.054 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-22T07:21:11.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.161+0000 7fc919dbd640 1 Processor -- start 2024-04-22T07:21:11.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.161+0000 7fc919dbd640 1 -- start start 2024-04-22T07:21:11.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.162+0000 7fc919dbd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc9141550f0 0x7fc91415ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:11.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.162+0000 7fc919dbd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc9140cb5b0 0x7fc9140cba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:11.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.162+0000 7fc919dbd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9140cd040 0x7fc9140cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:11.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.162+0000 7fc919dbd640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fc91415afd0 con 0x7fc9140cb5b0 2024-04-22T07:21:11.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.162+0000 7fc919dbd640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fc91415b290 con 0x7fc9141550f0 2024-04-22T07:21:11.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.162+0000 7fc919dbd640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc91415b570 con 0x7fc9140cd040 2024-04-22T07:21:11.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.162+0000 7fc912ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc9140cb5b0 0x7fc9140cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:11.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.162+0000 7fc912ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc9140cb5b0 0x7fc9140cba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55586/0 (socket says 172.21.15.40:55586) 2024-04-22T07:21:11.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.162+0000 7fc912ffd640 1 -- 172.21.15.40:0/556708157 learned_addr learned my addr 172.21.15.40:0/556708157 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:11.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.162+0000 7fc913fff640 1 --2- 172.21.15.40:0/556708157 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9140cd040 0x7fc9140cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:11.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.162+0000 7fc9137fe640 1 --2- 172.21.15.40:0/556708157 >> v2:172.21.15.62:3300/0 conn(0x7fc9141550f0 0x7fc91415ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:11.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.162+0000 7fc912ffd640 1 -- 172.21.15.40:0/556708157 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9140cd040 msgr2=0x7fc9140cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:11.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.162+0000 7fc912ffd640 1 --2- 172.21.15.40:0/556708157 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9140cd040 0x7fc9140cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.162+0000 7fc912ffd640 1 -- 172.21.15.40:0/556708157 >> v2:172.21.15.62:3300/0 conn(0x7fc9141550f0 msgr2=0x7fc91415ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:11.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.162+0000 7fc912ffd640 1 --2- 172.21.15.40:0/556708157 >> v2:172.21.15.62:3300/0 conn(0x7fc9141550f0 0x7fc91415ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.162+0000 7fc912ffd640 1 -- 172.21.15.40:0/556708157 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc91415b850 con 0x7fc9140cb5b0 2024-04-22T07:21:11.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.163+0000 7fc912ffd640 1 --2- 172.21.15.40:0/556708157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9140cb5b0 0x7fc9140cba00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc91406c8d0 tx=0x7fc90802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5bc7466b80dc681 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:11.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.163+0000 7fc9127fc640 1 -- 172.21.15.40:0/556708157 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90802e070 con 0x7fc9140cb5b0 2024-04-22T07:21:11.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.163+0000 7fc9127fc640 1 -- 172.21.15.40:0/556708157 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc908037070 con 0x7fc9140cb5b0 2024-04-22T07:21:11.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.163+0000 7fc9127fc640 1 -- 172.21.15.40:0/556708157 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc908031a00 con 0x7fc9140cb5b0 2024-04-22T07:21:11.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.164+0000 7fc919dbd640 1 -- 172.21.15.40:0/556708157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9140cb5b0 msgr2=0x7fc9140cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:11.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.164+0000 7fc919dbd640 1 --2- 172.21.15.40:0/556708157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9140cb5b0 0x7fc9140cba00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc91406c8d0 tx=0x7fc90802b880 comp rx=0 tx=0).stop 2024-04-22T07:21:11.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.164+0000 7fc919dbd640 1 -- 172.21.15.40:0/556708157 shutdown_connections 2024-04-22T07:21:11.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.164+0000 7fc919dbd640 1 --2- 172.21.15.40:0/556708157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9140cb5b0 0x7fc9140cba00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.164+0000 7fc919dbd640 1 --2- 172.21.15.40:0/556708157 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9140cd040 0x7fc9140cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.164+0000 7fc919dbd640 1 --2- 172.21.15.40:0/556708157 >> v2:172.21.15.62:3300/0 conn(0x7fc9141550f0 0x7fc91415ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.164+0000 7fc919dbd640 1 -- 172.21.15.40:0/556708157 >> 172.21.15.40:0/556708157 conn(0x7fc91406b920 msgr2=0x7fc91406bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:11.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.164+0000 7fc919dbd640 1 -- 172.21.15.40:0/556708157 shutdown_connections 2024-04-22T07:21:11.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.164+0000 7fc919dbd640 1 -- 172.21.15.40:0/556708157 wait complete. 2024-04-22T07:21:11.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.165+0000 7fc919dbd640 1 Processor -- start 2024-04-22T07:21:11.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.165+0000 7fc919dbd640 1 -- start start 2024-04-22T07:21:11.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.166+0000 7fc919dbd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9140cb5b0 0x7fc91415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:11.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.166+0000 7fc919dbd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9140cd040 0x7fc91415cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:11.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.166+0000 7fc919dbd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9141550f0 0x7fc914159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:11.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.166+0000 7fc919dbd640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc9140c5630 con 0x7fc9140cd040 2024-04-22T07:21:11.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.166+0000 7fc919dbd640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc9141554d0 con 0x7fc9140cb5b0 2024-04-22T07:21:11.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.166+0000 7fc919dbd640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc9140c57b0 con 0x7fc9141550f0 2024-04-22T07:21:11.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.166+0000 7fc912ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9140cd040 0x7fc91415cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:11.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.166+0000 7fc912ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9140cd040 0x7fc91415cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55594/0 (socket says 172.21.15.40:55594) 2024-04-22T07:21:11.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.166+0000 7fc912ffd640 1 -- 172.21.15.40:0/680629785 learned_addr learned my addr 172.21.15.40:0/680629785 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:11.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.166+0000 7fc9137fe640 1 --2- 172.21.15.40:0/680629785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9140cb5b0 0x7fc91415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:11.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.166+0000 7fc913fff640 1 --2- 172.21.15.40:0/680629785 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9141550f0 0x7fc914159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:11.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.166+0000 7fc912ffd640 1 -- 172.21.15.40:0/680629785 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9141550f0 msgr2=0x7fc914159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:11.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.166+0000 7fc912ffd640 1 --2- 172.21.15.40:0/680629785 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9141550f0 0x7fc914159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.166+0000 7fc912ffd640 1 -- 172.21.15.40:0/680629785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9140cb5b0 msgr2=0x7fc91415c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:11.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.166+0000 7fc912ffd640 1 --2- 172.21.15.40:0/680629785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9140cb5b0 0x7fc91415c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.166+0000 7fc912ffd640 1 -- 172.21.15.40:0/680629785 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9140b60a0 con 0x7fc9140cd040 2024-04-22T07:21:11.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.167+0000 7fc912ffd640 1 --2- 172.21.15.40:0/680629785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9140cd040 0x7fc91415cef0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc908000c00 tx=0x7fc9080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:11.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.167+0000 7fc8fbfff640 1 -- 172.21.15.40:0/680629785 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc908032880 con 0x7fc9140cd040 2024-04-22T07:21:11.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.167+0000 7fc8fbfff640 1 -- 172.21.15.40:0/680629785 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc908032a40 con 0x7fc9140cd040 2024-04-22T07:21:11.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.167+0000 7fc919dbd640 1 -- 172.21.15.40:0/680629785 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9140b53e0 con 0x7fc9140cd040 2024-04-22T07:21:11.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.167+0000 7fc8fbfff640 1 -- 172.21.15.40:0/680629785 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc908032e30 con 0x7fc9140cd040 2024-04-22T07:21:11.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.167+0000 7fc919dbd640 1 -- 172.21.15.40:0/680629785 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9140b5100 con 0x7fc9140cd040 2024-04-22T07:21:11.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.168+0000 7fc919dbd640 1 -- 172.21.15.40:0/680629785 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc914151df0 con 0x7fc9140cd040 2024-04-22T07:21:11.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.168+0000 7fc8fbfff640 1 -- 172.21.15.40:0/680629785 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc9080453f0 con 0x7fc9140cd040 2024-04-22T07:21:11.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.169+0000 7fc8fbfff640 1 --2- 172.21.15.40:0/680629785 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc90006c8f0 0x7fc90006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:11.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.169+0000 7fc8fbfff640 1 -- 172.21.15.40:0/680629785 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc9080ad940 con 0x7fc9140cd040 2024-04-22T07:21:11.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.169+0000 7fc9137fe640 1 --2- 172.21.15.40:0/680629785 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc90006c8f0 0x7fc90006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:11.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.169+0000 7fc9137fe640 1 --2- 172.21.15.40:0/680629785 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc90006c8f0 0x7fc90006edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc904007920 tx=0x7fc904008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:11.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.173+0000 7fc8fbfff640 1 -- 172.21.15.40:0/680629785 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc914151df0 con 0x7fc9140cd040 2024-04-22T07:21:11.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.356+0000 7fc919dbd640 1 -- 172.21.15.40:0/680629785 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc91404fdc0 con 0x7fc9140cd040 2024-04-22T07:21:11.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.357+0000 7fc8fbfff640 1 -- 172.21.15.40:0/680629785 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7fc908040070 con 0x7fc9140cd040 2024-04-22T07:21:11.354 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-04-22T07:21:11.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.359+0000 7fc919dbd640 1 -- 172.21.15.40:0/680629785 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc90006c8f0 msgr2=0x7fc90006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:11.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.359+0000 7fc919dbd640 1 --2- 172.21.15.40:0/680629785 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc90006c8f0 0x7fc90006edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc904007920 tx=0x7fc904008040 comp rx=0 tx=0).stop 2024-04-22T07:21:11.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.359+0000 7fc919dbd640 1 -- 172.21.15.40:0/680629785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9140cd040 msgr2=0x7fc91415cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:11.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.359+0000 7fc919dbd640 1 --2- 172.21.15.40:0/680629785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9140cd040 0x7fc91415cef0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc908000c00 tx=0x7fc9080046c0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.359+0000 7fc919dbd640 1 -- 172.21.15.40:0/680629785 shutdown_connections 2024-04-22T07:21:11.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.359+0000 7fc919dbd640 1 --2- 172.21.15.40:0/680629785 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc9141550f0 0x7fc914159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.359+0000 7fc919dbd640 1 --2- 172.21.15.40:0/680629785 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc90006c8f0 0x7fc90006edb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.359+0000 7fc919dbd640 1 --2- 172.21.15.40:0/680629785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9140cd040 0x7fc91415cef0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.359+0000 7fc919dbd640 1 --2- 172.21.15.40:0/680629785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9140cb5b0 0x7fc91415c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.359+0000 7fc919dbd640 1 -- 172.21.15.40:0/680629785 >> 172.21.15.40:0/680629785 conn(0x7fc91406b920 msgr2=0x7fc9140cc330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:11.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.359+0000 7fc919dbd640 1 -- 172.21.15.40:0/680629785 shutdown_connections 2024-04-22T07:21:11.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.359+0000 7fc919dbd640 1 -- 172.21.15.40:0/680629785 wait complete. 2024-04-22T07:21:11.366 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:21:11.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.470+0000 7f3b398a8640 1 Processor -- start 2024-04-22T07:21:11.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.470+0000 7f3b398a8640 1 -- start start 2024-04-22T07:21:11.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.471+0000 7f3b398a8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3b34154ed0 0x7f3b340cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:11.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.471+0000 7f3b398a8640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b340cc650 0x7f3b3415e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:11.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.471+0000 7f3b398a8640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b340c5960 con 0x7f3b3415ef10 2024-04-22T07:21:11.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.471+0000 7f3b398a8640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f3b3415e260 con 0x7f3b34154ed0 2024-04-22T07:21:11.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.471+0000 7f3b398a8640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f3b3415b7b0 con 0x7f3b340cc650 2024-04-22T07:21:11.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.471+0000 7f3b32ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3b34154ed0 0x7f3b340cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:11.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.471+0000 7f3b337fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3b3415ef10 0x7f3b340ccfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37686/0 (socket says 172.21.15.40:37686) 2024-04-22T07:21:11.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.471+0000 7f3b337fe640 1 -- 172.21.15.40:0/1988746434 learned_addr learned my addr 172.21.15.40:0/1988746434 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:11.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.471+0000 7f3b2bfff640 1 --2- 172.21.15.40:0/1988746434 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b340cc650 0x7f3b3415e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:11.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.471+0000 7f3b32ffd640 1 -- 172.21.15.40:0/1988746434 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b340cc650 msgr2=0x7f3b3415e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:11.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.471+0000 7f3b32ffd640 1 --2- 172.21.15.40:0/1988746434 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b340cc650 0x7f3b3415e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.471+0000 7f3b32ffd640 1 -- 172.21.15.40:0/1988746434 >> v1:172.21.15.40:6789/0 conn(0x7f3b3415ef10 legacy=0x7f3b340ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:11.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.471+0000 7f3b32ffd640 1 -- 172.21.15.40:0/1988746434 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b340cc0f0 con 0x7f3b34154ed0 2024-04-22T07:21:11.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.471+0000 7f3b327fc640 1 -- 172.21.15.40:0/1988746434 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 499444941 0 0) 0x7f3b2c001490 con 0x7f3b3415ef10 2024-04-22T07:21:11.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.472+0000 7f3b32ffd640 1 --2- 172.21.15.40:0/1988746434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b34154ed0 0x7f3b340cb490 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3b240097a0 tx=0x7f3b2402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227e1f7e02933b1a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:11.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.472+0000 7f3b327fc640 1 -- 172.21.15.40:0/1988746434 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b240315a0 con 0x7f3b34154ed0 2024-04-22T07:21:11.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.472+0000 7f3b327fc640 1 -- 172.21.15.40:0/1988746434 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b24037070 con 0x7f3b34154ed0 2024-04-22T07:21:11.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.472+0000 7f3b327fc640 1 -- 172.21.15.40:0/1988746434 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b24031960 con 0x7f3b34154ed0 2024-04-22T07:21:11.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.473+0000 7f3b398a8640 1 -- 172.21.15.40:0/1988746434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b34154ed0 msgr2=0x7f3b340cb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:11.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.473+0000 7f3b398a8640 1 --2- 172.21.15.40:0/1988746434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b34154ed0 0x7f3b340cb490 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3b240097a0 tx=0x7f3b2402b840 comp rx=0 tx=0).stop 2024-04-22T07:21:11.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.473+0000 7f3b398a8640 1 -- 172.21.15.40:0/1988746434 shutdown_connections 2024-04-22T07:21:11.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.473+0000 7f3b398a8640 1 --2- 172.21.15.40:0/1988746434 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b340cc650 0x7f3b3415e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.473+0000 7f3b398a8640 1 --2- 172.21.15.40:0/1988746434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b34154ed0 0x7f3b340cb490 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.473+0000 7f3b398a8640 1 -- 172.21.15.40:0/1988746434 >> 172.21.15.40:0/1988746434 conn(0x7f3b34073d10 msgr2=0x7f3b3406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:11.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.473+0000 7f3b398a8640 1 -- 172.21.15.40:0/1988746434 shutdown_connections 2024-04-22T07:21:11.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.473+0000 7f3b398a8640 1 -- 172.21.15.40:0/1988746434 wait complete. 2024-04-22T07:21:11.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.474+0000 7f3b398a8640 1 Processor -- start 2024-04-22T07:21:11.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.474+0000 7f3b398a8640 1 -- start start 2024-04-22T07:21:11.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.475+0000 7f3b398a8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b340cc650 0x7f3b340c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:11.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.475+0000 7f3b398a8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b34154ed0 0x7f3b340ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:11.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.475+0000 7f3b398a8640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b3415ef10 0x7f3b340c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:11.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.475+0000 7f3b398a8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3b340cc3b0 con 0x7f3b340cc650 2024-04-22T07:21:11.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.475+0000 7f3b398a8640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3415e4b0 con 0x7f3b34154ed0 2024-04-22T07:21:11.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.475+0000 7f3b398a8640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f3b340cbb20 con 0x7f3b3415ef10 2024-04-22T07:21:11.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.475+0000 7f3b32ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b340cc650 0x7f3b340c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:11.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.475+0000 7f3b32ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b340cc650 0x7f3b340c8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55620/0 (socket says 172.21.15.40:55620) 2024-04-22T07:21:11.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.475+0000 7f3b32ffd640 1 -- 172.21.15.40:0/3110241097 learned_addr learned my addr 172.21.15.40:0/3110241097 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:11.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.475+0000 7f3b32ffd640 1 -- 172.21.15.40:0/3110241097 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b3415ef10 msgr2=0x7f3b340c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:11.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.475+0000 7f3b32ffd640 1 --2- 172.21.15.40:0/3110241097 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b3415ef10 0x7f3b340c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.475+0000 7f3b32ffd640 1 -- 172.21.15.40:0/3110241097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b34154ed0 msgr2=0x7f3b340ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:11.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.475+0000 7f3b32ffd640 1 --2- 172.21.15.40:0/3110241097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b34154ed0 0x7f3b340ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.475+0000 7f3b32ffd640 1 -- 172.21.15.40:0/3110241097 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b340c81e0 con 0x7f3b340cc650 2024-04-22T07:21:11.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.475+0000 7f3b32ffd640 1 --2- 172.21.15.40:0/3110241097 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b340cc650 0x7f3b340c8fc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3b24000c00 tx=0x7f3b240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:11.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.475+0000 7f3b30ff9640 1 -- 172.21.15.40:0/3110241097 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b24004230 con 0x7f3b340cc650 2024-04-22T07:21:11.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.475+0000 7f3b30ff9640 1 -- 172.21.15.40:0/3110241097 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b240043d0 con 0x7f3b340cc650 2024-04-22T07:21:11.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.475+0000 7f3b398a8640 1 -- 172.21.15.40:0/3110241097 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b341f1130 con 0x7f3b340cc650 2024-04-22T07:21:11.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.475+0000 7f3b30ff9640 1 -- 172.21.15.40:0/3110241097 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b24003850 con 0x7f3b340cc650 2024-04-22T07:21:11.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.475+0000 7f3b398a8640 1 -- 172.21.15.40:0/3110241097 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b341f16f0 con 0x7f3b340cc650 2024-04-22T07:21:11.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.476+0000 7f3b398a8640 1 -- 172.21.15.40:0/3110241097 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b34069d40 con 0x7f3b340cc650 2024-04-22T07:21:11.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.477+0000 7f3b30ff9640 1 -- 172.21.15.40:0/3110241097 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3b240039f0 con 0x7f3b340cc650 2024-04-22T07:21:11.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.477+0000 7f3b30ff9640 1 --2- 172.21.15.40:0/3110241097 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f3b1406c8f0 0x7f3b1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:11.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.477+0000 7f3b30ff9640 1 -- 172.21.15.40:0/3110241097 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f3b2402f030 con 0x7f3b340cc650 2024-04-22T07:21:11.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.477+0000 7f3b2bfff640 1 --2- 172.21.15.40:0/3110241097 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f3b1406c8f0 0x7f3b1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:11.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.478+0000 7f3b2bfff640 1 --2- 172.21.15.40:0/3110241097 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f3b1406c8f0 0x7f3b1406edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3b340b64e0 tx=0x7f3b1c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:11.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.481+0000 7f3b30ff9640 1 -- 172.21.15.40:0/3110241097 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3b24041070 con 0x7f3b340cc650 2024-04-22T07:21:11.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.709+0000 7f3b398a8640 1 -- 172.21.15.40:0/3110241097 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b340cbe30 con 0x7f3b340cc650 2024-04-22T07:21:11.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.709+0000 7f3b30ff9640 1 -- 172.21.15.40:0/3110241097 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6821 (secure 0 0 0) 0x7f3b2407bfa0 con 0x7f3b340cc650 2024-04-22T07:21:11.706 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:21:11.707 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1193926607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1193926607},{"type":"v1","addr":"172.21.15.62:6835","nonce":1193926607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/602167189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":602167189},{"type":"v1","addr":"172.21.15.62:6837","nonce":602167189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2062933254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2062933254},{"type":"v1","addr":"172.21.15.40:6835","nonce":2062933254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3873524978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3873524978},{"type":"v1","addr":"172.21.15.40:6837","nonce":3873524978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/1922761385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":1922761385},{"type":"v1","addr":"172.21.15.40:6839","nonce":1922761385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:20:53.216204+0000","modified":"2024-04-22T07:20:58.875393+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.62:6836/2884673656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2884673656},{"type":"v1","addr":"172.21.15.62:6836","nonce":2884673656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4305]},"id":1}]} 2024-04-22T07:21:11.707 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-04-22T07:21:11.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.711+0000 7f3b398a8640 1 -- 172.21.15.40:0/3110241097 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f3b1406c8f0 msgr2=0x7f3b1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:11.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.711+0000 7f3b398a8640 1 --2- 172.21.15.40:0/3110241097 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f3b1406c8f0 0x7f3b1406edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3b340b64e0 tx=0x7f3b1c008040 comp rx=0 tx=0).stop 2024-04-22T07:21:11.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.711+0000 7f3b398a8640 1 -- 172.21.15.40:0/3110241097 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b340cc650 msgr2=0x7f3b340c8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:11.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.711+0000 7f3b398a8640 1 --2- 172.21.15.40:0/3110241097 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b340cc650 0x7f3b340c8fc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3b24000c00 tx=0x7f3b240046c0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.711+0000 7f3b398a8640 1 -- 172.21.15.40:0/3110241097 shutdown_connections 2024-04-22T07:21:11.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.711+0000 7f3b398a8640 1 --2- 172.21.15.40:0/3110241097 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3b3415ef10 0x7f3b340c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.711+0000 7f3b398a8640 1 --2- 172.21.15.40:0/3110241097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b34154ed0 0x7f3b340ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.711+0000 7f3b398a8640 1 --2- 172.21.15.40:0/3110241097 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f3b1406c8f0 0x7f3b1406edb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.711+0000 7f3b398a8640 1 --2- 172.21.15.40:0/3110241097 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b340cc650 0x7f3b340c8fc0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.711+0000 7f3b398a8640 1 -- 172.21.15.40:0/3110241097 >> 172.21.15.40:0/3110241097 conn(0x7f3b34073d10 msgr2=0x7f3b340cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:11.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.711+0000 7f3b398a8640 1 -- 172.21.15.40:0/3110241097 shutdown_connections 2024-04-22T07:21:11.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.711+0000 7f3b398a8640 1 -- 172.21.15.40:0/3110241097 wait complete. 2024-04-22T07:21:11.723 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:21:11.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.825+0000 7f5bd3d04640 1 Processor -- start 2024-04-22T07:21:11.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.825+0000 7f5bd3d04640 1 -- start start 2024-04-22T07:21:11.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.826+0000 7f5bd3d04640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5bcc0cbe20 0x7f5bcc0b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:11.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.826+0000 7f5bd3d04640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bcc15b1b0 con 0x7f5bcc15f0c0 2024-04-22T07:21:11.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.826+0000 7f5bd3d04640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bcc15b490 con 0x7f5bcc155130 2024-04-22T07:21:11.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.826+0000 7f5bd3d04640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f5bcc15b770 con 0x7f5bcc0cbe20 2024-04-22T07:21:11.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.826+0000 7f5bd129f640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5bcc15f0c0 0x7f5bcc0cb710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37688/0 (socket says 172.21.15.40:37688) 2024-04-22T07:21:11.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.826+0000 7f5bd129f640 1 -- 172.21.15.40:0/3818461634 learned_addr learned my addr 172.21.15.40:0/3818461634 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:11.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.826+0000 7f5bd0a9e640 1 -- 172.21.15.40:0/3818461634 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 122384225 0 0) 0x7f5bcc15b1b0 con 0x7f5bcc15f0c0 2024-04-22T07:21:11.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.826+0000 7f5bd0a9e640 1 -- 172.21.15.40:0/3818461634 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bb4003520 con 0x7f5bcc15f0c0 2024-04-22T07:21:11.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.827+0000 7f5bd22a1640 1 --2- 172.21.15.40:0/3818461634 >> v2:172.21.15.62:3300/0 conn(0x7f5bcc0cbe20 0x7f5bcc0b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:11.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.827+0000 7f5bd0a9e640 1 -- 172.21.15.40:0/3818461634 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3915359209 0 0) 0x7f5bb4003520 con 0x7f5bcc15f0c0 2024-04-22T07:21:11.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.827+0000 7f5bd0a9e640 1 -- 172.21.15.40:0/3818461634 >> v2:172.21.15.62:3300/0 conn(0x7f5bcc0cbe20 msgr2=0x7f5bcc0b4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:11.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.827+0000 7f5bd0a9e640 1 --2- 172.21.15.40:0/3818461634 >> v2:172.21.15.62:3300/0 conn(0x7f5bcc0cbe20 0x7f5bcc0b4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.827+0000 7f5bd0a9e640 1 -- 172.21.15.40:0/3818461634 >> v1:172.21.15.62:6789/0 conn(0x7f5bcc155130 legacy=0x7f5bcc0cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:11.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.827+0000 7f5bd0a9e640 1 -- 172.21.15.40:0/3818461634 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bcc15ba50 con 0x7f5bcc15f0c0 2024-04-22T07:21:11.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.827+0000 7f5bd0a9e640 1 -- 172.21.15.40:0/3818461634 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7f5bc0001670 con 0x7f5bcc15f0c0 2024-04-22T07:21:11.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.827+0000 7f5bd0a9e640 1 -- 172.21.15.40:0/3818461634 >> v1:172.21.15.40:6789/0 conn(0x7f5bcc15f0c0 legacy=0x7f5bcc0cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:11.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.827+0000 7f5bd0a9e640 1 --2- 172.21.15.40:0/3818461634 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5bb40039b0 0x7f5bb4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:11.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.827+0000 7f5bd0a9e640 1 --2- 172.21.15.40:0/3818461634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb4004800 0x7f5bb4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:11.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.827+0000 7f5bd0a9e640 1 --2- 172.21.15.40:0/3818461634 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5bb40051c0 0x7f5bb400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:11.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.827+0000 7f5bd0a9e640 1 -- 172.21.15.40:0/3818461634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc15b770 con 0x7f5bb4004800 2024-04-22T07:21:11.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.827+0000 7f5bd0a9e640 1 -- 172.21.15.40:0/3818461634 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb400c0f0 con 0x7f5bb40039b0 2024-04-22T07:21:11.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.827+0000 7f5bd0a9e640 1 -- 172.21.15.40:0/3818461634 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5bb400c2f0 con 0x7f5bb40051c0 2024-04-22T07:21:11.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.827+0000 7f5bd129f640 1 --2- 172.21.15.40:0/3818461634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb4004800 0x7f5bb4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:11.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.827+0000 7f5bd1aa0640 1 --2- 172.21.15.40:0/3818461634 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5bb40039b0 0x7f5bb4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:11.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.827+0000 7f5bd22a1640 1 --2- 172.21.15.40:0/3818461634 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5bb40051c0 0x7f5bb400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:11.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.827+0000 7f5bd129f640 1 -- 172.21.15.40:0/3818461634 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5bb40051c0 msgr2=0x7f5bb400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.827+0000 7f5bd129f640 1 --2- 172.21.15.40:0/3818461634 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5bb40051c0 0x7f5bb400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.827+0000 7f5bd129f640 1 -- 172.21.15.40:0/3818461634 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5bb40039b0 msgr2=0x7f5bb4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.827+0000 7f5bd129f640 1 --2- 172.21.15.40:0/3818461634 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5bb40039b0 0x7f5bb4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.827+0000 7f5bd129f640 1 -- 172.21.15.40:0/3818461634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb4003520 con 0x7f5bb4004800 2024-04-22T07:21:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.827+0000 7f5bd22a1640 1 -- 172.21.15.40:0/3818461634 reap_dead start 2024-04-22T07:21:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.828+0000 7f5bd129f640 1 --2- 172.21.15.40:0/3818461634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb4004800 0x7f5bb4004c80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5bc000c240 tx=0x7f5bb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b8e7eee82256c6b server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.828+0000 7f5bd0a9e640 1 -- 172.21.15.40:0/3818461634 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0007cf0 con 0x7f5bb4004800 2024-04-22T07:21:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.828+0000 7f5bd0a9e640 1 -- 172.21.15.40:0/3818461634 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bc0030070 con 0x7f5bb4004800 2024-04-22T07:21:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.828+0000 7f5bd0a9e640 1 -- 172.21.15.40:0/3818461634 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0005d70 con 0x7f5bb4004800 2024-04-22T07:21:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.829+0000 7f5bd3d04640 1 -- 172.21.15.40:0/3818461634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb4004800 msgr2=0x7f5bb4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.829+0000 7f5bd3d04640 1 --2- 172.21.15.40:0/3818461634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb4004800 0x7f5bb4004c80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5bc000c240 tx=0x7f5bb4005830 comp rx=0 tx=0).stop 2024-04-22T07:21:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.829+0000 7f5bd3d04640 1 -- 172.21.15.40:0/3818461634 shutdown_connections 2024-04-22T07:21:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.829+0000 7f5bd3d04640 1 --2- 172.21.15.40:0/3818461634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bb4004800 0x7f5bb4004c80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.829+0000 7f5bd3d04640 1 -- 172.21.15.40:0/3818461634 >> 172.21.15.40:0/3818461634 conn(0x7f5bcc067890 msgr2=0x7f5bcc072860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:11.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.829+0000 7f5bd3d04640 1 -- 172.21.15.40:0/3818461634 shutdown_connections 2024-04-22T07:21:11.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.829+0000 7f5bd3d04640 1 -- 172.21.15.40:0/3818461634 wait complete. 2024-04-22T07:21:11.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.830+0000 7f5bd3d04640 1 Processor -- start 2024-04-22T07:21:11.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.830+0000 7f5bd3d04640 1 -- start start 2024-04-22T07:21:11.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.831+0000 7f5bd3d04640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5bb4004800 0x7f5bcc0c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:11.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.831+0000 7f5bd3d04640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bcc1e4510 0x7f5bcc1e4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:11.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.831+0000 7f5bd3d04640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5bcc1528a0 0x7f5bcc152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:11.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.831+0000 7f5bd3d04640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc0cb710 con 0x7f5bcc1e4510 2024-04-22T07:21:11.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.831+0000 7f5bd3d04640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc155510 con 0x7f5bb4004800 2024-04-22T07:21:11.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.831+0000 7f5bd3d04640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5bcc0cb890 con 0x7f5bcc1528a0 2024-04-22T07:21:11.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.831+0000 7f5bd129f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bcc1e4510 0x7f5bcc1e4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:11.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.831+0000 7f5bd129f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bcc1e4510 0x7f5bcc1e4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55626/0 (socket says 172.21.15.40:55626) 2024-04-22T07:21:11.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.831+0000 7f5bd129f640 1 -- 172.21.15.40:0/388005584 learned_addr learned my addr 172.21.15.40:0/388005584 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:11.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.831+0000 7f5bd22a1640 1 --2- 172.21.15.40:0/388005584 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5bcc1528a0 0x7f5bcc152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:11.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.831+0000 7f5bd1aa0640 1 --2- 172.21.15.40:0/388005584 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5bb4004800 0x7f5bcc0c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:11.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.831+0000 7f5bd129f640 1 -- 172.21.15.40:0/388005584 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5bcc1528a0 msgr2=0x7f5bcc152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:11.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.831+0000 7f5bd129f640 1 --2- 172.21.15.40:0/388005584 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5bcc1528a0 0x7f5bcc152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.831+0000 7f5bd129f640 1 -- 172.21.15.40:0/388005584 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5bb4004800 msgr2=0x7f5bcc0c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:11.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.831+0000 7f5bd129f640 1 --2- 172.21.15.40:0/388005584 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5bb4004800 0x7f5bcc0c68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:11.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.831+0000 7f5bd129f640 1 -- 172.21.15.40:0/388005584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bcc1e5500 con 0x7f5bcc1e4510 2024-04-22T07:21:11.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.831+0000 7f5bd129f640 1 --2- 172.21.15.40:0/388005584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bcc1e4510 0x7f5bcc1e4970 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5bc000c240 tx=0x7f5bcc0b34f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:11.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.831+0000 7f5bca7fc640 1 -- 172.21.15.40:0/388005584 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0001c30 con 0x7f5bcc1e4510 2024-04-22T07:21:11.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.831+0000 7f5bca7fc640 1 -- 172.21.15.40:0/388005584 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bc0004bf0 con 0x7f5bcc1e4510 2024-04-22T07:21:11.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.831+0000 7f5bd3d04640 1 -- 172.21.15.40:0/388005584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bcc1e57e0 con 0x7f5bcc1e4510 2024-04-22T07:21:11.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.831+0000 7f5bca7fc640 1 -- 172.21.15.40:0/388005584 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc0007070 con 0x7f5bcc1e4510 2024-04-22T07:21:11.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.831+0000 7f5bd3d04640 1 -- 172.21.15.40:0/388005584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bcc1e5da0 con 0x7f5bcc1e4510 2024-04-22T07:21:11.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.832+0000 7f5bd3d04640 1 -- 172.21.15.40:0/388005584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bcc069d40 con 0x7f5bcc1e4510 2024-04-22T07:21:11.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.833+0000 7f5bca7fc640 1 -- 172.21.15.40:0/388005584 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5bc0048020 con 0x7f5bcc1e4510 2024-04-22T07:21:11.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.833+0000 7f5bca7fc640 1 --2- 172.21.15.40:0/388005584 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5bb806c920 0x7f5bb806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:11.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.833+0000 7f5bca7fc640 1 -- 172.21.15.40:0/388005584 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5bc00ace30 con 0x7f5bcc1e4510 2024-04-22T07:21:11.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.833+0000 7f5bd1aa0640 1 --2- 172.21.15.40:0/388005584 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5bb806c920 0x7f5bb806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:11.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.834+0000 7f5bd1aa0640 1 --2- 172.21.15.40:0/388005584 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5bb806c920 0x7f5bb806ede0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5bc40017e0 tx=0x7f5bc4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:11.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:11.838+0000 7f5bca7fc640 1 -- 172.21.15.40:0/388005584 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5bc007ac10 con 0x7f5bcc1e4510 2024-04-22T07:21:12.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.024+0000 7f5bd3d04640 1 -- 172.21.15.40:0/388005584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5bcc0cc2e0 con 0x7f5bcc1e4510 2024-04-22T07:21:12.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.025+0000 7f5bca7fc640 1 -- 172.21.15.40:0/388005584 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16537 (secure 0 0 0) 0x7f5bc007ef10 con 0x7f5bcc1e4510 2024-04-22T07:21:12.023 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:21:12.024 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":23,"fsid":"dd5b16e4-89fe-4602-b37f-062846793158","created":"2024-04-22T07:20:29.488892+0000","modified":"2024-04-22T07:20:54.858120+0000","last_up_change":"2024-04-22T07:20:40.397383+0000","last_in_change":"2024-04-22T07:20:31.702551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:20:41.793179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:20:51.815779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:20:52.164265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32238b7e-228b-4a67-bfca-16e8f0020a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6801","nonce":1526385055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6803","nonce":1526385055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6807","nonce":1526385055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6805","nonce":1526385055}]},"public_addr":"172.21.15.40:6801/1526385055","cluster_addr":"172.21.15.40:6803/1526385055","heartbeat_back_addr":"172.21.15.40:6807/1526385055","heartbeat_front_addr":"172.21.15.40:6805/1526385055","state":["exists","up"]},{"osd":1,"uuid":"5ad8da43-39b1-4295-b4d1-0f1e1d06fc0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6809","nonce":623026645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6811","nonce":623026645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6815","nonce":623026645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6813","nonce":623026645}]},"public_addr":"172.21.15.40:6809/623026645","cluster_addr":"172.21.15.40:6811/623026645","heartbeat_back_addr":"172.21.15.40:6815/623026645","heartbeat_front_addr":"172.21.15.40:6813/623026645","state":["exists","up"]},{"osd":2,"uuid":"7d2c6d50-719d-4232-ad47-f04dcf1a8bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6820","nonce":1885686505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6824","nonce":1885686505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6831","nonce":1885686505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6828","nonce":1885686505}]},"public_addr":"172.21.15.40:6820/1885686505","cluster_addr":"172.21.15.40:6824/1885686505","heartbeat_back_addr":"172.21.15.40:6831/1885686505","heartbeat_front_addr":"172.21.15.40:6828/1885686505","state":["exists","up"]},{"osd":3,"uuid":"af42e7d6-a6bf-403e-92e7-162d7c4fbf0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6817","nonce":130276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6819","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6821","nonce":130276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6829","nonce":130276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6823","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6825","nonce":130276746}]},"public_addr":"172.21.15.40:6817/130276746","cluster_addr":"172.21.15.40:6821/130276746","heartbeat_back_addr":"172.21.15.40:6829/130276746","heartbeat_front_addr":"172.21.15.40:6825/130276746","state":["exists","up"]},{"osd":4,"uuid":"f8e89e0d-be96-4f19-88c0-69c408df7d98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6801","nonce":2251435758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6803","nonce":2251435758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6807","nonce":2251435758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6805","nonce":2251435758}]},"public_addr":"172.21.15.62:6801/2251435758","cluster_addr":"172.21.15.62:6803/2251435758","heartbeat_back_addr":"172.21.15.62:6807/2251435758","heartbeat_front_addr":"172.21.15.62:6805/2251435758","state":["exists","up"]},{"osd":5,"uuid":"ba6dc1bc-272b-4f80-b55f-40bc4a0c3ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6809","nonce":3509322231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6811","nonce":3509322231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6815","nonce":3509322231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6813","nonce":3509322231}]},"public_addr":"172.21.15.62:6809/3509322231","cluster_addr":"172.21.15.62:6811/3509322231","heartbeat_back_addr":"172.21.15.62:6815/3509322231","heartbeat_front_addr":"172.21.15.62:6813/3509322231","state":["exists","up"]},{"osd":6,"uuid":"834fcd74-14bf-45ec-a10a-0374f4ce9bf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6825","nonce":3094315954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6827","nonce":3094315954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6831","nonce":3094315954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6829","nonce":3094315954}]},"public_addr":"172.21.15.62:6825/3094315954","cluster_addr":"172.21.15.62:6827/3094315954","heartbeat_back_addr":"172.21.15.62:6831/3094315954","heartbeat_front_addr":"172.21.15.62:6829/3094315954","state":["exists","up"]},{"osd":7,"uuid":"831c9a73-960e-4d2e-b86a-33a6916be059","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6817","nonce":147453972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6819","nonce":147453972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6823","nonce":147453972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6821","nonce":147453972}]},"public_addr":"172.21.15.62:6817/147453972","cluster_addr":"172.21.15.62:6819/147453972","heartbeat_back_addr":"172.21.15.62:6823/147453972","heartbeat_front_addr":"172.21.15.62:6821/147453972","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.828738+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.873471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.908090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.894782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:37.686796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.801123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.852323+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.812139+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:21:12.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.027+0000 7f5bd3d04640 1 -- 172.21.15.40:0/388005584 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5bb806c920 msgr2=0x7f5bb806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:12.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.027+0000 7f5bd3d04640 1 --2- 172.21.15.40:0/388005584 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5bb806c920 0x7f5bb806ede0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5bc40017e0 tx=0x7f5bc4009040 comp rx=0 tx=0).stop 2024-04-22T07:21:12.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.027+0000 7f5bd3d04640 1 -- 172.21.15.40:0/388005584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bcc1e4510 msgr2=0x7f5bcc1e4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:12.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.027+0000 7f5bd3d04640 1 --2- 172.21.15.40:0/388005584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bcc1e4510 0x7f5bcc1e4970 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5bc000c240 tx=0x7f5bcc0b34f0 comp rx=0 tx=0).stop 2024-04-22T07:21:12.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.027+0000 7f5bd3d04640 1 -- 172.21.15.40:0/388005584 shutdown_connections 2024-04-22T07:21:12.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.027+0000 7f5bd3d04640 1 --2- 172.21.15.40:0/388005584 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5bcc1528a0 0x7f5bcc152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:12.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.027+0000 7f5bd3d04640 1 --2- 172.21.15.40:0/388005584 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5bb806c920 0x7f5bb806ede0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:12.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.027+0000 7f5bd3d04640 1 --2- 172.21.15.40:0/388005584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bcc1e4510 0x7f5bcc1e4970 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:12.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.027+0000 7f5bd3d04640 1 --2- 172.21.15.40:0/388005584 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5bb4004800 0x7f5bcc0c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:12.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.027+0000 7f5bd3d04640 1 -- 172.21.15.40:0/388005584 >> 172.21.15.40:0/388005584 conn(0x7f5bcc067890 msgr2=0x7f5bcc15a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:12.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.027+0000 7f5bd3d04640 1 -- 172.21.15.40:0/388005584 shutdown_connections 2024-04-22T07:21:12.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.027+0000 7f5bd3d04640 1 -- 172.21.15.40:0/388005584 wait complete. 2024-04-22T07:21:12.036 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:21:12.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.139+0000 7fadeb984640 1 Processor -- start 2024-04-22T07:21:12.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.139+0000 7fadeb984640 1 -- start start 2024-04-22T07:21:12.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.140+0000 7fadeb984640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fade4155130 0x7fade40cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:12.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.140+0000 7fadeb984640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fade415f0c0 0x7fade40cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:12.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.140+0000 7fadeb984640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fade415b1b0 con 0x7fade40cb710 2024-04-22T07:21:12.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.140+0000 7fadeb984640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fade415b490 con 0x7fade4155130 2024-04-22T07:21:12.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.140+0000 7fadeb984640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fade415b770 con 0x7fade415f0c0 2024-04-22T07:21:12.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.140+0000 7fade9720640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fade4155130 0x7fade40cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:12.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.140+0000 7fade9f21640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fade40cb710 0x7fade40b4bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37704/0 (socket says 172.21.15.40:37704) 2024-04-22T07:21:12.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.140+0000 7fade9f21640 1 -- 172.21.15.40:0/3134177497 learned_addr learned my addr 172.21.15.40:0/3134177497 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:12.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.140+0000 7fade8f1f640 1 --2- 172.21.15.40:0/3134177497 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fade415f0c0 0x7fade40cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:12.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.140+0000 7fade9720640 1 -- 172.21.15.40:0/3134177497 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fade415f0c0 msgr2=0x7fade40cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:12.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.140+0000 7fade9720640 1 --2- 172.21.15.40:0/3134177497 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fade415f0c0 0x7fade40cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:12.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.140+0000 7fade9720640 1 -- 172.21.15.40:0/3134177497 >> v1:172.21.15.40:6789/0 conn(0x7fade40cb710 legacy=0x7fade40b4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:12.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.140+0000 7fade9720640 1 -- 172.21.15.40:0/3134177497 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade415ba50 con 0x7fade4155130 2024-04-22T07:21:12.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.140+0000 7fade3fff640 1 -- 172.21.15.40:0/3134177497 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 615494715 0 0) 0x7fade415b1b0 con 0x7fade40cb710 2024-04-22T07:21:12.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.141+0000 7fade8f1f640 1 --2- 172.21.15.40:0/3134177497 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fade415f0c0 0x7fade40cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:12.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.141+0000 7fade9720640 1 --2- 172.21.15.40:0/3134177497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fade4155130 0x7fade40cd130 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7faddc0097a0 tx=0x7faddc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec160d9d877fb67 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:12.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.141+0000 7fade3fff640 1 -- 172.21.15.40:0/3134177497 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc034070 con 0x7fade4155130 2024-04-22T07:21:12.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.141+0000 7fade3fff640 1 -- 172.21.15.40:0/3134177497 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faddc030610 con 0x7fade4155130 2024-04-22T07:21:12.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.141+0000 7fade3fff640 1 -- 172.21.15.40:0/3134177497 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc0309e0 con 0x7fade4155130 2024-04-22T07:21:12.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.142+0000 7fadeb984640 1 -- 172.21.15.40:0/3134177497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fade4155130 msgr2=0x7fade40cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:12.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.142+0000 7fadeb984640 1 --2- 172.21.15.40:0/3134177497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fade4155130 0x7fade40cd130 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7faddc0097a0 tx=0x7faddc02b960 comp rx=0 tx=0).stop 2024-04-22T07:21:12.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.142+0000 7fadeb984640 1 -- 172.21.15.40:0/3134177497 shutdown_connections 2024-04-22T07:21:12.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.142+0000 7fadeb984640 1 --2- 172.21.15.40:0/3134177497 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fade415f0c0 0x7fade40cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:12.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.142+0000 7fadeb984640 1 --2- 172.21.15.40:0/3134177497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fade4155130 0x7fade40cd130 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:12.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.142+0000 7fadeb984640 1 -- 172.21.15.40:0/3134177497 >> 172.21.15.40:0/3134177497 conn(0x7fade4067890 msgr2=0x7fade4072860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:12.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.142+0000 7fadeb984640 1 -- 172.21.15.40:0/3134177497 shutdown_connections 2024-04-22T07:21:12.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.142+0000 7fadeb984640 1 -- 172.21.15.40:0/3134177497 wait complete. 2024-04-22T07:21:12.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.143+0000 7fadeb984640 1 Processor -- start 2024-04-22T07:21:12.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.143+0000 7fadeb984640 1 -- start start 2024-04-22T07:21:12.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.144+0000 7fadeb984640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fade40cb710 0x7fade41f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:12.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.144+0000 7fadeb984640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fade4155130 0x7fade4144a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:12.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.144+0000 7fadeb984640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fade415f0c0 0x7fade4144fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:12.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.144+0000 7fadeb984640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fade40b52d0 con 0x7fade40cb710 2024-04-22T07:21:12.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.144+0000 7fadeb984640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fade4155510 con 0x7fade4155130 2024-04-22T07:21:12.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.144+0000 7fadeb984640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fade40b5450 con 0x7fade415f0c0 2024-04-22T07:21:12.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.144+0000 7fade9720640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fade40cb710 0x7fade41f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:12.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.144+0000 7fade9720640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fade40cb710 0x7fade41f1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55630/0 (socket says 172.21.15.40:55630) 2024-04-22T07:21:12.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.144+0000 7fade9720640 1 -- 172.21.15.40:0/2368734497 learned_addr learned my addr 172.21.15.40:0/2368734497 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:12.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.144+0000 7fade8f1f640 1 --2- 172.21.15.40:0/2368734497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fade4155130 0x7fade4144a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:12.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.144+0000 7fade9f21640 1 --2- 172.21.15.40:0/2368734497 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fade415f0c0 0x7fade4144fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:12.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.144+0000 7fade9720640 1 -- 172.21.15.40:0/2368734497 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fade415f0c0 msgr2=0x7fade4144fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:12.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.144+0000 7fade9720640 1 --2- 172.21.15.40:0/2368734497 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fade415f0c0 0x7fade4144fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:12.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.144+0000 7fade9720640 1 -- 172.21.15.40:0/2368734497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fade4155130 msgr2=0x7fade4144a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:12.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.144+0000 7fade9720640 1 --2- 172.21.15.40:0/2368734497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fade4155130 0x7fade4144a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:12.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.144+0000 7fade9720640 1 -- 172.21.15.40:0/2368734497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade4145510 con 0x7fade40cb710 2024-04-22T07:21:12.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.144+0000 7fade9720640 1 --2- 172.21.15.40:0/2368734497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fade40cb710 0x7fade41f1e50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7faddc009890 tx=0x7faddc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:12.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.145+0000 7fade1ffb640 1 -- 172.21.15.40:0/2368734497 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc034040 con 0x7fade40cb710 2024-04-22T07:21:12.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.145+0000 7fade1ffb640 1 -- 172.21.15.40:0/2368734497 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faddc039a10 con 0x7fade40cb710 2024-04-22T07:21:12.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.145+0000 7fade1ffb640 1 -- 172.21.15.40:0/2368734497 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc039de0 con 0x7fade40cb710 2024-04-22T07:21:12.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.145+0000 7fadeb984640 1 -- 172.21.15.40:0/2368734497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade40c71b0 con 0x7fade40cb710 2024-04-22T07:21:12.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.145+0000 7fadeb984640 1 -- 172.21.15.40:0/2368734497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade41e5e00 con 0x7fade40cb710 2024-04-22T07:21:12.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.146+0000 7fadeb984640 1 -- 172.21.15.40:0/2368734497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade40b4180 con 0x7fade40cb710 2024-04-22T07:21:12.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.146+0000 7fade1ffb640 1 -- 172.21.15.40:0/2368734497 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faddc037070 con 0x7fade40cb710 2024-04-22T07:21:12.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.147+0000 7fade1ffb640 1 --2- 172.21.15.40:0/2368734497 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fadd006c920 0x7fadd006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:12.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.147+0000 7fade8f1f640 1 --2- 172.21.15.40:0/2368734497 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fadd006c920 0x7fadd006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:12.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.147+0000 7fade1ffb640 1 -- 172.21.15.40:0/2368734497 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7faddc0adb90 con 0x7fade40cb710 2024-04-22T07:21:12.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.147+0000 7fade8f1f640 1 --2- 172.21.15.40:0/2368734497 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fadd006c920 0x7fadd006ede0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fade40b3d80 tx=0x7fadd8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:12.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.151+0000 7fade1ffb640 1 -- 172.21.15.40:0/2368734497 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fade40b4180 con 0x7fade40cb710 2024-04-22T07:21:12.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.374+0000 7fadeb984640 1 -- 172.21.15.40:0/2368734497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fade414f1b0 con 0x7fade40cb710 2024-04-22T07:21:12.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.374+0000 7fade1ffb640 1 -- 172.21.15.40:0/2368734497 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6821 (secure 0 0 0) 0x7faddc07bfb0 con 0x7fade40cb710 2024-04-22T07:21:12.372 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:21:12.372 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1193926607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1193926607},{"type":"v1","addr":"172.21.15.62:6835","nonce":1193926607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/602167189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":602167189},{"type":"v1","addr":"172.21.15.62:6837","nonce":602167189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2062933254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2062933254},{"type":"v1","addr":"172.21.15.40:6835","nonce":2062933254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3873524978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3873524978},{"type":"v1","addr":"172.21.15.40:6837","nonce":3873524978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/1922761385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":1922761385},{"type":"v1","addr":"172.21.15.40:6839","nonce":1922761385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:20:53.216204+0000","modified":"2024-04-22T07:20:58.875393+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.62:6836/2884673656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2884673656},{"type":"v1","addr":"172.21.15.62:6836","nonce":2884673656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4305]},"id":1}]} 2024-04-22T07:21:12.373 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-04-22T07:21:12.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.376+0000 7fadeb984640 1 -- 172.21.15.40:0/2368734497 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fadd006c920 msgr2=0x7fadd006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:12.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.376+0000 7fadeb984640 1 --2- 172.21.15.40:0/2368734497 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fadd006c920 0x7fadd006ede0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fade40b3d80 tx=0x7fadd8008040 comp rx=0 tx=0).stop 2024-04-22T07:21:12.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.376+0000 7fadeb984640 1 -- 172.21.15.40:0/2368734497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fade40cb710 msgr2=0x7fade41f1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:12.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.376+0000 7fadeb984640 1 --2- 172.21.15.40:0/2368734497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fade40cb710 0x7fade41f1e50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7faddc009890 tx=0x7faddc0046c0 comp rx=0 tx=0).stop 2024-04-22T07:21:12.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.376+0000 7fadeb984640 1 -- 172.21.15.40:0/2368734497 shutdown_connections 2024-04-22T07:21:12.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.376+0000 7fadeb984640 1 --2- 172.21.15.40:0/2368734497 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fade415f0c0 0x7fade4144fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:12.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.376+0000 7fadeb984640 1 --2- 172.21.15.40:0/2368734497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fade4155130 0x7fade4144a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:12.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.376+0000 7fadeb984640 1 --2- 172.21.15.40:0/2368734497 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fadd006c920 0x7fadd006ede0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:12.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.376+0000 7fadeb984640 1 --2- 172.21.15.40:0/2368734497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fade40cb710 0x7fade41f1e50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:12.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.376+0000 7fadeb984640 1 -- 172.21.15.40:0/2368734497 >> 172.21.15.40:0/2368734497 conn(0x7fade4067890 msgr2=0x7fade40b4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:12.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.376+0000 7fadeb984640 1 -- 172.21.15.40:0/2368734497 shutdown_connections 2024-04-22T07:21:12.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:12.376+0000 7fadeb984640 1 -- 172.21.15.40:0/2368734497 wait complete. 2024-04-22T07:21:12.989 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-22T07:20:53.216204+0000', 'modified': '2024-04-22T07:20:58.875393+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4305}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4305': {'gid': 4305, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.62:6836/2884673656', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6833', 'nonce': 2884673656}, {'type': 'v1', 'addr': '172.21.15.62:6836', 'nonce': 2884673656}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4305, 'qdb_cluster': [4305]} 2024-04-22T07:21:12.989 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-22T07:21:12.989 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-22T07:21:13.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.104+0000 7f04ee5f4640 1 Processor -- start 2024-04-22T07:21:13.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.104+0000 7f04ee5f4640 1 -- start start 2024-04-22T07:21:13.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.105+0000 7f04ee5f4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f04e80caee0 0x7f04e8166650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.105+0000 7f04ee5f4640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04e80ccd80 con 0x7f04e8072d40 2024-04-22T07:21:13.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.105+0000 7f04ee5f4640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04e80cb370 con 0x7f04e8154fb0 2024-04-22T07:21:13.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.105+0000 7f04ee5f4640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f04e80c5c50 con 0x7f04e80caee0 2024-04-22T07:21:13.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.105+0000 7f04ecb91640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f04e80caee0 0x7f04e8166650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.105+0000 7f04e77fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f04e8072d40 0x7f04e80d09f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37714/0 (socket says 172.21.15.40:37714) 2024-04-22T07:21:13.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.105+0000 7f04e77fe640 1 -- 172.21.15.40:0/908870303 learned_addr learned my addr 172.21.15.40:0/908870303 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:13.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.105+0000 7f04ecb91640 1 -- 172.21.15.40:0/908870303 >> v1:172.21.15.62:6789/0 conn(0x7f04e8154fb0 legacy=0x7f04e815e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.105+0000 7f04ecb91640 1 -- 172.21.15.40:0/908870303 >> v1:172.21.15.40:6789/0 conn(0x7f04e8072d40 legacy=0x7f04e80d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.105+0000 7f04e6ffd640 1 -- 172.21.15.40:0/908870303 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4185446104 0 0) 0x7f04e80ccd80 con 0x7f04e8072d40 2024-04-22T07:21:13.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.105+0000 7f04ecb91640 1 -- 172.21.15.40:0/908870303 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04e80cc7e0 con 0x7f04e80caee0 2024-04-22T07:21:13.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.106+0000 7f04ecb91640 1 --2- 172.21.15.40:0/908870303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04e80caee0 0x7f04e8166650 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f04e0009d90 tx=0x7f04e002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee8a797950341071 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:13.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.106+0000 7f04e6ffd640 1 -- 172.21.15.40:0/908870303 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e0039070 con 0x7f04e80caee0 2024-04-22T07:21:13.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.106+0000 7f04e6ffd640 1 -- 172.21.15.40:0/908870303 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e002cd00 con 0x7f04e80caee0 2024-04-22T07:21:13.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.106+0000 7f04e6ffd640 1 -- 172.21.15.40:0/908870303 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e0034660 con 0x7f04e80caee0 2024-04-22T07:21:13.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.107+0000 7f04ee5f4640 1 -- 172.21.15.40:0/908870303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04e80caee0 msgr2=0x7f04e8166650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.107+0000 7f04ee5f4640 1 --2- 172.21.15.40:0/908870303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04e80caee0 0x7f04e8166650 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f04e0009d90 tx=0x7f04e002bf50 comp rx=0 tx=0).stop 2024-04-22T07:21:13.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.107+0000 7f04ee5f4640 1 -- 172.21.15.40:0/908870303 shutdown_connections 2024-04-22T07:21:13.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.107+0000 7f04ee5f4640 1 --2- 172.21.15.40:0/908870303 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04e80caee0 0x7f04e8166650 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.107+0000 7f04ee5f4640 1 -- 172.21.15.40:0/908870303 >> 172.21.15.40:0/908870303 conn(0x7f04e80676b0 msgr2=0x7f04e8067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:13.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.107+0000 7f04ee5f4640 1 -- 172.21.15.40:0/908870303 shutdown_connections 2024-04-22T07:21:13.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.107+0000 7f04ee5f4640 1 -- 172.21.15.40:0/908870303 wait complete. 2024-04-22T07:21:13.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.108+0000 7f04ee5f4640 1 Processor -- start 2024-04-22T07:21:13.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.108+0000 7f04ee5f4640 1 -- start start 2024-04-22T07:21:13.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.109+0000 7f04ee5f4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04e8072d40 0x7f04e8159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.109+0000 7f04ee5f4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04e80caee0 0x7f04e8152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.109+0000 7f04ee5f4640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04e8154fb0 0x7f04e81f13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.109+0000 7f04ee5f4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f04e80cb8d0 con 0x7f04e8072d40 2024-04-22T07:21:13.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.109+0000 7f04ee5f4640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f04e8073160 con 0x7f04e80caee0 2024-04-22T07:21:13.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.109+0000 7f04ee5f4640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f04e80cbbb0 con 0x7f04e8154fb0 2024-04-22T07:21:13.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.109+0000 7f04e7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04e8072d40 0x7f04e8159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.109+0000 7f04e7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04e8072d40 0x7f04e8159580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55648/0 (socket says 172.21.15.40:55648) 2024-04-22T07:21:13.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.109+0000 7f04e7fff640 1 -- 172.21.15.40:0/1857565865 learned_addr learned my addr 172.21.15.40:0/1857565865 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:13.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.109+0000 7f04e77fe640 1 --2- 172.21.15.40:0/1857565865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04e80caee0 0x7f04e8152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.109+0000 7f04ecb91640 1 --2- 172.21.15.40:0/1857565865 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04e8154fb0 0x7f04e81f13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.110+0000 7f04e7fff640 1 -- 172.21.15.40:0/1857565865 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04e8154fb0 msgr2=0x7f04e81f13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.110+0000 7f04e7fff640 1 --2- 172.21.15.40:0/1857565865 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04e8154fb0 0x7f04e81f13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.110+0000 7f04e7fff640 1 -- 172.21.15.40:0/1857565865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04e80caee0 msgr2=0x7f04e8152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.110+0000 7f04e7fff640 1 --2- 172.21.15.40:0/1857565865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04e80caee0 0x7f04e8152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.110+0000 7f04e7fff640 1 -- 172.21.15.40:0/1857565865 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04e8157460 con 0x7f04e8072d40 2024-04-22T07:21:13.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.110+0000 7f04ecb91640 1 --2- 172.21.15.40:0/1857565865 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04e8154fb0 0x7f04e81f13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:13.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.110+0000 7f04e77fe640 1 --2- 172.21.15.40:0/1857565865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04e80caee0 0x7f04e8152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:13.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.110+0000 7f04e7fff640 1 --2- 172.21.15.40:0/1857565865 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04e8072d40 0x7f04e8159580 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f04d800c400 tx=0x7f04d800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:13.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.110+0000 7f04e4ff9640 1 -- 172.21.15.40:0/1857565865 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d8017070 con 0x7f04e8072d40 2024-04-22T07:21:13.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.110+0000 7f04e4ff9640 1 -- 172.21.15.40:0/1857565865 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04d80052d0 con 0x7f04e8072d40 2024-04-22T07:21:13.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.110+0000 7f04ee5f4640 1 -- 172.21.15.40:0/1857565865 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04e8157700 con 0x7f04e8072d40 2024-04-22T07:21:13.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.110+0000 7f04e4ff9640 1 -- 172.21.15.40:0/1857565865 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d8003830 con 0x7f04e8072d40 2024-04-22T07:21:13.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.110+0000 7f04ee5f4640 1 -- 172.21.15.40:0/1857565865 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04e8157cc0 con 0x7f04e8072d40 2024-04-22T07:21:13.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.112+0000 7f04e4ff9640 1 -- 172.21.15.40:0/1857565865 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f04d801a070 con 0x7f04e8072d40 2024-04-22T07:21:13.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.112+0000 7f04e4ff9640 1 --2- 172.21.15.40:0/1857565865 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f04d406c8f0 0x7f04d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.112+0000 7f04e4ff9640 1 -- 172.21.15.40:0/1857565865 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f04d808af40 con 0x7f04e8072d40 2024-04-22T07:21:13.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.112+0000 7f04e77fe640 1 --2- 172.21.15.40:0/1857565865 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f04d406c8f0 0x7f04d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.112+0000 7f04e77fe640 1 --2- 172.21.15.40:0/1857565865 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f04d406c8f0 0x7f04d406edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f04e81eeba0 tx=0x7f04dc007c50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:13.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.113+0000 7f04f11e5740 1 Processor -- start 2024-04-22T07:21:13.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.113+0000 7f04f11e5740 1 -- start start 2024-04-22T07:21:13.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.114+0000 7f04f11e5740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55595d529e40 0x55595d532f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.114+0000 7f04f11e5740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55595d4eaec0 0x55595d5334a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.114+0000 7f04f11e5740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55595d4e6ca0 0x55595d50eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.114+0000 7f04f11e5740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55595d44db10 con 0x55595d4eaec0 2024-04-22T07:21:13.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.114+0000 7f04f11e5740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55595d3eb240 con 0x55595d529e40 2024-04-22T07:21:13.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.114+0000 7f04f11e5740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55595d449ad0 con 0x55595d4e6ca0 2024-04-22T07:21:13.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.114+0000 7f04e77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55595d4eaec0 0x55595d5334a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.114+0000 7f04e77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55595d4eaec0 0x55595d5334a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55652/0 (socket says 172.21.15.40:55652) 2024-04-22T07:21:13.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.114+0000 7f04e77fe640 1 -- 172.21.15.40:0/701406631 learned_addr learned my addr 172.21.15.40:0/701406631 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:13.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.114+0000 7f04e7fff640 1 --2- 172.21.15.40:0/701406631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55595d529e40 0x55595d532f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.114+0000 7f04ecb91640 1 --2- 172.21.15.40:0/701406631 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55595d4e6ca0 0x55595d50eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.114+0000 7f04e77fe640 1 -- 172.21.15.40:0/701406631 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55595d4e6ca0 msgr2=0x55595d50eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:13.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.114+0000 7f04e77fe640 1 --2- 172.21.15.40:0/701406631 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55595d4e6ca0 0x55595d50eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.114+0000 7f04e77fe640 1 -- 172.21.15.40:0/701406631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55595d529e40 msgr2=0x55595d532f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:13.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.114+0000 7f04e77fe640 1 --2- 172.21.15.40:0/701406631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55595d529e40 0x55595d532f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.114+0000 7f04e77fe640 1 -- 172.21.15.40:0/701406631 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55595d1602d0 con 0x55595d4eaec0 2024-04-22T07:21:13.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.114+0000 7f04e7fff640 1 --2- 172.21.15.40:0/701406631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55595d529e40 0x55595d532f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:13.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.114+0000 7f04e77fe640 1 --2- 172.21.15.40:0/701406631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55595d4eaec0 0x55595d5334a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f04dc000f60 tx=0x7f04dc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd04fb54f01098c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:13.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.114+0000 7f04cdffb640 1 -- 172.21.15.40:0/701406631 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04dc015110 con 0x55595d4eaec0 2024-04-22T07:21:13.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.114+0000 7f04cdffb640 1 -- 172.21.15.40:0/701406631 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04dc015990 con 0x55595d4eaec0 2024-04-22T07:21:13.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.114+0000 7f04cdffb640 1 -- 172.21.15.40:0/701406631 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04dc015d40 con 0x55595d4eaec0 2024-04-22T07:21:13.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.115+0000 7f04f11e5740 1 -- 172.21.15.40:0/701406631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55595d4eaec0 msgr2=0x55595d5334a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.115+0000 7f04f11e5740 1 --2- 172.21.15.40:0/701406631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55595d4eaec0 0x55595d5334a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f04dc000f60 tx=0x7f04dc012000 comp rx=0 tx=0).stop 2024-04-22T07:21:13.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.115+0000 7f04f11e5740 1 -- 172.21.15.40:0/701406631 shutdown_connections 2024-04-22T07:21:13.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.115+0000 7f04f11e5740 1 --2- 172.21.15.40:0/701406631 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55595d4e6ca0 0x55595d50eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.115+0000 7f04f11e5740 1 --2- 172.21.15.40:0/701406631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55595d4eaec0 0x55595d5334a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.115+0000 7f04f11e5740 1 --2- 172.21.15.40:0/701406631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55595d529e40 0x55595d532f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.115+0000 7f04f11e5740 1 -- 172.21.15.40:0/701406631 >> 172.21.15.40:0/701406631 conn(0x55595d4e5990 msgr2=0x55595d4e8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:13.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.115+0000 7f04f11e5740 1 -- 172.21.15.40:0/701406631 shutdown_connections 2024-04-22T07:21:13.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.115+0000 7f04f11e5740 1 -- 172.21.15.40:0/701406631 wait complete. 2024-04-22T07:21:13.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.116+0000 7f04f11e5740 1 -- start start 2024-04-22T07:21:13.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.116+0000 7f04f11e5740 1 Processor -- start 2024-04-22T07:21:13.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.117+0000 7f04f11e5740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55595d4eaec0 0x55595d508190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.117+0000 7f04f11e5740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55595d529e40 0x55595d532660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.117+0000 7f04f11e5740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55595d531850 0x55595d4e33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.117+0000 7f04f11e5740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55595d4e9250 con 0x55595d4eaec0 2024-04-22T07:21:13.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.117+0000 7f04f11e5740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55595d3d6190 con 0x55595d531850 2024-04-22T07:21:13.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.117+0000 7f04f11e5740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55595d4e9530 con 0x55595d529e40 2024-04-22T07:21:13.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.117+0000 7f04f11e5740 10 client.0 _ll_register_callbacks cb 0x55595d3d18b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:21:13.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.117+0000 7f04e7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55595d4eaec0 0x55595d508190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.117+0000 7f04e7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55595d4eaec0 0x55595d508190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55654/0 (socket says 172.21.15.40:55654) 2024-04-22T07:21:13.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.117+0000 7f04e7fff640 1 -- 172.21.15.40:0/3925628619 learned_addr learned my addr 172.21.15.40:0/3925628619 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:13.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.117+0000 7f04e77fe640 1 --2- 172.21.15.40:0/3925628619 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55595d529e40 0x55595d532660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.117+0000 7f04ecb91640 1 --2- 172.21.15.40:0/3925628619 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55595d531850 0x55595d4e33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.117+0000 7f04e7fff640 1 -- 172.21.15.40:0/3925628619 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55595d529e40 msgr2=0x55595d532660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:13.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.117+0000 7f04e7fff640 1 --2- 172.21.15.40:0/3925628619 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55595d529e40 0x55595d532660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.117+0000 7f04e7fff640 1 -- 172.21.15.40:0/3925628619 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55595d531850 msgr2=0x55595d4e33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:13.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.117+0000 7f04e7fff640 1 --2- 172.21.15.40:0/3925628619 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55595d531850 0x55595d4e33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.117+0000 7f04e7fff640 1 -- 172.21.15.40:0/3925628619 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55595d22a6b0 con 0x55595d4eaec0 2024-04-22T07:21:13.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.117+0000 7f04e7fff640 1 --2- 172.21.15.40:0/3925628619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55595d4eaec0 0x55595d508190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f04d8000fb0 tx=0x7f04d80593a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4829f40453ffe5c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:13.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.117+0000 7f04c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-04-22T07:21:13.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.117+0000 7f04c6ffd640 1 -- 172.21.15.40:0/3925628619 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d8061850 con 0x55595d4eaec0 2024-04-22T07:21:13.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.117+0000 7f04c6ffd640 1 -- 172.21.15.40:0/3925628619 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f04d8055250 con 0x55595d4eaec0 2024-04-22T07:21:13.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.117+0000 7f04f11e5740 1 -- 172.21.15.40:0/3925628619 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04dc015990 con 0x55595d4eaec0 2024-04-22T07:21:13.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.118+0000 7f04c6ffd640 1 -- 172.21.15.40:0/3925628619 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f04d8089120 con 0x55595d4eaec0 2024-04-22T07:21:13.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.118+0000 7f04f11e5740 10 client.4725 fetch_fsmap learned FSMap version 8 2024-04-22T07:21:13.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.118+0000 7f04f11e5740 1 -- 172.21.15.40:0/3925628619 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55595d4e38e0 con 0x55595d4eaec0 2024-04-22T07:21:13.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.118+0000 7f04c6ffd640 1 -- 172.21.15.40:0/3925628619 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04dc015990 con 0x55595d4eaec0 2024-04-22T07:21:13.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.118+0000 7f04c6ffd640 1 -- 172.21.15.40:0/3925628619 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f04d8058030 con 0x55595d4eaec0 2024-04-22T07:21:13.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.118+0000 7f04f11e5740 10 client.4725 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:21:13.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.118+0000 7f04f11e5740 10 client.4725 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-22T07:21:13.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.118+0000 7f04f11e5740 20 client.4725 populate_metadata read hostname 'smithi040' 2024-04-22T07:21:13.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.118+0000 7f04f11e5740 1 --2- 172.21.15.40:0/3925628619 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55595d5478f0 0x55595d549ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.118+0000 7f04f11e5740 4 client.4725 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T07:21:13.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.118+0000 7f04f11e5740 1 -- 172.21.15.40:0/3925628619 --> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55595d45b530 con 0x55595d5478f0 2024-04-22T07:21:13.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.118+0000 7f04e77fe640 1 --2- 172.21.15.40:0/3925628619 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55595d5478f0 0x55595d549ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.119+0000 7f04e77fe640 1 --2- 172.21.15.40:0/3925628619 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55595d5478f0 0x55595d549ce0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=166fef4cc3cfebed server_cookie=36bb73973e56abbc in_seq=0 out_seq=0 2024-04-22T07:21:13.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.119+0000 7f04c6ffd640 10 client.4725 ms_handle_connect on v2:172.21.15.62:6833/2884673656 2024-04-22T07:21:13.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.119+0000 7f04c6ffd640 1 -- 172.21.15.40:0/3925628619 <== mds.0 v2:172.21.15.62:6833/2884673656 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55595d45b530 con 0x55595d5478f0 2024-04-22T07:21:13.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.119+0000 7f04c6ffd640 10 client.4725 handle_command_reply: tid=0 2024-04-22T07:21:13.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.119+0000 7f04f11e5740 1 client.4725 shutdown 2024-04-22T07:21:13.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.120+0000 7f04f11e5740 1 -- 172.21.15.40:0/3925628619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55595d4eaec0 msgr2=0x55595d508190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.120+0000 7f04f11e5740 1 --2- 172.21.15.40:0/3925628619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55595d4eaec0 0x55595d508190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f04d8000fb0 tx=0x7f04d80593a0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.120+0000 7f04f11e5740 1 -- 172.21.15.40:0/3925628619 shutdown_connections 2024-04-22T07:21:13.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.120+0000 7f04f11e5740 1 --2- 172.21.15.40:0/3925628619 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55595d5478f0 0x55595d549ce0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.120+0000 7f04f11e5740 1 --2- 172.21.15.40:0/3925628619 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55595d531850 0x55595d4e33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.120+0000 7f04f11e5740 1 --2- 172.21.15.40:0/3925628619 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55595d529e40 0x55595d532660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.120+0000 7f04c6ffd640 0 client.4725 ms_handle_reset on v2:172.21.15.62:6833/2884673656 2024-04-22T07:21:13.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.120+0000 7f04f11e5740 1 --2- 172.21.15.40:0/3925628619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55595d4eaec0 0x55595d508190 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.120+0000 7f04f11e5740 1 -- 172.21.15.40:0/3925628619 >> 172.21.15.40:0/3925628619 conn(0x55595d4e6ca0 msgr2=0x55595d50af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:13.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.120+0000 7f04f11e5740 1 -- 172.21.15.40:0/3925628619 shutdown_connections 2024-04-22T07:21:13.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.120+0000 7f04f11e5740 1 -- 172.21.15.40:0/3925628619 wait complete. 2024-04-22T07:21:13.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.120+0000 7f04f11e5740 20 client.4725 trim_cache size 0 max 16384 2024-04-22T07:21:13.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.138+0000 7f04f11e5740 1 Processor -- start 2024-04-22T07:21:13.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.138+0000 7f04f11e5740 1 -- start start 2024-04-22T07:21:13.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.139+0000 7f04f11e5740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55595d4eaec0 0x55595d4e2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.139+0000 7f04f11e5740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55595d529e40 0x55595d508cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.139+0000 7f04f11e5740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55595d531850 0x55595d5264f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.139+0000 7f04f11e5740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f04e81f4560 con 0x55595d531850 2024-04-22T07:21:13.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.139+0000 7f04f11e5740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f04e81f4bb0 con 0x55595d529e40 2024-04-22T07:21:13.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.139+0000 7f04f11e5740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55595d509a30 con 0x55595d4eaec0 2024-04-22T07:21:13.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.139+0000 7f04ecb91640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55595d531850 0x55595d5264f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.139+0000 7f04ecb91640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55595d531850 0x55595d5264f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55666/0 (socket says 172.21.15.40:55666) 2024-04-22T07:21:13.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.139+0000 7f04ecb91640 1 -- 172.21.15.40:0/2455558443 learned_addr learned my addr 172.21.15.40:0/2455558443 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:13.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.139+0000 7f04e77fe640 1 --2- 172.21.15.40:0/2455558443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55595d529e40 0x55595d508cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.139+0000 7f04e7fff640 1 --2- 172.21.15.40:0/2455558443 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55595d4eaec0 0x55595d4e2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.139+0000 7f04ecb91640 1 -- 172.21.15.40:0/2455558443 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55595d4eaec0 msgr2=0x55595d4e2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:13.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.139+0000 7f04ecb91640 1 --2- 172.21.15.40:0/2455558443 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55595d4eaec0 0x55595d4e2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.139+0000 7f04ecb91640 1 -- 172.21.15.40:0/2455558443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55595d529e40 msgr2=0x55595d508cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:13.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.139+0000 7f04ecb91640 1 --2- 172.21.15.40:0/2455558443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55595d529e40 0x55595d508cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.139+0000 7f04ecb91640 1 -- 172.21.15.40:0/2455558443 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55595d50e5b0 con 0x55595d531850 2024-04-22T07:21:13.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.139+0000 7f04ecb91640 1 --2- 172.21.15.40:0/2455558443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55595d531850 0x55595d5264f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f04e0009eb0 tx=0x7f04e002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a2359d4653073dc server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:13.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.139+0000 7f04cd7fa640 1 -- 172.21.15.40:0/2455558443 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e0039040 con 0x55595d531850 2024-04-22T07:21:13.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.139+0000 7f04cd7fa640 1 -- 172.21.15.40:0/2455558443 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e0034640 con 0x55595d531850 2024-04-22T07:21:13.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.139+0000 7f04cd7fa640 1 -- 172.21.15.40:0/2455558443 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e0034a30 con 0x55595d531850 2024-04-22T07:21:13.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.140+0000 7f04f11e5740 1 -- 172.21.15.40:0/2455558443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55595d531850 msgr2=0x55595d5264f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.140+0000 7f04f11e5740 1 --2- 172.21.15.40:0/2455558443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55595d531850 0x55595d5264f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f04e0009eb0 tx=0x7f04e002e000 comp rx=0 tx=0).stop 2024-04-22T07:21:13.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.140+0000 7f04f11e5740 1 -- 172.21.15.40:0/2455558443 shutdown_connections 2024-04-22T07:21:13.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.140+0000 7f04f11e5740 1 --2- 172.21.15.40:0/2455558443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55595d531850 0x55595d5264f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.140+0000 7f04f11e5740 1 --2- 172.21.15.40:0/2455558443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55595d529e40 0x55595d508cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.140+0000 7f04f11e5740 1 --2- 172.21.15.40:0/2455558443 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55595d4eaec0 0x55595d4e2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.140+0000 7f04f11e5740 1 -- 172.21.15.40:0/2455558443 >> 172.21.15.40:0/2455558443 conn(0x55595d4e6ca0 msgr2=0x55595d5078e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:13.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.140+0000 7f04f11e5740 1 -- 172.21.15.40:0/2455558443 shutdown_connections 2024-04-22T07:21:13.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.140+0000 7f04f11e5740 1 -- 172.21.15.40:0/2455558443 wait complete. 2024-04-22T07:21:13.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.140+0000 7f04f11e5740 1 -- start start 2024-04-22T07:21:13.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.141+0000 7f04f11e5740 1 Processor -- start 2024-04-22T07:21:13.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.141+0000 7f04f11e5740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55595d4eaec0 0x55595d5a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.141+0000 7f04f11e5740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55595d529e40 0x55595d4e7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.141+0000 7f04f11e5740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55595d531850 0x55595d59b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.141+0000 7f04f11e5740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55595d527af0 con 0x55595d531850 2024-04-22T07:21:13.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.141+0000 7f04f11e5740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55595d531cd0 con 0x55595d529e40 2024-04-22T07:21:13.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.141+0000 7f04f11e5740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55595d523970 con 0x55595d4eaec0 2024-04-22T07:21:13.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.141+0000 7f04f11e5740 10 client.0 _ll_register_callbacks cb 0x7f04d8054e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:21:13.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.141+0000 7f04ecb91640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55595d531850 0x55595d59b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.141+0000 7f04ecb91640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55595d531850 0x55595d59b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55672/0 (socket says 172.21.15.40:55672) 2024-04-22T07:21:13.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.141+0000 7f04ecb91640 1 -- 172.21.15.40:0/1684989072 learned_addr learned my addr 172.21.15.40:0/1684989072 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:13.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.142+0000 7f04e7fff640 1 --2- 172.21.15.40:0/1684989072 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55595d4eaec0 0x55595d5a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.142+0000 7f04e77fe640 1 --2- 172.21.15.40:0/1684989072 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55595d529e40 0x55595d4e7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.142+0000 7f04ecb91640 1 -- 172.21.15.40:0/1684989072 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55595d4eaec0 msgr2=0x55595d5a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:13.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.142+0000 7f04ecb91640 1 --2- 172.21.15.40:0/1684989072 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55595d4eaec0 0x55595d5a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.142+0000 7f04ecb91640 1 -- 172.21.15.40:0/1684989072 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55595d529e40 msgr2=0x55595d4e7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:13.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.142+0000 7f04ecb91640 1 --2- 172.21.15.40:0/1684989072 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55595d529e40 0x55595d4e7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.142+0000 7f04ecb91640 1 -- 172.21.15.40:0/1684989072 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55595d509730 con 0x55595d531850 2024-04-22T07:21:13.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.142+0000 7f04ecb91640 1 --2- 172.21.15.40:0/1684989072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55595d531850 0x55595d59b860 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f04e0046000 tx=0x7f04e0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9aeeb720f0f26ca server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:13.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.142+0000 7f04c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-04-22T07:21:13.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.142+0000 7f04c6ffd640 1 -- 172.21.15.40:0/1684989072 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e0039040 con 0x55595d531850 2024-04-22T07:21:13.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.142+0000 7f04c6ffd640 1 -- 172.21.15.40:0/1684989072 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f04e00349f0 con 0x55595d531850 2024-04-22T07:21:13.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.142+0000 7f04f11e5740 1 -- 172.21.15.40:0/1684989072 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04e0034640 con 0x55595d531850 2024-04-22T07:21:13.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.142+0000 7f04c6ffd640 1 -- 172.21.15.40:0/1684989072 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f04e0034bf0 con 0x55595d531850 2024-04-22T07:21:13.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.142+0000 7f04f11e5740 10 client.4731 fetch_fsmap learned FSMap version 8 2024-04-22T07:21:13.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.142+0000 7f04f11e5740 1 -- 172.21.15.40:0/1684989072 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55595d5a87b0 con 0x55595d531850 2024-04-22T07:21:13.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.142+0000 7f04c6ffd640 1 -- 172.21.15.40:0/1684989072 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e0034640 con 0x55595d531850 2024-04-22T07:21:13.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.142+0000 7f04c6ffd640 1 -- 172.21.15.40:0/1684989072 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f04e00416f0 con 0x55595d531850 2024-04-22T07:21:13.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.142+0000 7f04f11e5740 10 client.4731 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:21:13.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.142+0000 7f04f11e5740 10 client.4731 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-22T07:21:13.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.142+0000 7f04f11e5740 20 client.4731 populate_metadata read hostname 'smithi040' 2024-04-22T07:21:13.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.142+0000 7f04f11e5740 1 --2- 172.21.15.40:0/1684989072 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55595d5294e0 0x55595d5b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.142+0000 7f04f11e5740 4 client.4731 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-22T07:21:13.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.142+0000 7f04f11e5740 1 -- 172.21.15.40:0/1684989072 --> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] -- command(tid 0: {"prefix": "status"}) -- 0x55595d4553a0 con 0x55595d5294e0 2024-04-22T07:21:13.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.143+0000 7f04e7fff640 1 --2- 172.21.15.40:0/1684989072 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55595d5294e0 0x55595d5b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.143+0000 7f04e7fff640 1 --2- 172.21.15.40:0/1684989072 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55595d5294e0 0x55595d5b1ab0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a84cb5e7e7577da server_cookie=d1ee12d88279a3e8 in_seq=0 out_seq=0 2024-04-22T07:21:13.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.143+0000 7f04c6ffd640 10 client.4731 ms_handle_connect on v2:172.21.15.62:6833/2884673656 2024-04-22T07:21:13.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.143+0000 7f04c6ffd640 1 -- 172.21.15.40:0/1684989072 <== mds.0 v2:172.21.15.62:6833/2884673656 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55595d4553a0 con 0x55595d5294e0 2024-04-22T07:21:13.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.143+0000 7f04c6ffd640 10 client.4731 handle_command_reply: tid=0 2024-04-22T07:21:13.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.143+0000 7f04f11e5740 1 client.4731 shutdown 2024-04-22T07:21:13.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.143+0000 7f04f11e5740 1 -- 172.21.15.40:0/1684989072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55595d531850 msgr2=0x55595d59b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.143+0000 7f04f11e5740 1 --2- 172.21.15.40:0/1684989072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55595d531850 0x55595d59b860 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f04e0046000 tx=0x7f04e0004ab0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.143+0000 7f04f11e5740 1 -- 172.21.15.40:0/1684989072 shutdown_connections 2024-04-22T07:21:13.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.143+0000 7f04f11e5740 1 --2- 172.21.15.40:0/1684989072 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55595d5294e0 0x55595d5b1ab0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.143+0000 7f04f11e5740 1 --2- 172.21.15.40:0/1684989072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55595d531850 0x55595d59b860 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.143+0000 7f04f11e5740 1 --2- 172.21.15.40:0/1684989072 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55595d529e40 0x55595d4e7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.143+0000 7f04c6ffd640 0 client.4731 ms_handle_reset on v2:172.21.15.62:6833/2884673656 2024-04-22T07:21:13.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.143+0000 7f04f11e5740 1 --2- 172.21.15.40:0/1684989072 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55595d4eaec0 0x55595d5a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.143+0000 7f04f11e5740 1 -- 172.21.15.40:0/1684989072 >> 172.21.15.40:0/1684989072 conn(0x55595d4e6ca0 msgr2=0x55595d53cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:13.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.143+0000 7f04f11e5740 1 -- 172.21.15.40:0/1684989072 shutdown_connections 2024-04-22T07:21:13.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.144+0000 7f04f11e5740 1 -- 172.21.15.40:0/1684989072 wait complete. 2024-04-22T07:21:13.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.144+0000 7f04f11e5740 20 client.4731 trim_cache size 0 max 16384 2024-04-22T07:21:13.148 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-22T07:21:13.148 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "dd5b16e4-89fe-4602-b37f-062846793158", 2024-04-22T07:21:13.148 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2024-04-22T07:21:13.148 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4305, 2024-04-22T07:21:13.148 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-04-22T07:21:13.148 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-04-22T07:21:13.148 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-04-22T07:21:13.148 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 19.284522774999999, 2024-04-22T07:21:13.148 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 8, 2024-04-22T07:21:13.148 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 23, 2024-04-22T07:21:13.148 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 23, 2024-04-22T07:21:13.148 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 25.828024343999999 2024-04-22T07:21:13.148 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-22T07:21:13.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.144+0000 7f04ee5f4640 1 -- 172.21.15.40:0/1857565865 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f04d406c8f0 msgr2=0x7f04d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.144+0000 7f04ee5f4640 1 --2- 172.21.15.40:0/1857565865 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f04d406c8f0 0x7f04d406edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f04e81eeba0 tx=0x7f04dc007c50 comp rx=0 tx=0).stop 2024-04-22T07:21:13.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.144+0000 7f04ee5f4640 1 -- 172.21.15.40:0/1857565865 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04e8072d40 msgr2=0x7f04e8159580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.144+0000 7f04ee5f4640 1 --2- 172.21.15.40:0/1857565865 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04e8072d40 0x7f04e8159580 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f04d800c400 tx=0x7f04d800c8c0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.144+0000 7f04ee5f4640 1 -- 172.21.15.40:0/1857565865 shutdown_connections 2024-04-22T07:21:13.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.144+0000 7f04ee5f4640 1 --2- 172.21.15.40:0/1857565865 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f04e8154fb0 0x7f04e81f13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.144+0000 7f04ee5f4640 1 --2- 172.21.15.40:0/1857565865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04e80caee0 0x7f04e8152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.144+0000 7f04ee5f4640 1 --2- 172.21.15.40:0/1857565865 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f04d406c8f0 0x7f04d406edb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.144+0000 7f04ee5f4640 1 --2- 172.21.15.40:0/1857565865 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04e8072d40 0x7f04e8159580 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.144+0000 7f04ee5f4640 1 -- 172.21.15.40:0/1857565865 >> 172.21.15.40:0/1857565865 conn(0x7f04e80676b0 msgr2=0x7f04e80cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:13.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.144+0000 7f04ee5f4640 1 -- 172.21.15.40:0/1857565865 shutdown_connections 2024-04-22T07:21:13.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.144+0000 7f04ee5f4640 1 -- 172.21.15.40:0/1857565865 wait complete. 2024-04-22T07:21:13.153 INFO:teuthology.run_tasks:Running task sequential... 2024-04-22T07:21:13.165 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-22T07:21:13.165 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-22T07:21:13.166 INFO:teuthology.task.print:Enabling mgr modules 2024-04-22T07:21:13.166 INFO:teuthology.run_tasks:Running task kclient... 2024-04-22T07:21:13.195 INFO:tasks.kclient:Mounting kernel clients... 2024-04-22T07:21:13.195 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-22T07:21:13.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T07:21:13.195 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-04-22T07:21:13.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T07:21:13.211 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2024-04-22T07:21:13.278 INFO:teuthology.orchestra.run.smithi040.stderr:Cannot find device "ceph-brx" 2024-04-22T07:21:13.279 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T07:21:13.279 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-04-22T07:21:13.279 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-22T07:21:13.279 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-22T07:21:13.280 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-22T07:21:13.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.423+0000 7fc4db29a640 1 Processor -- start 2024-04-22T07:21:13.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.423+0000 7fc4db29a640 1 -- start start 2024-04-22T07:21:13.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.424+0000 7fc4db29a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc4d4072a40 0x7fc4d4071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.424+0000 7fc4db29a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4d40cb210 con 0x7fc4d41552b0 2024-04-22T07:21:13.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.424+0000 7fc4db29a640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4d40c66c0 con 0x7fc4d4154ed0 2024-04-22T07:21:13.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.424+0000 7fc4db29a640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fc4d40cafb0 con 0x7fc4d4072a40 2024-04-22T07:21:13.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.424+0000 7fc4d8835640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc4d41552b0 0x7fc4d40cbf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37728/0 (socket says 172.21.15.40:37728) 2024-04-22T07:21:13.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.424+0000 7fc4d8835640 1 -- 172.21.15.40:0/789797968 learned_addr learned my addr 172.21.15.40:0/789797968 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:13.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.424+0000 7fc4cbfff640 1 -- 172.21.15.40:0/789797968 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1826760585 0 0) 0x7fc4d40cb210 con 0x7fc4d41552b0 2024-04-22T07:21:13.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.424+0000 7fc4cbfff640 1 -- 172.21.15.40:0/789797968 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4c0003520 con 0x7fc4d41552b0 2024-04-22T07:21:13.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.424+0000 7fc4d9837640 1 --2- 172.21.15.40:0/789797968 >> v2:172.21.15.62:3300/0 conn(0x7fc4d4072a40 0x7fc4d4071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.424+0000 7fc4cbfff640 1 -- 172.21.15.40:0/789797968 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1280536647 0 0) 0x7fc4c0003520 con 0x7fc4d41552b0 2024-04-22T07:21:13.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.424+0000 7fc4cbfff640 1 -- 172.21.15.40:0/789797968 >> v2:172.21.15.62:3300/0 conn(0x7fc4d4072a40 msgr2=0x7fc4d4071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:13.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.424+0000 7fc4cbfff640 1 --2- 172.21.15.40:0/789797968 >> v2:172.21.15.62:3300/0 conn(0x7fc4d4072a40 0x7fc4d4071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.424+0000 7fc4cbfff640 1 -- 172.21.15.40:0/789797968 >> v1:172.21.15.62:6789/0 conn(0x7fc4d4154ed0 legacy=0x7fc4d415ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.424+0000 7fc4cbfff640 1 -- 172.21.15.40:0/789797968 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d40cb4d0 con 0x7fc4d41552b0 2024-04-22T07:21:13.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.424+0000 7fc4cbfff640 1 -- 172.21.15.40:0/789797968 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7fc4c4001670 con 0x7fc4d41552b0 2024-04-22T07:21:13.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.424+0000 7fc4d9837640 1 --2- 172.21.15.40:0/789797968 >> v2:172.21.15.62:3300/0 conn(0x7fc4d4072a40 0x7fc4d4071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:13.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.424+0000 7fc4cbfff640 1 -- 172.21.15.40:0/789797968 >> v1:172.21.15.40:6789/0 conn(0x7fc4d41552b0 legacy=0x7fc4d40cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.424+0000 7fc4cbfff640 1 --2- 172.21.15.40:0/789797968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4c00039b0 0x7fc4c0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.424+0000 7fc4cbfff640 1 --2- 172.21.15.40:0/789797968 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4c0004800 0x7fc4c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.424+0000 7fc4cbfff640 1 --2- 172.21.15.40:0/789797968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4c00051c0 0x7fc4c000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.424+0000 7fc4cbfff640 1 -- 172.21.15.40:0/789797968 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d40cafb0 con 0x7fc4c00039b0 2024-04-22T07:21:13.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.424+0000 7fc4cbfff640 1 -- 172.21.15.40:0/789797968 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c000c0f0 con 0x7fc4c00051c0 2024-04-22T07:21:13.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.424+0000 7fc4cbfff640 1 -- 172.21.15.40:0/789797968 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc4c000c2f0 con 0x7fc4c0004800 2024-04-22T07:21:13.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.425+0000 7fc4d9036640 1 --2- 172.21.15.40:0/789797968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4c00039b0 0x7fc4c0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.425+0000 7fc4d8835640 1 --2- 172.21.15.40:0/789797968 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4c0004800 0x7fc4c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.425+0000 7fc4d9837640 1 --2- 172.21.15.40:0/789797968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4c00051c0 0x7fc4c000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.425+0000 7fc4d9036640 1 -- 172.21.15.40:0/789797968 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4c0004800 msgr2=0x7fc4c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:13.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.425+0000 7fc4d9036640 1 --2- 172.21.15.40:0/789797968 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4c0004800 0x7fc4c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.425+0000 7fc4d9036640 1 -- 172.21.15.40:0/789797968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4c00051c0 msgr2=0x7fc4c000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:13.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.425+0000 7fc4d9036640 1 --2- 172.21.15.40:0/789797968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4c00051c0 0x7fc4c000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.425+0000 7fc4d9837640 1 -- 172.21.15.40:0/789797968 reap_dead start 2024-04-22T07:21:13.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.425+0000 7fc4d9036640 1 -- 172.21.15.40:0/789797968 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4c0003520 con 0x7fc4c00039b0 2024-04-22T07:21:13.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.425+0000 7fc4d8835640 1 --2- 172.21.15.40:0/789797968 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4c0004800 0x7fc4c0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:13.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.426+0000 7fc4d9036640 1 --2- 172.21.15.40:0/789797968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4c00039b0 0x7fc4c0003dd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0001750 tx=0x7fc4c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff34676d962fe7a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:13.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.426+0000 7fc4cbfff640 1 -- 172.21.15.40:0/789797968 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0001370 con 0x7fc4c00039b0 2024-04-22T07:21:13.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.426+0000 7fc4cbfff640 1 -- 172.21.15.40:0/789797968 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d00052d0 con 0x7fc4c00039b0 2024-04-22T07:21:13.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.426+0000 7fc4cbfff640 1 -- 172.21.15.40:0/789797968 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0003830 con 0x7fc4c00039b0 2024-04-22T07:21:13.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.426+0000 7fc4db29a640 1 -- 172.21.15.40:0/789797968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4c00039b0 msgr2=0x7fc4c0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.426+0000 7fc4db29a640 1 --2- 172.21.15.40:0/789797968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4c00039b0 0x7fc4c0003dd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0001750 tx=0x7fc4c0005830 comp rx=0 tx=0).stop 2024-04-22T07:21:13.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.426+0000 7fc4db29a640 1 -- 172.21.15.40:0/789797968 shutdown_connections 2024-04-22T07:21:13.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.426+0000 7fc4db29a640 1 --2- 172.21.15.40:0/789797968 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4c00039b0 0x7fc4c0003dd0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.426+0000 7fc4db29a640 1 -- 172.21.15.40:0/789797968 >> 172.21.15.40:0/789797968 conn(0x7fc4d40736e0 msgr2=0x7fc4d406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:13.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.426+0000 7fc4db29a640 1 -- 172.21.15.40:0/789797968 shutdown_connections 2024-04-22T07:21:13.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.426+0000 7fc4db29a640 1 -- 172.21.15.40:0/789797968 wait complete. 2024-04-22T07:21:13.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.427+0000 7fc4db29a640 1 Processor -- start 2024-04-22T07:21:13.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.428+0000 7fc4db29a640 1 -- start start 2024-04-22T07:21:13.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.428+0000 7fc4db29a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4c00039b0 0x7fc4d41f1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.428+0000 7fc4db29a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4d4155870 0x7fc4d40c7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.428+0000 7fc4db29a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4d4157f90 0x7fc4d40c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.428+0000 7fc4db29a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d40c5be0 con 0x7fc4c00039b0 2024-04-22T07:21:13.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.428+0000 7fc4db29a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d40c5900 con 0x7fc4d4155870 2024-04-22T07:21:13.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.428+0000 7fc4db29a640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc4d40c5ec0 con 0x7fc4d4157f90 2024-04-22T07:21:13.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.428+0000 7fc4d9036640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4c00039b0 0x7fc4d41f1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.428+0000 7fc4d9036640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4c00039b0 0x7fc4d41f1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55696/0 (socket says 172.21.15.40:55696) 2024-04-22T07:21:13.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.428+0000 7fc4d9036640 1 -- 172.21.15.40:0/3223690852 learned_addr learned my addr 172.21.15.40:0/3223690852 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:13.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.428+0000 7fc4d9837640 1 --2- 172.21.15.40:0/3223690852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4d4157f90 0x7fc4d40c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.428+0000 7fc4d8835640 1 --2- 172.21.15.40:0/3223690852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4d4155870 0x7fc4d40c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.429+0000 7fc4d9036640 1 -- 172.21.15.40:0/3223690852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4d4157f90 msgr2=0x7fc4d40c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.429+0000 7fc4d9036640 1 --2- 172.21.15.40:0/3223690852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4d4157f90 0x7fc4d40c7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.429+0000 7fc4d9036640 1 -- 172.21.15.40:0/3223690852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4d4155870 msgr2=0x7fc4d40c7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.429+0000 7fc4d9036640 1 --2- 172.21.15.40:0/3223690852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4d4155870 0x7fc4d40c7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.429+0000 7fc4d9036640 1 -- 172.21.15.40:0/3223690852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d41f20d0 con 0x7fc4c00039b0 2024-04-22T07:21:13.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.429+0000 7fc4d9036640 1 --2- 172.21.15.40:0/3223690852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4c00039b0 0x7fc4d41f1b90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0034040 tx=0x7fc4d0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:13.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.429+0000 7fc4c9ffb640 1 -- 172.21.15.40:0/3223690852 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0041070 con 0x7fc4c00039b0 2024-04-22T07:21:13.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.429+0000 7fc4c9ffb640 1 -- 172.21.15.40:0/3223690852 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d0005480 con 0x7fc4c00039b0 2024-04-22T07:21:13.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.429+0000 7fc4db29a640 1 -- 172.21.15.40:0/3223690852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4d40c9e70 con 0x7fc4c00039b0 2024-04-22T07:21:13.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.429+0000 7fc4c9ffb640 1 -- 172.21.15.40:0/3223690852 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0007a30 con 0x7fc4c00039b0 2024-04-22T07:21:13.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.429+0000 7fc4db29a640 1 -- 172.21.15.40:0/3223690852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4d40ca430 con 0x7fc4c00039b0 2024-04-22T07:21:13.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.430+0000 7fc4db29a640 1 -- 172.21.15.40:0/3223690852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4d40b5b40 con 0x7fc4c00039b0 2024-04-22T07:21:13.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.431+0000 7fc4c9ffb640 1 -- 172.21.15.40:0/3223690852 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc4d0044070 con 0x7fc4c00039b0 2024-04-22T07:21:13.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.431+0000 7fc4c9ffb640 1 --2- 172.21.15.40:0/3223690852 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc4b806c920 0x7fc4b806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:13.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.431+0000 7fc4d8835640 1 --2- 172.21.15.40:0/3223690852 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc4b806c920 0x7fc4b806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:13.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.431+0000 7fc4c9ffb640 1 -- 172.21.15.40:0/3223690852 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc4d00ad5c0 con 0x7fc4c00039b0 2024-04-22T07:21:13.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.432+0000 7fc4d8835640 1 --2- 172.21.15.40:0/3223690852 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc4b806c920 0x7fc4b806ede0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4155800 tx=0x7fc4c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:13.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.436+0000 7fc4c9ffb640 1 -- 172.21.15.40:0/3223690852 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc4d40b5b40 con 0x7fc4c00039b0 2024-04-22T07:21:13.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.660+0000 7fc4db29a640 1 -- 172.21.15.40:0/3223690852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc4d40cac80 con 0x7fc4c00039b0 2024-04-22T07:21:13.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.660+0000 7fc4c9ffb640 1 -- 172.21.15.40:0/3223690852 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fc4d40cac80 con 0x7fc4c00039b0 2024-04-22T07:21:13.658 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-22T07:21:13.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.662+0000 7fc4db29a640 1 -- 172.21.15.40:0/3223690852 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc4b806c920 msgr2=0x7fc4b806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.662+0000 7fc4db29a640 1 --2- 172.21.15.40:0/3223690852 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc4b806c920 0x7fc4b806ede0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4155800 tx=0x7fc4c4009040 comp rx=0 tx=0).stop 2024-04-22T07:21:13.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.662+0000 7fc4db29a640 1 -- 172.21.15.40:0/3223690852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4c00039b0 msgr2=0x7fc4d41f1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:13.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.662+0000 7fc4db29a640 1 --2- 172.21.15.40:0/3223690852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4c00039b0 0x7fc4d41f1b90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0034040 tx=0x7fc4d0001120 comp rx=0 tx=0).stop 2024-04-22T07:21:13.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.662+0000 7fc4db29a640 1 -- 172.21.15.40:0/3223690852 shutdown_connections 2024-04-22T07:21:13.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.662+0000 7fc4db29a640 1 --2- 172.21.15.40:0/3223690852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc4d4157f90 0x7fc4d40c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.662+0000 7fc4db29a640 1 --2- 172.21.15.40:0/3223690852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4d4155870 0x7fc4d40c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.662+0000 7fc4db29a640 1 --2- 172.21.15.40:0/3223690852 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc4b806c920 0x7fc4b806ede0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.662+0000 7fc4db29a640 1 --2- 172.21.15.40:0/3223690852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4c00039b0 0x7fc4d41f1b90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:13.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.662+0000 7fc4db29a640 1 -- 172.21.15.40:0/3223690852 >> 172.21.15.40:0/3223690852 conn(0x7fc4d40736e0 msgr2=0x7fc4d40cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:13.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.662+0000 7fc4db29a640 1 -- 172.21.15.40:0/3223690852 shutdown_connections 2024-04-22T07:21:13.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13.662+0000 7fc4db29a640 1 -- 172.21.15.40:0/3223690852 wait complete. 2024-04-22T07:21:13.671 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-22T07:21:13.671 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-22T07:21:13.671 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2024-04-22T07:21:13.671 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-22T07:21:13.671 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-22T07:21:13.671 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-22T07:21:13.671 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-22T07:21:13.671 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-22T07:21:13.671 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-22T07:21:13.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T07:21:13.672 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2024-04-22T07:21:13.687 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-22T07:21:13.687 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-22T07:21:13.687 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2024-04-22T07:21:13.687 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-22T07:21:13.687 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2024-04-22T07:21:13.687 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-22T07:21:13.688 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-22T07:21:13.688 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2024-04-22T07:21:13.688 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2024-04-22T07:21:13.688 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-22T07:21:13.688 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2024-04-22T07:21:13.688 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2024-04-22T07:21:13.688 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-22T07:21:13.688 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2024-04-22T07:21:13.688 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2024-04-22T07:21:13.688 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-22T07:21:13.688 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42645sec preferred_lft 42645sec 2024-04-22T07:21:13.688 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link noprefixroute 2024-04-22T07:21:13.688 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-22T07:21:13.689 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-22T07:21:13.689 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2024-04-22T07:21:13.689 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2024-04-22T07:21:13.689 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-22T07:21:13.689 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-22T07:21:13.689 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-22T07:21:13.689 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add name ceph-brx type bridge 2024-04-22T07:21:13.690 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr flush dev ceph-brx 2024-04-22T07:21:13.690 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set ceph-brx up 2024-04-22T07:21:13.690 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-22T07:21:13.690 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-22T07:21:13.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-22T07:21:13.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T07:21:13.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T07:21:13.872 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-22T07:21:13.897 INFO:teuthology.orchestra.run.smithi040.stdout:1 2024-04-22T07:21:13.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T07:21:13.898 DEBUG:teuthology.orchestra.run.smithi040:> route 2024-04-22T07:21:13.967 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2024-04-22T07:21:13.967 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-22T07:21:13.967 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-22T07:21:13.967 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-22T07:21:13.967 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-22T07:21:13.968 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-22T07:21:13.968 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-22T07:21:13.968 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-22T07:21:13.968 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-22T07:21:13.968 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-22T07:21:13.968 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-22T07:21:14.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-22T07:21:14.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T07:21:14.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T07:21:14.233 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-04-22T07:21:14.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T07:21:14.249 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2024-04-22T07:21:14.304 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-22T07:21:14.304 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-22T07:21:14.304 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-22T07:21:14.304 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-22T07:21:14.305 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-22T07:21:14.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-22T07:21:14.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T07:21:14.426 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-22T07:21:14.426 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-22T07:21:14.426 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-22T07:21:14.426 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-22T07:21:14.426 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-22T07:21:14.426 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-22T07:21:14.426 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-22T07:21:14.426 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-22T07:21:14.426 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-22T07:21:14.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-22T07:21:14.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T07:21:14.597 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-22T07:21:14.597 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-22T07:21:14.597 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2024-04-22T07:21:14.597 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.0 master ceph-brx 2024-04-22T07:21:14.597 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-22T07:21:14.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-22T07:21:14.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T07:21:14.676 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-22T07:21:14.676 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-22T07:21:14.692 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-22T07:21:14.692 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-22T07:21:14.693 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-22T07:21:14.748 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-22T07:21:14.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T07:21:14.748 DEBUG:teuthology.orchestra.run.smithi040:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-22T07:21:14.840 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-22T07:21:14.840 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-22T07:21:14.943 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-22T07:21:14.943 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-22T07:21:14.943 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.62:3300,172.21.15.62:3301" 2024-04-22T07:21:14.943 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: trying mount with new device syntax: 0@dd5b16e4-89fe-4602-b37f-062846793158.cephfs=/ 2024-04-22T07:21:14.944 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.40:3300/172.21.15.62:3300/172.21.15.62:3301" will pass to kernel 2024-04-22T07:21:14.944 INFO:teuthology.orchestra.run.smithi040.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-22T07:21:14.944 INFO:teuthology.orchestra.run.smithi040.stdout: You just mounted a file system that supports labels which does not 2024-04-22T07:21:14.944 INFO:teuthology.orchestra.run.smithi040.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-22T07:21:14.944 INFO:teuthology.orchestra.run.smithi040.stdout: applications will generate AVC messages and not be allowed access to 2024-04-22T07:21:14.945 INFO:teuthology.orchestra.run.smithi040.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-22T07:21:14.946 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-22T07:21:14.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T07:21:14.947 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-22T07:21:14.971 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-22T07:21:15.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-22T07:21:15.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T07:21:15.074 INFO:teuthology.orchestra.run.smithi040.stdout:client4660 2024-04-22T07:21:15.074 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:21:15.074 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-22T07:21:15.091 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-22T07:21:15.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-22T07:21:15.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T07:21:15.193 INFO:teuthology.orchestra.run.smithi040.stdout:client4660 2024-04-22T07:21:15.193 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-22T07:21:15.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-22T07:21:15.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T07:21:15.256 INFO:teuthology.orchestra.run.smithi040.stdout:client4660 2024-04-22T07:21:15.256 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/dd5b16e4-89fe-4602-b37f-062846793158.client4660/status') 2024-04-22T07:21:15.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-22T07:21:15.320 INFO:teuthology.orchestra.run.smithi040.stdout:instance: client.4660 (3)172.21.15.40:0/4245927582 2024-04-22T07:21:15.320 INFO:teuthology.orchestra.run.smithi040.stdout:blocklisted: false 2024-04-22T07:21:15.321 INFO:teuthology.orchestra.run.smithi040.stderr:0+1 records in 2024-04-22T07:21:15.321 INFO:teuthology.orchestra.run.smithi040.stderr:0+1 records out 2024-04-22T07:21:15.321 INFO:teuthology.orchestra.run.smithi040.stderr:70 bytes copied, 3.2735e-05 s, 2.1 MB/s 2024-04-22T07:21:15.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-22T07:21:15.328 INFO:teuthology.run_tasks:Running task quiescer... 2024-04-22T07:21:15.341 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:21:15.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.444+0000 7fd4bb911640 1 Processor -- start 2024-04-22T07:21:15.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.444+0000 7fd4bb911640 1 -- start start 2024-04-22T07:21:15.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.445+0000 7fd4bb911640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd4b4154f50 0x7fd4b40cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:15.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.445+0000 7fd4bb911640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd4b40cc5a0 0x7fd4b40d0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:15.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.445+0000 7fd4bb911640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4b40d0ad0 0x7fd4b415b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:15.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.445+0000 7fd4bb911640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fd4b415af50 con 0x7fd4b4154f50 2024-04-22T07:21:15.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.445+0000 7fd4bb911640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fd4b415e6e0 con 0x7fd4b40cc5a0 2024-04-22T07:21:15.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.445+0000 7fd4bb911640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fd4b415e9c0 con 0x7fd4b40d0ad0 2024-04-22T07:21:15.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.445+0000 7fd4b96ad640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd4b4154f50 0x7fd4b40cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:15.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.445+0000 7fd4b96ad640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd4b4154f50 0x7fd4b40cc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55706/0 (socket says 172.21.15.40:55706) 2024-04-22T07:21:15.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.445+0000 7fd4b96ad640 1 -- 172.21.15.40:0/4220464408 learned_addr learned my addr 172.21.15.40:0/4220464408 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:15.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.446+0000 7fd4b9eae640 1 --2- 172.21.15.40:0/4220464408 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4b40d0ad0 0x7fd4b415b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:15.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.446+0000 7fd4b8eac640 1 --2- 172.21.15.40:0/4220464408 >> v2:172.21.15.62:3300/0 conn(0x7fd4b40cc5a0 0x7fd4b40d0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:15.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.446+0000 7fd4b96ad640 1 -- 172.21.15.40:0/4220464408 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4b40d0ad0 msgr2=0x7fd4b415b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:15.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.446+0000 7fd4b96ad640 1 --2- 172.21.15.40:0/4220464408 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4b40d0ad0 0x7fd4b415b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:15.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.446+0000 7fd4b96ad640 1 -- 172.21.15.40:0/4220464408 >> v2:172.21.15.62:3300/0 conn(0x7fd4b40cc5a0 msgr2=0x7fd4b40d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:15.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.446+0000 7fd4b96ad640 1 --2- 172.21.15.40:0/4220464408 >> v2:172.21.15.62:3300/0 conn(0x7fd4b40cc5a0 0x7fd4b40d0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:15.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.446+0000 7fd4b96ad640 1 -- 172.21.15.40:0/4220464408 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b415eca0 con 0x7fd4b4154f50 2024-04-22T07:21:15.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.446+0000 7fd4b96ad640 1 --2- 172.21.15.40:0/4220464408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4b4154f50 0x7fd4b40cc060 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd4b406c9e0 tx=0x7fd4b002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf203eb2bf7655d server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:15.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.447+0000 7fd4abfff640 1 -- 172.21.15.40:0/4220464408 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0034070 con 0x7fd4b4154f50 2024-04-22T07:21:15.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.447+0000 7fd4abfff640 1 -- 172.21.15.40:0/4220464408 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4b0030860 con 0x7fd4b4154f50 2024-04-22T07:21:15.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.447+0000 7fd4abfff640 1 -- 172.21.15.40:0/4220464408 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0030c30 con 0x7fd4b4154f50 2024-04-22T07:21:15.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.447+0000 7fd4bb911640 1 -- 172.21.15.40:0/4220464408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4b4154f50 msgr2=0x7fd4b40cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:15.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.447+0000 7fd4bb911640 1 --2- 172.21.15.40:0/4220464408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4b4154f50 0x7fd4b40cc060 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd4b406c9e0 tx=0x7fd4b002b9a0 comp rx=0 tx=0).stop 2024-04-22T07:21:15.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.447+0000 7fd4bb911640 1 -- 172.21.15.40:0/4220464408 shutdown_connections 2024-04-22T07:21:15.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.447+0000 7fd4bb911640 1 --2- 172.21.15.40:0/4220464408 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4b40d0ad0 0x7fd4b415b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:15.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.447+0000 7fd4bb911640 1 --2- 172.21.15.40:0/4220464408 >> v2:172.21.15.62:3300/0 conn(0x7fd4b40cc5a0 0x7fd4b40d0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:15.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.447+0000 7fd4bb911640 1 --2- 172.21.15.40:0/4220464408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4b4154f50 0x7fd4b40cc060 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:15.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.447+0000 7fd4bb911640 1 -- 172.21.15.40:0/4220464408 >> 172.21.15.40:0/4220464408 conn(0x7fd4b40676b0 msgr2=0x7fd4b4067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:15.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.447+0000 7fd4bb911640 1 -- 172.21.15.40:0/4220464408 shutdown_connections 2024-04-22T07:21:15.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.447+0000 7fd4bb911640 1 -- 172.21.15.40:0/4220464408 wait complete. 2024-04-22T07:21:15.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.449+0000 7fd4bb911640 1 Processor -- start 2024-04-22T07:21:15.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.449+0000 7fd4bb911640 1 -- start start 2024-04-22T07:21:15.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.449+0000 7fd4bb911640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4b40cc5a0 0x7fd4b415dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:15.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.449+0000 7fd4bb911640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4b40d0ad0 0x7fd4b4142770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:15.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.449+0000 7fd4bb911640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4b4154f50 0x7fd4b40cd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:15.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.449+0000 7fd4bb911640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b415e3a0 con 0x7fd4b4154f50 2024-04-22T07:21:15.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.449+0000 7fd4bb911640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b415f260 con 0x7fd4b40cc5a0 2024-04-22T07:21:15.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.449+0000 7fd4bb911640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fd4b4155330 con 0x7fd4b40d0ad0 2024-04-22T07:21:15.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.449+0000 7fd4b9eae640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4b4154f50 0x7fd4b40cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:15.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.449+0000 7fd4b9eae640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4b4154f50 0x7fd4b40cd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55718/0 (socket says 172.21.15.40:55718) 2024-04-22T07:21:15.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.449+0000 7fd4b9eae640 1 -- 172.21.15.40:0/1186901776 learned_addr learned my addr 172.21.15.40:0/1186901776 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:15.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.450+0000 7fd4b96ad640 1 --2- 172.21.15.40:0/1186901776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4b40cc5a0 0x7fd4b415dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:15.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.450+0000 7fd4b8eac640 1 --2- 172.21.15.40:0/1186901776 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4b40d0ad0 0x7fd4b4142770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:15.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.450+0000 7fd4b9eae640 1 -- 172.21.15.40:0/1186901776 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4b40d0ad0 msgr2=0x7fd4b4142770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:15.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.450+0000 7fd4b9eae640 1 --2- 172.21.15.40:0/1186901776 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4b40d0ad0 0x7fd4b4142770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:15.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.450+0000 7fd4b9eae640 1 -- 172.21.15.40:0/1186901776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4b40cc5a0 msgr2=0x7fd4b415dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:15.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.450+0000 7fd4b9eae640 1 --2- 172.21.15.40:0/1186901776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4b40cc5a0 0x7fd4b415dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:15.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.450+0000 7fd4b9eae640 1 -- 172.21.15.40:0/1186901776 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b415cce0 con 0x7fd4b4154f50 2024-04-22T07:21:15.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.450+0000 7fd4b9eae640 1 --2- 172.21.15.40:0/1186901776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4b4154f50 0x7fd4b40cd560 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac007e70 tx=0x7fd4ac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:15.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.450+0000 7fd4a9ffb640 1 -- 172.21.15.40:0/1186901776 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac014620 con 0x7fd4b4154f50 2024-04-22T07:21:15.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.450+0000 7fd4a9ffb640 1 -- 172.21.15.40:0/1186901776 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4ac019070 con 0x7fd4b4154f50 2024-04-22T07:21:15.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.450+0000 7fd4bb911640 1 -- 172.21.15.40:0/1186901776 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b4159d00 con 0x7fd4b4154f50 2024-04-22T07:21:15.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.450+0000 7fd4a9ffb640 1 -- 172.21.15.40:0/1186901776 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac014a20 con 0x7fd4b4154f50 2024-04-22T07:21:15.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.450+0000 7fd4bb911640 1 -- 172.21.15.40:0/1186901776 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b415cf50 con 0x7fd4b4154f50 2024-04-22T07:21:15.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.451+0000 7fd4bb911640 1 -- 172.21.15.40:0/1186901776 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4b4069d40 con 0x7fd4b4154f50 2024-04-22T07:21:15.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.452+0000 7fd4a9ffb640 1 -- 172.21.15.40:0/1186901776 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd4ac014bc0 con 0x7fd4b4154f50 2024-04-22T07:21:15.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.452+0000 7fd4a9ffb640 1 --2- 172.21.15.40:0/1186901776 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fd49806c8f0 0x7fd49806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:15.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.452+0000 7fd4a9ffb640 1 -- 172.21.15.40:0/1186901776 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd4ac08c3a0 con 0x7fd4b4154f50 2024-04-22T07:21:15.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.452+0000 7fd4b96ad640 1 --2- 172.21.15.40:0/1186901776 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fd49806c8f0 0x7fd49806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:15.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.453+0000 7fd4b96ad640 1 --2- 172.21.15.40:0/1186901776 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fd49806c8f0 0x7fd49806edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0036000 tx=0x7fd4b003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:15.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.457+0000 7fd4a9ffb640 1 -- 172.21.15.40:0/1186901776 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd4ac05a0f0 con 0x7fd4b4154f50 2024-04-22T07:21:15.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.642+0000 7fd4bb911640 1 -- 172.21.15.40:0/1186901776 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd4b41587d0 con 0x7fd4b4154f50 2024-04-22T07:21:15.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.643+0000 7fd4a9ffb640 1 -- 172.21.15.40:0/1186901776 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16537 (secure 0 0 0) 0x7fd4ac05e3f0 con 0x7fd4b4154f50 2024-04-22T07:21:15.641 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:21:15.641 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":23,"fsid":"dd5b16e4-89fe-4602-b37f-062846793158","created":"2024-04-22T07:20:29.488892+0000","modified":"2024-04-22T07:20:54.858120+0000","last_up_change":"2024-04-22T07:20:40.397383+0000","last_in_change":"2024-04-22T07:20:31.702551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:20:41.793179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:20:51.815779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:20:52.164265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32238b7e-228b-4a67-bfca-16e8f0020a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6801","nonce":1526385055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6803","nonce":1526385055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6807","nonce":1526385055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6805","nonce":1526385055}]},"public_addr":"172.21.15.40:6801/1526385055","cluster_addr":"172.21.15.40:6803/1526385055","heartbeat_back_addr":"172.21.15.40:6807/1526385055","heartbeat_front_addr":"172.21.15.40:6805/1526385055","state":["exists","up"]},{"osd":1,"uuid":"5ad8da43-39b1-4295-b4d1-0f1e1d06fc0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6809","nonce":623026645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6811","nonce":623026645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6815","nonce":623026645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6813","nonce":623026645}]},"public_addr":"172.21.15.40:6809/623026645","cluster_addr":"172.21.15.40:6811/623026645","heartbeat_back_addr":"172.21.15.40:6815/623026645","heartbeat_front_addr":"172.21.15.40:6813/623026645","state":["exists","up"]},{"osd":2,"uuid":"7d2c6d50-719d-4232-ad47-f04dcf1a8bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6820","nonce":1885686505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6824","nonce":1885686505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6831","nonce":1885686505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6828","nonce":1885686505}]},"public_addr":"172.21.15.40:6820/1885686505","cluster_addr":"172.21.15.40:6824/1885686505","heartbeat_back_addr":"172.21.15.40:6831/1885686505","heartbeat_front_addr":"172.21.15.40:6828/1885686505","state":["exists","up"]},{"osd":3,"uuid":"af42e7d6-a6bf-403e-92e7-162d7c4fbf0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6817","nonce":130276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6819","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6821","nonce":130276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6829","nonce":130276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6823","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6825","nonce":130276746}]},"public_addr":"172.21.15.40:6817/130276746","cluster_addr":"172.21.15.40:6821/130276746","heartbeat_back_addr":"172.21.15.40:6829/130276746","heartbeat_front_addr":"172.21.15.40:6825/130276746","state":["exists","up"]},{"osd":4,"uuid":"f8e89e0d-be96-4f19-88c0-69c408df7d98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6801","nonce":2251435758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6803","nonce":2251435758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6807","nonce":2251435758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6805","nonce":2251435758}]},"public_addr":"172.21.15.62:6801/2251435758","cluster_addr":"172.21.15.62:6803/2251435758","heartbeat_back_addr":"172.21.15.62:6807/2251435758","heartbeat_front_addr":"172.21.15.62:6805/2251435758","state":["exists","up"]},{"osd":5,"uuid":"ba6dc1bc-272b-4f80-b55f-40bc4a0c3ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6809","nonce":3509322231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6811","nonce":3509322231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6815","nonce":3509322231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6813","nonce":3509322231}]},"public_addr":"172.21.15.62:6809/3509322231","cluster_addr":"172.21.15.62:6811/3509322231","heartbeat_back_addr":"172.21.15.62:6815/3509322231","heartbeat_front_addr":"172.21.15.62:6813/3509322231","state":["exists","up"]},{"osd":6,"uuid":"834fcd74-14bf-45ec-a10a-0374f4ce9bf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6825","nonce":3094315954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6827","nonce":3094315954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6831","nonce":3094315954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6829","nonce":3094315954}]},"public_addr":"172.21.15.62:6825/3094315954","cluster_addr":"172.21.15.62:6827/3094315954","heartbeat_back_addr":"172.21.15.62:6831/3094315954","heartbeat_front_addr":"172.21.15.62:6829/3094315954","state":["exists","up"]},{"osd":7,"uuid":"831c9a73-960e-4d2e-b86a-33a6916be059","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6817","nonce":147453972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6819","nonce":147453972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6823","nonce":147453972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6821","nonce":147453972}]},"public_addr":"172.21.15.62:6817/147453972","cluster_addr":"172.21.15.62:6819/147453972","heartbeat_back_addr":"172.21.15.62:6823/147453972","heartbeat_front_addr":"172.21.15.62:6821/147453972","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.828738+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.873471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.908090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.894782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:37.686796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.801123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.852323+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.812139+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:21:15.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.645+0000 7fd4bb911640 1 -- 172.21.15.40:0/1186901776 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fd49806c8f0 msgr2=0x7fd49806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:15.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.645+0000 7fd4bb911640 1 --2- 172.21.15.40:0/1186901776 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fd49806c8f0 0x7fd49806edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0036000 tx=0x7fd4b003b040 comp rx=0 tx=0).stop 2024-04-22T07:21:15.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.645+0000 7fd4bb911640 1 -- 172.21.15.40:0/1186901776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4b4154f50 msgr2=0x7fd4b40cd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:15.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.645+0000 7fd4bb911640 1 --2- 172.21.15.40:0/1186901776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4b4154f50 0x7fd4b40cd560 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac007e70 tx=0x7fd4ac00e4b0 comp rx=0 tx=0).stop 2024-04-22T07:21:15.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.645+0000 7fd4bb911640 1 -- 172.21.15.40:0/1186901776 shutdown_connections 2024-04-22T07:21:15.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.645+0000 7fd4bb911640 1 --2- 172.21.15.40:0/1186901776 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fd49806c8f0 0x7fd49806edb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:15.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.645+0000 7fd4bb911640 1 --2- 172.21.15.40:0/1186901776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4b4154f50 0x7fd4b40cd560 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:15.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.645+0000 7fd4bb911640 1 --2- 172.21.15.40:0/1186901776 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd4b40d0ad0 0x7fd4b4142770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:15.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.645+0000 7fd4bb911640 1 --2- 172.21.15.40:0/1186901776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4b40cc5a0 0x7fd4b415dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:15.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.645+0000 7fd4bb911640 1 -- 172.21.15.40:0/1186901776 >> 172.21.15.40:0/1186901776 conn(0x7fd4b40676b0 msgr2=0x7fd4b40c6810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:15.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.645+0000 7fd4bb911640 1 -- 172.21.15.40:0/1186901776 shutdown_connections 2024-04-22T07:21:15.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.645+0000 7fd4bb911640 1 -- 172.21.15.40:0/1186901776 wait complete. 2024-04-22T07:21:15.654 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T07:20:41.793179+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-22T07:20:51.815779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-22T07:20:52.164265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-22T07:21:15.654 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T07:21:15.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.761+0000 7f5872775640 1 Processor -- start 2024-04-22T07:21:15.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.761+0000 7f5872775640 1 -- start start 2024-04-22T07:21:15.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.762+0000 7f5872775640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f586c15ed60 0x7f586c0cd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:15.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.762+0000 7f5872775640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f586c0cd580 0x7f586c0c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:15.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.762+0000 7f5872775640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f586c15f1a0 con 0x7f586c1551f0 2024-04-22T07:21:15.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.762+0000 7f5872775640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f586c1555d0 con 0x7f586c0cd580 2024-04-22T07:21:15.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.762+0000 7f5872775640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f586c15bb00 con 0x7f586c15ed60 2024-04-22T07:21:15.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.762+0000 7f5870d12640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f586c0cd580 0x7f586c0c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:15.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.762+0000 7f5870d12640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f586c0cd580 0x7f586c0c55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55730/0 (socket says 172.21.15.40:55730) 2024-04-22T07:21:15.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.762+0000 7f5870d12640 1 -- 172.21.15.40:0/2633949848 learned_addr learned my addr 172.21.15.40:0/2633949848 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:15.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.762+0000 7f5870d12640 1 -- 172.21.15.40:0/2633949848 >> v2:172.21.15.62:3300/0 conn(0x7f586c15ed60 msgr2=0x7f586c0cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:15.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.763+0000 7f5870d12640 1 --2- 172.21.15.40:0/2633949848 >> v2:172.21.15.62:3300/0 conn(0x7f586c15ed60 0x7f586c0cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:15.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.763+0000 7f5870d12640 1 -- 172.21.15.40:0/2633949848 >> v1:172.21.15.62:6789/0 conn(0x7f586c1551f0 legacy=0x7f586c0cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:15.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.763+0000 7f5870d12640 1 -- 172.21.15.40:0/2633949848 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f586c0cbed0 con 0x7f586c0cd580 2024-04-22T07:21:15.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.763+0000 7f5870d12640 1 --2- 172.21.15.40:0/2633949848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f586c0cd580 0x7f586c0c55e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f586c15bc80 tx=0x7f586402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ec9e46e166dc4c server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:15.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.763+0000 7f586affd640 1 -- 172.21.15.40:0/2633949848 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586402cb00 con 0x7f586c0cd580 2024-04-22T07:21:15.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.763+0000 7f586affd640 1 -- 172.21.15.40:0/2633949848 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f586402cca0 con 0x7f586c0cd580 2024-04-22T07:21:15.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.763+0000 7f586affd640 1 -- 172.21.15.40:0/2633949848 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5864034610 con 0x7f586c0cd580 2024-04-22T07:21:15.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.764+0000 7f5872775640 1 -- 172.21.15.40:0/2633949848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f586c0cd580 msgr2=0x7f586c0c55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:15.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.764+0000 7f5872775640 1 --2- 172.21.15.40:0/2633949848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f586c0cd580 0x7f586c0c55e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f586c15bc80 tx=0x7f586402bf60 comp rx=0 tx=0).stop 2024-04-22T07:21:15.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.764+0000 7f5872775640 1 -- 172.21.15.40:0/2633949848 shutdown_connections 2024-04-22T07:21:15.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.764+0000 7f5872775640 1 --2- 172.21.15.40:0/2633949848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f586c0cd580 0x7f586c0c55e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:15.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.764+0000 7f5872775640 1 --2- 172.21.15.40:0/2633949848 >> v2:172.21.15.62:3300/0 conn(0x7f586c15ed60 0x7f586c0cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:15.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.764+0000 7f5872775640 1 -- 172.21.15.40:0/2633949848 >> 172.21.15.40:0/2633949848 conn(0x7f586c06b920 msgr2=0x7f586c06bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:15.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.764+0000 7f5872775640 1 -- 172.21.15.40:0/2633949848 shutdown_connections 2024-04-22T07:21:15.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.764+0000 7f5872775640 1 -- 172.21.15.40:0/2633949848 wait complete. 2024-04-22T07:21:15.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.765+0000 7f5872775640 1 Processor -- start 2024-04-22T07:21:15.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.765+0000 7f5872775640 1 -- start start 2024-04-22T07:21:15.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.766+0000 7f5872775640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f586c0cd580 0x7f586c15c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:15.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.766+0000 7f5872775640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f586c1551f0 0x7f586c15cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:15.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.766+0000 7f5872775640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f586c15ed60 0x7f586c1570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:15.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.766+0000 7f5872775640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f586c15b4b0 con 0x7f586c15ed60 2024-04-22T07:21:15.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.766+0000 7f5872775640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f586c15b1d0 con 0x7f586c1551f0 2024-04-22T07:21:15.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.766+0000 7f5872775640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f586c15b790 con 0x7f586c0cd580 2024-04-22T07:21:15.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.766+0000 7f5870d12640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f586c15ed60 0x7f586c1570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:15.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.766+0000 7f5870d12640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f586c15ed60 0x7f586c1570a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55734/0 (socket says 172.21.15.40:55734) 2024-04-22T07:21:15.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.766+0000 7f5870d12640 1 -- 172.21.15.40:0/3218554476 learned_addr learned my addr 172.21.15.40:0/3218554476 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:15.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.766+0000 7f586bfff640 1 --2- 172.21.15.40:0/3218554476 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f586c0cd580 0x7f586c15c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:15.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.766+0000 7f586b7fe640 1 --2- 172.21.15.40:0/3218554476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f586c1551f0 0x7f586c15cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:15.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.767+0000 7f5870d12640 1 -- 172.21.15.40:0/3218554476 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f586c0cd580 msgr2=0x7f586c15c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:15.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.767+0000 7f5870d12640 1 --2- 172.21.15.40:0/3218554476 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f586c0cd580 0x7f586c15c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:15.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.767+0000 7f5870d12640 1 -- 172.21.15.40:0/3218554476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f586c1551f0 msgr2=0x7f586c15cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:15.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.767+0000 7f5870d12640 1 --2- 172.21.15.40:0/3218554476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f586c1551f0 0x7f586c15cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:15.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.767+0000 7f5870d12640 1 -- 172.21.15.40:0/3218554476 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f586c1f1900 con 0x7f586c15ed60 2024-04-22T07:21:15.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.767+0000 7f586b7fe640 1 --2- 172.21.15.40:0/3218554476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f586c1551f0 0x7f586c15cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:15.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.767+0000 7f5870d12640 1 --2- 172.21.15.40:0/3218554476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f586c15ed60 0x7f586c1570a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5864009f10 tx=0x7f5864004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:15.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.767+0000 7f5868ff9640 1 -- 172.21.15.40:0/3218554476 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5864043020 con 0x7f586c15ed60 2024-04-22T07:21:15.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.767+0000 7f5868ff9640 1 -- 172.21.15.40:0/3218554476 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f586402ce50 con 0x7f586c15ed60 2024-04-22T07:21:15.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.767+0000 7f5872775640 1 -- 172.21.15.40:0/3218554476 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f586c156600 con 0x7f586c15ed60 2024-04-22T07:21:15.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.767+0000 7f5868ff9640 1 -- 172.21.15.40:0/3218554476 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5864009510 con 0x7f586c15ed60 2024-04-22T07:21:15.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.767+0000 7f5872775640 1 -- 172.21.15.40:0/3218554476 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f586c1568a0 con 0x7f586c15ed60 2024-04-22T07:21:15.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.768+0000 7f5872775640 1 -- 172.21.15.40:0/3218554476 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f586c154510 con 0x7f586c15ed60 2024-04-22T07:21:15.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.769+0000 7f5868ff9640 1 -- 172.21.15.40:0/3218554476 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5864046020 con 0x7f586c15ed60 2024-04-22T07:21:15.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.769+0000 7f5868ff9640 1 --2- 172.21.15.40:0/3218554476 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f584c06c920 0x7f584c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:15.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.769+0000 7f5868ff9640 1 -- 172.21.15.40:0/3218554476 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f58640add10 con 0x7f586c15ed60 2024-04-22T07:21:15.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.769+0000 7f586bfff640 1 --2- 172.21.15.40:0/3218554476 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f584c06c920 0x7f584c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:15.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.769+0000 7f586bfff640 1 --2- 172.21.15.40:0/3218554476 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f584c06c920 0x7f584c06ede0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5854007fd0 tx=0x7f5854009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:15.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.773+0000 7f5868ff9640 1 -- 172.21.15.40:0/3218554476 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f586c154510 con 0x7f586c15ed60 2024-04-22T07:21:15.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.962+0000 7f5872775640 1 -- 172.21.15.40:0/3218554476 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f586c04fdc0 con 0x7f586c15ed60 2024-04-22T07:21:15.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.962+0000 7f5868ff9640 1 -- 172.21.15.40:0/3218554476 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f586404e020 con 0x7f586c15ed60 2024-04-22T07:21:15.961 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-04-22T07:21:15.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.964+0000 7f5872775640 1 -- 172.21.15.40:0/3218554476 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f584c06c920 msgr2=0x7f584c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:15.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.964+0000 7f5872775640 1 --2- 172.21.15.40:0/3218554476 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f584c06c920 0x7f584c06ede0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5854007fd0 tx=0x7f5854009040 comp rx=0 tx=0).stop 2024-04-22T07:21:15.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.964+0000 7f5872775640 1 -- 172.21.15.40:0/3218554476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f586c15ed60 msgr2=0x7f586c1570a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:15.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.964+0000 7f5872775640 1 --2- 172.21.15.40:0/3218554476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f586c15ed60 0x7f586c1570a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5864009f10 tx=0x7f5864004a40 comp rx=0 tx=0).stop 2024-04-22T07:21:15.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.964+0000 7f5872775640 1 -- 172.21.15.40:0/3218554476 shutdown_connections 2024-04-22T07:21:15.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.964+0000 7f5872775640 1 --2- 172.21.15.40:0/3218554476 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f584c06c920 0x7f584c06ede0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:15.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.964+0000 7f5872775640 1 --2- 172.21.15.40:0/3218554476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f586c15ed60 0x7f586c1570a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:15.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.964+0000 7f5872775640 1 --2- 172.21.15.40:0/3218554476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f586c1551f0 0x7f586c15cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:15.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.964+0000 7f5872775640 1 --2- 172.21.15.40:0/3218554476 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f586c0cd580 0x7f586c15c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:15.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.964+0000 7f5872775640 1 -- 172.21.15.40:0/3218554476 >> 172.21.15.40:0/3218554476 conn(0x7f586c06b920 msgr2=0x7f586c150140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:15.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.964+0000 7f5872775640 1 -- 172.21.15.40:0/3218554476 shutdown_connections 2024-04-22T07:21:15.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:15.964+0000 7f5872775640 1 -- 172.21.15.40:0/3218554476 wait complete. 2024-04-22T07:21:15.973 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-22T07:21:16.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.078+0000 7f8e20759640 1 Processor -- start 2024-04-22T07:21:16.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.078+0000 7f8e20759640 1 -- start start 2024-04-22T07:21:16.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.079+0000 7f8e20759640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8e1815ed60 0x7f8e180cd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:16.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.079+0000 7f8e20759640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8e180cd580 0x7f8e180c5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:16.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.079+0000 7f8e20759640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e1815afd0 con 0x7f8e181550f0 2024-04-22T07:21:16.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.079+0000 7f8e20759640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f8e1815b290 con 0x7f8e180cd580 2024-04-22T07:21:16.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.079+0000 7f8e20759640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f8e1815b570 con 0x7f8e1815ed60 2024-04-22T07:21:16.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.079+0000 7f8e1ecf6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8e180cd580 0x7f8e180c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:16.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.079+0000 7f8e1ecf6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8e180cd580 0x7f8e180c5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55746/0 (socket says 172.21.15.40:55746) 2024-04-22T07:21:16.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.079+0000 7f8e1ecf6640 1 -- 172.21.15.40:0/1889565298 learned_addr learned my addr 172.21.15.40:0/1889565298 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:16.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.080+0000 7f8e1dcf4640 1 --2- 172.21.15.40:0/1889565298 >> v2:172.21.15.62:3300/0 conn(0x7f8e1815ed60 0x7f8e180cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:16.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.080+0000 7f8e1ecf6640 1 -- 172.21.15.40:0/1889565298 >> v2:172.21.15.62:3300/0 conn(0x7f8e1815ed60 msgr2=0x7f8e180cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:16.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.080+0000 7f8e1ecf6640 1 --2- 172.21.15.40:0/1889565298 >> v2:172.21.15.62:3300/0 conn(0x7f8e1815ed60 0x7f8e180cd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:16.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.080+0000 7f8e1ecf6640 1 -- 172.21.15.40:0/1889565298 >> v1:172.21.15.62:6789/0 conn(0x7f8e181550f0 legacy=0x7f8e180cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:16.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.080+0000 7f8e1ecf6640 1 -- 172.21.15.40:0/1889565298 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e1815b850 con 0x7f8e180cd580 2024-04-22T07:21:16.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.080+0000 7f8e1dcf4640 1 --2- 172.21.15.40:0/1889565298 >> v2:172.21.15.62:3300/0 conn(0x7f8e1815ed60 0x7f8e180cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:16.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.080+0000 7f8e1ecf6640 1 --2- 172.21.15.40:0/1889565298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e180cd580 0x7f8e180c5630 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8e180733c0 tx=0x7f8e1002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de6b96e159527652 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:16.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.081+0000 7f8e1d4f3640 1 -- 172.21.15.40:0/1889565298 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1002c9f0 con 0x7f8e180cd580 2024-04-22T07:21:16.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.081+0000 7f8e1d4f3640 1 -- 172.21.15.40:0/1889565298 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e1002cb90 con 0x7f8e180cd580 2024-04-22T07:21:16.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.081+0000 7f8e1d4f3640 1 -- 172.21.15.40:0/1889565298 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e100343f0 con 0x7f8e180cd580 2024-04-22T07:21:16.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.081+0000 7f8e20759640 1 -- 172.21.15.40:0/1889565298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e180cd580 msgr2=0x7f8e180c5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:16.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.081+0000 7f8e20759640 1 --2- 172.21.15.40:0/1889565298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e180cd580 0x7f8e180c5630 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8e180733c0 tx=0x7f8e1002be50 comp rx=0 tx=0).stop 2024-04-22T07:21:16.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.081+0000 7f8e20759640 1 -- 172.21.15.40:0/1889565298 shutdown_connections 2024-04-22T07:21:16.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.081+0000 7f8e20759640 1 --2- 172.21.15.40:0/1889565298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e180cd580 0x7f8e180c5630 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:16.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.081+0000 7f8e20759640 1 --2- 172.21.15.40:0/1889565298 >> v2:172.21.15.62:3300/0 conn(0x7f8e1815ed60 0x7f8e180cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:16.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.081+0000 7f8e20759640 1 -- 172.21.15.40:0/1889565298 >> 172.21.15.40:0/1889565298 conn(0x7f8e1806b920 msgr2=0x7f8e1806bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:16.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.081+0000 7f8e20759640 1 -- 172.21.15.40:0/1889565298 shutdown_connections 2024-04-22T07:21:16.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.081+0000 7f8e20759640 1 -- 172.21.15.40:0/1889565298 wait complete. 2024-04-22T07:21:16.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.082+0000 7f8e20759640 1 Processor -- start 2024-04-22T07:21:16.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.082+0000 7f8e20759640 1 -- start start 2024-04-22T07:21:16.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.083+0000 7f8e20759640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8e180cd580 0x7f8e180c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:16.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.083+0000 7f8e20759640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e181550f0 0x7f8e181f16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:16.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.083+0000 7f8e20759640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e1815ed60 0x7f8e181f4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:16.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.083+0000 7f8e20759640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8e181554d0 con 0x7f8e181550f0 2024-04-22T07:21:16.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.083+0000 7f8e20759640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1815f1b0 con 0x7f8e1815ed60 2024-04-22T07:21:16.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.083+0000 7f8e20759640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f8e180cbcc0 con 0x7f8e180cd580 2024-04-22T07:21:16.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.083+0000 7f8e1dcf4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e181550f0 0x7f8e181f16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:16.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.083+0000 7f8e1dcf4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e181550f0 0x7f8e181f16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55762/0 (socket says 172.21.15.40:55762) 2024-04-22T07:21:16.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.083+0000 7f8e1dcf4640 1 -- 172.21.15.40:0/3300742525 learned_addr learned my addr 172.21.15.40:0/3300742525 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:16.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.083+0000 7f8e1e4f5640 1 --2- 172.21.15.40:0/3300742525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8e180cd580 0x7f8e180c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:16.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.083+0000 7f8e1ecf6640 1 --2- 172.21.15.40:0/3300742525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e1815ed60 0x7f8e181f4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:16.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.083+0000 7f8e1dcf4640 1 -- 172.21.15.40:0/3300742525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8e180cd580 msgr2=0x7f8e180c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:16.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.083+0000 7f8e1dcf4640 1 --2- 172.21.15.40:0/3300742525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8e180cd580 0x7f8e180c6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:16.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.084+0000 7f8e1dcf4640 1 -- 172.21.15.40:0/3300742525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e1815ed60 msgr2=0x7f8e181f4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:16.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.084+0000 7f8e1dcf4640 1 --2- 172.21.15.40:0/3300742525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e1815ed60 0x7f8e181f4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:16.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.084+0000 7f8e1dcf4640 1 -- 172.21.15.40:0/3300742525 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e181f0ef0 con 0x7f8e181550f0 2024-04-22T07:21:16.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.084+0000 7f8e1ecf6640 1 --2- 172.21.15.40:0/3300742525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e1815ed60 0x7f8e181f4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:16.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.084+0000 7f8e1dcf4640 1 --2- 172.21.15.40:0/3300742525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e181550f0 0x7f8e181f16b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800c820 tx=0x7f8e0800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:16.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.084+0000 7f8e0effd640 1 -- 172.21.15.40:0/3300742525 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e08015070 con 0x7f8e181550f0 2024-04-22T07:21:16.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.084+0000 7f8e0effd640 1 -- 172.21.15.40:0/3300742525 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e08007a30 con 0x7f8e181550f0 2024-04-22T07:21:16.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.084+0000 7f8e20759640 1 -- 172.21.15.40:0/3300742525 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e1815ca30 con 0x7f8e181550f0 2024-04-22T07:21:16.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.084+0000 7f8e0effd640 1 -- 172.21.15.40:0/3300742525 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e08007de0 con 0x7f8e181550f0 2024-04-22T07:21:16.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.084+0000 7f8e20759640 1 -- 172.21.15.40:0/3300742525 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e1815c470 con 0x7f8e181550f0 2024-04-22T07:21:16.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.085+0000 7f8e20759640 1 -- 172.21.15.40:0/3300742525 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e181514b0 con 0x7f8e181550f0 2024-04-22T07:21:16.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.085+0000 7f8e0effd640 1 -- 172.21.15.40:0/3300742525 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8e08018070 con 0x7f8e181550f0 2024-04-22T07:21:16.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.086+0000 7f8e0effd640 1 --2- 172.21.15.40:0/3300742525 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8dfc06c920 0x7f8dfc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:16.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.086+0000 7f8e0effd640 1 -- 172.21.15.40:0/3300742525 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f8e0808b9b0 con 0x7f8e181550f0 2024-04-22T07:21:16.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.086+0000 7f8e1e4f5640 1 --2- 172.21.15.40:0/3300742525 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8dfc06c920 0x7f8dfc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:16.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.086+0000 7f8e1e4f5640 1 --2- 172.21.15.40:0/3300742525 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8dfc06c920 0x7f8dfc06ede0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8e140015d0 tx=0x7f8e14009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:16.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.090+0000 7f8e0effd640 1 -- 172.21.15.40:0/3300742525 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8e08059de0 con 0x7f8e181550f0 2024-04-22T07:21:16.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.273+0000 7f8e20759640 1 -- 172.21.15.40:0/3300742525 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8e1804fdc0 con 0x7f8e181550f0 2024-04-22T07:21:16.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.274+0000 7f8e0effd640 1 -- 172.21.15.40:0/3300742525 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f8e080596e0 con 0x7f8e181550f0 2024-04-22T07:21:16.272 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-22T07:21:16.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.275+0000 7f8e20759640 1 -- 172.21.15.40:0/3300742525 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8dfc06c920 msgr2=0x7f8dfc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:16.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.275+0000 7f8e20759640 1 --2- 172.21.15.40:0/3300742525 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8dfc06c920 0x7f8dfc06ede0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8e140015d0 tx=0x7f8e14009040 comp rx=0 tx=0).stop 2024-04-22T07:21:16.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.275+0000 7f8e20759640 1 -- 172.21.15.40:0/3300742525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e181550f0 msgr2=0x7f8e181f16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:16.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.275+0000 7f8e20759640 1 --2- 172.21.15.40:0/3300742525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e181550f0 0x7f8e181f16b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800c820 tx=0x7f8e0800cce0 comp rx=0 tx=0).stop 2024-04-22T07:21:16.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.275+0000 7f8e20759640 1 -- 172.21.15.40:0/3300742525 shutdown_connections 2024-04-22T07:21:16.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.275+0000 7f8e20759640 1 --2- 172.21.15.40:0/3300742525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e1815ed60 0x7f8e181f4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:16.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.275+0000 7f8e20759640 1 --2- 172.21.15.40:0/3300742525 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8dfc06c920 0x7f8dfc06ede0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:16.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.275+0000 7f8e20759640 1 --2- 172.21.15.40:0/3300742525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e181550f0 0x7f8e181f16b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:16.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.275+0000 7f8e20759640 1 --2- 172.21.15.40:0/3300742525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8e180cd580 0x7f8e180c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:16.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.275+0000 7f8e20759640 1 -- 172.21.15.40:0/3300742525 >> 172.21.15.40:0/3300742525 conn(0x7f8e1806b920 msgr2=0x7f8e18153ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:16.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.276+0000 7f8e20759640 1 -- 172.21.15.40:0/3300742525 shutdown_connections 2024-04-22T07:21:16.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.276+0000 7f8e20759640 1 -- 172.21.15.40:0/3300742525 wait complete. 2024-04-22T07:21:16.284 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-22T07:21:16.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.390+0000 7fc607967640 1 Processor -- start 2024-04-22T07:21:16.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.390+0000 7fc607967640 1 -- start start 2024-04-22T07:21:16.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.391+0000 7fc607967640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc60015ed60 0x7fc6000cd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:16.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.391+0000 7fc607967640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6000cd580 0x7fc6000c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:16.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.391+0000 7fc607967640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc60015f1a0 con 0x7fc6001551f0 2024-04-22T07:21:16.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.391+0000 7fc607967640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fc6001555d0 con 0x7fc60015ed60 2024-04-22T07:21:16.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.391+0000 7fc607967640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc60015bb00 con 0x7fc6000cd580 2024-04-22T07:21:16.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.391+0000 7fc604f02640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc60015ed60 0x7fc6000cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:16.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.391+0000 7fc605f04640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6000cd580 0x7fc6000c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:16.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.391+0000 7fc604f02640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc60015ed60 0x7fc6000cd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.40:56608/0 (socket says 172.21.15.40:56608) 2024-04-22T07:21:16.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.391+0000 7fc605703640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc6001551f0 0x7fc6000cb5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.40:56548/0 (socket says 172.21.15.40:56548) 2024-04-22T07:21:16.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.391+0000 7fc604f02640 1 -- 172.21.15.40:0/3188538575 learned_addr learned my addr 172.21.15.40:0/3188538575 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:16.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.391+0000 7fc604f02640 1 -- 172.21.15.40:0/3188538575 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6000cd580 msgr2=0x7fc6000c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:16.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.391+0000 7fc604f02640 1 --2- 172.21.15.40:0/3188538575 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6000cd580 0x7fc6000c55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:16.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.391+0000 7fc604f02640 1 -- 172.21.15.40:0/3188538575 >> v1:172.21.15.62:6789/0 conn(0x7fc6001551f0 legacy=0x7fc6000cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:16.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.391+0000 7fc604f02640 1 -- 172.21.15.40:0/3188538575 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6000cbed0 con 0x7fc60015ed60 2024-04-22T07:21:16.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.391+0000 7fc605f04640 1 --2- 172.21.15.40:0/3188538575 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6000cd580 0x7fc6000c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:21:16.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.392+0000 7fc604f02640 1 --2- 172.21.15.40:0/3188538575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc60015ed60 0x7fc6000cd040 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0009870 tx=0x7fc5f002ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a9e70c505832df7 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:16.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.392+0000 7fc5f7fff640 1 -- 172.21.15.40:0/3188538575 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f002f840 con 0x7fc60015ed60 2024-04-22T07:21:16.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.393+0000 7fc5f7fff640 1 -- 172.21.15.40:0/3188538575 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5f002f9e0 con 0x7fc60015ed60 2024-04-22T07:21:16.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.393+0000 7fc5f7fff640 1 -- 172.21.15.40:0/3188538575 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f002fdb0 con 0x7fc60015ed60 2024-04-22T07:21:16.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.393+0000 7fc607967640 1 -- 172.21.15.40:0/3188538575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc60015ed60 msgr2=0x7fc6000cd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:16.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.393+0000 7fc607967640 1 --2- 172.21.15.40:0/3188538575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc60015ed60 0x7fc6000cd040 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0009870 tx=0x7fc5f002ba20 comp rx=0 tx=0).stop 2024-04-22T07:21:16.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.393+0000 7fc607967640 1 -- 172.21.15.40:0/3188538575 shutdown_connections 2024-04-22T07:21:16.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.393+0000 7fc607967640 1 --2- 172.21.15.40:0/3188538575 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6000cd580 0x7fc6000c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:16.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.393+0000 7fc607967640 1 --2- 172.21.15.40:0/3188538575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc60015ed60 0x7fc6000cd040 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:16.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.393+0000 7fc607967640 1 -- 172.21.15.40:0/3188538575 >> 172.21.15.40:0/3188538575 conn(0x7fc60006b920 msgr2=0x7fc60006bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:16.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.393+0000 7fc607967640 1 -- 172.21.15.40:0/3188538575 shutdown_connections 2024-04-22T07:21:16.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.393+0000 7fc607967640 1 -- 172.21.15.40:0/3188538575 wait complete. 2024-04-22T07:21:16.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.394+0000 7fc607967640 1 Processor -- start 2024-04-22T07:21:16.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.394+0000 7fc607967640 1 -- start start 2024-04-22T07:21:16.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.395+0000 7fc607967640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6000cd580 0x7fc60014f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:16.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.395+0000 7fc607967640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6001551f0 0x7fc6001f0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:16.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.395+0000 7fc607967640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc60015ed60 0x7fc6001e7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:16.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.395+0000 7fc607967640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc60015b4b0 con 0x7fc6001551f0 2024-04-22T07:21:16.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.395+0000 7fc607967640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc60015b1d0 con 0x7fc60015ed60 2024-04-22T07:21:16.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.395+0000 7fc607967640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc60015b790 con 0x7fc6000cd580 2024-04-22T07:21:16.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.395+0000 7fc604f02640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6001551f0 0x7fc6001f0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:16.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.395+0000 7fc604f02640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6001551f0 0x7fc6001f0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55766/0 (socket says 172.21.15.40:55766) 2024-04-22T07:21:16.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.395+0000 7fc604f02640 1 -- 172.21.15.40:0/2206219808 learned_addr learned my addr 172.21.15.40:0/2206219808 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:16.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.395+0000 7fc605703640 1 --2- 172.21.15.40:0/2206219808 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6000cd580 0x7fc60014f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:16.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.395+0000 7fc605f04640 1 --2- 172.21.15.40:0/2206219808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc60015ed60 0x7fc6001e7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:16.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.395+0000 7fc604f02640 1 -- 172.21.15.40:0/2206219808 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6000cd580 msgr2=0x7fc60014f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:16.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.395+0000 7fc604f02640 1 --2- 172.21.15.40:0/2206219808 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6000cd580 0x7fc60014f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:16.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.395+0000 7fc604f02640 1 -- 172.21.15.40:0/2206219808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc60015ed60 msgr2=0x7fc6001e7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:16.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.395+0000 7fc604f02640 1 --2- 172.21.15.40:0/2206219808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc60015ed60 0x7fc6001e7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:16.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.395+0000 7fc604f02640 1 -- 172.21.15.40:0/2206219808 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc60015c0c0 con 0x7fc6001551f0 2024-04-22T07:21:16.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.396+0000 7fc604f02640 1 --2- 172.21.15.40:0/2206219808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6001551f0 0x7fc6001f0ea0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00090b0 tx=0x7fc5f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:16.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.396+0000 7fc5f5ffb640 1 -- 172.21.15.40:0/2206219808 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0046070 con 0x7fc6001551f0 2024-04-22T07:21:16.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.396+0000 7fc5f5ffb640 1 -- 172.21.15.40:0/2206219808 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5f0037c40 con 0x7fc6001551f0 2024-04-22T07:21:16.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.396+0000 7fc607967640 1 -- 172.21.15.40:0/2206219808 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc60015c360 con 0x7fc6001551f0 2024-04-22T07:21:16.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.396+0000 7fc5f5ffb640 1 -- 172.21.15.40:0/2206219808 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0041440 con 0x7fc6001551f0 2024-04-22T07:21:16.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.396+0000 7fc607967640 1 -- 172.21.15.40:0/2206219808 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6001f4410 con 0x7fc6001551f0 2024-04-22T07:21:16.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.397+0000 7fc607967640 1 -- 172.21.15.40:0/2206219808 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc600150ad0 con 0x7fc6001551f0 2024-04-22T07:21:16.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.397+0000 7fc5f5ffb640 1 -- 172.21.15.40:0/2206219808 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc5f0049070 con 0x7fc6001551f0 2024-04-22T07:21:16.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.398+0000 7fc5f5ffb640 1 --2- 172.21.15.40:0/2206219808 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc5e406c920 0x7fc5e406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:16.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.398+0000 7fc5f5ffb640 1 -- 172.21.15.40:0/2206219808 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc5f00ad670 con 0x7fc6001551f0 2024-04-22T07:21:16.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.398+0000 7fc605703640 1 --2- 172.21.15.40:0/2206219808 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc5e406c920 0x7fc5e406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:16.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.398+0000 7fc605703640 1 --2- 172.21.15.40:0/2206219808 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc5e406c920 0x7fc5e406ede0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc007fd0 tx=0x7fc5fc007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:16.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.402+0000 7fc5f5ffb640 1 -- 172.21.15.40:0/2206219808 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc5f0033030 con 0x7fc6001551f0 2024-04-22T07:21:16.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.590+0000 7fc607967640 1 -- 172.21.15.40:0/2206219808 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc60004fdc0 con 0x7fc6001551f0 2024-04-22T07:21:16.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.590+0000 7fc5f5ffb640 1 -- 172.21.15.40:0/2206219808 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7fc5f007b3c0 con 0x7fc6001551f0 2024-04-22T07:21:16.588 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-04-22T07:21:16.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.592+0000 7fc607967640 1 -- 172.21.15.40:0/2206219808 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc5e406c920 msgr2=0x7fc5e406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:16.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.592+0000 7fc607967640 1 --2- 172.21.15.40:0/2206219808 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc5e406c920 0x7fc5e406ede0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc007fd0 tx=0x7fc5fc007e80 comp rx=0 tx=0).stop 2024-04-22T07:21:16.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.592+0000 7fc607967640 1 -- 172.21.15.40:0/2206219808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6001551f0 msgr2=0x7fc6001f0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:16.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.592+0000 7fc607967640 1 --2- 172.21.15.40:0/2206219808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6001551f0 0x7fc6001f0ea0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00090b0 tx=0x7fc5f0004730 comp rx=0 tx=0).stop 2024-04-22T07:21:16.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.592+0000 7fc607967640 1 -- 172.21.15.40:0/2206219808 shutdown_connections 2024-04-22T07:21:16.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.592+0000 7fc607967640 1 --2- 172.21.15.40:0/2206219808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc60015ed60 0x7fc6001e7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:16.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.593+0000 7fc607967640 1 --2- 172.21.15.40:0/2206219808 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc5e406c920 0x7fc5e406ede0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:16.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.593+0000 7fc607967640 1 --2- 172.21.15.40:0/2206219808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6001551f0 0x7fc6001f0ea0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:16.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.593+0000 7fc607967640 1 --2- 172.21.15.40:0/2206219808 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc6000cd580 0x7fc60014f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:16.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.593+0000 7fc607967640 1 -- 172.21.15.40:0/2206219808 >> 172.21.15.40:0/2206219808 conn(0x7fc60006b920 msgr2=0x7fc6000c5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:16.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.593+0000 7fc607967640 1 -- 172.21.15.40:0/2206219808 shutdown_connections 2024-04-22T07:21:16.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.593+0000 7fc607967640 1 -- 172.21.15.40:0/2206219808 wait complete. 2024-04-22T07:21:16.601 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:21:16.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.705+0000 7f8a97aa7640 1 Processor -- start 2024-04-22T07:21:16.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.705+0000 7f8a97aa7640 1 -- start start 2024-04-22T07:21:16.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.706+0000 7f8a97aa7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8a90155130 0x7f8a900caef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:16.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.706+0000 7f8a97aa7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8a900cbd00 0x7f8a900d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:16.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.706+0000 7f8a97aa7640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a9015ac10 con 0x7f8a900d0e00 2024-04-22T07:21:16.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.706+0000 7f8a97aa7640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f8a900ccef0 con 0x7f8a90155130 2024-04-22T07:21:16.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.706+0000 7f8a97aa7640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f8a90072e70 con 0x7f8a900cbd00 2024-04-22T07:21:16.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.706+0000 7f8a95843640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8a90155130 0x7f8a900caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:16.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.706+0000 7f8a96044640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8a900d0e00 0x7f8a900cd380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37738/0 (socket says 172.21.15.40:37738) 2024-04-22T07:21:16.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.706+0000 7f8a96044640 1 -- 172.21.15.40:0/406134884 learned_addr learned my addr 172.21.15.40:0/406134884 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:16.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.706+0000 7f8a95042640 1 --2- 172.21.15.40:0/406134884 >> v2:172.21.15.62:3300/0 conn(0x7f8a900cbd00 0x7f8a900d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:16.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.706+0000 7f8a95843640 1 -- 172.21.15.40:0/406134884 >> v2:172.21.15.62:3300/0 conn(0x7f8a900cbd00 msgr2=0x7f8a900d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:16.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.706+0000 7f8a95843640 1 --2- 172.21.15.40:0/406134884 >> v2:172.21.15.62:3300/0 conn(0x7f8a900cbd00 0x7f8a900d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:16.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.706+0000 7f8a95843640 1 -- 172.21.15.40:0/406134884 >> v1:172.21.15.40:6789/0 conn(0x7f8a900d0e00 legacy=0x7f8a900cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:16.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.706+0000 7f8a95843640 1 -- 172.21.15.40:0/406134884 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9015aed0 con 0x7f8a90155130 2024-04-22T07:21:16.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.707+0000 7f8a95843640 1 --2- 172.21.15.40:0/406134884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a90155130 0x7f8a900caef0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8a900732e0 tx=0x7f8a8c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531011593b872c2c server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:16.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.707+0000 7f8a94841640 1 -- 172.21.15.40:0/406134884 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c034070 con 0x7f8a90155130 2024-04-22T07:21:16.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.707+0000 7f8a94841640 1 -- 172.21.15.40:0/406134884 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a8c030610 con 0x7f8a90155130 2024-04-22T07:21:16.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.707+0000 7f8a94841640 1 -- 172.21.15.40:0/406134884 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c0309e0 con 0x7f8a90155130 2024-04-22T07:21:16.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.707+0000 7f8a97aa7640 1 -- 172.21.15.40:0/406134884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a90155130 msgr2=0x7f8a900caef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:16.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.707+0000 7f8a97aa7640 1 --2- 172.21.15.40:0/406134884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a90155130 0x7f8a900caef0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8a900732e0 tx=0x7f8a8c02b960 comp rx=0 tx=0).stop 2024-04-22T07:21:16.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.707+0000 7f8a97aa7640 1 -- 172.21.15.40:0/406134884 shutdown_connections 2024-04-22T07:21:16.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.708+0000 7f8a97aa7640 1 --2- 172.21.15.40:0/406134884 >> v2:172.21.15.62:3300/0 conn(0x7f8a900cbd00 0x7f8a900d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:16.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.708+0000 7f8a97aa7640 1 --2- 172.21.15.40:0/406134884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a90155130 0x7f8a900caef0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:16.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.708+0000 7f8a97aa7640 1 -- 172.21.15.40:0/406134884 >> 172.21.15.40:0/406134884 conn(0x7f8a9006ce70 msgr2=0x7f8a9006d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:16.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.708+0000 7f8a97aa7640 1 -- 172.21.15.40:0/406134884 shutdown_connections 2024-04-22T07:21:16.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.708+0000 7f8a97aa7640 1 -- 172.21.15.40:0/406134884 wait complete. 2024-04-22T07:21:16.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.709+0000 7f8a97aa7640 1 Processor -- start 2024-04-22T07:21:16.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.709+0000 7f8a97aa7640 1 -- start start 2024-04-22T07:21:16.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.709+0000 7f8a97aa7640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8a900cbd00 0x7f8a90147450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:16.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.709+0000 7f8a97aa7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a900d0e00 0x7f8a90159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:16.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.709+0000 7f8a97aa7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a90155130 0x7f8a90159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:16.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.709+0000 7f8a97aa7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9015b770 con 0x7f8a90155130 2024-04-22T07:21:16.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.709+0000 7f8a97aa7640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9015b490 con 0x7f8a900d0e00 2024-04-22T07:21:16.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.709+0000 7f8a97aa7640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f8a9015ba50 con 0x7f8a900cbd00 2024-04-22T07:21:16.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.710+0000 7f8a96044640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a90155130 0x7f8a90159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:16.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.710+0000 7f8a96044640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a90155130 0x7f8a90159650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55794/0 (socket says 172.21.15.40:55794) 2024-04-22T07:21:16.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.710+0000 7f8a96044640 1 -- 172.21.15.40:0/2269016743 learned_addr learned my addr 172.21.15.40:0/2269016743 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:16.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.710+0000 7f8a95042640 1 --2- 172.21.15.40:0/2269016743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a900d0e00 0x7f8a90159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:16.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.710+0000 7f8a95843640 1 --2- 172.21.15.40:0/2269016743 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8a900cbd00 0x7f8a90147450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:16.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.710+0000 7f8a96044640 1 -- 172.21.15.40:0/2269016743 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8a900cbd00 msgr2=0x7f8a90147450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:16.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.710+0000 7f8a96044640 1 --2- 172.21.15.40:0/2269016743 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8a900cbd00 0x7f8a90147450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:16.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.710+0000 7f8a96044640 1 -- 172.21.15.40:0/2269016743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a900d0e00 msgr2=0x7f8a90159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:16.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.710+0000 7f8a96044640 1 --2- 172.21.15.40:0/2269016743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a900d0e00 0x7f8a90159110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:16.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.710+0000 7f8a96044640 1 -- 172.21.15.40:0/2269016743 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a901542f0 con 0x7f8a90155130 2024-04-22T07:21:16.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.710+0000 7f8a96044640 1 --2- 172.21.15.40:0/2269016743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a90155130 0x7f8a90159650 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8a8800cab0 tx=0x7f8a8800cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:16.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.710+0000 7f8a867fc640 1 -- 172.21.15.40:0/2269016743 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a88017070 con 0x7f8a90155130 2024-04-22T07:21:16.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.710+0000 7f8a867fc640 1 -- 172.21.15.40:0/2269016743 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a8800ac30 con 0x7f8a90155130 2024-04-22T07:21:16.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.710+0000 7f8a97aa7640 1 -- 172.21.15.40:0/2269016743 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a901e63e0 con 0x7f8a90155130 2024-04-22T07:21:16.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.710+0000 7f8a867fc640 1 -- 172.21.15.40:0/2269016743 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a88012400 con 0x7f8a90155130 2024-04-22T07:21:16.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.710+0000 7f8a97aa7640 1 -- 172.21.15.40:0/2269016743 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a90154590 con 0x7f8a90155130 2024-04-22T07:21:16.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.711+0000 7f8a97aa7640 1 -- 172.21.15.40:0/2269016743 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a900694f0 con 0x7f8a90155130 2024-04-22T07:21:16.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.712+0000 7f8a867fc640 1 -- 172.21.15.40:0/2269016743 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8a8801a070 con 0x7f8a90155130 2024-04-22T07:21:16.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.712+0000 7f8a867fc640 1 --2- 172.21.15.40:0/2269016743 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8a7406c8f0 0x7f8a7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:16.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.712+0000 7f8a867fc640 1 -- 172.21.15.40:0/2269016743 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f8a8808b630 con 0x7f8a90155130 2024-04-22T07:21:16.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.712+0000 7f8a95843640 1 --2- 172.21.15.40:0/2269016743 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8a7406c8f0 0x7f8a7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:16.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.713+0000 7f8a95843640 1 --2- 172.21.15.40:0/2269016743 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8a7406c8f0 0x7f8a7406edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c036000 tx=0x7f8a8c03b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:16.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.716+0000 7f8a867fc640 1 -- 172.21.15.40:0/2269016743 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8a900694f0 con 0x7f8a90155130 2024-04-22T07:21:16.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.904+0000 7f8a97aa7640 1 -- 172.21.15.40:0/2269016743 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8a900cb4d0 con 0x7f8a90155130 2024-04-22T07:21:16.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.905+0000 7f8a867fc640 1 -- 172.21.15.40:0/2269016743 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16537 (secure 0 0 0) 0x7f8a880594a0 con 0x7f8a90155130 2024-04-22T07:21:16.903 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:21:16.903 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":23,"fsid":"dd5b16e4-89fe-4602-b37f-062846793158","created":"2024-04-22T07:20:29.488892+0000","modified":"2024-04-22T07:20:54.858120+0000","last_up_change":"2024-04-22T07:20:40.397383+0000","last_in_change":"2024-04-22T07:20:31.702551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:20:41.793179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:20:51.815779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:20:52.164265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32238b7e-228b-4a67-bfca-16e8f0020a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6801","nonce":1526385055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6803","nonce":1526385055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6807","nonce":1526385055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6805","nonce":1526385055}]},"public_addr":"172.21.15.40:6801/1526385055","cluster_addr":"172.21.15.40:6803/1526385055","heartbeat_back_addr":"172.21.15.40:6807/1526385055","heartbeat_front_addr":"172.21.15.40:6805/1526385055","state":["exists","up"]},{"osd":1,"uuid":"5ad8da43-39b1-4295-b4d1-0f1e1d06fc0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6809","nonce":623026645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6811","nonce":623026645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6815","nonce":623026645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6813","nonce":623026645}]},"public_addr":"172.21.15.40:6809/623026645","cluster_addr":"172.21.15.40:6811/623026645","heartbeat_back_addr":"172.21.15.40:6815/623026645","heartbeat_front_addr":"172.21.15.40:6813/623026645","state":["exists","up"]},{"osd":2,"uuid":"7d2c6d50-719d-4232-ad47-f04dcf1a8bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6820","nonce":1885686505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6824","nonce":1885686505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6831","nonce":1885686505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6828","nonce":1885686505}]},"public_addr":"172.21.15.40:6820/1885686505","cluster_addr":"172.21.15.40:6824/1885686505","heartbeat_back_addr":"172.21.15.40:6831/1885686505","heartbeat_front_addr":"172.21.15.40:6828/1885686505","state":["exists","up"]},{"osd":3,"uuid":"af42e7d6-a6bf-403e-92e7-162d7c4fbf0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6817","nonce":130276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6819","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6821","nonce":130276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6829","nonce":130276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6823","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6825","nonce":130276746}]},"public_addr":"172.21.15.40:6817/130276746","cluster_addr":"172.21.15.40:6821/130276746","heartbeat_back_addr":"172.21.15.40:6829/130276746","heartbeat_front_addr":"172.21.15.40:6825/130276746","state":["exists","up"]},{"osd":4,"uuid":"f8e89e0d-be96-4f19-88c0-69c408df7d98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6801","nonce":2251435758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6803","nonce":2251435758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6807","nonce":2251435758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6805","nonce":2251435758}]},"public_addr":"172.21.15.62:6801/2251435758","cluster_addr":"172.21.15.62:6803/2251435758","heartbeat_back_addr":"172.21.15.62:6807/2251435758","heartbeat_front_addr":"172.21.15.62:6805/2251435758","state":["exists","up"]},{"osd":5,"uuid":"ba6dc1bc-272b-4f80-b55f-40bc4a0c3ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6809","nonce":3509322231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6811","nonce":3509322231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6815","nonce":3509322231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6813","nonce":3509322231}]},"public_addr":"172.21.15.62:6809/3509322231","cluster_addr":"172.21.15.62:6811/3509322231","heartbeat_back_addr":"172.21.15.62:6815/3509322231","heartbeat_front_addr":"172.21.15.62:6813/3509322231","state":["exists","up"]},{"osd":6,"uuid":"834fcd74-14bf-45ec-a10a-0374f4ce9bf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6825","nonce":3094315954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6827","nonce":3094315954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6831","nonce":3094315954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6829","nonce":3094315954}]},"public_addr":"172.21.15.62:6825/3094315954","cluster_addr":"172.21.15.62:6827/3094315954","heartbeat_back_addr":"172.21.15.62:6831/3094315954","heartbeat_front_addr":"172.21.15.62:6829/3094315954","state":["exists","up"]},{"osd":7,"uuid":"831c9a73-960e-4d2e-b86a-33a6916be059","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6817","nonce":147453972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6819","nonce":147453972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6823","nonce":147453972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6821","nonce":147453972}]},"public_addr":"172.21.15.62:6817/147453972","cluster_addr":"172.21.15.62:6819/147453972","heartbeat_back_addr":"172.21.15.62:6823/147453972","heartbeat_front_addr":"172.21.15.62:6821/147453972","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.828738+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.873471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.908090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.894782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:37.686796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.801123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.852323+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.812139+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:21:16.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.907+0000 7f8a97aa7640 1 -- 172.21.15.40:0/2269016743 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8a7406c8f0 msgr2=0x7f8a7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:16.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.907+0000 7f8a97aa7640 1 --2- 172.21.15.40:0/2269016743 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8a7406c8f0 0x7f8a7406edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c036000 tx=0x7f8a8c03b040 comp rx=0 tx=0).stop 2024-04-22T07:21:16.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.907+0000 7f8a97aa7640 1 -- 172.21.15.40:0/2269016743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a90155130 msgr2=0x7f8a90159650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:16.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.907+0000 7f8a97aa7640 1 --2- 172.21.15.40:0/2269016743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a90155130 0x7f8a90159650 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8a8800cab0 tx=0x7f8a8800cf70 comp rx=0 tx=0).stop 2024-04-22T07:21:16.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.907+0000 7f8a97aa7640 1 -- 172.21.15.40:0/2269016743 shutdown_connections 2024-04-22T07:21:16.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.907+0000 7f8a97aa7640 1 --2- 172.21.15.40:0/2269016743 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8a7406c8f0 0x7f8a7406edb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:16.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.907+0000 7f8a97aa7640 1 --2- 172.21.15.40:0/2269016743 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a90155130 0x7f8a90159650 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:16.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.907+0000 7f8a97aa7640 1 --2- 172.21.15.40:0/2269016743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8a900d0e00 0x7f8a90159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:16.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.907+0000 7f8a97aa7640 1 --2- 172.21.15.40:0/2269016743 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8a900cbd00 0x7f8a90147450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:16.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.907+0000 7f8a97aa7640 1 -- 172.21.15.40:0/2269016743 >> 172.21.15.40:0/2269016743 conn(0x7f8a9006ce70 msgr2=0x7f8a900cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:16.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.907+0000 7f8a97aa7640 1 -- 172.21.15.40:0/2269016743 shutdown_connections 2024-04-22T07:21:16.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:16.907+0000 7f8a97aa7640 1 -- 172.21.15.40:0/2269016743 wait complete. 2024-04-22T07:21:16.916 INFO:tasks.quiescer.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T07:20:41.793179+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-22T07:20:51.815779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-22T07:20:52.164265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-22T07:21:16.916 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T07:21:17.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.022+0000 7f53cb1ef640 1 Processor -- start 2024-04-22T07:21:17.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.022+0000 7f53cb1ef640 1 -- start start 2024-04-22T07:21:17.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.023+0000 7f53cb1ef640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f53c4072d40 0x7f53c40caee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:17.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.023+0000 7f53cb1ef640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f53c40d09f0 0x7f53c40d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:17.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.023+0000 7f53cb1ef640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53c40ccd80 con 0x7f53c4154fb0 2024-04-22T07:21:17.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.023+0000 7f53cb1ef640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f53c40c5c50 con 0x7f53c40d09f0 2024-04-22T07:21:17.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.023+0000 7f53cb1ef640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f53c4073160 con 0x7f53c4072d40 2024-04-22T07:21:17.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.023+0000 7f53c978c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f53c40d09f0 0x7f53c40d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:17.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.023+0000 7f53c8f8b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f53c4154fb0 0x7f53c415e2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37742/0 (socket says 172.21.15.40:37742) 2024-04-22T07:21:17.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.023+0000 7f53c8f8b640 1 -- 172.21.15.40:0/50476381 learned_addr learned my addr 172.21.15.40:0/50476381 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:17.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.023+0000 7f53c3fff640 1 --2- 172.21.15.40:0/50476381 >> v2:172.21.15.62:3300/0 conn(0x7f53c4072d40 0x7f53c40caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:17.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.024+0000 7f53c978c640 1 -- 172.21.15.40:0/50476381 >> v2:172.21.15.62:3300/0 conn(0x7f53c4072d40 msgr2=0x7f53c40caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:17.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.024+0000 7f53c978c640 1 --2- 172.21.15.40:0/50476381 >> v2:172.21.15.62:3300/0 conn(0x7f53c4072d40 0x7f53c40caee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.024+0000 7f53c978c640 1 -- 172.21.15.40:0/50476381 >> v1:172.21.15.40:6789/0 conn(0x7f53c4154fb0 legacy=0x7f53c415e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:17.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.024+0000 7f53c37fe640 1 -- 172.21.15.40:0/50476381 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2402205108 0 0) 0x7f53c40ccd80 con 0x7f53c4154fb0 2024-04-22T07:21:17.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.024+0000 7f53c978c640 1 -- 172.21.15.40:0/50476381 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c40cc7e0 con 0x7f53c40d09f0 2024-04-22T07:21:17.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.024+0000 7f53c978c640 1 --2- 172.21.15.40:0/50476381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53c40d09f0 0x7f53c40d0e80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f53c40c7830 tx=0x7f53b402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=406a2d917403a795 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:17.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.024+0000 7f53c37fe640 1 -- 172.21.15.40:0/50476381 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b4035020 con 0x7f53c40d09f0 2024-04-22T07:21:17.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.025+0000 7f53c37fe640 1 -- 172.21.15.40:0/50476381 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53b4031830 con 0x7f53c40d09f0 2024-04-22T07:21:17.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.025+0000 7f53c37fe640 1 -- 172.21.15.40:0/50476381 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b4031c00 con 0x7f53c40d09f0 2024-04-22T07:21:17.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.025+0000 7f53cb1ef640 1 -- 172.21.15.40:0/50476381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53c40d09f0 msgr2=0x7f53c40d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:17.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.025+0000 7f53cb1ef640 1 --2- 172.21.15.40:0/50476381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53c40d09f0 0x7f53c40d0e80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f53c40c7830 tx=0x7f53b402b8d0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.025+0000 7f53cb1ef640 1 -- 172.21.15.40:0/50476381 shutdown_connections 2024-04-22T07:21:17.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.025+0000 7f53cb1ef640 1 --2- 172.21.15.40:0/50476381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53c40d09f0 0x7f53c40d0e80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.025+0000 7f53cb1ef640 1 --2- 172.21.15.40:0/50476381 >> v2:172.21.15.62:3300/0 conn(0x7f53c4072d40 0x7f53c40caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.025+0000 7f53cb1ef640 1 -- 172.21.15.40:0/50476381 >> 172.21.15.40:0/50476381 conn(0x7f53c40676b0 msgr2=0x7f53c4067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:17.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.025+0000 7f53cb1ef640 1 -- 172.21.15.40:0/50476381 shutdown_connections 2024-04-22T07:21:17.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.025+0000 7f53cb1ef640 1 -- 172.21.15.40:0/50476381 wait complete. 2024-04-22T07:21:17.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.026+0000 7f53cb1ef640 1 Processor -- start 2024-04-22T07:21:17.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.026+0000 7f53cb1ef640 1 -- start start 2024-04-22T07:21:17.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.027+0000 7f53cb1ef640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53c4072d40 0x7f53c40c7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:17.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.027+0000 7f53cb1ef640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53c40d09f0 0x7f53c41507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:17.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.027+0000 7f53cb1ef640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53c4154fb0 0x7f53c41f15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:17.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.027+0000 7f53cb1ef640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f53c40cbbb0 con 0x7f53c4072d40 2024-04-22T07:21:17.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.027+0000 7f53cb1ef640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f53c40cb8d0 con 0x7f53c40d09f0 2024-04-22T07:21:17.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.027+0000 7f53cb1ef640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f53c40cbe90 con 0x7f53c4154fb0 2024-04-22T07:21:17.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.027+0000 7f53c8f8b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53c4072d40 0x7f53c40c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:17.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.027+0000 7f53c8f8b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53c4072d40 0x7f53c40c7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55818/0 (socket says 172.21.15.40:55818) 2024-04-22T07:21:17.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.027+0000 7f53c8f8b640 1 -- 172.21.15.40:0/705011053 learned_addr learned my addr 172.21.15.40:0/705011053 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:17.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.027+0000 7f53c3fff640 1 --2- 172.21.15.40:0/705011053 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53c40d09f0 0x7f53c41507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:17.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.027+0000 7f53c978c640 1 --2- 172.21.15.40:0/705011053 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53c4154fb0 0x7f53c41f15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:17.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.027+0000 7f53c8f8b640 1 -- 172.21.15.40:0/705011053 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53c4154fb0 msgr2=0x7f53c41f15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:17.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.027+0000 7f53c8f8b640 1 --2- 172.21.15.40:0/705011053 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53c4154fb0 0x7f53c41f15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.027+0000 7f53c8f8b640 1 -- 172.21.15.40:0/705011053 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53c40d09f0 msgr2=0x7f53c41507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:17.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.027+0000 7f53c8f8b640 1 --2- 172.21.15.40:0/705011053 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53c40d09f0 0x7f53c41507e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.027+0000 7f53c8f8b640 1 -- 172.21.15.40:0/705011053 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c4158290 con 0x7f53c4072d40 2024-04-22T07:21:17.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.028+0000 7f53c8f8b640 1 --2- 172.21.15.40:0/705011053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53c4072d40 0x7f53c40c7830 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00c7c0 tx=0x7f53bc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:17.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.028+0000 7f53c17fa640 1 -- 172.21.15.40:0/705011053 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc018070 con 0x7f53c4072d40 2024-04-22T07:21:17.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.028+0000 7f53c17fa640 1 -- 172.21.15.40:0/705011053 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53bc00a5e0 con 0x7f53c4072d40 2024-04-22T07:21:17.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.028+0000 7f53cb1ef640 1 -- 172.21.15.40:0/705011053 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c4158570 con 0x7f53c4072d40 2024-04-22T07:21:17.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.028+0000 7f53c17fa640 1 -- 172.21.15.40:0/705011053 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc00a9d0 con 0x7f53c4072d40 2024-04-22T07:21:17.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.028+0000 7f53cb1ef640 1 -- 172.21.15.40:0/705011053 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c41f0aa0 con 0x7f53c4072d40 2024-04-22T07:21:17.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.029+0000 7f53cb1ef640 1 -- 172.21.15.40:0/705011053 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53c40cece0 con 0x7f53c4072d40 2024-04-22T07:21:17.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.029+0000 7f53c17fa640 1 -- 172.21.15.40:0/705011053 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f53bc01b070 con 0x7f53c4072d40 2024-04-22T07:21:17.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.030+0000 7f53c17fa640 1 --2- 172.21.15.40:0/705011053 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f53a406c8f0 0x7f53a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:17.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.030+0000 7f53c17fa640 1 -- 172.21.15.40:0/705011053 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f53bc08b180 con 0x7f53c4072d40 2024-04-22T07:21:17.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.030+0000 7f53c3fff640 1 --2- 172.21.15.40:0/705011053 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f53a406c8f0 0x7f53a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:17.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.030+0000 7f53c3fff640 1 --2- 172.21.15.40:0/705011053 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f53a406c8f0 0x7f53a406edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f53c41e8000 tx=0x7f53ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:17.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.034+0000 7f53c17fa640 1 -- 172.21.15.40:0/705011053 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f53bc059520 con 0x7f53c4072d40 2024-04-22T07:21:17.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.217+0000 7f53cb1ef640 1 -- 172.21.15.40:0/705011053 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f53c404fdc0 con 0x7f53c4072d40 2024-04-22T07:21:17.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.217+0000 7f53c17fa640 1 -- 172.21.15.40:0/705011053 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f53bc058e20 con 0x7f53c4072d40 2024-04-22T07:21:17.215 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-04-22T07:21:17.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.219+0000 7f53cb1ef640 1 -- 172.21.15.40:0/705011053 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f53a406c8f0 msgr2=0x7f53a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:17.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.219+0000 7f53cb1ef640 1 --2- 172.21.15.40:0/705011053 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f53a406c8f0 0x7f53a406edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f53c41e8000 tx=0x7f53ac008040 comp rx=0 tx=0).stop 2024-04-22T07:21:17.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.219+0000 7f53cb1ef640 1 -- 172.21.15.40:0/705011053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53c4072d40 msgr2=0x7f53c40c7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:17.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.219+0000 7f53cb1ef640 1 --2- 172.21.15.40:0/705011053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53c4072d40 0x7f53c40c7830 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00c7c0 tx=0x7f53bc00cc80 comp rx=0 tx=0).stop 2024-04-22T07:21:17.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.219+0000 7f53cb1ef640 1 -- 172.21.15.40:0/705011053 shutdown_connections 2024-04-22T07:21:17.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.219+0000 7f53cb1ef640 1 --2- 172.21.15.40:0/705011053 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53c4154fb0 0x7f53c41f15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.219+0000 7f53cb1ef640 1 --2- 172.21.15.40:0/705011053 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53c40d09f0 0x7f53c41507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.219+0000 7f53cb1ef640 1 --2- 172.21.15.40:0/705011053 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f53a406c8f0 0x7f53a406edb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.219+0000 7f53cb1ef640 1 --2- 172.21.15.40:0/705011053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53c4072d40 0x7f53c40c7830 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.219+0000 7f53cb1ef640 1 -- 172.21.15.40:0/705011053 >> 172.21.15.40:0/705011053 conn(0x7f53c40676b0 msgr2=0x7f53c415ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:17.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.219+0000 7f53cb1ef640 1 -- 172.21.15.40:0/705011053 shutdown_connections 2024-04-22T07:21:17.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.219+0000 7f53cb1ef640 1 -- 172.21.15.40:0/705011053 wait complete. 2024-04-22T07:21:17.228 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-22T07:21:17.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.334+0000 7f2a81dbd640 1 Processor -- start 2024-04-22T07:21:17.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.334+0000 7f2a81dbd640 1 -- start start 2024-04-22T07:21:17.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.334+0000 7f2a81dbd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2a7c06b920 0x7f2a7c15b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:17.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.334+0000 7f2a81dbd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2a7c0c3e40 0x7f2a7c0c4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:17.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.334+0000 7f2a81dbd640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a7c06c500 con 0x7f2a7c06fd10 2024-04-22T07:21:17.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.334+0000 7f2a81dbd640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f2a7c15b370 con 0x7f2a7c06b920 2024-04-22T07:21:17.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.334+0000 7f2a81dbd640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f2a7c0700f0 con 0x7f2a7c0c3e40 2024-04-22T07:21:17.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.335+0000 7f2a7b7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2a7c06fd10 0x7f2a7c0c8fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37756/0 (socket says 172.21.15.40:37756) 2024-04-22T07:21:17.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.335+0000 7f2a7b7fe640 1 -- 172.21.15.40:0/2974829855 learned_addr learned my addr 172.21.15.40:0/2974829855 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:17.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.335+0000 7f2a7affd640 1 --2- 172.21.15.40:0/2974829855 >> v2:172.21.15.40:3300/0 conn(0x7f2a7c06b920 0x7f2a7c15b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:17.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.335+0000 7f2a7bfff640 1 --2- 172.21.15.40:0/2974829855 >> v2:172.21.15.62:3300/0 conn(0x7f2a7c0c3e40 0x7f2a7c0c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:17.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.335+0000 7f2a7a7fc640 1 -- 172.21.15.40:0/2974829855 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2170310101 0 0) 0x7f2a7c06c500 con 0x7f2a7c06fd10 2024-04-22T07:21:17.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.335+0000 7f2a7a7fc640 1 -- 172.21.15.40:0/2974829855 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a64003520 con 0x7f2a7c06fd10 2024-04-22T07:21:17.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.335+0000 7f2a7affd640 1 -- 172.21.15.40:0/2974829855 >> v2:172.21.15.62:3300/0 conn(0x7f2a7c0c3e40 msgr2=0x7f2a7c0c4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:17.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.335+0000 7f2a7affd640 1 --2- 172.21.15.40:0/2974829855 >> v2:172.21.15.62:3300/0 conn(0x7f2a7c0c3e40 0x7f2a7c0c4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.335+0000 7f2a7affd640 1 -- 172.21.15.40:0/2974829855 >> v1:172.21.15.40:6789/0 conn(0x7f2a7c06fd10 legacy=0x7f2a7c0c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:17.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.335+0000 7f2a7affd640 1 -- 172.21.15.40:0/2974829855 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a7c06c7e0 con 0x7f2a7c06b920 2024-04-22T07:21:17.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.336+0000 7f2a7affd640 1 --2- 172.21.15.40:0/2974829855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7c06b920 0x7f2a7c15b800 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c073930 tx=0x7f2a7002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f62ae067194b7d server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:17.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.336+0000 7f2a7a7fc640 1 -- 172.21.15.40:0/2974829855 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a70035020 con 0x7f2a7c06b920 2024-04-22T07:21:17.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.336+0000 7f2a7a7fc640 1 -- 172.21.15.40:0/2974829855 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a70031830 con 0x7f2a7c06b920 2024-04-22T07:21:17.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.336+0000 7f2a7a7fc640 1 -- 172.21.15.40:0/2974829855 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a70031c00 con 0x7f2a7c06b920 2024-04-22T07:21:17.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.336+0000 7f2a81dbd640 1 -- 172.21.15.40:0/2974829855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7c06b920 msgr2=0x7f2a7c15b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:17.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.336+0000 7f2a81dbd640 1 --2- 172.21.15.40:0/2974829855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7c06b920 0x7f2a7c15b800 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c073930 tx=0x7f2a7002b8d0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.336+0000 7f2a81dbd640 1 -- 172.21.15.40:0/2974829855 shutdown_connections 2024-04-22T07:21:17.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.336+0000 7f2a81dbd640 1 --2- 172.21.15.40:0/2974829855 >> v2:172.21.15.62:3300/0 conn(0x7f2a7c0c3e40 0x7f2a7c0c4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.336+0000 7f2a81dbd640 1 --2- 172.21.15.40:0/2974829855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7c06b920 0x7f2a7c15b800 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.336+0000 7f2a81dbd640 1 -- 172.21.15.40:0/2974829855 >> 172.21.15.40:0/2974829855 conn(0x7f2a7c071530 msgr2=0x7f2a7c071910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:17.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.336+0000 7f2a81dbd640 1 -- 172.21.15.40:0/2974829855 shutdown_connections 2024-04-22T07:21:17.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.336+0000 7f2a81dbd640 1 -- 172.21.15.40:0/2974829855 wait complete. 2024-04-22T07:21:17.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.338+0000 7f2a81dbd640 1 Processor -- start 2024-04-22T07:21:17.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.338+0000 7f2a81dbd640 1 -- start start 2024-04-22T07:21:17.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.338+0000 7f2a81dbd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7c06b920 0x7f2a7c0af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:17.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.338+0000 7f2a81dbd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2a7c06fd10 0x7f2a7c0afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:17.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.338+0000 7f2a81dbd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a7c0c3e40 0x7f2a7c152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:17.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.338+0000 7f2a81dbd640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7c06cda0 con 0x7f2a7c06b920 2024-04-22T07:21:17.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.338+0000 7f2a81dbd640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7c15b000 con 0x7f2a7c0c3e40 2024-04-22T07:21:17.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.338+0000 7f2a81dbd640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f2a7c15bd40 con 0x7f2a7c06fd10 2024-04-22T07:21:17.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.339+0000 7f2a7b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7c06b920 0x7f2a7c0af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:17.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.339+0000 7f2a7b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7c06b920 0x7f2a7c0af4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55838/0 (socket says 172.21.15.40:55838) 2024-04-22T07:21:17.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.339+0000 7f2a7b7fe640 1 -- 172.21.15.40:0/1382317938 learned_addr learned my addr 172.21.15.40:0/1382317938 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:17.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.339+0000 7f2a7bfff640 1 --2- 172.21.15.40:0/1382317938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a7c0c3e40 0x7f2a7c152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:17.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.339+0000 7f2a7affd640 1 --2- 172.21.15.40:0/1382317938 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2a7c06fd10 0x7f2a7c0afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:17.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.339+0000 7f2a7b7fe640 1 -- 172.21.15.40:0/1382317938 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2a7c06fd10 msgr2=0x7f2a7c0afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:17.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.339+0000 7f2a7b7fe640 1 --2- 172.21.15.40:0/1382317938 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2a7c06fd10 0x7f2a7c0afa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.339+0000 7f2a7b7fe640 1 -- 172.21.15.40:0/1382317938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a7c0c3e40 msgr2=0x7f2a7c152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:17.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.339+0000 7f2a7b7fe640 1 --2- 172.21.15.40:0/1382317938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a7c0c3e40 0x7f2a7c152180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.339+0000 7f2a7b7fe640 1 -- 172.21.15.40:0/1382317938 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a7c0c6780 con 0x7f2a7c06b920 2024-04-22T07:21:17.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.339+0000 7f2a7b7fe640 1 --2- 172.21.15.40:0/1382317938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7c06b920 0x7f2a7c0af4c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c00c460 tx=0x7f2a6c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:17.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.339+0000 7f2a63fff640 1 -- 172.21.15.40:0/1382317938 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c017070 con 0x7f2a7c06b920 2024-04-22T07:21:17.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.339+0000 7f2a81dbd640 1 -- 172.21.15.40:0/1382317938 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a7c0c6a60 con 0x7f2a7c06b920 2024-04-22T07:21:17.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.339+0000 7f2a63fff640 1 -- 172.21.15.40:0/1382317938 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a6c005ce0 con 0x7f2a7c06b920 2024-04-22T07:21:17.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.339+0000 7f2a63fff640 1 -- 172.21.15.40:0/1382317938 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c007290 con 0x7f2a7c06b920 2024-04-22T07:21:17.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.339+0000 7f2a81dbd640 1 -- 172.21.15.40:0/1382317938 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a7c0aecc0 con 0x7f2a7c06b920 2024-04-22T07:21:17.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.340+0000 7f2a81dbd640 1 -- 172.21.15.40:0/1382317938 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a7c069550 con 0x7f2a7c06b920 2024-04-22T07:21:17.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.341+0000 7f2a63fff640 1 -- 172.21.15.40:0/1382317938 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2a6c01a070 con 0x7f2a7c06b920 2024-04-22T07:21:17.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.341+0000 7f2a63fff640 1 --2- 172.21.15.40:0/1382317938 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2a6806c8f0 0x7f2a6806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:17.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.341+0000 7f2a63fff640 1 -- 172.21.15.40:0/1382317938 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2a6c08af50 con 0x7f2a7c06b920 2024-04-22T07:21:17.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.341+0000 7f2a7affd640 1 --2- 172.21.15.40:0/1382317938 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2a6806c8f0 0x7f2a6806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:17.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.342+0000 7f2a7affd640 1 --2- 172.21.15.40:0/1382317938 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2a6806c8f0 0x7f2a6806edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2a70036000 tx=0x7f2a70008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:17.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.345+0000 7f2a63fff640 1 -- 172.21.15.40:0/1382317938 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2a6c059300 con 0x7f2a7c06b920 2024-04-22T07:21:17.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.527+0000 7f2a81dbd640 1 -- 172.21.15.40:0/1382317938 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2a7c0722a0 con 0x7f2a7c06b920 2024-04-22T07:21:17.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.527+0000 7f2a63fff640 1 -- 172.21.15.40:0/1382317938 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f2a6c076e20 con 0x7f2a7c06b920 2024-04-22T07:21:17.525 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-22T07:21:17.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.529+0000 7f2a81dbd640 1 -- 172.21.15.40:0/1382317938 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2a6806c8f0 msgr2=0x7f2a6806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:17.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.529+0000 7f2a81dbd640 1 --2- 172.21.15.40:0/1382317938 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2a6806c8f0 0x7f2a6806edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2a70036000 tx=0x7f2a70008030 comp rx=0 tx=0).stop 2024-04-22T07:21:17.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.529+0000 7f2a81dbd640 1 -- 172.21.15.40:0/1382317938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7c06b920 msgr2=0x7f2a7c0af4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:17.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.529+0000 7f2a81dbd640 1 --2- 172.21.15.40:0/1382317938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7c06b920 0x7f2a7c0af4c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c00c460 tx=0x7f2a6c00c920 comp rx=0 tx=0).stop 2024-04-22T07:21:17.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.529+0000 7f2a81dbd640 1 -- 172.21.15.40:0/1382317938 shutdown_connections 2024-04-22T07:21:17.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.529+0000 7f2a81dbd640 1 --2- 172.21.15.40:0/1382317938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2a7c0c3e40 0x7f2a7c152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.529+0000 7f2a81dbd640 1 --2- 172.21.15.40:0/1382317938 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2a7c06fd10 0x7f2a7c0afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.529+0000 7f2a81dbd640 1 --2- 172.21.15.40:0/1382317938 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2a6806c8f0 0x7f2a6806edb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.529+0000 7f2a81dbd640 1 --2- 172.21.15.40:0/1382317938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a7c06b920 0x7f2a7c0af4c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.529+0000 7f2a81dbd640 1 -- 172.21.15.40:0/1382317938 >> 172.21.15.40:0/1382317938 conn(0x7f2a7c071530 msgr2=0x7f2a7c15a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:17.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.529+0000 7f2a81dbd640 1 -- 172.21.15.40:0/1382317938 shutdown_connections 2024-04-22T07:21:17.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.529+0000 7f2a81dbd640 1 -- 172.21.15.40:0/1382317938 wait complete. 2024-04-22T07:21:17.538 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-22T07:21:17.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.644+0000 7f388ddb6640 1 Processor -- start 2024-04-22T07:21:17.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.644+0000 7f388ddb6640 1 -- start start 2024-04-22T07:21:17.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.645+0000 7f388ddb6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f38881550f0 0x7f388815ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:17.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.645+0000 7f388ddb6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f38880cba00 0x7f38880c5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:17.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.645+0000 7f388ddb6640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f388815afd0 con 0x7f38880cb5b0 2024-04-22T07:21:17.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.645+0000 7f388ddb6640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f388815b290 con 0x7f38881550f0 2024-04-22T07:21:17.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.645+0000 7f388ddb6640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f388815b570 con 0x7f38880cba00 2024-04-22T07:21:17.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.645+0000 7f38877fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f38881550f0 0x7f388815ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:17.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.645+0000 7f38877fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f38881550f0 0x7f388815ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55842/0 (socket says 172.21.15.40:55842) 2024-04-22T07:21:17.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.645+0000 7f38877fe640 1 -- 172.21.15.40:0/951440994 learned_addr learned my addr 172.21.15.40:0/951440994 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:17.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.646+0000 7f3887fff640 1 --2- 172.21.15.40:0/951440994 >> v2:172.21.15.62:3300/0 conn(0x7f38880cba00 0x7f38880c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:17.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.646+0000 7f38877fe640 1 -- 172.21.15.40:0/951440994 >> v2:172.21.15.62:3300/0 conn(0x7f38880cba00 msgr2=0x7f38880c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:17.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.646+0000 7f38877fe640 1 --2- 172.21.15.40:0/951440994 >> v2:172.21.15.62:3300/0 conn(0x7f38880cba00 0x7f38880c5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.646+0000 7f38877fe640 1 -- 172.21.15.40:0/951440994 >> v1:172.21.15.62:6789/0 conn(0x7f38880cb5b0 legacy=0x7f38880cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:17.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.646+0000 7f38877fe640 1 -- 172.21.15.40:0/951440994 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f388815b850 con 0x7f38881550f0 2024-04-22T07:21:17.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.646+0000 7f38877fe640 1 --2- 172.21.15.40:0/951440994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38881550f0 0x7f388815ed60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f38880c75b0 tx=0x7f387802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a187c2bf2d8260 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:17.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.647+0000 7f38867fc640 1 -- 172.21.15.40:0/951440994 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878035020 con 0x7f38881550f0 2024-04-22T07:21:17.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.647+0000 7f38867fc640 1 -- 172.21.15.40:0/951440994 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3878031870 con 0x7f38881550f0 2024-04-22T07:21:17.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.647+0000 7f38867fc640 1 -- 172.21.15.40:0/951440994 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878031c40 con 0x7f38881550f0 2024-04-22T07:21:17.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.647+0000 7f388ddb6640 1 -- 172.21.15.40:0/951440994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38881550f0 msgr2=0x7f388815ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:17.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.647+0000 7f388ddb6640 1 --2- 172.21.15.40:0/951440994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38881550f0 0x7f388815ed60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f38880c75b0 tx=0x7f387802b910 comp rx=0 tx=0).stop 2024-04-22T07:21:17.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.647+0000 7f388ddb6640 1 -- 172.21.15.40:0/951440994 shutdown_connections 2024-04-22T07:21:17.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.647+0000 7f388ddb6640 1 --2- 172.21.15.40:0/951440994 >> v2:172.21.15.62:3300/0 conn(0x7f38880cba00 0x7f38880c5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.647+0000 7f388ddb6640 1 --2- 172.21.15.40:0/951440994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38881550f0 0x7f388815ed60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.647+0000 7f388ddb6640 1 -- 172.21.15.40:0/951440994 >> 172.21.15.40:0/951440994 conn(0x7f388806b920 msgr2=0x7f388806bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:17.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.647+0000 7f388ddb6640 1 -- 172.21.15.40:0/951440994 shutdown_connections 2024-04-22T07:21:17.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.647+0000 7f388ddb6640 1 -- 172.21.15.40:0/951440994 wait complete. 2024-04-22T07:21:17.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.648+0000 7f388ddb6640 1 Processor -- start 2024-04-22T07:21:17.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.649+0000 7f388ddb6640 1 -- start start 2024-04-22T07:21:17.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.649+0000 7f388ddb6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38880cb5b0 0x7f38881f18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:17.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.649+0000 7f388ddb6640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38880cba00 0x7f38880c6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:17.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.649+0000 7f388ddb6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38881550f0 0x7f388815bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:17.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.649+0000 7f388ddb6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f38880cd750 con 0x7f38880cb5b0 2024-04-22T07:21:17.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.649+0000 7f388ddb6640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f38881554d0 con 0x7f38881550f0 2024-04-22T07:21:17.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.649+0000 7f388ddb6640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f38880cd8d0 con 0x7f38880cba00 2024-04-22T07:21:17.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.649+0000 7f38877fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38880cb5b0 0x7f38881f18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:17.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.649+0000 7f38877fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38880cb5b0 0x7f38881f18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55852/0 (socket says 172.21.15.40:55852) 2024-04-22T07:21:17.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.649+0000 7f38877fe640 1 -- 172.21.15.40:0/520674950 learned_addr learned my addr 172.21.15.40:0/520674950 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:17.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.649+0000 7f3887fff640 1 --2- 172.21.15.40:0/520674950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38881550f0 0x7f388815bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:17.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.649+0000 7f3886ffd640 1 --2- 172.21.15.40:0/520674950 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38880cba00 0x7f38880c6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:17.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.650+0000 7f38877fe640 1 -- 172.21.15.40:0/520674950 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38880cba00 msgr2=0x7f38880c6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:17.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.650+0000 7f38877fe640 1 --2- 172.21.15.40:0/520674950 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38880cba00 0x7f38880c6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.650+0000 7f38877fe640 1 -- 172.21.15.40:0/520674950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38881550f0 msgr2=0x7f388815bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:17.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.650+0000 7f38877fe640 1 --2- 172.21.15.40:0/520674950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38881550f0 0x7f388815bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.650+0000 7f38877fe640 1 -- 172.21.15.40:0/520674950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f388814ef20 con 0x7f38880cb5b0 2024-04-22T07:21:17.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.650+0000 7f38877fe640 1 --2- 172.21.15.40:0/520674950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38880cb5b0 0x7f38881f18e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f387802b950 tx=0x7f38780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:17.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.650+0000 7f386ffff640 1 -- 172.21.15.40:0/520674950 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878040070 con 0x7f38880cb5b0 2024-04-22T07:21:17.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.650+0000 7f386ffff640 1 -- 172.21.15.40:0/520674950 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3878030d00 con 0x7f38880cb5b0 2024-04-22T07:21:17.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.650+0000 7f388ddb6640 1 -- 172.21.15.40:0/520674950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f388815e110 con 0x7f38880cb5b0 2024-04-22T07:21:17.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.650+0000 7f386ffff640 1 -- 172.21.15.40:0/520674950 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878035040 con 0x7f38880cb5b0 2024-04-22T07:21:17.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.650+0000 7f388ddb6640 1 -- 172.21.15.40:0/520674950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38881e7610 con 0x7f38880cb5b0 2024-04-22T07:21:17.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.651+0000 7f388ddb6640 1 -- 172.21.15.40:0/520674950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3888153130 con 0x7f38880cb5b0 2024-04-22T07:21:17.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.652+0000 7f386ffff640 1 -- 172.21.15.40:0/520674950 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f387804b060 con 0x7f38880cb5b0 2024-04-22T07:21:17.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.652+0000 7f386ffff640 1 --2- 172.21.15.40:0/520674950 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f387406c8f0 0x7f387406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:17.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.652+0000 7f3886ffd640 1 --2- 172.21.15.40:0/520674950 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f387406c8f0 0x7f387406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:17.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.652+0000 7f386ffff640 1 -- 172.21.15.40:0/520674950 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f38780ad850 con 0x7f38880cb5b0 2024-04-22T07:21:17.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.653+0000 7f3886ffd640 1 --2- 172.21.15.40:0/520674950 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f387406c8f0 0x7f387406edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f38880c7420 tx=0x7f387c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:17.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.657+0000 7f386ffff640 1 -- 172.21.15.40:0/520674950 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3888153130 con 0x7f38880cb5b0 2024-04-22T07:21:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.840+0000 7f388ddb6640 1 -- 172.21.15.40:0/520674950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f38880ccae0 con 0x7f38880cb5b0 2024-04-22T07:21:17.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.841+0000 7f386ffff640 1 -- 172.21.15.40:0/520674950 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f387807b5a0 con 0x7f38880cb5b0 2024-04-22T07:21:17.839 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-04-22T07:21:17.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.842+0000 7f388ddb6640 1 -- 172.21.15.40:0/520674950 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f387406c8f0 msgr2=0x7f387406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.842+0000 7f388ddb6640 1 --2- 172.21.15.40:0/520674950 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f387406c8f0 0x7f387406edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f38880c7420 tx=0x7f387c009040 comp rx=0 tx=0).stop 2024-04-22T07:21:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.842+0000 7f388ddb6640 1 -- 172.21.15.40:0/520674950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38880cb5b0 msgr2=0x7f38881f18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.842+0000 7f388ddb6640 1 --2- 172.21.15.40:0/520674950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38880cb5b0 0x7f38881f18e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f387802b950 tx=0x7f38780046c0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.842+0000 7f388ddb6640 1 -- 172.21.15.40:0/520674950 shutdown_connections 2024-04-22T07:21:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.842+0000 7f388ddb6640 1 --2- 172.21.15.40:0/520674950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38881550f0 0x7f388815bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.842+0000 7f388ddb6640 1 --2- 172.21.15.40:0/520674950 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f38880cba00 0x7f38880c6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.842+0000 7f388ddb6640 1 --2- 172.21.15.40:0/520674950 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f387406c8f0 0x7f387406edb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.842+0000 7f388ddb6640 1 --2- 172.21.15.40:0/520674950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38880cb5b0 0x7f38881f18e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.842+0000 7f388ddb6640 1 -- 172.21.15.40:0/520674950 >> 172.21.15.40:0/520674950 conn(0x7f388806b920 msgr2=0x7f3888071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.843+0000 7f388ddb6640 1 -- 172.21.15.40:0/520674950 shutdown_connections 2024-04-22T07:21:17.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.843+0000 7f388ddb6640 1 -- 172.21.15.40:0/520674950 wait complete. 2024-04-22T07:21:17.851 INFO:tasks.quiescer.ceph_manager:waiting for clean 2024-04-22T07:21:17.851 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T07:21:17.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.957+0000 7f3165940640 1 Processor -- start 2024-04-22T07:21:17.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.957+0000 7f3165940640 1 -- start start 2024-04-22T07:21:17.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.958+0000 7f3165940640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3160154f50 0x7f31600cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:17.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.958+0000 7f3165940640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f316015b3e0 0x7f316015b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:17.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.958+0000 7f3165940640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f316015bd90 con 0x7f31600cc5a0 2024-04-22T07:21:17.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.958+0000 7f3165940640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f316015af50 con 0x7f316015b3e0 2024-04-22T07:21:17.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.958+0000 7f3165940640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f316015e6e0 con 0x7f3160154f50 2024-04-22T07:21:17.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.958+0000 7f3157fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f31600cc5a0 0x7f31600d0590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37760/0 (socket says 172.21.15.40:37760) 2024-04-22T07:21:17.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.958+0000 7f3157fff640 1 -- 172.21.15.40:0/3951981226 learned_addr learned my addr 172.21.15.40:0/3951981226 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:17.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.958+0000 7f315effd640 1 --2- 172.21.15.40:0/3951981226 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3160154f50 0x7f31600cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:17.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.958+0000 7f315f7fe640 1 --2- 172.21.15.40:0/3951981226 >> v2:172.21.15.62:3300/0 conn(0x7f316015b3e0 0x7f316015b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:17.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.958+0000 7f315e7fc640 1 -- 172.21.15.40:0/3951981226 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2351975808 0 0) 0x7f3148001110 con 0x7f31600cc5a0 2024-04-22T07:21:17.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.958+0000 7f315e7fc640 1 -- 172.21.15.40:0/3951981226 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f314c003520 con 0x7f31600cc5a0 2024-04-22T07:21:17.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.958+0000 7f315effd640 1 -- 172.21.15.40:0/3951981226 >> v2:172.21.15.62:3300/0 conn(0x7f316015b3e0 msgr2=0x7f316015b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:17.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.958+0000 7f315effd640 1 --2- 172.21.15.40:0/3951981226 >> v2:172.21.15.62:3300/0 conn(0x7f316015b3e0 0x7f316015b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.958+0000 7f315effd640 1 -- 172.21.15.40:0/3951981226 >> v1:172.21.15.40:6789/0 conn(0x7f31600cc5a0 legacy=0x7f31600d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:17.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.958+0000 7f315e7fc640 1 -- 172.21.15.40:0/3951981226 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 960560104 0 0) 0x7f314c003520 con 0x7f31600cc5a0 2024-04-22T07:21:17.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.958+0000 7f315effd640 1 -- 172.21.15.40:0/3951981226 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f316015e9c0 con 0x7f3160154f50 2024-04-22T07:21:17.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.958+0000 7f315f7fe640 1 --2- 172.21.15.40:0/3951981226 >> v2:172.21.15.62:3300/0 conn(0x7f316015b3e0 0x7f316015b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:21:17.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.959+0000 7f315effd640 1 --2- 172.21.15.40:0/3951981226 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3160154f50 0x7f31600cc060 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f31500097a0 tx=0x7f315002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ff814279007628b server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:17.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.960+0000 7f315e7fc640 1 -- 172.21.15.40:0/3951981226 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3150038070 con 0x7f3160154f50 2024-04-22T07:21:17.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.960+0000 7f315e7fc640 1 -- 172.21.15.40:0/3951981226 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3150031500 con 0x7f3160154f50 2024-04-22T07:21:17.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.960+0000 7f315e7fc640 1 -- 172.21.15.40:0/3951981226 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3148001840 con 0x7f3160154f50 2024-04-22T07:21:17.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.960+0000 7f3165940640 1 -- 172.21.15.40:0/3951981226 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3160154f50 msgr2=0x7f31600cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:17.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.960+0000 7f3165940640 1 --2- 172.21.15.40:0/3951981226 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3160154f50 0x7f31600cc060 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f31500097a0 tx=0x7f315002b820 comp rx=0 tx=0).stop 2024-04-22T07:21:17.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.960+0000 7f3165940640 1 -- 172.21.15.40:0/3951981226 shutdown_connections 2024-04-22T07:21:17.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.960+0000 7f3165940640 1 --2- 172.21.15.40:0/3951981226 >> v2:172.21.15.62:3300/0 conn(0x7f316015b3e0 0x7f316015b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.960+0000 7f3165940640 1 --2- 172.21.15.40:0/3951981226 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3160154f50 0x7f31600cc060 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.960+0000 7f3165940640 1 -- 172.21.15.40:0/3951981226 >> 172.21.15.40:0/3951981226 conn(0x7f31600676b0 msgr2=0x7f3160067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.960+0000 7f3165940640 1 -- 172.21.15.40:0/3951981226 shutdown_connections 2024-04-22T07:21:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.960+0000 7f3165940640 1 -- 172.21.15.40:0/3951981226 wait complete. 2024-04-22T07:21:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.961+0000 7f3165940640 1 Processor -- start 2024-04-22T07:21:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.962+0000 7f3165940640 1 -- start start 2024-04-22T07:21:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.962+0000 7f3165940640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31600cc5a0 0x7f316015d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.962+0000 7f3165940640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3160154f50 0x7f3160152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.962+0000 7f3165940640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f316015b3e0 0x7f3160152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.962+0000 7f3165940640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f316015f260 con 0x7f316015b3e0 2024-04-22T07:21:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.962+0000 7f3165940640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f316015ef80 con 0x7f31600cc5a0 2024-04-22T07:21:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.962+0000 7f3165940640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f316015e3a0 con 0x7f3160154f50 2024-04-22T07:21:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.962+0000 7f315f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f316015b3e0 0x7f3160152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.962+0000 7f315f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f316015b3e0 0x7f3160152db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55868/0 (socket says 172.21.15.40:55868) 2024-04-22T07:21:17.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.962+0000 7f315f7fe640 1 -- 172.21.15.40:0/3201398342 learned_addr learned my addr 172.21.15.40:0/3201398342 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.962+0000 7f3157fff640 1 --2- 172.21.15.40:0/3201398342 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3160154f50 0x7f3160152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.962+0000 7f315effd640 1 --2- 172.21.15.40:0/3201398342 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31600cc5a0 0x7f316015d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.963+0000 7f315f7fe640 1 -- 172.21.15.40:0/3201398342 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3160154f50 msgr2=0x7f3160152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.963+0000 7f315f7fe640 1 --2- 172.21.15.40:0/3201398342 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3160154f50 0x7f3160152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.963+0000 7f315f7fe640 1 -- 172.21.15.40:0/3201398342 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31600cc5a0 msgr2=0x7f316015d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.963+0000 7f315f7fe640 1 --2- 172.21.15.40:0/3201398342 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31600cc5a0 0x7f316015d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.963+0000 7f315f7fe640 1 -- 172.21.15.40:0/3201398342 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3160159c90 con 0x7f316015b3e0 2024-04-22T07:21:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.963+0000 7f315effd640 1 --2- 172.21.15.40:0/3201398342 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31600cc5a0 0x7f316015d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.963+0000 7f315f7fe640 1 --2- 172.21.15.40:0/3201398342 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f316015b3e0 0x7f3160152db0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3158009e60 tx=0x7f315800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.963+0000 7f315cff9640 1 -- 172.21.15.40:0/3201398342 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3158018030 con 0x7f316015b3e0 2024-04-22T07:21:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.963+0000 7f315cff9640 1 -- 172.21.15.40:0/3201398342 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f315800cdf0 con 0x7f316015b3e0 2024-04-22T07:21:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.963+0000 7f3165940640 1 -- 172.21.15.40:0/3201398342 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3160159fc0 con 0x7f316015b3e0 2024-04-22T07:21:17.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.963+0000 7f315cff9640 1 -- 172.21.15.40:0/3201398342 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3158003bb0 con 0x7f316015b3e0 2024-04-22T07:21:17.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.963+0000 7f3165940640 1 -- 172.21.15.40:0/3201398342 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f316015a580 con 0x7f316015b3e0 2024-04-22T07:21:17.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.964+0000 7f3165940640 1 -- 172.21.15.40:0/3201398342 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31600694b0 con 0x7f316015b3e0 2024-04-22T07:21:17.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.965+0000 7f315cff9640 1 -- 172.21.15.40:0/3201398342 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f315801b070 con 0x7f316015b3e0 2024-04-22T07:21:17.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.965+0000 7f315cff9640 1 --2- 172.21.15.40:0/3201398342 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f314006c920 0x7f314006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:17.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.965+0000 7f315cff9640 1 -- 172.21.15.40:0/3201398342 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f315808c4f0 con 0x7f316015b3e0 2024-04-22T07:21:17.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.965+0000 7f315effd640 1 --2- 172.21.15.40:0/3201398342 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f314006c920 0x7f314006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:17.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.966+0000 7f315effd640 1 --2- 172.21.15.40:0/3201398342 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f314006c920 0x7f314006ede0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3150035000 tx=0x7f3150008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:17.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:17.969+0000 7f315cff9640 1 -- 172.21.15.40:0/3201398342 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f31600694b0 con 0x7f316015b3e0 2024-04-22T07:21:18.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.151+0000 7f3165940640 1 -- 172.21.15.40:0/3201398342 --> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f316015da80 con 0x7f314006c920 2024-04-22T07:21:18.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.157+0000 7f315cff9640 1 -- 172.21.15.40:0/3201398342 <== mgr.4107 v2:172.21.15.40:6832/91163869 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7f316015da80 con 0x7f314006c920 2024-04-22T07:21:18.160 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:21:18.162 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-22T07:21:18.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.160+0000 7f3165940640 1 -- 172.21.15.40:0/3201398342 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f314006c920 msgr2=0x7f314006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:18.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.160+0000 7f3165940640 1 --2- 172.21.15.40:0/3201398342 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f314006c920 0x7f314006ede0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3150035000 tx=0x7f3150008030 comp rx=0 tx=0).stop 2024-04-22T07:21:18.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.160+0000 7f3165940640 1 -- 172.21.15.40:0/3201398342 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f316015b3e0 msgr2=0x7f3160152db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:18.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.160+0000 7f3165940640 1 --2- 172.21.15.40:0/3201398342 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f316015b3e0 0x7f3160152db0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3158009e60 tx=0x7f315800c490 comp rx=0 tx=0).stop 2024-04-22T07:21:18.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.160+0000 7f3165940640 1 -- 172.21.15.40:0/3201398342 shutdown_connections 2024-04-22T07:21:18.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.160+0000 7f3165940640 1 --2- 172.21.15.40:0/3201398342 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f314006c920 0x7f314006ede0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:18.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.160+0000 7f3165940640 1 --2- 172.21.15.40:0/3201398342 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f316015b3e0 0x7f3160152db0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:18.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.160+0000 7f3165940640 1 --2- 172.21.15.40:0/3201398342 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3160154f50 0x7f3160152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:18.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.160+0000 7f3165940640 1 --2- 172.21.15.40:0/3201398342 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31600cc5a0 0x7f316015d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:18.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.160+0000 7f3165940640 1 -- 172.21.15.40:0/3201398342 >> 172.21.15.40:0/3201398342 conn(0x7f31600676b0 msgr2=0x7f31600c6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:18.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.160+0000 7f3165940640 1 -- 172.21.15.40:0/3201398342 shutdown_connections 2024-04-22T07:21:18.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.160+0000 7f3165940640 1 -- 172.21.15.40:0/3201398342 wait complete. 2024-04-22T07:21:18.169 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-04-22T07:21:17.781653+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593034,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219180,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755540,"statfs":{"total":773094113280,"available":772869672960,"internally_reserved":0,"allocated":3121152,"data_stored":1835692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":256,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002520"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977886+0000","last_change":"2024-04-22T07:20:53.873662+0000","last_active":"2024-04-22T07:20:54.977886+0000","last_peered":"2024-04-22T07:20:54.977886+0000","last_clean":"2024-04-22T07:20:54.977886+0000","last_became_active":"2024-04-22T07:20:53.873384+0000","last_became_peered":"2024-04-22T07:20:53.873384+0000","last_unstale":"2024-04-22T07:20:54.977886+0000","last_undegraded":"2024-04-22T07:20:54.977886+0000","last_fullsized":"2024-04-22T07:20:54.977886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980006+0000","last_change":"2024-04-22T07:20:53.870454+0000","last_active":"2024-04-22T07:20:54.980006+0000","last_peered":"2024-04-22T07:20:54.980006+0000","last_clean":"2024-04-22T07:20:54.980006+0000","last_became_active":"2024-04-22T07:20:53.869964+0000","last_became_peered":"2024-04-22T07:20:53.869964+0000","last_unstale":"2024-04-22T07:20:54.980006+0000","last_undegraded":"2024-04-22T07:20:54.980006+0000","last_fullsized":"2024-04-22T07:20:54.980006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979125+0000","last_change":"2024-04-22T07:20:53.871145+0000","last_active":"2024-04-22T07:20:54.979125+0000","last_peered":"2024-04-22T07:20:54.979125+0000","last_clean":"2024-04-22T07:20:54.979125+0000","last_became_active":"2024-04-22T07:20:53.870819+0000","last_became_peered":"2024-04-22T07:20:53.870819+0000","last_unstale":"2024-04-22T07:20:54.979125+0000","last_undegraded":"2024-04-22T07:20:54.979125+0000","last_fullsized":"2024-04-22T07:20:54.979125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:02:16.373202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861622+0000","last_change":"2024-04-22T07:20:53.870458+0000","last_active":"2024-04-22T07:20:54.861622+0000","last_peered":"2024-04-22T07:20:54.861622+0000","last_clean":"2024-04-22T07:20:54.861622+0000","last_became_active":"2024-04-22T07:20:53.870125+0000","last_became_peered":"2024-04-22T07:20:53.870125+0000","last_unstale":"2024-04-22T07:20:54.861622+0000","last_undegraded":"2024-04-22T07:20:54.861622+0000","last_fullsized":"2024-04-22T07:20:54.861622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977801+0000","last_change":"2024-04-22T07:20:53.877301+0000","last_active":"2024-04-22T07:20:54.977801+0000","last_peered":"2024-04-22T07:20:54.977801+0000","last_clean":"2024-04-22T07:20:54.977801+0000","last_became_active":"2024-04-22T07:20:53.874941+0000","last_became_peered":"2024-04-22T07:20:53.874941+0000","last_unstale":"2024-04-22T07:20:54.977801+0000","last_undegraded":"2024-04-22T07:20:54.977801+0000","last_fullsized":"2024-04-22T07:20:54.977801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:52.686229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861484+0000","last_change":"2024-04-22T07:20:53.869735+0000","last_active":"2024-04-22T07:20:54.861484+0000","last_peered":"2024-04-22T07:20:54.861484+0000","last_clean":"2024-04-22T07:20:54.861484+0000","last_became_active":"2024-04-22T07:20:53.869369+0000","last_became_peered":"2024-04-22T07:20:53.869369+0000","last_unstale":"2024-04-22T07:20:54.861484+0000","last_undegraded":"2024-04-22T07:20:54.861484+0000","last_fullsized":"2024-04-22T07:20:54.861484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:27.624819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977494+0000","last_change":"2024-04-22T07:20:53.873492+0000","last_active":"2024-04-22T07:20:54.977494+0000","last_peered":"2024-04-22T07:20:54.977494+0000","last_clean":"2024-04-22T07:20:54.977494+0000","last_became_active":"2024-04-22T07:20:53.873220+0000","last_became_peered":"2024-04-22T07:20:53.873220+0000","last_unstale":"2024-04-22T07:20:54.977494+0000","last_undegraded":"2024-04-22T07:20:54.977494+0000","last_fullsized":"2024-04-22T07:20:54.977494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:35:26.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979018+0000","last_change":"2024-04-22T07:20:53.875847+0000","last_active":"2024-04-22T07:20:54.979018+0000","last_peered":"2024-04-22T07:20:54.979018+0000","last_clean":"2024-04-22T07:20:54.979018+0000","last_became_active":"2024-04-22T07:20:53.875017+0000","last_became_peered":"2024-04-22T07:20:53.875017+0000","last_unstale":"2024-04-22T07:20:54.979018+0000","last_undegraded":"2024-04-22T07:20:54.979018+0000","last_fullsized":"2024-04-22T07:20:54.979018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:07.080135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863086+0000","last_change":"2024-04-22T07:20:53.869174+0000","last_active":"2024-04-22T07:20:54.863086+0000","last_peered":"2024-04-22T07:20:54.863086+0000","last_clean":"2024-04-22T07:20:54.863086+0000","last_became_active":"2024-04-22T07:20:53.868906+0000","last_became_peered":"2024-04-22T07:20:53.868906+0000","last_unstale":"2024-04-22T07:20:54.863086+0000","last_undegraded":"2024-04-22T07:20:54.863086+0000","last_fullsized":"2024-04-22T07:20:54.863086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977893+0000","last_change":"2024-04-22T07:20:53.874933+0000","last_active":"2024-04-22T07:20:54.977893+0000","last_peered":"2024-04-22T07:20:54.977893+0000","last_clean":"2024-04-22T07:20:54.977893+0000","last_became_active":"2024-04-22T07:20:53.874673+0000","last_became_peered":"2024-04-22T07:20:53.874673+0000","last_unstale":"2024-04-22T07:20:54.977893+0000","last_undegraded":"2024-04-22T07:20:54.977893+0000","last_fullsized":"2024-04-22T07:20:54.977893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977684+0000","last_change":"2024-04-22T07:20:53.874909+0000","last_active":"2024-04-22T07:20:54.977684+0000","last_peered":"2024-04-22T07:20:54.977684+0000","last_clean":"2024-04-22T07:20:54.977684+0000","last_became_active":"2024-04-22T07:20:53.873945+0000","last_became_peered":"2024-04-22T07:20:53.873945+0000","last_unstale":"2024-04-22T07:20:54.977684+0000","last_undegraded":"2024-04-22T07:20:54.977684+0000","last_fullsized":"2024-04-22T07:20:54.977684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:53.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977652+0000","last_change":"2024-04-22T07:20:53.878344+0000","last_active":"2024-04-22T07:20:54.977652+0000","last_peered":"2024-04-22T07:20:54.977652+0000","last_clean":"2024-04-22T07:20:54.977652+0000","last_became_active":"2024-04-22T07:20:53.877192+0000","last_became_peered":"2024-04-22T07:20:53.877192+0000","last_unstale":"2024-04-22T07:20:54.977652+0000","last_undegraded":"2024-04-22T07:20:54.977652+0000","last_fullsized":"2024-04-22T07:20:54.977652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:42:03.637655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979583+0000","last_change":"2024-04-22T07:20:53.879419+0000","last_active":"2024-04-22T07:20:54.979583+0000","last_peered":"2024-04-22T07:20:54.979583+0000","last_clean":"2024-04-22T07:20:54.979583+0000","last_became_active":"2024-04-22T07:20:53.879070+0000","last_became_peered":"2024-04-22T07:20:53.879070+0000","last_unstale":"2024-04-22T07:20:54.979583+0000","last_undegraded":"2024-04-22T07:20:54.979583+0000","last_fullsized":"2024-04-22T07:20:54.979583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979592+0000","last_change":"2024-04-22T07:20:53.877395+0000","last_active":"2024-04-22T07:20:54.979592+0000","last_peered":"2024-04-22T07:20:54.979592+0000","last_clean":"2024-04-22T07:20:54.979592+0000","last_became_active":"2024-04-22T07:20:53.877116+0000","last_became_peered":"2024-04-22T07:20:53.877116+0000","last_unstale":"2024-04-22T07:20:54.979592+0000","last_undegraded":"2024-04-22T07:20:54.979592+0000","last_fullsized":"2024-04-22T07:20:54.979592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:21:25.001413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979310+0000","last_change":"2024-04-22T07:20:53.875156+0000","last_active":"2024-04-22T07:20:54.979310+0000","last_peered":"2024-04-22T07:20:54.979310+0000","last_clean":"2024-04-22T07:20:54.979310+0000","last_became_active":"2024-04-22T07:20:53.874468+0000","last_became_peered":"2024-04-22T07:20:53.874468+0000","last_unstale":"2024-04-22T07:20:54.979310+0000","last_undegraded":"2024-04-22T07:20:54.979310+0000","last_fullsized":"2024-04-22T07:20:54.979310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:42:03.637655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862585+0000","last_change":"2024-04-22T07:20:53.867178+0000","last_active":"2024-04-22T07:20:54.862585+0000","last_peered":"2024-04-22T07:20:54.862585+0000","last_clean":"2024-04-22T07:20:54.862585+0000","last_became_active":"2024-04-22T07:20:53.865491+0000","last_became_peered":"2024-04-22T07:20:53.865491+0000","last_unstale":"2024-04-22T07:20:54.862585+0000","last_undegraded":"2024-04-22T07:20:54.862585+0000","last_fullsized":"2024-04-22T07:20:54.862585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863583+0000","last_change":"2024-04-22T07:20:53.876797+0000","last_active":"2024-04-22T07:20:54.863583+0000","last_peered":"2024-04-22T07:20:54.863583+0000","last_clean":"2024-04-22T07:20:54.863583+0000","last_became_active":"2024-04-22T07:20:53.876321+0000","last_became_peered":"2024-04-22T07:20:53.876321+0000","last_unstale":"2024-04-22T07:20:54.863583+0000","last_undegraded":"2024-04-22T07:20:54.863583+0000","last_fullsized":"2024-04-22T07:20:54.863583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:22:45.699676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980360+0000","last_change":"2024-04-22T07:20:53.868760+0000","last_active":"2024-04-22T07:20:54.980360+0000","last_peered":"2024-04-22T07:20:54.980360+0000","last_clean":"2024-04-22T07:20:54.980360+0000","last_became_active":"2024-04-22T07:20:53.868441+0000","last_became_peered":"2024-04-22T07:20:53.868441+0000","last_unstale":"2024-04-22T07:20:54.980360+0000","last_undegraded":"2024-04-22T07:20:54.980360+0000","last_fullsized":"2024-04-22T07:20:54.980360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863503+0000","last_change":"2024-04-22T07:20:53.864806+0000","last_active":"2024-04-22T07:20:54.863503+0000","last_peered":"2024-04-22T07:20:54.863503+0000","last_clean":"2024-04-22T07:20:54.863503+0000","last_became_active":"2024-04-22T07:20:53.864535+0000","last_became_peered":"2024-04-22T07:20:53.864535+0000","last_unstale":"2024-04-22T07:20:54.863503+0000","last_undegraded":"2024-04-22T07:20:54.863503+0000","last_fullsized":"2024-04-22T07:20:54.863503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:22:07.227993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977721+0000","last_change":"2024-04-22T07:20:53.878013+0000","last_active":"2024-04-22T07:20:54.977721+0000","last_peered":"2024-04-22T07:20:54.977721+0000","last_clean":"2024-04-22T07:20:54.977721+0000","last_became_active":"2024-04-22T07:20:53.876641+0000","last_became_peered":"2024-04-22T07:20:53.876641+0000","last_unstale":"2024-04-22T07:20:54.977721+0000","last_undegraded":"2024-04-22T07:20:54.977721+0000","last_fullsized":"2024-04-22T07:20:54.977721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:45:15.519469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978885+0000","last_change":"2024-04-22T07:20:53.868319+0000","last_active":"2024-04-22T07:20:54.978885+0000","last_peered":"2024-04-22T07:20:54.978885+0000","last_clean":"2024-04-22T07:20:54.978885+0000","last_became_active":"2024-04-22T07:20:53.868014+0000","last_became_peered":"2024-04-22T07:20:53.868014+0000","last_unstale":"2024-04-22T07:20:54.978885+0000","last_undegraded":"2024-04-22T07:20:54.978885+0000","last_fullsized":"2024-04-22T07:20:54.978885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:09:27.178992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862823+0000","last_change":"2024-04-22T07:20:53.867684+0000","last_active":"2024-04-22T07:20:54.862823+0000","last_peered":"2024-04-22T07:20:54.862823+0000","last_clean":"2024-04-22T07:20:54.862823+0000","last_became_active":"2024-04-22T07:20:53.867403+0000","last_became_peered":"2024-04-22T07:20:53.867403+0000","last_unstale":"2024-04-22T07:20:54.862823+0000","last_undegraded":"2024-04-22T07:20:54.862823+0000","last_fullsized":"2024-04-22T07:20:54.862823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979253+0000","last_change":"2024-04-22T07:20:53.869595+0000","last_active":"2024-04-22T07:20:54.979253+0000","last_peered":"2024-04-22T07:20:54.979253+0000","last_clean":"2024-04-22T07:20:54.979253+0000","last_became_active":"2024-04-22T07:20:53.868519+0000","last_became_peered":"2024-04-22T07:20:53.868519+0000","last_unstale":"2024-04-22T07:20:54.979253+0000","last_undegraded":"2024-04-22T07:20:54.979253+0000","last_fullsized":"2024-04-22T07:20:54.979253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:35:26.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862610+0000","last_change":"2024-04-22T07:20:53.865275+0000","last_active":"2024-04-22T07:20:54.862610+0000","last_peered":"2024-04-22T07:20:54.862610+0000","last_clean":"2024-04-22T07:20:54.862610+0000","last_became_active":"2024-04-22T07:20:53.865026+0000","last_became_peered":"2024-04-22T07:20:53.865026+0000","last_unstale":"2024-04-22T07:20:54.862610+0000","last_undegraded":"2024-04-22T07:20:54.862610+0000","last_fullsized":"2024-04-22T07:20:54.862610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:48:40.630407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979451+0000","last_change":"2024-04-22T07:20:53.873457+0000","last_active":"2024-04-22T07:20:54.979451+0000","last_peered":"2024-04-22T07:20:54.979451+0000","last_clean":"2024-04-22T07:20:54.979451+0000","last_became_active":"2024-04-22T07:20:53.873147+0000","last_became_peered":"2024-04-22T07:20:53.873147+0000","last_unstale":"2024-04-22T07:20:54.979451+0000","last_undegraded":"2024-04-22T07:20:54.979451+0000","last_fullsized":"2024-04-22T07:20:54.979451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:53.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861933+0000","last_change":"2024-04-22T07:20:53.865327+0000","last_active":"2024-04-22T07:20:54.861933+0000","last_peered":"2024-04-22T07:20:54.861933+0000","last_clean":"2024-04-22T07:20:54.861933+0000","last_became_active":"2024-04-22T07:20:53.865030+0000","last_became_peered":"2024-04-22T07:20:53.865030+0000","last_unstale":"2024-04-22T07:20:54.861933+0000","last_undegraded":"2024-04-22T07:20:54.861933+0000","last_fullsized":"2024-04-22T07:20:54.861933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979550+0000","last_change":"2024-04-22T07:20:53.876792+0000","last_active":"2024-04-22T07:20:54.979550+0000","last_peered":"2024-04-22T07:20:54.979550+0000","last_clean":"2024-04-22T07:20:54.979550+0000","last_became_active":"2024-04-22T07:20:53.876446+0000","last_became_peered":"2024-04-22T07:20:53.876446+0000","last_unstale":"2024-04-22T07:20:54.979550+0000","last_undegraded":"2024-04-22T07:20:54.979550+0000","last_fullsized":"2024-04-22T07:20:54.979550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:34.943561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979292+0000","last_change":"2024-04-22T07:20:53.878147+0000","last_active":"2024-04-22T07:20:54.979292+0000","last_peered":"2024-04-22T07:20:54.979292+0000","last_clean":"2024-04-22T07:20:54.979292+0000","last_became_active":"2024-04-22T07:20:53.877867+0000","last_became_peered":"2024-04-22T07:20:53.877867+0000","last_unstale":"2024-04-22T07:20:54.979292+0000","last_undegraded":"2024-04-22T07:20:54.979292+0000","last_fullsized":"2024-04-22T07:20:54.979292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979201+0000","last_change":"2024-04-22T07:20:53.872447+0000","last_active":"2024-04-22T07:20:54.979201+0000","last_peered":"2024-04-22T07:20:54.979201+0000","last_clean":"2024-04-22T07:20:54.979201+0000","last_became_active":"2024-04-22T07:20:53.871862+0000","last_became_peered":"2024-04-22T07:20:53.871862+0000","last_unstale":"2024-04-22T07:20:54.979201+0000","last_undegraded":"2024-04-22T07:20:54.979201+0000","last_fullsized":"2024-04-22T07:20:54.979201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:08:33.063318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862747+0000","last_change":"2024-04-22T07:20:53.862483+0000","last_active":"2024-04-22T07:20:54.862747+0000","last_peered":"2024-04-22T07:20:54.862747+0000","last_clean":"2024-04-22T07:20:54.862747+0000","last_became_active":"2024-04-22T07:20:53.862199+0000","last_became_peered":"2024-04-22T07:20:53.862199+0000","last_unstale":"2024-04-22T07:20:54.862747+0000","last_undegraded":"2024-04-22T07:20:54.862747+0000","last_fullsized":"2024-04-22T07:20:54.862747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:10:12.276510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979743+0000","last_change":"2024-04-22T07:20:53.872507+0000","last_active":"2024-04-22T07:20:54.979743+0000","last_peered":"2024-04-22T07:20:54.979743+0000","last_clean":"2024-04-22T07:20:54.979743+0000","last_became_active":"2024-04-22T07:20:53.872199+0000","last_became_peered":"2024-04-22T07:20:53.872199+0000","last_unstale":"2024-04-22T07:20:54.979743+0000","last_undegraded":"2024-04-22T07:20:54.979743+0000","last_fullsized":"2024-04-22T07:20:54.979743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:09.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861399+0000","last_change":"2024-04-22T07:20:53.863946+0000","last_active":"2024-04-22T07:20:54.861399+0000","last_peered":"2024-04-22T07:20:54.861399+0000","last_clean":"2024-04-22T07:20:54.861399+0000","last_became_active":"2024-04-22T07:20:53.863688+0000","last_became_peered":"2024-04-22T07:20:53.863688+0000","last_unstale":"2024-04-22T07:20:54.861399+0000","last_undegraded":"2024-04-22T07:20:54.861399+0000","last_fullsized":"2024-04-22T07:20:54.861399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862947+0000","last_change":"2024-04-22T07:20:53.874785+0000","last_active":"2024-04-22T07:20:54.862947+0000","last_peered":"2024-04-22T07:20:54.862947+0000","last_clean":"2024-04-22T07:20:54.862947+0000","last_became_active":"2024-04-22T07:20:53.874524+0000","last_became_peered":"2024-04-22T07:20:53.874524+0000","last_unstale":"2024-04-22T07:20:54.862947+0000","last_undegraded":"2024-04-22T07:20:54.862947+0000","last_fullsized":"2024-04-22T07:20:54.862947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.787613+0000","last_change":"2024-04-22T07:20:52.860712+0000","last_active":"2024-04-22T07:20:55.787613+0000","last_peered":"2024-04-22T07:20:55.787613+0000","last_clean":"2024-04-22T07:20:55.787613+0000","last_became_active":"2024-04-22T07:20:52.860015+0000","last_became_peered":"2024-04-22T07:20:52.860015+0000","last_unstale":"2024-04-22T07:20:55.787613+0000","last_undegraded":"2024-04-22T07:20:55.787613+0000","last_fullsized":"2024-04-22T07:20:55.787613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:59:32.487127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980495+0000","last_change":"2024-04-22T07:20:53.879570+0000","last_active":"2024-04-22T07:20:54.980495+0000","last_peered":"2024-04-22T07:20:54.980495+0000","last_clean":"2024-04-22T07:20:54.980495+0000","last_became_active":"2024-04-22T07:20:53.879191+0000","last_became_peered":"2024-04-22T07:20:53.879191+0000","last_unstale":"2024-04-22T07:20:54.980495+0000","last_undegraded":"2024-04-22T07:20:54.980495+0000","last_fullsized":"2024-04-22T07:20:54.980495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:34:52.306691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.787136+0000","last_change":"2024-04-22T07:20:52.862510+0000","last_active":"2024-04-22T07:20:55.787136+0000","last_peered":"2024-04-22T07:20:55.787136+0000","last_clean":"2024-04-22T07:20:55.787136+0000","last_became_active":"2024-04-22T07:20:52.862228+0000","last_became_peered":"2024-04-22T07:20:52.862228+0000","last_unstale":"2024-04-22T07:20:55.787136+0000","last_undegraded":"2024-04-22T07:20:55.787136+0000","last_fullsized":"2024-04-22T07:20:55.787136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:51.683021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979012+0000","last_change":"2024-04-22T07:20:52.856651+0000","last_active":"2024-04-22T07:20:54.979012+0000","last_peered":"2024-04-22T07:20:54.979012+0000","last_clean":"2024-04-22T07:20:54.979012+0000","last_became_active":"2024-04-22T07:20:52.856096+0000","last_became_peered":"2024-04-22T07:20:52.856096+0000","last_unstale":"2024-04-22T07:20:54.979012+0000","last_undegraded":"2024-04-22T07:20:54.979012+0000","last_fullsized":"2024-04-22T07:20:54.979012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:04.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979658+0000","last_change":"2024-04-22T07:20:53.873708+0000","last_active":"2024-04-22T07:20:54.979658+0000","last_peered":"2024-04-22T07:20:54.979658+0000","last_clean":"2024-04-22T07:20:54.979658+0000","last_became_active":"2024-04-22T07:20:53.872793+0000","last_became_peered":"2024-04-22T07:20:53.872793+0000","last_unstale":"2024-04-22T07:20:54.979658+0000","last_undegraded":"2024-04-22T07:20:54.979658+0000","last_fullsized":"2024-04-22T07:20:54.979658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:52.686229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862729+0000","last_change":"2024-04-22T07:20:52.861133+0000","last_active":"2024-04-22T07:20:54.862729+0000","last_peered":"2024-04-22T07:20:54.862729+0000","last_clean":"2024-04-22T07:20:54.862729+0000","last_became_active":"2024-04-22T07:20:52.860736+0000","last_became_peered":"2024-04-22T07:20:52.860736+0000","last_unstale":"2024-04-22T07:20:54.862729+0000","last_undegraded":"2024-04-22T07:20:54.862729+0000","last_fullsized":"2024-04-22T07:20:54.862729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:06.123308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980308+0000","last_change":"2024-04-22T07:20:53.867477+0000","last_active":"2024-04-22T07:20:54.980308+0000","last_peered":"2024-04-22T07:20:54.980308+0000","last_clean":"2024-04-22T07:20:54.980308+0000","last_became_active":"2024-04-22T07:20:53.867086+0000","last_became_peered":"2024-04-22T07:20:53.867086+0000","last_unstale":"2024-04-22T07:20:54.980308+0000","last_undegraded":"2024-04-22T07:20:54.980308+0000","last_fullsized":"2024-04-22T07:20:54.980308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:56:55.644168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863067+0000","last_change":"2024-04-22T07:20:52.863567+0000","last_active":"2024-04-22T07:20:54.863067+0000","last_peered":"2024-04-22T07:20:54.863067+0000","last_clean":"2024-04-22T07:20:54.863067+0000","last_became_active":"2024-04-22T07:20:52.863285+0000","last_became_peered":"2024-04-22T07:20:52.863285+0000","last_unstale":"2024-04-22T07:20:54.863067+0000","last_undegraded":"2024-04-22T07:20:54.863067+0000","last_fullsized":"2024-04-22T07:20:54.863067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861976+0000","last_change":"2024-04-22T07:20:53.864955+0000","last_active":"2024-04-22T07:20:54.861976+0000","last_peered":"2024-04-22T07:20:54.861976+0000","last_clean":"2024-04-22T07:20:54.861976+0000","last_became_active":"2024-04-22T07:20:53.864694+0000","last_became_peered":"2024-04-22T07:20:53.864694+0000","last_unstale":"2024-04-22T07:20:54.861976+0000","last_undegraded":"2024-04-22T07:20:54.861976+0000","last_fullsized":"2024-04-22T07:20:54.861976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977898+0000","last_change":"2024-04-22T07:20:52.858761+0000","last_active":"2024-04-22T07:20:54.977898+0000","last_peered":"2024-04-22T07:20:54.977898+0000","last_clean":"2024-04-22T07:20:54.977898+0000","last_became_active":"2024-04-22T07:20:52.856815+0000","last_became_peered":"2024-04-22T07:20:52.856815+0000","last_unstale":"2024-04-22T07:20:54.977898+0000","last_undegraded":"2024-04-22T07:20:54.977898+0000","last_fullsized":"2024-04-22T07:20:54.977898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:06.123308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979798+0000","last_change":"2024-04-22T07:20:53.867290+0000","last_active":"2024-04-22T07:20:54.979798+0000","last_peered":"2024-04-22T07:20:54.979798+0000","last_clean":"2024-04-22T07:20:54.979798+0000","last_became_active":"2024-04-22T07:20:53.866955+0000","last_became_peered":"2024-04-22T07:20:53.866955+0000","last_unstale":"2024-04-22T07:20:54.979798+0000","last_undegraded":"2024-04-22T07:20:54.979798+0000","last_fullsized":"2024-04-22T07:20:54.979798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:43.442316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.870244+0000","last_change":"2024-04-22T07:20:52.863670+0000","last_active":"2024-04-22T07:20:58.870244+0000","last_peered":"2024-04-22T07:20:58.870244+0000","last_clean":"2024-04-22T07:20:58.870244+0000","last_became_active":"2024-04-22T07:20:52.863320+0000","last_became_peered":"2024-04-22T07:20:52.863320+0000","last_unstale":"2024-04-22T07:20:58.870244+0000","last_undegraded":"2024-04-22T07:20:58.870244+0000","last_fullsized":"2024-04-22T07:20:58.870244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:04.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862589+0000","last_change":"2024-04-22T07:20:53.868286+0000","last_active":"2024-04-22T07:20:54.862589+0000","last_peered":"2024-04-22T07:20:54.862589+0000","last_clean":"2024-04-22T07:20:54.862589+0000","last_became_active":"2024-04-22T07:20:53.862811+0000","last_became_peered":"2024-04-22T07:20:53.862811+0000","last_unstale":"2024-04-22T07:20:54.862589+0000","last_undegraded":"2024-04-22T07:20:54.862589+0000","last_fullsized":"2024-04-22T07:20:54.862589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:21:14.945657+0000","last_change":"2024-04-22T07:20:52.863638+0000","last_active":"2024-04-22T07:21:14.945657+0000","last_peered":"2024-04-22T07:21:14.945657+0000","last_clean":"2024-04-22T07:21:14.945657+0000","last_became_active":"2024-04-22T07:20:52.863244+0000","last_became_peered":"2024-04-22T07:20:52.863244+0000","last_unstale":"2024-04-22T07:21:14.945657+0000","last_undegraded":"2024-04-22T07:21:14.945657+0000","last_fullsized":"2024-04-22T07:21:14.945657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:36:49.017537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1868,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977713+0000","last_change":"2024-04-22T07:20:53.875162+0000","last_active":"2024-04-22T07:20:54.977713+0000","last_peered":"2024-04-22T07:20:54.977713+0000","last_clean":"2024-04-22T07:20:54.977713+0000","last_became_active":"2024-04-22T07:20:53.874612+0000","last_became_peered":"2024-04-22T07:20:53.874612+0000","last_unstale":"2024-04-22T07:20:54.977713+0000","last_undegraded":"2024-04-22T07:20:54.977713+0000","last_fullsized":"2024-04-22T07:20:54.977713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:13:12.303505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.869961+0000","last_change":"2024-04-22T07:20:52.855194+0000","last_active":"2024-04-22T07:20:58.869961+0000","last_peered":"2024-04-22T07:20:58.869961+0000","last_clean":"2024-04-22T07:20:58.869961+0000","last_became_active":"2024-04-22T07:20:52.854915+0000","last_became_peered":"2024-04-22T07:20:52.854915+0000","last_unstale":"2024-04-22T07:20:58.869961+0000","last_undegraded":"2024-04-22T07:20:58.869961+0000","last_fullsized":"2024-04-22T07:20:58.869961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979725+0000","last_change":"2024-04-22T07:20:53.868695+0000","last_active":"2024-04-22T07:20:54.979725+0000","last_peered":"2024-04-22T07:20:54.979725+0000","last_clean":"2024-04-22T07:20:54.979725+0000","last_became_active":"2024-04-22T07:20:53.868400+0000","last_became_peered":"2024-04-22T07:20:53.868400+0000","last_unstale":"2024-04-22T07:20:54.979725+0000","last_undegraded":"2024-04-22T07:20:54.979725+0000","last_fullsized":"2024-04-22T07:20:54.979725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:30:23.352871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863163+0000","last_change":"2024-04-22T07:20:52.861884+0000","last_active":"2024-04-22T07:20:54.863163+0000","last_peered":"2024-04-22T07:20:54.863163+0000","last_clean":"2024-04-22T07:20:54.863163+0000","last_became_active":"2024-04-22T07:20:52.861546+0000","last_became_peered":"2024-04-22T07:20:52.861546+0000","last_unstale":"2024-04-22T07:20:54.863163+0000","last_undegraded":"2024-04-22T07:20:54.863163+0000","last_fullsized":"2024-04-22T07:20:54.863163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:37.283262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862882+0000","last_change":"2024-04-22T07:20:53.863071+0000","last_active":"2024-04-22T07:20:54.862882+0000","last_peered":"2024-04-22T07:20:54.862882+0000","last_clean":"2024-04-22T07:20:54.862882+0000","last_became_active":"2024-04-22T07:20:53.862763+0000","last_became_peered":"2024-04-22T07:20:53.862763+0000","last_unstale":"2024-04-22T07:20:54.862882+0000","last_undegraded":"2024-04-22T07:20:54.862882+0000","last_fullsized":"2024-04-22T07:20:54.862882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:19:57.432323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977415+0000","last_change":"2024-04-22T07:20:52.865285+0000","last_active":"2024-04-22T07:20:54.977415+0000","last_peered":"2024-04-22T07:20:54.977415+0000","last_clean":"2024-04-22T07:20:54.977415+0000","last_became_active":"2024-04-22T07:20:52.864725+0000","last_became_peered":"2024-04-22T07:20:52.864725+0000","last_unstale":"2024-04-22T07:20:54.977415+0000","last_undegraded":"2024-04-22T07:20:54.977415+0000","last_fullsized":"2024-04-22T07:20:54.977415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:23:28.850031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862533+0000","last_change":"2024-04-22T07:20:53.875479+0000","last_active":"2024-04-22T07:20:54.862533+0000","last_peered":"2024-04-22T07:20:54.862533+0000","last_clean":"2024-04-22T07:20:54.862533+0000","last_became_active":"2024-04-22T07:20:53.874567+0000","last_became_peered":"2024-04-22T07:20:53.874567+0000","last_unstale":"2024-04-22T07:20:54.862533+0000","last_undegraded":"2024-04-22T07:20:54.862533+0000","last_fullsized":"2024-04-22T07:20:54.862533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.871647+0000","last_change":"2024-04-22T07:20:52.860646+0000","last_active":"2024-04-22T07:20:58.871647+0000","last_peered":"2024-04-22T07:20:58.871647+0000","last_clean":"2024-04-22T07:20:58.871647+0000","last_became_active":"2024-04-22T07:20:52.860347+0000","last_became_peered":"2024-04-22T07:20:52.860347+0000","last_unstale":"2024-04-22T07:20:58.871647+0000","last_undegraded":"2024-04-22T07:20:58.871647+0000","last_fullsized":"2024-04-22T07:20:58.871647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:53:20.912264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862635+0000","last_change":"2024-04-22T07:20:53.859641+0000","last_active":"2024-04-22T07:20:54.862635+0000","last_peered":"2024-04-22T07:20:54.862635+0000","last_clean":"2024-04-22T07:20:54.862635+0000","last_became_active":"2024-04-22T07:20:53.859365+0000","last_became_peered":"2024-04-22T07:20:53.859365+0000","last_unstale":"2024-04-22T07:20:54.862635+0000","last_undegraded":"2024-04-22T07:20:54.862635+0000","last_fullsized":"2024-04-22T07:20:54.862635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:46:50.322722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.788730+0000","last_change":"2024-04-22T07:20:52.866960+0000","last_active":"2024-04-22T07:20:55.788730+0000","last_peered":"2024-04-22T07:20:55.788730+0000","last_clean":"2024-04-22T07:20:55.788730+0000","last_became_active":"2024-04-22T07:20:52.866654+0000","last_became_peered":"2024-04-22T07:20:52.866654+0000","last_unstale":"2024-04-22T07:20:55.788730+0000","last_undegraded":"2024-04-22T07:20:55.788730+0000","last_fullsized":"2024-04-22T07:20:55.788730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:51.683021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862087+0000","last_change":"2024-04-22T07:20:53.874775+0000","last_active":"2024-04-22T07:20:54.862087+0000","last_peered":"2024-04-22T07:20:54.862087+0000","last_clean":"2024-04-22T07:20:54.862087+0000","last_became_active":"2024-04-22T07:20:53.874499+0000","last_became_peered":"2024-04-22T07:20:53.874499+0000","last_unstale":"2024-04-22T07:20:54.862087+0000","last_undegraded":"2024-04-22T07:20:54.862087+0000","last_fullsized":"2024-04-22T07:20:54.862087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:23.268067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.871021+0000","last_change":"2024-04-22T07:20:52.867201+0000","last_active":"2024-04-22T07:20:58.871021+0000","last_peered":"2024-04-22T07:20:58.871021+0000","last_clean":"2024-04-22T07:20:58.871021+0000","last_became_active":"2024-04-22T07:20:52.866627+0000","last_became_peered":"2024-04-22T07:20:52.866627+0000","last_unstale":"2024-04-22T07:20:58.871021+0000","last_undegraded":"2024-04-22T07:20:58.871021+0000","last_fullsized":"2024-04-22T07:20:58.871021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:09:08.908298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977901+0000","last_change":"2024-04-22T07:20:53.871645+0000","last_active":"2024-04-22T07:20:54.977901+0000","last_peered":"2024-04-22T07:20:54.977901+0000","last_clean":"2024-04-22T07:20:54.977901+0000","last_became_active":"2024-04-22T07:20:53.871353+0000","last_became_peered":"2024-04-22T07:20:53.871353+0000","last_unstale":"2024-04-22T07:20:54.977901+0000","last_undegraded":"2024-04-22T07:20:54.977901+0000","last_fullsized":"2024-04-22T07:20:54.977901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:48:40.630407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.787667+0000","last_change":"2024-04-22T07:20:52.866996+0000","last_active":"2024-04-22T07:20:55.787667+0000","last_peered":"2024-04-22T07:20:55.787667+0000","last_clean":"2024-04-22T07:20:55.787667+0000","last_became_active":"2024-04-22T07:20:52.866677+0000","last_became_peered":"2024-04-22T07:20:52.866677+0000","last_unstale":"2024-04-22T07:20:55.787667+0000","last_undegraded":"2024-04-22T07:20:55.787667+0000","last_fullsized":"2024-04-22T07:20:55.787667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977832+0000","last_change":"2024-04-22T07:20:53.871064+0000","last_active":"2024-04-22T07:20:54.977832+0000","last_peered":"2024-04-22T07:20:54.977832+0000","last_clean":"2024-04-22T07:20:54.977832+0000","last_became_active":"2024-04-22T07:20:53.866968+0000","last_became_peered":"2024-04-22T07:20:53.866968+0000","last_unstale":"2024-04-22T07:20:54.977832+0000","last_undegraded":"2024-04-22T07:20:54.977832+0000","last_fullsized":"2024-04-22T07:20:54.977832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:43.442316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979659+0000","last_change":"2024-04-22T07:20:52.856958+0000","last_active":"2024-04-22T07:20:54.979659+0000","last_peered":"2024-04-22T07:20:54.979659+0000","last_clean":"2024-04-22T07:20:54.979659+0000","last_became_active":"2024-04-22T07:20:52.856289+0000","last_became_peered":"2024-04-22T07:20:52.856289+0000","last_unstale":"2024-04-22T07:20:54.979659+0000","last_undegraded":"2024-04-22T07:20:54.979659+0000","last_fullsized":"2024-04-22T07:20:54.979659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863352+0000","last_change":"2024-04-22T07:20:53.872915+0000","last_active":"2024-04-22T07:20:54.863352+0000","last_peered":"2024-04-22T07:20:54.863352+0000","last_clean":"2024-04-22T07:20:54.863352+0000","last_became_active":"2024-04-22T07:20:53.872005+0000","last_became_peered":"2024-04-22T07:20:53.872005+0000","last_unstale":"2024-04-22T07:20:54.863352+0000","last_undegraded":"2024-04-22T07:20:54.863352+0000","last_fullsized":"2024-04-22T07:20:54.863352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:53:29.242632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862549+0000","last_change":"2024-04-22T07:20:43.747396+0000","last_active":"2024-04-22T07:20:54.862549+0000","last_peered":"2024-04-22T07:20:54.862549+0000","last_clean":"2024-04-22T07:20:54.862549+0000","last_became_active":"2024-04-22T07:20:43.746332+0000","last_became_peered":"2024-04-22T07:20:43.746332+0000","last_unstale":"2024-04-22T07:20:54.862549+0000","last_undegraded":"2024-04-22T07:20:54.862549+0000","last_fullsized":"2024-04-22T07:20:54.862549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:42.732916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:42.732916+0000","last_clean_scrub_stamp":"2024-04-22T07:20:42.732916+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:02:55.086445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863049+0000","last_change":"2024-04-22T07:20:52.862492+0000","last_active":"2024-04-22T07:20:54.863049+0000","last_peered":"2024-04-22T07:20:54.863049+0000","last_clean":"2024-04-22T07:20:54.863049+0000","last_became_active":"2024-04-22T07:20:52.862201+0000","last_became_peered":"2024-04-22T07:20:52.862201+0000","last_unstale":"2024-04-22T07:20:54.863049+0000","last_undegraded":"2024-04-22T07:20:54.863049+0000","last_fullsized":"2024-04-22T07:20:54.863049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:52.015227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979807+0000","last_change":"2024-04-22T07:20:53.868797+0000","last_active":"2024-04-22T07:20:54.979807+0000","last_peered":"2024-04-22T07:20:54.979807+0000","last_clean":"2024-04-22T07:20:54.979807+0000","last_became_active":"2024-04-22T07:20:53.868335+0000","last_became_peered":"2024-04-22T07:20:53.868335+0000","last_unstale":"2024-04-22T07:20:54.979807+0000","last_undegraded":"2024-04-22T07:20:54.979807+0000","last_fullsized":"2024-04-22T07:20:54.979807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:43:02.116289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862731+0000","last_change":"2024-04-22T07:20:52.867622+0000","last_active":"2024-04-22T07:20:54.862731+0000","last_peered":"2024-04-22T07:20:54.862731+0000","last_clean":"2024-04-22T07:20:54.862731+0000","last_became_active":"2024-04-22T07:20:52.866996+0000","last_became_peered":"2024-04-22T07:20:52.866996+0000","last_unstale":"2024-04-22T07:20:54.862731+0000","last_undegraded":"2024-04-22T07:20:54.862731+0000","last_fullsized":"2024-04-22T07:20:54.862731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:08.286530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978392+0000","last_change":"2024-04-22T07:20:53.871576+0000","last_active":"2024-04-22T07:20:54.978392+0000","last_peered":"2024-04-22T07:20:54.978392+0000","last_clean":"2024-04-22T07:20:54.978392+0000","last_became_active":"2024-04-22T07:20:53.871239+0000","last_became_peered":"2024-04-22T07:20:53.871239+0000","last_unstale":"2024-04-22T07:20:54.978392+0000","last_undegraded":"2024-04-22T07:20:54.978392+0000","last_fullsized":"2024-04-22T07:20:54.978392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979845+0000","last_change":"2024-04-22T07:20:52.866974+0000","last_active":"2024-04-22T07:20:54.979845+0000","last_peered":"2024-04-22T07:20:54.979845+0000","last_clean":"2024-04-22T07:20:54.979845+0000","last_became_active":"2024-04-22T07:20:52.866581+0000","last_became_peered":"2024-04-22T07:20:52.866581+0000","last_unstale":"2024-04-22T07:20:54.979845+0000","last_undegraded":"2024-04-22T07:20:54.979845+0000","last_fullsized":"2024-04-22T07:20:54.979845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979503+0000","last_change":"2024-04-22T07:20:53.865035+0000","last_active":"2024-04-22T07:20:54.979503+0000","last_peered":"2024-04-22T07:20:54.979503+0000","last_clean":"2024-04-22T07:20:54.979503+0000","last_became_active":"2024-04-22T07:20:53.864523+0000","last_became_peered":"2024-04-22T07:20:53.864523+0000","last_unstale":"2024-04-22T07:20:54.979503+0000","last_undegraded":"2024-04-22T07:20:54.979503+0000","last_fullsized":"2024-04-22T07:20:54.979503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:13:12.303505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863169+0000","last_change":"2024-04-22T07:20:52.858498+0000","last_active":"2024-04-22T07:20:54.863169+0000","last_peered":"2024-04-22T07:20:54.863169+0000","last_clean":"2024-04-22T07:20:54.863169+0000","last_became_active":"2024-04-22T07:20:52.858139+0000","last_became_peered":"2024-04-22T07:20:52.858139+0000","last_unstale":"2024-04-22T07:20:54.863169+0000","last_undegraded":"2024-04-22T07:20:54.863169+0000","last_fullsized":"2024-04-22T07:20:54.863169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:45.382709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977943+0000","last_change":"2024-04-22T07:20:53.877595+0000","last_active":"2024-04-22T07:20:54.977943+0000","last_peered":"2024-04-22T07:20:54.977943+0000","last_clean":"2024-04-22T07:20:54.977943+0000","last_became_active":"2024-04-22T07:20:53.877208+0000","last_became_peered":"2024-04-22T07:20:53.877208+0000","last_unstale":"2024-04-22T07:20:54.977943+0000","last_undegraded":"2024-04-22T07:20:54.977943+0000","last_fullsized":"2024-04-22T07:20:54.977943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:46:50.322722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979001+0000","last_change":"2024-04-22T07:20:52.866224+0000","last_active":"2024-04-22T07:20:54.979001+0000","last_peered":"2024-04-22T07:20:54.979001+0000","last_clean":"2024-04-22T07:20:54.979001+0000","last_became_active":"2024-04-22T07:20:52.865903+0000","last_became_peered":"2024-04-22T07:20:52.865903+0000","last_unstale":"2024-04-22T07:20:54.979001+0000","last_undegraded":"2024-04-22T07:20:54.979001+0000","last_fullsized":"2024-04-22T07:20:54.979001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861395+0000","last_change":"2024-04-22T07:20:53.873266+0000","last_active":"2024-04-22T07:20:54.861395+0000","last_peered":"2024-04-22T07:20:54.861395+0000","last_clean":"2024-04-22T07:20:54.861395+0000","last_became_active":"2024-04-22T07:20:53.872915+0000","last_became_peered":"2024-04-22T07:20:53.872915+0000","last_unstale":"2024-04-22T07:20:54.861395+0000","last_undegraded":"2024-04-22T07:20:54.861395+0000","last_fullsized":"2024-04-22T07:20:54.861395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:09.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863471+0000","last_change":"2024-04-22T07:20:52.863593+0000","last_active":"2024-04-22T07:20:54.863471+0000","last_peered":"2024-04-22T07:20:54.863471+0000","last_clean":"2024-04-22T07:20:54.863471+0000","last_became_active":"2024-04-22T07:20:52.863296+0000","last_became_peered":"2024-04-22T07:20:52.863296+0000","last_unstale":"2024-04-22T07:20:54.863471+0000","last_undegraded":"2024-04-22T07:20:54.863471+0000","last_fullsized":"2024-04-22T07:20:54.863471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:22.261683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979540+0000","last_change":"2024-04-22T07:20:53.874491+0000","last_active":"2024-04-22T07:20:54.979540+0000","last_peered":"2024-04-22T07:20:54.979540+0000","last_clean":"2024-04-22T07:20:54.979540+0000","last_became_active":"2024-04-22T07:20:53.874202+0000","last_became_peered":"2024-04-22T07:20:53.874202+0000","last_unstale":"2024-04-22T07:20:54.979540+0000","last_undegraded":"2024-04-22T07:20:54.979540+0000","last_fullsized":"2024-04-22T07:20:54.979540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:23.268067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980655+0000","last_change":"2024-04-22T07:20:52.865905+0000","last_active":"2024-04-22T07:20:54.980655+0000","last_peered":"2024-04-22T07:20:54.980655+0000","last_clean":"2024-04-22T07:20:54.980655+0000","last_became_active":"2024-04-22T07:20:52.865566+0000","last_became_peered":"2024-04-22T07:20:52.865566+0000","last_unstale":"2024-04-22T07:20:54.980655+0000","last_undegraded":"2024-04-22T07:20:54.980655+0000","last_fullsized":"2024-04-22T07:20:54.980655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:38:31.271879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980566+0000","last_change":"2024-04-22T07:20:53.869951+0000","last_active":"2024-04-22T07:20:54.980566+0000","last_peered":"2024-04-22T07:20:54.980566+0000","last_clean":"2024-04-22T07:20:54.980566+0000","last_became_active":"2024-04-22T07:20:53.869613+0000","last_became_peered":"2024-04-22T07:20:53.869613+0000","last_unstale":"2024-04-22T07:20:54.980566+0000","last_undegraded":"2024-04-22T07:20:54.980566+0000","last_fullsized":"2024-04-22T07:20:54.980566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:14:09.372107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.867345+0000","last_change":"2024-04-22T07:20:52.864740+0000","last_active":"2024-04-22T07:20:58.867345+0000","last_peered":"2024-04-22T07:20:58.867345+0000","last_clean":"2024-04-22T07:20:58.867345+0000","last_became_active":"2024-04-22T07:20:52.864434+0000","last_became_peered":"2024-04-22T07:20:52.864434+0000","last_unstale":"2024-04-22T07:20:58.867345+0000","last_undegraded":"2024-04-22T07:20:58.867345+0000","last_fullsized":"2024-04-22T07:20:58.867345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:33.937176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980498+0000","last_change":"2024-04-22T07:20:53.871156+0000","last_active":"2024-04-22T07:20:54.980498+0000","last_peered":"2024-04-22T07:20:54.980498+0000","last_clean":"2024-04-22T07:20:54.980498+0000","last_became_active":"2024-04-22T07:20:53.870664+0000","last_became_peered":"2024-04-22T07:20:53.870664+0000","last_unstale":"2024-04-22T07:20:54.980498+0000","last_undegraded":"2024-04-22T07:20:54.980498+0000","last_fullsized":"2024-04-22T07:20:54.980498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:01:02.139458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977319+0000","last_change":"2024-04-22T07:20:52.854668+0000","last_active":"2024-04-22T07:20:54.977319+0000","last_peered":"2024-04-22T07:20:54.977319+0000","last_clean":"2024-04-22T07:20:54.977319+0000","last_became_active":"2024-04-22T07:20:52.854395+0000","last_became_peered":"2024-04-22T07:20:52.854395+0000","last_unstale":"2024-04-22T07:20:54.977319+0000","last_undegraded":"2024-04-22T07:20:54.977319+0000","last_fullsized":"2024-04-22T07:20:54.977319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:59:32.487127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862797+0000","last_change":"2024-04-22T07:20:53.870972+0000","last_active":"2024-04-22T07:20:54.862797+0000","last_peered":"2024-04-22T07:20:54.862797+0000","last_clean":"2024-04-22T07:20:54.862797+0000","last_became_active":"2024-04-22T07:20:53.870674+0000","last_became_peered":"2024-04-22T07:20:53.870674+0000","last_unstale":"2024-04-22T07:20:54.862797+0000","last_undegraded":"2024-04-22T07:20:54.862797+0000","last_fullsized":"2024-04-22T07:20:54.862797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:10.431906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980374+0000","last_change":"2024-04-22T07:20:52.866003+0000","last_active":"2024-04-22T07:20:54.980374+0000","last_peered":"2024-04-22T07:20:54.980374+0000","last_clean":"2024-04-22T07:20:54.980374+0000","last_became_active":"2024-04-22T07:20:52.865606+0000","last_became_peered":"2024-04-22T07:20:52.865606+0000","last_unstale":"2024-04-22T07:20:54.980374+0000","last_undegraded":"2024-04-22T07:20:54.980374+0000","last_fullsized":"2024-04-22T07:20:54.980374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:58:06.713204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978351+0000","last_change":"2024-04-22T07:20:53.870737+0000","last_active":"2024-04-22T07:20:54.978351+0000","last_peered":"2024-04-22T07:20:54.978351+0000","last_clean":"2024-04-22T07:20:54.978351+0000","last_became_active":"2024-04-22T07:20:53.870402+0000","last_became_peered":"2024-04-22T07:20:53.870402+0000","last_unstale":"2024-04-22T07:20:54.978351+0000","last_undegraded":"2024-04-22T07:20:54.978351+0000","last_fullsized":"2024-04-22T07:20:54.978351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:30:17.845591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979784+0000","last_change":"2024-04-22T07:20:52.861048+0000","last_active":"2024-04-22T07:20:54.979784+0000","last_peered":"2024-04-22T07:20:54.979784+0000","last_clean":"2024-04-22T07:20:54.979784+0000","last_became_active":"2024-04-22T07:20:52.860702+0000","last_became_peered":"2024-04-22T07:20:52.860702+0000","last_unstale":"2024-04-22T07:20:54.979784+0000","last_undegraded":"2024-04-22T07:20:54.979784+0000","last_fullsized":"2024-04-22T07:20:54.979784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979324+0000","last_change":"2024-04-22T07:20:53.868782+0000","last_active":"2024-04-22T07:20:54.979324+0000","last_peered":"2024-04-22T07:20:54.979324+0000","last_clean":"2024-04-22T07:20:54.979324+0000","last_became_active":"2024-04-22T07:20:53.868509+0000","last_became_peered":"2024-04-22T07:20:53.868509+0000","last_unstale":"2024-04-22T07:20:54.979324+0000","last_undegraded":"2024-04-22T07:20:54.979324+0000","last_fullsized":"2024-04-22T07:20:54.979324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:07.129692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.867515+0000","last_change":"2024-04-22T07:20:52.858508+0000","last_active":"2024-04-22T07:20:58.867515+0000","last_peered":"2024-04-22T07:20:58.867515+0000","last_clean":"2024-04-22T07:20:58.867515+0000","last_became_active":"2024-04-22T07:20:52.858215+0000","last_became_peered":"2024-04-22T07:20:52.858215+0000","last_unstale":"2024-04-22T07:20:58.867515+0000","last_undegraded":"2024-04-22T07:20:58.867515+0000","last_fullsized":"2024-04-22T07:20:58.867515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:26.618434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862971+0000","last_change":"2024-04-22T07:20:53.867977+0000","last_active":"2024-04-22T07:20:54.862971+0000","last_peered":"2024-04-22T07:20:54.862971+0000","last_clean":"2024-04-22T07:20:54.862971+0000","last_became_active":"2024-04-22T07:20:53.867447+0000","last_became_peered":"2024-04-22T07:20:53.867447+0000","last_unstale":"2024-04-22T07:20:54.862971+0000","last_undegraded":"2024-04-22T07:20:54.862971+0000","last_fullsized":"2024-04-22T07:20:54.862971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:48:52.934171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863377+0000","last_change":"2024-04-22T07:20:53.875681+0000","last_active":"2024-04-22T07:20:54.863377+0000","last_peered":"2024-04-22T07:20:54.863377+0000","last_clean":"2024-04-22T07:20:54.863377+0000","last_became_active":"2024-04-22T07:20:53.875305+0000","last_became_peered":"2024-04-22T07:20:53.875305+0000","last_unstale":"2024-04-22T07:20:54.863377+0000","last_undegraded":"2024-04-22T07:20:54.863377+0000","last_fullsized":"2024-04-22T07:20:54.863377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:22:34.452869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.866736+0000","last_change":"2024-04-22T07:20:52.857445+0000","last_active":"2024-04-22T07:20:58.866736+0000","last_peered":"2024-04-22T07:20:58.866736+0000","last_clean":"2024-04-22T07:20:58.866736+0000","last_became_active":"2024-04-22T07:20:52.856293+0000","last_became_peered":"2024-04-22T07:20:52.856293+0000","last_unstale":"2024-04-22T07:20:58.866736+0000","last_undegraded":"2024-04-22T07:20:58.866736+0000","last_fullsized":"2024-04-22T07:20:58.866736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:10.640191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862780+0000","last_change":"2024-04-22T07:20:53.870827+0000","last_active":"2024-04-22T07:20:54.862780+0000","last_peered":"2024-04-22T07:20:54.862780+0000","last_clean":"2024-04-22T07:20:54.862780+0000","last_became_active":"2024-04-22T07:20:53.870548+0000","last_became_peered":"2024-04-22T07:20:53.870548+0000","last_unstale":"2024-04-22T07:20:54.862780+0000","last_undegraded":"2024-04-22T07:20:54.862780+0000","last_fullsized":"2024-04-22T07:20:54.862780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:27.624819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.867037+0000","last_change":"2024-04-22T07:20:52.856933+0000","last_active":"2024-04-22T07:20:58.867037+0000","last_peered":"2024-04-22T07:20:58.867037+0000","last_clean":"2024-04-22T07:20:58.867037+0000","last_became_active":"2024-04-22T07:20:52.856617+0000","last_became_peered":"2024-04-22T07:20:52.856617+0000","last_unstale":"2024-04-22T07:20:58.867037+0000","last_undegraded":"2024-04-22T07:20:58.867037+0000","last_fullsized":"2024-04-22T07:20:58.867037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:08.286530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979619+0000","last_change":"2024-04-22T07:20:53.866552+0000","last_active":"2024-04-22T07:20:54.979619+0000","last_peered":"2024-04-22T07:20:54.979619+0000","last_clean":"2024-04-22T07:20:54.979619+0000","last_became_active":"2024-04-22T07:20:53.866286+0000","last_became_peered":"2024-04-22T07:20:53.866286+0000","last_unstale":"2024-04-22T07:20:54.979619+0000","last_undegraded":"2024-04-22T07:20:54.979619+0000","last_fullsized":"2024-04-22T07:20:54.979619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:45:15.519469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.787690+0000","last_change":"2024-04-22T07:20:52.863291+0000","last_active":"2024-04-22T07:20:55.787690+0000","last_peered":"2024-04-22T07:20:55.787690+0000","last_clean":"2024-04-22T07:20:55.787690+0000","last_became_active":"2024-04-22T07:20:52.862967+0000","last_became_peered":"2024-04-22T07:20:52.862967+0000","last_unstale":"2024-04-22T07:20:55.787690+0000","last_undegraded":"2024-04-22T07:20:55.787690+0000","last_fullsized":"2024-04-22T07:20:55.787690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:10.640191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980150+0000","last_change":"2024-04-22T07:20:53.871045+0000","last_active":"2024-04-22T07:20:54.980150+0000","last_peered":"2024-04-22T07:20:54.980150+0000","last_clean":"2024-04-22T07:20:54.980150+0000","last_became_active":"2024-04-22T07:20:53.870715+0000","last_became_peered":"2024-04-22T07:20:53.870715+0000","last_unstale":"2024-04-22T07:20:54.980150+0000","last_undegraded":"2024-04-22T07:20:54.980150+0000","last_fullsized":"2024-04-22T07:20:54.980150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.870910+0000","last_change":"2024-04-22T07:20:52.869553+0000","last_active":"2024-04-22T07:20:58.870910+0000","last_peered":"2024-04-22T07:20:58.870910+0000","last_clean":"2024-04-22T07:20:58.870910+0000","last_became_active":"2024-04-22T07:20:52.869300+0000","last_became_peered":"2024-04-22T07:20:52.869300+0000","last_unstale":"2024-04-22T07:20:58.870910+0000","last_undegraded":"2024-04-22T07:20:58.870910+0000","last_fullsized":"2024-04-22T07:20:58.870910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:27.709073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2666,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":81359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":835584,"data_stored":671695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":83103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":831488,"data_stored":671673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":81291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":253952,"data_stored":83519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T07:21:18.177 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T07:21:18.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.312+0000 7f7fd6b50640 1 Processor -- start 2024-04-22T07:21:18.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.312+0000 7f7fd6b50640 1 -- start start 2024-04-22T07:21:18.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.313+0000 7f7fd6b50640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fd00c4920 0x7f7fd006f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:18.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.313+0000 7f7fd6b50640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7fd00c9050 0x7f7fd006fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:18.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.313+0000 7f7fd6b50640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fd00ca1b0 con 0x7f7fd0152fb0 2024-04-22T07:21:18.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.313+0000 7f7fd6b50640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f7fd00ca490 con 0x7f7fd00c9050 2024-04-22T07:21:18.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.313+0000 7f7fd6b50640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f7fd00ca770 con 0x7f7fd00c4920 2024-04-22T07:21:18.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.313+0000 7f7fd50ed640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7fd00c9050 0x7f7fd006fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:18.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.313+0000 7f7fd50ed640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7fd00c9050 0x7f7fd006fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55882/0 (socket says 172.21.15.40:55882) 2024-04-22T07:21:18.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.313+0000 7f7fd50ed640 1 -- 172.21.15.40:0/2732020619 learned_addr learned my addr 172.21.15.40:0/2732020619 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:18.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.313+0000 7f7fcffff640 1 --2- 172.21.15.40:0/2732020619 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fd00c4920 0x7f7fd006f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:18.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.314+0000 7f7fd50ed640 1 -- 172.21.15.40:0/2732020619 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fd00c4920 msgr2=0x7f7fd006f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:18.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.314+0000 7f7fd50ed640 1 --2- 172.21.15.40:0/2732020619 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fd00c4920 0x7f7fd006f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:18.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.314+0000 7f7fd50ed640 1 -- 172.21.15.40:0/2732020619 >> v1:172.21.15.62:6789/0 conn(0x7f7fd0152fb0 legacy=0x7f7fd00c3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:18.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.314+0000 7f7fd50ed640 1 -- 172.21.15.40:0/2732020619 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd00caa50 con 0x7f7fd00c9050 2024-04-22T07:21:18.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.314+0000 7f7fcf7fe640 1 -- 172.21.15.40:0/2732020619 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4197483793 0 0) 0x7f7fd00ca1b0 con 0x7f7fd0152fb0 2024-04-22T07:21:18.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.314+0000 7f7fd50ed640 1 --2- 172.21.15.40:0/2732020619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fd00c9050 0x7f7fd006fdd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0009870 tx=0x7f7fc002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a42653270fc7176 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:18.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.315+0000 7f7fcf7fe640 1 -- 172.21.15.40:0/2732020619 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0035020 con 0x7f7fd00c9050 2024-04-22T07:21:18.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.315+0000 7f7fcf7fe640 1 -- 172.21.15.40:0/2732020619 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc0031640 con 0x7f7fd00c9050 2024-04-22T07:21:18.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.315+0000 7f7fcf7fe640 1 -- 172.21.15.40:0/2732020619 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc002d040 con 0x7f7fd00c9050 2024-04-22T07:21:18.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.315+0000 7f7fd6b50640 1 -- 172.21.15.40:0/2732020619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fd00c9050 msgr2=0x7f7fd006fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:18.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.315+0000 7f7fd6b50640 1 --2- 172.21.15.40:0/2732020619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fd00c9050 0x7f7fd006fdd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0009870 tx=0x7f7fc002b8f0 comp rx=0 tx=0).stop 2024-04-22T07:21:18.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.315+0000 7f7fd6b50640 1 -- 172.21.15.40:0/2732020619 shutdown_connections 2024-04-22T07:21:18.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.315+0000 7f7fd6b50640 1 --2- 172.21.15.40:0/2732020619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fd00c9050 0x7f7fd006fdd0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:18.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.315+0000 7f7fd6b50640 1 --2- 172.21.15.40:0/2732020619 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fd00c4920 0x7f7fd006f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:18.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.315+0000 7f7fd6b50640 1 -- 172.21.15.40:0/2732020619 >> 172.21.15.40:0/2732020619 conn(0x7f7fd006dd10 msgr2=0x7f7fd006e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:18.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.315+0000 7f7fd6b50640 1 -- 172.21.15.40:0/2732020619 shutdown_connections 2024-04-22T07:21:18.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.315+0000 7f7fd6b50640 1 -- 172.21.15.40:0/2732020619 wait complete. 2024-04-22T07:21:18.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.316+0000 7f7fd6b50640 1 Processor -- start 2024-04-22T07:21:18.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.316+0000 7f7fd6b50640 1 -- start start 2024-04-22T07:21:18.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.317+0000 7f7fd6b50640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fd00c4920 0x7f7fd00c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:18.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.317+0000 7f7fd6b50640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fd00c9050 0x7f7fd01eef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:18.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.317+0000 7f7fd6b50640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fd0152fb0 0x7f7fd01487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:18.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.317+0000 7f7fd6b50640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd01590e0 con 0x7f7fd00c9050 2024-04-22T07:21:18.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.317+0000 7f7fd6b50640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd0158b50 con 0x7f7fd0152fb0 2024-04-22T07:21:18.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.317+0000 7f7fd6b50640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f7fd0159260 con 0x7f7fd00c4920 2024-04-22T07:21:18.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.317+0000 7f7fcffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fd00c9050 0x7f7fd01eef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:18.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.317+0000 7f7fcffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fd00c9050 0x7f7fd01eef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55894/0 (socket says 172.21.15.40:55894) 2024-04-22T07:21:18.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.317+0000 7f7fcffff640 1 -- 172.21.15.40:0/3590979296 learned_addr learned my addr 172.21.15.40:0/3590979296 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:18.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.318+0000 7f7fd50ed640 1 --2- 172.21.15.40:0/3590979296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fd0152fb0 0x7f7fd01487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:18.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.318+0000 7f7fcffff640 1 -- 172.21.15.40:0/3590979296 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fd00c4920 msgr2=0x7f7fd00c8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:18.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.318+0000 7f7fd48ec640 1 --2- 172.21.15.40:0/3590979296 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fd00c4920 0x7f7fd00c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:18.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.318+0000 7f7fcffff640 1 --2- 172.21.15.40:0/3590979296 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fd00c4920 0x7f7fd00c8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:18.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.318+0000 7f7fcffff640 1 -- 172.21.15.40:0/3590979296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fd0152fb0 msgr2=0x7f7fd01487b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:18.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.318+0000 7f7fcffff640 1 --2- 172.21.15.40:0/3590979296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fd0152fb0 0x7f7fd01487b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:18.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.318+0000 7f7fcffff640 1 -- 172.21.15.40:0/3590979296 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd00cc9f0 con 0x7f7fd00c9050 2024-04-22T07:21:18.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.318+0000 7f7fd48ec640 1 --2- 172.21.15.40:0/3590979296 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fd00c4920 0x7f7fd00c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:18.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.318+0000 7f7fd50ed640 1 --2- 172.21.15.40:0/3590979296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fd0152fb0 0x7f7fd01487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:18.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.318+0000 7f7fcffff640 1 --2- 172.21.15.40:0/3590979296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fd00c9050 0x7f7fd01eef20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400e980 tx=0x7f7fc400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:18.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.318+0000 7f7fcd7fa640 1 -- 172.21.15.40:0/3590979296 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4017070 con 0x7f7fd00c9050 2024-04-22T07:21:18.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.318+0000 7f7fcd7fa640 1 -- 172.21.15.40:0/3590979296 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc400ca00 con 0x7f7fd00c9050 2024-04-22T07:21:18.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.318+0000 7f7fd6b50640 1 -- 172.21.15.40:0/3590979296 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fd00c7ef0 con 0x7f7fd00c9050 2024-04-22T07:21:18.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.318+0000 7f7fcd7fa640 1 -- 172.21.15.40:0/3590979296 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc400cdd0 con 0x7f7fd00c9050 2024-04-22T07:21:18.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.318+0000 7f7fd6b50640 1 -- 172.21.15.40:0/3590979296 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fd01f2750 con 0x7f7fd00c9050 2024-04-22T07:21:18.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.319+0000 7f7fd6b50640 1 -- 172.21.15.40:0/3590979296 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fd0068b20 con 0x7f7fd00c9050 2024-04-22T07:21:18.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.320+0000 7f7fcd7fa640 1 -- 172.21.15.40:0/3590979296 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7fc401a070 con 0x7f7fd00c9050 2024-04-22T07:21:18.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.320+0000 7f7fcd7fa640 1 --2- 172.21.15.40:0/3590979296 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f7fbc06c8f0 0x7f7fbc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:18.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.320+0000 7f7fcd7fa640 1 -- 172.21.15.40:0/3590979296 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7fc408bec0 con 0x7f7fd00c9050 2024-04-22T07:21:18.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.320+0000 7f7fd48ec640 1 --2- 172.21.15.40:0/3590979296 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f7fbc06c8f0 0x7f7fbc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:18.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.321+0000 7f7fd48ec640 1 --2- 172.21.15.40:0/3590979296 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f7fbc06c8f0 0x7f7fbc06edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80012e0 tx=0x7f7fc8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:18.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.324+0000 7f7fcd7fa640 1 -- 172.21.15.40:0/3590979296 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7fc405a2f0 con 0x7f7fd00c9050 2024-04-22T07:21:18.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.505+0000 7f7fd6b50640 1 -- 172.21.15.40:0/3590979296 --> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7fd0157bd0 con 0x7f7fbc06c8f0 2024-04-22T07:21:18.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.510+0000 7f7fcd7fa640 1 -- 172.21.15.40:0/3590979296 <== mgr.4107 v2:172.21.15.40:6832/91163869 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7f7fd0157bd0 con 0x7f7fbc06c8f0 2024-04-22T07:21:18.511 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:21:18.512 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-22T07:21:18.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.513+0000 7f7fd6b50640 1 -- 172.21.15.40:0/3590979296 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f7fbc06c8f0 msgr2=0x7f7fbc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:18.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.513+0000 7f7fd6b50640 1 --2- 172.21.15.40:0/3590979296 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f7fbc06c8f0 0x7f7fbc06edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80012e0 tx=0x7f7fc8009040 comp rx=0 tx=0).stop 2024-04-22T07:21:18.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.513+0000 7f7fd6b50640 1 -- 172.21.15.40:0/3590979296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fd00c9050 msgr2=0x7f7fd01eef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:18.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.513+0000 7f7fd6b50640 1 --2- 172.21.15.40:0/3590979296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fd00c9050 0x7f7fd01eef20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400e980 tx=0x7f7fc400ee40 comp rx=0 tx=0).stop 2024-04-22T07:21:18.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.513+0000 7f7fd6b50640 1 -- 172.21.15.40:0/3590979296 shutdown_connections 2024-04-22T07:21:18.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.514+0000 7f7fd6b50640 1 --2- 172.21.15.40:0/3590979296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fd0152fb0 0x7f7fd01487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:18.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.514+0000 7f7fd6b50640 1 --2- 172.21.15.40:0/3590979296 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f7fbc06c8f0 0x7f7fbc06edb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:18.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.514+0000 7f7fd6b50640 1 --2- 172.21.15.40:0/3590979296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fd00c9050 0x7f7fd01eef20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:18.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.514+0000 7f7fd6b50640 1 --2- 172.21.15.40:0/3590979296 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fd00c4920 0x7f7fd00c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:18.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.514+0000 7f7fd6b50640 1 -- 172.21.15.40:0/3590979296 >> 172.21.15.40:0/3590979296 conn(0x7f7fd006dd10 msgr2=0x7f7fd00c3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:18.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.514+0000 7f7fd6b50640 1 -- 172.21.15.40:0/3590979296 shutdown_connections 2024-04-22T07:21:18.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.514+0000 7f7fd6b50640 1 -- 172.21.15.40:0/3590979296 wait complete. 2024-04-22T07:21:18.522 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-04-22T07:21:17.781653+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593034,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219180,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755540,"statfs":{"total":773094113280,"available":772869672960,"internally_reserved":0,"allocated":3121152,"data_stored":1835692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":256,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002520"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977886+0000","last_change":"2024-04-22T07:20:53.873662+0000","last_active":"2024-04-22T07:20:54.977886+0000","last_peered":"2024-04-22T07:20:54.977886+0000","last_clean":"2024-04-22T07:20:54.977886+0000","last_became_active":"2024-04-22T07:20:53.873384+0000","last_became_peered":"2024-04-22T07:20:53.873384+0000","last_unstale":"2024-04-22T07:20:54.977886+0000","last_undegraded":"2024-04-22T07:20:54.977886+0000","last_fullsized":"2024-04-22T07:20:54.977886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980006+0000","last_change":"2024-04-22T07:20:53.870454+0000","last_active":"2024-04-22T07:20:54.980006+0000","last_peered":"2024-04-22T07:20:54.980006+0000","last_clean":"2024-04-22T07:20:54.980006+0000","last_became_active":"2024-04-22T07:20:53.869964+0000","last_became_peered":"2024-04-22T07:20:53.869964+0000","last_unstale":"2024-04-22T07:20:54.980006+0000","last_undegraded":"2024-04-22T07:20:54.980006+0000","last_fullsized":"2024-04-22T07:20:54.980006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979125+0000","last_change":"2024-04-22T07:20:53.871145+0000","last_active":"2024-04-22T07:20:54.979125+0000","last_peered":"2024-04-22T07:20:54.979125+0000","last_clean":"2024-04-22T07:20:54.979125+0000","last_became_active":"2024-04-22T07:20:53.870819+0000","last_became_peered":"2024-04-22T07:20:53.870819+0000","last_unstale":"2024-04-22T07:20:54.979125+0000","last_undegraded":"2024-04-22T07:20:54.979125+0000","last_fullsized":"2024-04-22T07:20:54.979125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:02:16.373202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861622+0000","last_change":"2024-04-22T07:20:53.870458+0000","last_active":"2024-04-22T07:20:54.861622+0000","last_peered":"2024-04-22T07:20:54.861622+0000","last_clean":"2024-04-22T07:20:54.861622+0000","last_became_active":"2024-04-22T07:20:53.870125+0000","last_became_peered":"2024-04-22T07:20:53.870125+0000","last_unstale":"2024-04-22T07:20:54.861622+0000","last_undegraded":"2024-04-22T07:20:54.861622+0000","last_fullsized":"2024-04-22T07:20:54.861622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977801+0000","last_change":"2024-04-22T07:20:53.877301+0000","last_active":"2024-04-22T07:20:54.977801+0000","last_peered":"2024-04-22T07:20:54.977801+0000","last_clean":"2024-04-22T07:20:54.977801+0000","last_became_active":"2024-04-22T07:20:53.874941+0000","last_became_peered":"2024-04-22T07:20:53.874941+0000","last_unstale":"2024-04-22T07:20:54.977801+0000","last_undegraded":"2024-04-22T07:20:54.977801+0000","last_fullsized":"2024-04-22T07:20:54.977801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:52.686229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861484+0000","last_change":"2024-04-22T07:20:53.869735+0000","last_active":"2024-04-22T07:20:54.861484+0000","last_peered":"2024-04-22T07:20:54.861484+0000","last_clean":"2024-04-22T07:20:54.861484+0000","last_became_active":"2024-04-22T07:20:53.869369+0000","last_became_peered":"2024-04-22T07:20:53.869369+0000","last_unstale":"2024-04-22T07:20:54.861484+0000","last_undegraded":"2024-04-22T07:20:54.861484+0000","last_fullsized":"2024-04-22T07:20:54.861484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:27.624819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977494+0000","last_change":"2024-04-22T07:20:53.873492+0000","last_active":"2024-04-22T07:20:54.977494+0000","last_peered":"2024-04-22T07:20:54.977494+0000","last_clean":"2024-04-22T07:20:54.977494+0000","last_became_active":"2024-04-22T07:20:53.873220+0000","last_became_peered":"2024-04-22T07:20:53.873220+0000","last_unstale":"2024-04-22T07:20:54.977494+0000","last_undegraded":"2024-04-22T07:20:54.977494+0000","last_fullsized":"2024-04-22T07:20:54.977494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:35:26.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979018+0000","last_change":"2024-04-22T07:20:53.875847+0000","last_active":"2024-04-22T07:20:54.979018+0000","last_peered":"2024-04-22T07:20:54.979018+0000","last_clean":"2024-04-22T07:20:54.979018+0000","last_became_active":"2024-04-22T07:20:53.875017+0000","last_became_peered":"2024-04-22T07:20:53.875017+0000","last_unstale":"2024-04-22T07:20:54.979018+0000","last_undegraded":"2024-04-22T07:20:54.979018+0000","last_fullsized":"2024-04-22T07:20:54.979018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:07.080135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863086+0000","last_change":"2024-04-22T07:20:53.869174+0000","last_active":"2024-04-22T07:20:54.863086+0000","last_peered":"2024-04-22T07:20:54.863086+0000","last_clean":"2024-04-22T07:20:54.863086+0000","last_became_active":"2024-04-22T07:20:53.868906+0000","last_became_peered":"2024-04-22T07:20:53.868906+0000","last_unstale":"2024-04-22T07:20:54.863086+0000","last_undegraded":"2024-04-22T07:20:54.863086+0000","last_fullsized":"2024-04-22T07:20:54.863086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977893+0000","last_change":"2024-04-22T07:20:53.874933+0000","last_active":"2024-04-22T07:20:54.977893+0000","last_peered":"2024-04-22T07:20:54.977893+0000","last_clean":"2024-04-22T07:20:54.977893+0000","last_became_active":"2024-04-22T07:20:53.874673+0000","last_became_peered":"2024-04-22T07:20:53.874673+0000","last_unstale":"2024-04-22T07:20:54.977893+0000","last_undegraded":"2024-04-22T07:20:54.977893+0000","last_fullsized":"2024-04-22T07:20:54.977893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977684+0000","last_change":"2024-04-22T07:20:53.874909+0000","last_active":"2024-04-22T07:20:54.977684+0000","last_peered":"2024-04-22T07:20:54.977684+0000","last_clean":"2024-04-22T07:20:54.977684+0000","last_became_active":"2024-04-22T07:20:53.873945+0000","last_became_peered":"2024-04-22T07:20:53.873945+0000","last_unstale":"2024-04-22T07:20:54.977684+0000","last_undegraded":"2024-04-22T07:20:54.977684+0000","last_fullsized":"2024-04-22T07:20:54.977684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:53.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977652+0000","last_change":"2024-04-22T07:20:53.878344+0000","last_active":"2024-04-22T07:20:54.977652+0000","last_peered":"2024-04-22T07:20:54.977652+0000","last_clean":"2024-04-22T07:20:54.977652+0000","last_became_active":"2024-04-22T07:20:53.877192+0000","last_became_peered":"2024-04-22T07:20:53.877192+0000","last_unstale":"2024-04-22T07:20:54.977652+0000","last_undegraded":"2024-04-22T07:20:54.977652+0000","last_fullsized":"2024-04-22T07:20:54.977652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:42:03.637655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979583+0000","last_change":"2024-04-22T07:20:53.879419+0000","last_active":"2024-04-22T07:20:54.979583+0000","last_peered":"2024-04-22T07:20:54.979583+0000","last_clean":"2024-04-22T07:20:54.979583+0000","last_became_active":"2024-04-22T07:20:53.879070+0000","last_became_peered":"2024-04-22T07:20:53.879070+0000","last_unstale":"2024-04-22T07:20:54.979583+0000","last_undegraded":"2024-04-22T07:20:54.979583+0000","last_fullsized":"2024-04-22T07:20:54.979583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979592+0000","last_change":"2024-04-22T07:20:53.877395+0000","last_active":"2024-04-22T07:20:54.979592+0000","last_peered":"2024-04-22T07:20:54.979592+0000","last_clean":"2024-04-22T07:20:54.979592+0000","last_became_active":"2024-04-22T07:20:53.877116+0000","last_became_peered":"2024-04-22T07:20:53.877116+0000","last_unstale":"2024-04-22T07:20:54.979592+0000","last_undegraded":"2024-04-22T07:20:54.979592+0000","last_fullsized":"2024-04-22T07:20:54.979592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:21:25.001413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979310+0000","last_change":"2024-04-22T07:20:53.875156+0000","last_active":"2024-04-22T07:20:54.979310+0000","last_peered":"2024-04-22T07:20:54.979310+0000","last_clean":"2024-04-22T07:20:54.979310+0000","last_became_active":"2024-04-22T07:20:53.874468+0000","last_became_peered":"2024-04-22T07:20:53.874468+0000","last_unstale":"2024-04-22T07:20:54.979310+0000","last_undegraded":"2024-04-22T07:20:54.979310+0000","last_fullsized":"2024-04-22T07:20:54.979310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:42:03.637655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862585+0000","last_change":"2024-04-22T07:20:53.867178+0000","last_active":"2024-04-22T07:20:54.862585+0000","last_peered":"2024-04-22T07:20:54.862585+0000","last_clean":"2024-04-22T07:20:54.862585+0000","last_became_active":"2024-04-22T07:20:53.865491+0000","last_became_peered":"2024-04-22T07:20:53.865491+0000","last_unstale":"2024-04-22T07:20:54.862585+0000","last_undegraded":"2024-04-22T07:20:54.862585+0000","last_fullsized":"2024-04-22T07:20:54.862585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863583+0000","last_change":"2024-04-22T07:20:53.876797+0000","last_active":"2024-04-22T07:20:54.863583+0000","last_peered":"2024-04-22T07:20:54.863583+0000","last_clean":"2024-04-22T07:20:54.863583+0000","last_became_active":"2024-04-22T07:20:53.876321+0000","last_became_peered":"2024-04-22T07:20:53.876321+0000","last_unstale":"2024-04-22T07:20:54.863583+0000","last_undegraded":"2024-04-22T07:20:54.863583+0000","last_fullsized":"2024-04-22T07:20:54.863583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:22:45.699676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980360+0000","last_change":"2024-04-22T07:20:53.868760+0000","last_active":"2024-04-22T07:20:54.980360+0000","last_peered":"2024-04-22T07:20:54.980360+0000","last_clean":"2024-04-22T07:20:54.980360+0000","last_became_active":"2024-04-22T07:20:53.868441+0000","last_became_peered":"2024-04-22T07:20:53.868441+0000","last_unstale":"2024-04-22T07:20:54.980360+0000","last_undegraded":"2024-04-22T07:20:54.980360+0000","last_fullsized":"2024-04-22T07:20:54.980360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863503+0000","last_change":"2024-04-22T07:20:53.864806+0000","last_active":"2024-04-22T07:20:54.863503+0000","last_peered":"2024-04-22T07:20:54.863503+0000","last_clean":"2024-04-22T07:20:54.863503+0000","last_became_active":"2024-04-22T07:20:53.864535+0000","last_became_peered":"2024-04-22T07:20:53.864535+0000","last_unstale":"2024-04-22T07:20:54.863503+0000","last_undegraded":"2024-04-22T07:20:54.863503+0000","last_fullsized":"2024-04-22T07:20:54.863503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:22:07.227993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977721+0000","last_change":"2024-04-22T07:20:53.878013+0000","last_active":"2024-04-22T07:20:54.977721+0000","last_peered":"2024-04-22T07:20:54.977721+0000","last_clean":"2024-04-22T07:20:54.977721+0000","last_became_active":"2024-04-22T07:20:53.876641+0000","last_became_peered":"2024-04-22T07:20:53.876641+0000","last_unstale":"2024-04-22T07:20:54.977721+0000","last_undegraded":"2024-04-22T07:20:54.977721+0000","last_fullsized":"2024-04-22T07:20:54.977721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:45:15.519469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978885+0000","last_change":"2024-04-22T07:20:53.868319+0000","last_active":"2024-04-22T07:20:54.978885+0000","last_peered":"2024-04-22T07:20:54.978885+0000","last_clean":"2024-04-22T07:20:54.978885+0000","last_became_active":"2024-04-22T07:20:53.868014+0000","last_became_peered":"2024-04-22T07:20:53.868014+0000","last_unstale":"2024-04-22T07:20:54.978885+0000","last_undegraded":"2024-04-22T07:20:54.978885+0000","last_fullsized":"2024-04-22T07:20:54.978885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:09:27.178992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862823+0000","last_change":"2024-04-22T07:20:53.867684+0000","last_active":"2024-04-22T07:20:54.862823+0000","last_peered":"2024-04-22T07:20:54.862823+0000","last_clean":"2024-04-22T07:20:54.862823+0000","last_became_active":"2024-04-22T07:20:53.867403+0000","last_became_peered":"2024-04-22T07:20:53.867403+0000","last_unstale":"2024-04-22T07:20:54.862823+0000","last_undegraded":"2024-04-22T07:20:54.862823+0000","last_fullsized":"2024-04-22T07:20:54.862823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979253+0000","last_change":"2024-04-22T07:20:53.869595+0000","last_active":"2024-04-22T07:20:54.979253+0000","last_peered":"2024-04-22T07:20:54.979253+0000","last_clean":"2024-04-22T07:20:54.979253+0000","last_became_active":"2024-04-22T07:20:53.868519+0000","last_became_peered":"2024-04-22T07:20:53.868519+0000","last_unstale":"2024-04-22T07:20:54.979253+0000","last_undegraded":"2024-04-22T07:20:54.979253+0000","last_fullsized":"2024-04-22T07:20:54.979253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:35:26.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862610+0000","last_change":"2024-04-22T07:20:53.865275+0000","last_active":"2024-04-22T07:20:54.862610+0000","last_peered":"2024-04-22T07:20:54.862610+0000","last_clean":"2024-04-22T07:20:54.862610+0000","last_became_active":"2024-04-22T07:20:53.865026+0000","last_became_peered":"2024-04-22T07:20:53.865026+0000","last_unstale":"2024-04-22T07:20:54.862610+0000","last_undegraded":"2024-04-22T07:20:54.862610+0000","last_fullsized":"2024-04-22T07:20:54.862610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:48:40.630407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979451+0000","last_change":"2024-04-22T07:20:53.873457+0000","last_active":"2024-04-22T07:20:54.979451+0000","last_peered":"2024-04-22T07:20:54.979451+0000","last_clean":"2024-04-22T07:20:54.979451+0000","last_became_active":"2024-04-22T07:20:53.873147+0000","last_became_peered":"2024-04-22T07:20:53.873147+0000","last_unstale":"2024-04-22T07:20:54.979451+0000","last_undegraded":"2024-04-22T07:20:54.979451+0000","last_fullsized":"2024-04-22T07:20:54.979451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:53.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861933+0000","last_change":"2024-04-22T07:20:53.865327+0000","last_active":"2024-04-22T07:20:54.861933+0000","last_peered":"2024-04-22T07:20:54.861933+0000","last_clean":"2024-04-22T07:20:54.861933+0000","last_became_active":"2024-04-22T07:20:53.865030+0000","last_became_peered":"2024-04-22T07:20:53.865030+0000","last_unstale":"2024-04-22T07:20:54.861933+0000","last_undegraded":"2024-04-22T07:20:54.861933+0000","last_fullsized":"2024-04-22T07:20:54.861933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979550+0000","last_change":"2024-04-22T07:20:53.876792+0000","last_active":"2024-04-22T07:20:54.979550+0000","last_peered":"2024-04-22T07:20:54.979550+0000","last_clean":"2024-04-22T07:20:54.979550+0000","last_became_active":"2024-04-22T07:20:53.876446+0000","last_became_peered":"2024-04-22T07:20:53.876446+0000","last_unstale":"2024-04-22T07:20:54.979550+0000","last_undegraded":"2024-04-22T07:20:54.979550+0000","last_fullsized":"2024-04-22T07:20:54.979550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:34.943561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979292+0000","last_change":"2024-04-22T07:20:53.878147+0000","last_active":"2024-04-22T07:20:54.979292+0000","last_peered":"2024-04-22T07:20:54.979292+0000","last_clean":"2024-04-22T07:20:54.979292+0000","last_became_active":"2024-04-22T07:20:53.877867+0000","last_became_peered":"2024-04-22T07:20:53.877867+0000","last_unstale":"2024-04-22T07:20:54.979292+0000","last_undegraded":"2024-04-22T07:20:54.979292+0000","last_fullsized":"2024-04-22T07:20:54.979292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979201+0000","last_change":"2024-04-22T07:20:53.872447+0000","last_active":"2024-04-22T07:20:54.979201+0000","last_peered":"2024-04-22T07:20:54.979201+0000","last_clean":"2024-04-22T07:20:54.979201+0000","last_became_active":"2024-04-22T07:20:53.871862+0000","last_became_peered":"2024-04-22T07:20:53.871862+0000","last_unstale":"2024-04-22T07:20:54.979201+0000","last_undegraded":"2024-04-22T07:20:54.979201+0000","last_fullsized":"2024-04-22T07:20:54.979201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:08:33.063318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862747+0000","last_change":"2024-04-22T07:20:53.862483+0000","last_active":"2024-04-22T07:20:54.862747+0000","last_peered":"2024-04-22T07:20:54.862747+0000","last_clean":"2024-04-22T07:20:54.862747+0000","last_became_active":"2024-04-22T07:20:53.862199+0000","last_became_peered":"2024-04-22T07:20:53.862199+0000","last_unstale":"2024-04-22T07:20:54.862747+0000","last_undegraded":"2024-04-22T07:20:54.862747+0000","last_fullsized":"2024-04-22T07:20:54.862747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:10:12.276510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979743+0000","last_change":"2024-04-22T07:20:53.872507+0000","last_active":"2024-04-22T07:20:54.979743+0000","last_peered":"2024-04-22T07:20:54.979743+0000","last_clean":"2024-04-22T07:20:54.979743+0000","last_became_active":"2024-04-22T07:20:53.872199+0000","last_became_peered":"2024-04-22T07:20:53.872199+0000","last_unstale":"2024-04-22T07:20:54.979743+0000","last_undegraded":"2024-04-22T07:20:54.979743+0000","last_fullsized":"2024-04-22T07:20:54.979743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:09.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861399+0000","last_change":"2024-04-22T07:20:53.863946+0000","last_active":"2024-04-22T07:20:54.861399+0000","last_peered":"2024-04-22T07:20:54.861399+0000","last_clean":"2024-04-22T07:20:54.861399+0000","last_became_active":"2024-04-22T07:20:53.863688+0000","last_became_peered":"2024-04-22T07:20:53.863688+0000","last_unstale":"2024-04-22T07:20:54.861399+0000","last_undegraded":"2024-04-22T07:20:54.861399+0000","last_fullsized":"2024-04-22T07:20:54.861399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862947+0000","last_change":"2024-04-22T07:20:53.874785+0000","last_active":"2024-04-22T07:20:54.862947+0000","last_peered":"2024-04-22T07:20:54.862947+0000","last_clean":"2024-04-22T07:20:54.862947+0000","last_became_active":"2024-04-22T07:20:53.874524+0000","last_became_peered":"2024-04-22T07:20:53.874524+0000","last_unstale":"2024-04-22T07:20:54.862947+0000","last_undegraded":"2024-04-22T07:20:54.862947+0000","last_fullsized":"2024-04-22T07:20:54.862947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.787613+0000","last_change":"2024-04-22T07:20:52.860712+0000","last_active":"2024-04-22T07:20:55.787613+0000","last_peered":"2024-04-22T07:20:55.787613+0000","last_clean":"2024-04-22T07:20:55.787613+0000","last_became_active":"2024-04-22T07:20:52.860015+0000","last_became_peered":"2024-04-22T07:20:52.860015+0000","last_unstale":"2024-04-22T07:20:55.787613+0000","last_undegraded":"2024-04-22T07:20:55.787613+0000","last_fullsized":"2024-04-22T07:20:55.787613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:59:32.487127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980495+0000","last_change":"2024-04-22T07:20:53.879570+0000","last_active":"2024-04-22T07:20:54.980495+0000","last_peered":"2024-04-22T07:20:54.980495+0000","last_clean":"2024-04-22T07:20:54.980495+0000","last_became_active":"2024-04-22T07:20:53.879191+0000","last_became_peered":"2024-04-22T07:20:53.879191+0000","last_unstale":"2024-04-22T07:20:54.980495+0000","last_undegraded":"2024-04-22T07:20:54.980495+0000","last_fullsized":"2024-04-22T07:20:54.980495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:34:52.306691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.787136+0000","last_change":"2024-04-22T07:20:52.862510+0000","last_active":"2024-04-22T07:20:55.787136+0000","last_peered":"2024-04-22T07:20:55.787136+0000","last_clean":"2024-04-22T07:20:55.787136+0000","last_became_active":"2024-04-22T07:20:52.862228+0000","last_became_peered":"2024-04-22T07:20:52.862228+0000","last_unstale":"2024-04-22T07:20:55.787136+0000","last_undegraded":"2024-04-22T07:20:55.787136+0000","last_fullsized":"2024-04-22T07:20:55.787136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:51.683021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979012+0000","last_change":"2024-04-22T07:20:52.856651+0000","last_active":"2024-04-22T07:20:54.979012+0000","last_peered":"2024-04-22T07:20:54.979012+0000","last_clean":"2024-04-22T07:20:54.979012+0000","last_became_active":"2024-04-22T07:20:52.856096+0000","last_became_peered":"2024-04-22T07:20:52.856096+0000","last_unstale":"2024-04-22T07:20:54.979012+0000","last_undegraded":"2024-04-22T07:20:54.979012+0000","last_fullsized":"2024-04-22T07:20:54.979012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:04.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979658+0000","last_change":"2024-04-22T07:20:53.873708+0000","last_active":"2024-04-22T07:20:54.979658+0000","last_peered":"2024-04-22T07:20:54.979658+0000","last_clean":"2024-04-22T07:20:54.979658+0000","last_became_active":"2024-04-22T07:20:53.872793+0000","last_became_peered":"2024-04-22T07:20:53.872793+0000","last_unstale":"2024-04-22T07:20:54.979658+0000","last_undegraded":"2024-04-22T07:20:54.979658+0000","last_fullsized":"2024-04-22T07:20:54.979658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:52.686229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862729+0000","last_change":"2024-04-22T07:20:52.861133+0000","last_active":"2024-04-22T07:20:54.862729+0000","last_peered":"2024-04-22T07:20:54.862729+0000","last_clean":"2024-04-22T07:20:54.862729+0000","last_became_active":"2024-04-22T07:20:52.860736+0000","last_became_peered":"2024-04-22T07:20:52.860736+0000","last_unstale":"2024-04-22T07:20:54.862729+0000","last_undegraded":"2024-04-22T07:20:54.862729+0000","last_fullsized":"2024-04-22T07:20:54.862729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:06.123308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980308+0000","last_change":"2024-04-22T07:20:53.867477+0000","last_active":"2024-04-22T07:20:54.980308+0000","last_peered":"2024-04-22T07:20:54.980308+0000","last_clean":"2024-04-22T07:20:54.980308+0000","last_became_active":"2024-04-22T07:20:53.867086+0000","last_became_peered":"2024-04-22T07:20:53.867086+0000","last_unstale":"2024-04-22T07:20:54.980308+0000","last_undegraded":"2024-04-22T07:20:54.980308+0000","last_fullsized":"2024-04-22T07:20:54.980308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:56:55.644168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863067+0000","last_change":"2024-04-22T07:20:52.863567+0000","last_active":"2024-04-22T07:20:54.863067+0000","last_peered":"2024-04-22T07:20:54.863067+0000","last_clean":"2024-04-22T07:20:54.863067+0000","last_became_active":"2024-04-22T07:20:52.863285+0000","last_became_peered":"2024-04-22T07:20:52.863285+0000","last_unstale":"2024-04-22T07:20:54.863067+0000","last_undegraded":"2024-04-22T07:20:54.863067+0000","last_fullsized":"2024-04-22T07:20:54.863067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861976+0000","last_change":"2024-04-22T07:20:53.864955+0000","last_active":"2024-04-22T07:20:54.861976+0000","last_peered":"2024-04-22T07:20:54.861976+0000","last_clean":"2024-04-22T07:20:54.861976+0000","last_became_active":"2024-04-22T07:20:53.864694+0000","last_became_peered":"2024-04-22T07:20:53.864694+0000","last_unstale":"2024-04-22T07:20:54.861976+0000","last_undegraded":"2024-04-22T07:20:54.861976+0000","last_fullsized":"2024-04-22T07:20:54.861976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977898+0000","last_change":"2024-04-22T07:20:52.858761+0000","last_active":"2024-04-22T07:20:54.977898+0000","last_peered":"2024-04-22T07:20:54.977898+0000","last_clean":"2024-04-22T07:20:54.977898+0000","last_became_active":"2024-04-22T07:20:52.856815+0000","last_became_peered":"2024-04-22T07:20:52.856815+0000","last_unstale":"2024-04-22T07:20:54.977898+0000","last_undegraded":"2024-04-22T07:20:54.977898+0000","last_fullsized":"2024-04-22T07:20:54.977898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:06.123308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979798+0000","last_change":"2024-04-22T07:20:53.867290+0000","last_active":"2024-04-22T07:20:54.979798+0000","last_peered":"2024-04-22T07:20:54.979798+0000","last_clean":"2024-04-22T07:20:54.979798+0000","last_became_active":"2024-04-22T07:20:53.866955+0000","last_became_peered":"2024-04-22T07:20:53.866955+0000","last_unstale":"2024-04-22T07:20:54.979798+0000","last_undegraded":"2024-04-22T07:20:54.979798+0000","last_fullsized":"2024-04-22T07:20:54.979798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:43.442316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.870244+0000","last_change":"2024-04-22T07:20:52.863670+0000","last_active":"2024-04-22T07:20:58.870244+0000","last_peered":"2024-04-22T07:20:58.870244+0000","last_clean":"2024-04-22T07:20:58.870244+0000","last_became_active":"2024-04-22T07:20:52.863320+0000","last_became_peered":"2024-04-22T07:20:52.863320+0000","last_unstale":"2024-04-22T07:20:58.870244+0000","last_undegraded":"2024-04-22T07:20:58.870244+0000","last_fullsized":"2024-04-22T07:20:58.870244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:04.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862589+0000","last_change":"2024-04-22T07:20:53.868286+0000","last_active":"2024-04-22T07:20:54.862589+0000","last_peered":"2024-04-22T07:20:54.862589+0000","last_clean":"2024-04-22T07:20:54.862589+0000","last_became_active":"2024-04-22T07:20:53.862811+0000","last_became_peered":"2024-04-22T07:20:53.862811+0000","last_unstale":"2024-04-22T07:20:54.862589+0000","last_undegraded":"2024-04-22T07:20:54.862589+0000","last_fullsized":"2024-04-22T07:20:54.862589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:21:14.945657+0000","last_change":"2024-04-22T07:20:52.863638+0000","last_active":"2024-04-22T07:21:14.945657+0000","last_peered":"2024-04-22T07:21:14.945657+0000","last_clean":"2024-04-22T07:21:14.945657+0000","last_became_active":"2024-04-22T07:20:52.863244+0000","last_became_peered":"2024-04-22T07:20:52.863244+0000","last_unstale":"2024-04-22T07:21:14.945657+0000","last_undegraded":"2024-04-22T07:21:14.945657+0000","last_fullsized":"2024-04-22T07:21:14.945657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:36:49.017537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1868,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977713+0000","last_change":"2024-04-22T07:20:53.875162+0000","last_active":"2024-04-22T07:20:54.977713+0000","last_peered":"2024-04-22T07:20:54.977713+0000","last_clean":"2024-04-22T07:20:54.977713+0000","last_became_active":"2024-04-22T07:20:53.874612+0000","last_became_peered":"2024-04-22T07:20:53.874612+0000","last_unstale":"2024-04-22T07:20:54.977713+0000","last_undegraded":"2024-04-22T07:20:54.977713+0000","last_fullsized":"2024-04-22T07:20:54.977713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:13:12.303505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.869961+0000","last_change":"2024-04-22T07:20:52.855194+0000","last_active":"2024-04-22T07:20:58.869961+0000","last_peered":"2024-04-22T07:20:58.869961+0000","last_clean":"2024-04-22T07:20:58.869961+0000","last_became_active":"2024-04-22T07:20:52.854915+0000","last_became_peered":"2024-04-22T07:20:52.854915+0000","last_unstale":"2024-04-22T07:20:58.869961+0000","last_undegraded":"2024-04-22T07:20:58.869961+0000","last_fullsized":"2024-04-22T07:20:58.869961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979725+0000","last_change":"2024-04-22T07:20:53.868695+0000","last_active":"2024-04-22T07:20:54.979725+0000","last_peered":"2024-04-22T07:20:54.979725+0000","last_clean":"2024-04-22T07:20:54.979725+0000","last_became_active":"2024-04-22T07:20:53.868400+0000","last_became_peered":"2024-04-22T07:20:53.868400+0000","last_unstale":"2024-04-22T07:20:54.979725+0000","last_undegraded":"2024-04-22T07:20:54.979725+0000","last_fullsized":"2024-04-22T07:20:54.979725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:30:23.352871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863163+0000","last_change":"2024-04-22T07:20:52.861884+0000","last_active":"2024-04-22T07:20:54.863163+0000","last_peered":"2024-04-22T07:20:54.863163+0000","last_clean":"2024-04-22T07:20:54.863163+0000","last_became_active":"2024-04-22T07:20:52.861546+0000","last_became_peered":"2024-04-22T07:20:52.861546+0000","last_unstale":"2024-04-22T07:20:54.863163+0000","last_undegraded":"2024-04-22T07:20:54.863163+0000","last_fullsized":"2024-04-22T07:20:54.863163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:37.283262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862882+0000","last_change":"2024-04-22T07:20:53.863071+0000","last_active":"2024-04-22T07:20:54.862882+0000","last_peered":"2024-04-22T07:20:54.862882+0000","last_clean":"2024-04-22T07:20:54.862882+0000","last_became_active":"2024-04-22T07:20:53.862763+0000","last_became_peered":"2024-04-22T07:20:53.862763+0000","last_unstale":"2024-04-22T07:20:54.862882+0000","last_undegraded":"2024-04-22T07:20:54.862882+0000","last_fullsized":"2024-04-22T07:20:54.862882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:19:57.432323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977415+0000","last_change":"2024-04-22T07:20:52.865285+0000","last_active":"2024-04-22T07:20:54.977415+0000","last_peered":"2024-04-22T07:20:54.977415+0000","last_clean":"2024-04-22T07:20:54.977415+0000","last_became_active":"2024-04-22T07:20:52.864725+0000","last_became_peered":"2024-04-22T07:20:52.864725+0000","last_unstale":"2024-04-22T07:20:54.977415+0000","last_undegraded":"2024-04-22T07:20:54.977415+0000","last_fullsized":"2024-04-22T07:20:54.977415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:23:28.850031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862533+0000","last_change":"2024-04-22T07:20:53.875479+0000","last_active":"2024-04-22T07:20:54.862533+0000","last_peered":"2024-04-22T07:20:54.862533+0000","last_clean":"2024-04-22T07:20:54.862533+0000","last_became_active":"2024-04-22T07:20:53.874567+0000","last_became_peered":"2024-04-22T07:20:53.874567+0000","last_unstale":"2024-04-22T07:20:54.862533+0000","last_undegraded":"2024-04-22T07:20:54.862533+0000","last_fullsized":"2024-04-22T07:20:54.862533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.871647+0000","last_change":"2024-04-22T07:20:52.860646+0000","last_active":"2024-04-22T07:20:58.871647+0000","last_peered":"2024-04-22T07:20:58.871647+0000","last_clean":"2024-04-22T07:20:58.871647+0000","last_became_active":"2024-04-22T07:20:52.860347+0000","last_became_peered":"2024-04-22T07:20:52.860347+0000","last_unstale":"2024-04-22T07:20:58.871647+0000","last_undegraded":"2024-04-22T07:20:58.871647+0000","last_fullsized":"2024-04-22T07:20:58.871647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:53:20.912264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862635+0000","last_change":"2024-04-22T07:20:53.859641+0000","last_active":"2024-04-22T07:20:54.862635+0000","last_peered":"2024-04-22T07:20:54.862635+0000","last_clean":"2024-04-22T07:20:54.862635+0000","last_became_active":"2024-04-22T07:20:53.859365+0000","last_became_peered":"2024-04-22T07:20:53.859365+0000","last_unstale":"2024-04-22T07:20:54.862635+0000","last_undegraded":"2024-04-22T07:20:54.862635+0000","last_fullsized":"2024-04-22T07:20:54.862635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:46:50.322722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.788730+0000","last_change":"2024-04-22T07:20:52.866960+0000","last_active":"2024-04-22T07:20:55.788730+0000","last_peered":"2024-04-22T07:20:55.788730+0000","last_clean":"2024-04-22T07:20:55.788730+0000","last_became_active":"2024-04-22T07:20:52.866654+0000","last_became_peered":"2024-04-22T07:20:52.866654+0000","last_unstale":"2024-04-22T07:20:55.788730+0000","last_undegraded":"2024-04-22T07:20:55.788730+0000","last_fullsized":"2024-04-22T07:20:55.788730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:51.683021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862087+0000","last_change":"2024-04-22T07:20:53.874775+0000","last_active":"2024-04-22T07:20:54.862087+0000","last_peered":"2024-04-22T07:20:54.862087+0000","last_clean":"2024-04-22T07:20:54.862087+0000","last_became_active":"2024-04-22T07:20:53.874499+0000","last_became_peered":"2024-04-22T07:20:53.874499+0000","last_unstale":"2024-04-22T07:20:54.862087+0000","last_undegraded":"2024-04-22T07:20:54.862087+0000","last_fullsized":"2024-04-22T07:20:54.862087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:23.268067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.871021+0000","last_change":"2024-04-22T07:20:52.867201+0000","last_active":"2024-04-22T07:20:58.871021+0000","last_peered":"2024-04-22T07:20:58.871021+0000","last_clean":"2024-04-22T07:20:58.871021+0000","last_became_active":"2024-04-22T07:20:52.866627+0000","last_became_peered":"2024-04-22T07:20:52.866627+0000","last_unstale":"2024-04-22T07:20:58.871021+0000","last_undegraded":"2024-04-22T07:20:58.871021+0000","last_fullsized":"2024-04-22T07:20:58.871021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:09:08.908298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977901+0000","last_change":"2024-04-22T07:20:53.871645+0000","last_active":"2024-04-22T07:20:54.977901+0000","last_peered":"2024-04-22T07:20:54.977901+0000","last_clean":"2024-04-22T07:20:54.977901+0000","last_became_active":"2024-04-22T07:20:53.871353+0000","last_became_peered":"2024-04-22T07:20:53.871353+0000","last_unstale":"2024-04-22T07:20:54.977901+0000","last_undegraded":"2024-04-22T07:20:54.977901+0000","last_fullsized":"2024-04-22T07:20:54.977901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:48:40.630407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.787667+0000","last_change":"2024-04-22T07:20:52.866996+0000","last_active":"2024-04-22T07:20:55.787667+0000","last_peered":"2024-04-22T07:20:55.787667+0000","last_clean":"2024-04-22T07:20:55.787667+0000","last_became_active":"2024-04-22T07:20:52.866677+0000","last_became_peered":"2024-04-22T07:20:52.866677+0000","last_unstale":"2024-04-22T07:20:55.787667+0000","last_undegraded":"2024-04-22T07:20:55.787667+0000","last_fullsized":"2024-04-22T07:20:55.787667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977832+0000","last_change":"2024-04-22T07:20:53.871064+0000","last_active":"2024-04-22T07:20:54.977832+0000","last_peered":"2024-04-22T07:20:54.977832+0000","last_clean":"2024-04-22T07:20:54.977832+0000","last_became_active":"2024-04-22T07:20:53.866968+0000","last_became_peered":"2024-04-22T07:20:53.866968+0000","last_unstale":"2024-04-22T07:20:54.977832+0000","last_undegraded":"2024-04-22T07:20:54.977832+0000","last_fullsized":"2024-04-22T07:20:54.977832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:43.442316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979659+0000","last_change":"2024-04-22T07:20:52.856958+0000","last_active":"2024-04-22T07:20:54.979659+0000","last_peered":"2024-04-22T07:20:54.979659+0000","last_clean":"2024-04-22T07:20:54.979659+0000","last_became_active":"2024-04-22T07:20:52.856289+0000","last_became_peered":"2024-04-22T07:20:52.856289+0000","last_unstale":"2024-04-22T07:20:54.979659+0000","last_undegraded":"2024-04-22T07:20:54.979659+0000","last_fullsized":"2024-04-22T07:20:54.979659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863352+0000","last_change":"2024-04-22T07:20:53.872915+0000","last_active":"2024-04-22T07:20:54.863352+0000","last_peered":"2024-04-22T07:20:54.863352+0000","last_clean":"2024-04-22T07:20:54.863352+0000","last_became_active":"2024-04-22T07:20:53.872005+0000","last_became_peered":"2024-04-22T07:20:53.872005+0000","last_unstale":"2024-04-22T07:20:54.863352+0000","last_undegraded":"2024-04-22T07:20:54.863352+0000","last_fullsized":"2024-04-22T07:20:54.863352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:53:29.242632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862549+0000","last_change":"2024-04-22T07:20:43.747396+0000","last_active":"2024-04-22T07:20:54.862549+0000","last_peered":"2024-04-22T07:20:54.862549+0000","last_clean":"2024-04-22T07:20:54.862549+0000","last_became_active":"2024-04-22T07:20:43.746332+0000","last_became_peered":"2024-04-22T07:20:43.746332+0000","last_unstale":"2024-04-22T07:20:54.862549+0000","last_undegraded":"2024-04-22T07:20:54.862549+0000","last_fullsized":"2024-04-22T07:20:54.862549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:42.732916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:42.732916+0000","last_clean_scrub_stamp":"2024-04-22T07:20:42.732916+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:02:55.086445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863049+0000","last_change":"2024-04-22T07:20:52.862492+0000","last_active":"2024-04-22T07:20:54.863049+0000","last_peered":"2024-04-22T07:20:54.863049+0000","last_clean":"2024-04-22T07:20:54.863049+0000","last_became_active":"2024-04-22T07:20:52.862201+0000","last_became_peered":"2024-04-22T07:20:52.862201+0000","last_unstale":"2024-04-22T07:20:54.863049+0000","last_undegraded":"2024-04-22T07:20:54.863049+0000","last_fullsized":"2024-04-22T07:20:54.863049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:52.015227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979807+0000","last_change":"2024-04-22T07:20:53.868797+0000","last_active":"2024-04-22T07:20:54.979807+0000","last_peered":"2024-04-22T07:20:54.979807+0000","last_clean":"2024-04-22T07:20:54.979807+0000","last_became_active":"2024-04-22T07:20:53.868335+0000","last_became_peered":"2024-04-22T07:20:53.868335+0000","last_unstale":"2024-04-22T07:20:54.979807+0000","last_undegraded":"2024-04-22T07:20:54.979807+0000","last_fullsized":"2024-04-22T07:20:54.979807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:43:02.116289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862731+0000","last_change":"2024-04-22T07:20:52.867622+0000","last_active":"2024-04-22T07:20:54.862731+0000","last_peered":"2024-04-22T07:20:54.862731+0000","last_clean":"2024-04-22T07:20:54.862731+0000","last_became_active":"2024-04-22T07:20:52.866996+0000","last_became_peered":"2024-04-22T07:20:52.866996+0000","last_unstale":"2024-04-22T07:20:54.862731+0000","last_undegraded":"2024-04-22T07:20:54.862731+0000","last_fullsized":"2024-04-22T07:20:54.862731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:08.286530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978392+0000","last_change":"2024-04-22T07:20:53.871576+0000","last_active":"2024-04-22T07:20:54.978392+0000","last_peered":"2024-04-22T07:20:54.978392+0000","last_clean":"2024-04-22T07:20:54.978392+0000","last_became_active":"2024-04-22T07:20:53.871239+0000","last_became_peered":"2024-04-22T07:20:53.871239+0000","last_unstale":"2024-04-22T07:20:54.978392+0000","last_undegraded":"2024-04-22T07:20:54.978392+0000","last_fullsized":"2024-04-22T07:20:54.978392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979845+0000","last_change":"2024-04-22T07:20:52.866974+0000","last_active":"2024-04-22T07:20:54.979845+0000","last_peered":"2024-04-22T07:20:54.979845+0000","last_clean":"2024-04-22T07:20:54.979845+0000","last_became_active":"2024-04-22T07:20:52.866581+0000","last_became_peered":"2024-04-22T07:20:52.866581+0000","last_unstale":"2024-04-22T07:20:54.979845+0000","last_undegraded":"2024-04-22T07:20:54.979845+0000","last_fullsized":"2024-04-22T07:20:54.979845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979503+0000","last_change":"2024-04-22T07:20:53.865035+0000","last_active":"2024-04-22T07:20:54.979503+0000","last_peered":"2024-04-22T07:20:54.979503+0000","last_clean":"2024-04-22T07:20:54.979503+0000","last_became_active":"2024-04-22T07:20:53.864523+0000","last_became_peered":"2024-04-22T07:20:53.864523+0000","last_unstale":"2024-04-22T07:20:54.979503+0000","last_undegraded":"2024-04-22T07:20:54.979503+0000","last_fullsized":"2024-04-22T07:20:54.979503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:13:12.303505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863169+0000","last_change":"2024-04-22T07:20:52.858498+0000","last_active":"2024-04-22T07:20:54.863169+0000","last_peered":"2024-04-22T07:20:54.863169+0000","last_clean":"2024-04-22T07:20:54.863169+0000","last_became_active":"2024-04-22T07:20:52.858139+0000","last_became_peered":"2024-04-22T07:20:52.858139+0000","last_unstale":"2024-04-22T07:20:54.863169+0000","last_undegraded":"2024-04-22T07:20:54.863169+0000","last_fullsized":"2024-04-22T07:20:54.863169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:45.382709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977943+0000","last_change":"2024-04-22T07:20:53.877595+0000","last_active":"2024-04-22T07:20:54.977943+0000","last_peered":"2024-04-22T07:20:54.977943+0000","last_clean":"2024-04-22T07:20:54.977943+0000","last_became_active":"2024-04-22T07:20:53.877208+0000","last_became_peered":"2024-04-22T07:20:53.877208+0000","last_unstale":"2024-04-22T07:20:54.977943+0000","last_undegraded":"2024-04-22T07:20:54.977943+0000","last_fullsized":"2024-04-22T07:20:54.977943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:46:50.322722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979001+0000","last_change":"2024-04-22T07:20:52.866224+0000","last_active":"2024-04-22T07:20:54.979001+0000","last_peered":"2024-04-22T07:20:54.979001+0000","last_clean":"2024-04-22T07:20:54.979001+0000","last_became_active":"2024-04-22T07:20:52.865903+0000","last_became_peered":"2024-04-22T07:20:52.865903+0000","last_unstale":"2024-04-22T07:20:54.979001+0000","last_undegraded":"2024-04-22T07:20:54.979001+0000","last_fullsized":"2024-04-22T07:20:54.979001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861395+0000","last_change":"2024-04-22T07:20:53.873266+0000","last_active":"2024-04-22T07:20:54.861395+0000","last_peered":"2024-04-22T07:20:54.861395+0000","last_clean":"2024-04-22T07:20:54.861395+0000","last_became_active":"2024-04-22T07:20:53.872915+0000","last_became_peered":"2024-04-22T07:20:53.872915+0000","last_unstale":"2024-04-22T07:20:54.861395+0000","last_undegraded":"2024-04-22T07:20:54.861395+0000","last_fullsized":"2024-04-22T07:20:54.861395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:09.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863471+0000","last_change":"2024-04-22T07:20:52.863593+0000","last_active":"2024-04-22T07:20:54.863471+0000","last_peered":"2024-04-22T07:20:54.863471+0000","last_clean":"2024-04-22T07:20:54.863471+0000","last_became_active":"2024-04-22T07:20:52.863296+0000","last_became_peered":"2024-04-22T07:20:52.863296+0000","last_unstale":"2024-04-22T07:20:54.863471+0000","last_undegraded":"2024-04-22T07:20:54.863471+0000","last_fullsized":"2024-04-22T07:20:54.863471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:22.261683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979540+0000","last_change":"2024-04-22T07:20:53.874491+0000","last_active":"2024-04-22T07:20:54.979540+0000","last_peered":"2024-04-22T07:20:54.979540+0000","last_clean":"2024-04-22T07:20:54.979540+0000","last_became_active":"2024-04-22T07:20:53.874202+0000","last_became_peered":"2024-04-22T07:20:53.874202+0000","last_unstale":"2024-04-22T07:20:54.979540+0000","last_undegraded":"2024-04-22T07:20:54.979540+0000","last_fullsized":"2024-04-22T07:20:54.979540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:23.268067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980655+0000","last_change":"2024-04-22T07:20:52.865905+0000","last_active":"2024-04-22T07:20:54.980655+0000","last_peered":"2024-04-22T07:20:54.980655+0000","last_clean":"2024-04-22T07:20:54.980655+0000","last_became_active":"2024-04-22T07:20:52.865566+0000","last_became_peered":"2024-04-22T07:20:52.865566+0000","last_unstale":"2024-04-22T07:20:54.980655+0000","last_undegraded":"2024-04-22T07:20:54.980655+0000","last_fullsized":"2024-04-22T07:20:54.980655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:38:31.271879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980566+0000","last_change":"2024-04-22T07:20:53.869951+0000","last_active":"2024-04-22T07:20:54.980566+0000","last_peered":"2024-04-22T07:20:54.980566+0000","last_clean":"2024-04-22T07:20:54.980566+0000","last_became_active":"2024-04-22T07:20:53.869613+0000","last_became_peered":"2024-04-22T07:20:53.869613+0000","last_unstale":"2024-04-22T07:20:54.980566+0000","last_undegraded":"2024-04-22T07:20:54.980566+0000","last_fullsized":"2024-04-22T07:20:54.980566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:14:09.372107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.867345+0000","last_change":"2024-04-22T07:20:52.864740+0000","last_active":"2024-04-22T07:20:58.867345+0000","last_peered":"2024-04-22T07:20:58.867345+0000","last_clean":"2024-04-22T07:20:58.867345+0000","last_became_active":"2024-04-22T07:20:52.864434+0000","last_became_peered":"2024-04-22T07:20:52.864434+0000","last_unstale":"2024-04-22T07:20:58.867345+0000","last_undegraded":"2024-04-22T07:20:58.867345+0000","last_fullsized":"2024-04-22T07:20:58.867345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:33.937176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980498+0000","last_change":"2024-04-22T07:20:53.871156+0000","last_active":"2024-04-22T07:20:54.980498+0000","last_peered":"2024-04-22T07:20:54.980498+0000","last_clean":"2024-04-22T07:20:54.980498+0000","last_became_active":"2024-04-22T07:20:53.870664+0000","last_became_peered":"2024-04-22T07:20:53.870664+0000","last_unstale":"2024-04-22T07:20:54.980498+0000","last_undegraded":"2024-04-22T07:20:54.980498+0000","last_fullsized":"2024-04-22T07:20:54.980498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:01:02.139458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977319+0000","last_change":"2024-04-22T07:20:52.854668+0000","last_active":"2024-04-22T07:20:54.977319+0000","last_peered":"2024-04-22T07:20:54.977319+0000","last_clean":"2024-04-22T07:20:54.977319+0000","last_became_active":"2024-04-22T07:20:52.854395+0000","last_became_peered":"2024-04-22T07:20:52.854395+0000","last_unstale":"2024-04-22T07:20:54.977319+0000","last_undegraded":"2024-04-22T07:20:54.977319+0000","last_fullsized":"2024-04-22T07:20:54.977319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:59:32.487127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862797+0000","last_change":"2024-04-22T07:20:53.870972+0000","last_active":"2024-04-22T07:20:54.862797+0000","last_peered":"2024-04-22T07:20:54.862797+0000","last_clean":"2024-04-22T07:20:54.862797+0000","last_became_active":"2024-04-22T07:20:53.870674+0000","last_became_peered":"2024-04-22T07:20:53.870674+0000","last_unstale":"2024-04-22T07:20:54.862797+0000","last_undegraded":"2024-04-22T07:20:54.862797+0000","last_fullsized":"2024-04-22T07:20:54.862797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:10.431906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980374+0000","last_change":"2024-04-22T07:20:52.866003+0000","last_active":"2024-04-22T07:20:54.980374+0000","last_peered":"2024-04-22T07:20:54.980374+0000","last_clean":"2024-04-22T07:20:54.980374+0000","last_became_active":"2024-04-22T07:20:52.865606+0000","last_became_peered":"2024-04-22T07:20:52.865606+0000","last_unstale":"2024-04-22T07:20:54.980374+0000","last_undegraded":"2024-04-22T07:20:54.980374+0000","last_fullsized":"2024-04-22T07:20:54.980374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:58:06.713204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978351+0000","last_change":"2024-04-22T07:20:53.870737+0000","last_active":"2024-04-22T07:20:54.978351+0000","last_peered":"2024-04-22T07:20:54.978351+0000","last_clean":"2024-04-22T07:20:54.978351+0000","last_became_active":"2024-04-22T07:20:53.870402+0000","last_became_peered":"2024-04-22T07:20:53.870402+0000","last_unstale":"2024-04-22T07:20:54.978351+0000","last_undegraded":"2024-04-22T07:20:54.978351+0000","last_fullsized":"2024-04-22T07:20:54.978351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:30:17.845591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979784+0000","last_change":"2024-04-22T07:20:52.861048+0000","last_active":"2024-04-22T07:20:54.979784+0000","last_peered":"2024-04-22T07:20:54.979784+0000","last_clean":"2024-04-22T07:20:54.979784+0000","last_became_active":"2024-04-22T07:20:52.860702+0000","last_became_peered":"2024-04-22T07:20:52.860702+0000","last_unstale":"2024-04-22T07:20:54.979784+0000","last_undegraded":"2024-04-22T07:20:54.979784+0000","last_fullsized":"2024-04-22T07:20:54.979784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979324+0000","last_change":"2024-04-22T07:20:53.868782+0000","last_active":"2024-04-22T07:20:54.979324+0000","last_peered":"2024-04-22T07:20:54.979324+0000","last_clean":"2024-04-22T07:20:54.979324+0000","last_became_active":"2024-04-22T07:20:53.868509+0000","last_became_peered":"2024-04-22T07:20:53.868509+0000","last_unstale":"2024-04-22T07:20:54.979324+0000","last_undegraded":"2024-04-22T07:20:54.979324+0000","last_fullsized":"2024-04-22T07:20:54.979324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:07.129692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.867515+0000","last_change":"2024-04-22T07:20:52.858508+0000","last_active":"2024-04-22T07:20:58.867515+0000","last_peered":"2024-04-22T07:20:58.867515+0000","last_clean":"2024-04-22T07:20:58.867515+0000","last_became_active":"2024-04-22T07:20:52.858215+0000","last_became_peered":"2024-04-22T07:20:52.858215+0000","last_unstale":"2024-04-22T07:20:58.867515+0000","last_undegraded":"2024-04-22T07:20:58.867515+0000","last_fullsized":"2024-04-22T07:20:58.867515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:26.618434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862971+0000","last_change":"2024-04-22T07:20:53.867977+0000","last_active":"2024-04-22T07:20:54.862971+0000","last_peered":"2024-04-22T07:20:54.862971+0000","last_clean":"2024-04-22T07:20:54.862971+0000","last_became_active":"2024-04-22T07:20:53.867447+0000","last_became_peered":"2024-04-22T07:20:53.867447+0000","last_unstale":"2024-04-22T07:20:54.862971+0000","last_undegraded":"2024-04-22T07:20:54.862971+0000","last_fullsized":"2024-04-22T07:20:54.862971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:48:52.934171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863377+0000","last_change":"2024-04-22T07:20:53.875681+0000","last_active":"2024-04-22T07:20:54.863377+0000","last_peered":"2024-04-22T07:20:54.863377+0000","last_clean":"2024-04-22T07:20:54.863377+0000","last_became_active":"2024-04-22T07:20:53.875305+0000","last_became_peered":"2024-04-22T07:20:53.875305+0000","last_unstale":"2024-04-22T07:20:54.863377+0000","last_undegraded":"2024-04-22T07:20:54.863377+0000","last_fullsized":"2024-04-22T07:20:54.863377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:22:34.452869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.866736+0000","last_change":"2024-04-22T07:20:52.857445+0000","last_active":"2024-04-22T07:20:58.866736+0000","last_peered":"2024-04-22T07:20:58.866736+0000","last_clean":"2024-04-22T07:20:58.866736+0000","last_became_active":"2024-04-22T07:20:52.856293+0000","last_became_peered":"2024-04-22T07:20:52.856293+0000","last_unstale":"2024-04-22T07:20:58.866736+0000","last_undegraded":"2024-04-22T07:20:58.866736+0000","last_fullsized":"2024-04-22T07:20:58.866736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:10.640191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862780+0000","last_change":"2024-04-22T07:20:53.870827+0000","last_active":"2024-04-22T07:20:54.862780+0000","last_peered":"2024-04-22T07:20:54.862780+0000","last_clean":"2024-04-22T07:20:54.862780+0000","last_became_active":"2024-04-22T07:20:53.870548+0000","last_became_peered":"2024-04-22T07:20:53.870548+0000","last_unstale":"2024-04-22T07:20:54.862780+0000","last_undegraded":"2024-04-22T07:20:54.862780+0000","last_fullsized":"2024-04-22T07:20:54.862780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:27.624819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.867037+0000","last_change":"2024-04-22T07:20:52.856933+0000","last_active":"2024-04-22T07:20:58.867037+0000","last_peered":"2024-04-22T07:20:58.867037+0000","last_clean":"2024-04-22T07:20:58.867037+0000","last_became_active":"2024-04-22T07:20:52.856617+0000","last_became_peered":"2024-04-22T07:20:52.856617+0000","last_unstale":"2024-04-22T07:20:58.867037+0000","last_undegraded":"2024-04-22T07:20:58.867037+0000","last_fullsized":"2024-04-22T07:20:58.867037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:08.286530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979619+0000","last_change":"2024-04-22T07:20:53.866552+0000","last_active":"2024-04-22T07:20:54.979619+0000","last_peered":"2024-04-22T07:20:54.979619+0000","last_clean":"2024-04-22T07:20:54.979619+0000","last_became_active":"2024-04-22T07:20:53.866286+0000","last_became_peered":"2024-04-22T07:20:53.866286+0000","last_unstale":"2024-04-22T07:20:54.979619+0000","last_undegraded":"2024-04-22T07:20:54.979619+0000","last_fullsized":"2024-04-22T07:20:54.979619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:45:15.519469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.787690+0000","last_change":"2024-04-22T07:20:52.863291+0000","last_active":"2024-04-22T07:20:55.787690+0000","last_peered":"2024-04-22T07:20:55.787690+0000","last_clean":"2024-04-22T07:20:55.787690+0000","last_became_active":"2024-04-22T07:20:52.862967+0000","last_became_peered":"2024-04-22T07:20:52.862967+0000","last_unstale":"2024-04-22T07:20:55.787690+0000","last_undegraded":"2024-04-22T07:20:55.787690+0000","last_fullsized":"2024-04-22T07:20:55.787690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:10.640191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980150+0000","last_change":"2024-04-22T07:20:53.871045+0000","last_active":"2024-04-22T07:20:54.980150+0000","last_peered":"2024-04-22T07:20:54.980150+0000","last_clean":"2024-04-22T07:20:54.980150+0000","last_became_active":"2024-04-22T07:20:53.870715+0000","last_became_peered":"2024-04-22T07:20:53.870715+0000","last_unstale":"2024-04-22T07:20:54.980150+0000","last_undegraded":"2024-04-22T07:20:54.980150+0000","last_fullsized":"2024-04-22T07:20:54.980150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.870910+0000","last_change":"2024-04-22T07:20:52.869553+0000","last_active":"2024-04-22T07:20:58.870910+0000","last_peered":"2024-04-22T07:20:58.870910+0000","last_clean":"2024-04-22T07:20:58.870910+0000","last_became_active":"2024-04-22T07:20:52.869300+0000","last_became_peered":"2024-04-22T07:20:52.869300+0000","last_unstale":"2024-04-22T07:20:58.870910+0000","last_undegraded":"2024-04-22T07:20:58.870910+0000","last_fullsized":"2024-04-22T07:20:58.870910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:27.709073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2666,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":81359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":835584,"data_stored":671695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":83103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":831488,"data_stored":671673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":81291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":253952,"data_stored":83519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T07:21:18.526 INFO:tasks.quiescer.ceph_manager:clean! 2024-04-22T07:21:18.526 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T07:21:18.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.666+0000 7f65dc7e0640 1 Processor -- start 2024-04-22T07:21:18.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.666+0000 7f65dc7e0640 1 -- start start 2024-04-22T07:21:18.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.667+0000 7f65dc7e0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f65d4154f50 0x7f65d40cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:18.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.667+0000 7f65dc7e0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f65d40cc5a0 0x7f65d40d0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:18.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.667+0000 7f65dc7e0640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65d415e6e0 con 0x7f65d40d0ad0 2024-04-22T07:21:18.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.667+0000 7f65dc7e0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f65d415af50 con 0x7f65d40cc5a0 2024-04-22T07:21:18.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.667+0000 7f65dc7e0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f65d415e9c0 con 0x7f65d4154f50 2024-04-22T07:21:18.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.667+0000 7f65d9d7b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f65d40cc5a0 0x7f65d40d0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:18.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.667+0000 7f65d9d7b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f65d40cc5a0 0x7f65d40d0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55904/0 (socket says 172.21.15.40:55904) 2024-04-22T07:21:18.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.667+0000 7f65d9d7b640 1 -- 172.21.15.40:0/569286659 learned_addr learned my addr 172.21.15.40:0/569286659 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:18.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.667+0000 7f65d9d7b640 1 -- 172.21.15.40:0/569286659 >> v2:172.21.15.62:3300/0 conn(0x7f65d4154f50 msgr2=0x7f65d40cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:18.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.667+0000 7f65d9d7b640 1 --2- 172.21.15.40:0/569286659 >> v2:172.21.15.62:3300/0 conn(0x7f65d4154f50 0x7f65d40cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:18.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.667+0000 7f65d9d7b640 1 -- 172.21.15.40:0/569286659 >> v1:172.21.15.62:6789/0 conn(0x7f65d40d0ad0 legacy=0x7f65d415b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:18.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.667+0000 7f65d9d7b640 1 -- 172.21.15.40:0/569286659 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d415eca0 con 0x7f65d40cc5a0 2024-04-22T07:21:18.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.668+0000 7f65d9d7b640 1 --2- 172.21.15.40:0/569286659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65d40cc5a0 0x7f65d40d0590 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f65d40d1320 tx=0x7f65c402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb61aa61c4a6aed server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:18.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.668+0000 7f65d957a640 1 -- 172.21.15.40:0/569286659 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c4034070 con 0x7f65d40cc5a0 2024-04-22T07:21:18.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.668+0000 7f65d957a640 1 -- 172.21.15.40:0/569286659 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c4030860 con 0x7f65d40cc5a0 2024-04-22T07:21:18.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.668+0000 7f65d957a640 1 -- 172.21.15.40:0/569286659 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c4030c30 con 0x7f65d40cc5a0 2024-04-22T07:21:18.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.669+0000 7f65dc7e0640 1 -- 172.21.15.40:0/569286659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65d40cc5a0 msgr2=0x7f65d40d0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:18.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.669+0000 7f65dc7e0640 1 --2- 172.21.15.40:0/569286659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65d40cc5a0 0x7f65d40d0590 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f65d40d1320 tx=0x7f65c402b9a0 comp rx=0 tx=0).stop 2024-04-22T07:21:18.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.669+0000 7f65dc7e0640 1 -- 172.21.15.40:0/569286659 shutdown_connections 2024-04-22T07:21:18.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.669+0000 7f65dc7e0640 1 --2- 172.21.15.40:0/569286659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65d40cc5a0 0x7f65d40d0590 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:18.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.669+0000 7f65dc7e0640 1 --2- 172.21.15.40:0/569286659 >> v2:172.21.15.62:3300/0 conn(0x7f65d4154f50 0x7f65d40cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:18.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.669+0000 7f65dc7e0640 1 -- 172.21.15.40:0/569286659 >> 172.21.15.40:0/569286659 conn(0x7f65d40676b0 msgr2=0x7f65d4067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:18.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.669+0000 7f65dc7e0640 1 -- 172.21.15.40:0/569286659 shutdown_connections 2024-04-22T07:21:18.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.669+0000 7f65dc7e0640 1 -- 172.21.15.40:0/569286659 wait complete. 2024-04-22T07:21:18.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.670+0000 7f65dc7e0640 1 Processor -- start 2024-04-22T07:21:18.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.670+0000 7f65dc7e0640 1 -- start start 2024-04-22T07:21:18.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.671+0000 7f65dc7e0640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65d40cc5a0 0x7f65d41f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:18.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.671+0000 7f65dc7e0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d40d0ad0 0x7f65d41e6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:18.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.671+0000 7f65dc7e0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65d4154f50 0x7f65d414f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:18.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.671+0000 7f65dc7e0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f65d415e3a0 con 0x7f65d4154f50 2024-04-22T07:21:18.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.671+0000 7f65dc7e0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f65d415f260 con 0x7f65d40d0ad0 2024-04-22T07:21:18.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.671+0000 7f65dc7e0640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f65d4155330 con 0x7f65d40cc5a0 2024-04-22T07:21:18.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.671+0000 7f65dad7d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65d4154f50 0x7f65d414f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:18.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.671+0000 7f65dad7d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65d4154f50 0x7f65d414f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55912/0 (socket says 172.21.15.40:55912) 2024-04-22T07:21:18.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.671+0000 7f65dad7d640 1 -- 172.21.15.40:0/1753537446 learned_addr learned my addr 172.21.15.40:0/1753537446 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:18.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.671+0000 7f65da57c640 1 --2- 172.21.15.40:0/1753537446 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65d40cc5a0 0x7f65d41f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:18.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.671+0000 7f65d9d7b640 1 --2- 172.21.15.40:0/1753537446 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d40d0ad0 0x7f65d41e6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:18.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.671+0000 7f65dad7d640 1 -- 172.21.15.40:0/1753537446 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65d40cc5a0 msgr2=0x7f65d41f5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:18.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.671+0000 7f65dad7d640 1 --2- 172.21.15.40:0/1753537446 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65d40cc5a0 0x7f65d41f5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:18.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.671+0000 7f65dad7d640 1 -- 172.21.15.40:0/1753537446 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d40d0ad0 msgr2=0x7f65d41e6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:18.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.671+0000 7f65dad7d640 1 --2- 172.21.15.40:0/1753537446 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d40d0ad0 0x7f65d41e6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:18.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.671+0000 7f65dad7d640 1 -- 172.21.15.40:0/1753537446 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d41f1180 con 0x7f65d4154f50 2024-04-22T07:21:18.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.671+0000 7f65dad7d640 1 --2- 172.21.15.40:0/1753537446 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65d4154f50 0x7f65d414f520 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f65cc00c7b0 tx=0x7f65cc00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:18.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.671+0000 7f65caffd640 1 -- 172.21.15.40:0/1753537446 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65cc017070 con 0x7f65d4154f50 2024-04-22T07:21:18.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.671+0000 7f65caffd640 1 -- 172.21.15.40:0/1753537446 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65cc003da0 con 0x7f65d4154f50 2024-04-22T07:21:18.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.671+0000 7f65dc7e0640 1 -- 172.21.15.40:0/1753537446 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65d41f1420 con 0x7f65d4154f50 2024-04-22T07:21:18.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.671+0000 7f65caffd640 1 -- 172.21.15.40:0/1753537446 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65cc00ce60 con 0x7f65d4154f50 2024-04-22T07:21:18.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.672+0000 7f65dc7e0640 1 -- 172.21.15.40:0/1753537446 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65d41f19e0 con 0x7f65d4154f50 2024-04-22T07:21:18.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.672+0000 7f65dc7e0640 1 -- 172.21.15.40:0/1753537446 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65d4069d40 con 0x7f65d4154f50 2024-04-22T07:21:18.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.673+0000 7f65caffd640 1 -- 172.21.15.40:0/1753537446 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f65cc01a070 con 0x7f65d4154f50 2024-04-22T07:21:18.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.673+0000 7f65caffd640 1 --2- 172.21.15.40:0/1753537446 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f65b806c920 0x7f65b806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:18.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.673+0000 7f65caffd640 1 -- 172.21.15.40:0/1753537446 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f65cc08b0f0 con 0x7f65d4154f50 2024-04-22T07:21:18.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.674+0000 7f65da57c640 1 --2- 172.21.15.40:0/1753537446 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f65b806c920 0x7f65b806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:18.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.674+0000 7f65da57c640 1 --2- 172.21.15.40:0/1753537446 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f65b806c920 0x7f65b806ede0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f65d00098e0 tx=0x7f65d0009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:18.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.678+0000 7f65caffd640 1 -- 172.21.15.40:0/1753537446 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f65cc058e40 con 0x7f65d4154f50 2024-04-22T07:21:18.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.859+0000 7f65dc7e0640 1 -- 172.21.15.40:0/1753537446 --> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f65d40d0880 con 0x7f65b806c920 2024-04-22T07:21:18.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.865+0000 7f65caffd640 1 -- 172.21.15.40:0/1753537446 <== mgr.4107 v2:172.21.15.40:6832/91163869 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7f65d40d0880 con 0x7f65b806c920 2024-04-22T07:21:18.865 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:21:18.866 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-22T07:21:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.868+0000 7f65dc7e0640 1 -- 172.21.15.40:0/1753537446 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f65b806c920 msgr2=0x7f65b806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.868+0000 7f65dc7e0640 1 --2- 172.21.15.40:0/1753537446 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f65b806c920 0x7f65b806ede0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f65d00098e0 tx=0x7f65d0009060 comp rx=0 tx=0).stop 2024-04-22T07:21:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.868+0000 7f65dc7e0640 1 -- 172.21.15.40:0/1753537446 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65d4154f50 msgr2=0x7f65d414f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.868+0000 7f65dc7e0640 1 --2- 172.21.15.40:0/1753537446 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65d4154f50 0x7f65d414f520 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f65cc00c7b0 tx=0x7f65cc00cc70 comp rx=0 tx=0).stop 2024-04-22T07:21:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.868+0000 7f65dc7e0640 1 -- 172.21.15.40:0/1753537446 shutdown_connections 2024-04-22T07:21:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.868+0000 7f65dc7e0640 1 --2- 172.21.15.40:0/1753537446 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f65b806c920 0x7f65b806ede0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.868+0000 7f65dc7e0640 1 --2- 172.21.15.40:0/1753537446 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65d4154f50 0x7f65d414f520 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.868+0000 7f65dc7e0640 1 --2- 172.21.15.40:0/1753537446 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65d40d0ad0 0x7f65d41e6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.868+0000 7f65dc7e0640 1 --2- 172.21.15.40:0/1753537446 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f65d40cc5a0 0x7f65d41f5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.868+0000 7f65dc7e0640 1 -- 172.21.15.40:0/1753537446 >> 172.21.15.40:0/1753537446 conn(0x7f65d40676b0 msgr2=0x7f65d40b4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:18.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.868+0000 7f65dc7e0640 1 -- 172.21.15.40:0/1753537446 shutdown_connections 2024-04-22T07:21:18.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:18.868+0000 7f65dc7e0640 1 -- 172.21.15.40:0/1753537446 wait complete. 2024-04-22T07:21:18.877 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-04-22T07:21:17.781653+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593034,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219180,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755540,"statfs":{"total":773094113280,"available":772869672960,"internally_reserved":0,"allocated":3121152,"data_stored":1835692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":256,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002520"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977886+0000","last_change":"2024-04-22T07:20:53.873662+0000","last_active":"2024-04-22T07:20:54.977886+0000","last_peered":"2024-04-22T07:20:54.977886+0000","last_clean":"2024-04-22T07:20:54.977886+0000","last_became_active":"2024-04-22T07:20:53.873384+0000","last_became_peered":"2024-04-22T07:20:53.873384+0000","last_unstale":"2024-04-22T07:20:54.977886+0000","last_undegraded":"2024-04-22T07:20:54.977886+0000","last_fullsized":"2024-04-22T07:20:54.977886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980006+0000","last_change":"2024-04-22T07:20:53.870454+0000","last_active":"2024-04-22T07:20:54.980006+0000","last_peered":"2024-04-22T07:20:54.980006+0000","last_clean":"2024-04-22T07:20:54.980006+0000","last_became_active":"2024-04-22T07:20:53.869964+0000","last_became_peered":"2024-04-22T07:20:53.869964+0000","last_unstale":"2024-04-22T07:20:54.980006+0000","last_undegraded":"2024-04-22T07:20:54.980006+0000","last_fullsized":"2024-04-22T07:20:54.980006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979125+0000","last_change":"2024-04-22T07:20:53.871145+0000","last_active":"2024-04-22T07:20:54.979125+0000","last_peered":"2024-04-22T07:20:54.979125+0000","last_clean":"2024-04-22T07:20:54.979125+0000","last_became_active":"2024-04-22T07:20:53.870819+0000","last_became_peered":"2024-04-22T07:20:53.870819+0000","last_unstale":"2024-04-22T07:20:54.979125+0000","last_undegraded":"2024-04-22T07:20:54.979125+0000","last_fullsized":"2024-04-22T07:20:54.979125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:02:16.373202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861622+0000","last_change":"2024-04-22T07:20:53.870458+0000","last_active":"2024-04-22T07:20:54.861622+0000","last_peered":"2024-04-22T07:20:54.861622+0000","last_clean":"2024-04-22T07:20:54.861622+0000","last_became_active":"2024-04-22T07:20:53.870125+0000","last_became_peered":"2024-04-22T07:20:53.870125+0000","last_unstale":"2024-04-22T07:20:54.861622+0000","last_undegraded":"2024-04-22T07:20:54.861622+0000","last_fullsized":"2024-04-22T07:20:54.861622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977801+0000","last_change":"2024-04-22T07:20:53.877301+0000","last_active":"2024-04-22T07:20:54.977801+0000","last_peered":"2024-04-22T07:20:54.977801+0000","last_clean":"2024-04-22T07:20:54.977801+0000","last_became_active":"2024-04-22T07:20:53.874941+0000","last_became_peered":"2024-04-22T07:20:53.874941+0000","last_unstale":"2024-04-22T07:20:54.977801+0000","last_undegraded":"2024-04-22T07:20:54.977801+0000","last_fullsized":"2024-04-22T07:20:54.977801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:52.686229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861484+0000","last_change":"2024-04-22T07:20:53.869735+0000","last_active":"2024-04-22T07:20:54.861484+0000","last_peered":"2024-04-22T07:20:54.861484+0000","last_clean":"2024-04-22T07:20:54.861484+0000","last_became_active":"2024-04-22T07:20:53.869369+0000","last_became_peered":"2024-04-22T07:20:53.869369+0000","last_unstale":"2024-04-22T07:20:54.861484+0000","last_undegraded":"2024-04-22T07:20:54.861484+0000","last_fullsized":"2024-04-22T07:20:54.861484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:27.624819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977494+0000","last_change":"2024-04-22T07:20:53.873492+0000","last_active":"2024-04-22T07:20:54.977494+0000","last_peered":"2024-04-22T07:20:54.977494+0000","last_clean":"2024-04-22T07:20:54.977494+0000","last_became_active":"2024-04-22T07:20:53.873220+0000","last_became_peered":"2024-04-22T07:20:53.873220+0000","last_unstale":"2024-04-22T07:20:54.977494+0000","last_undegraded":"2024-04-22T07:20:54.977494+0000","last_fullsized":"2024-04-22T07:20:54.977494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:35:26.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979018+0000","last_change":"2024-04-22T07:20:53.875847+0000","last_active":"2024-04-22T07:20:54.979018+0000","last_peered":"2024-04-22T07:20:54.979018+0000","last_clean":"2024-04-22T07:20:54.979018+0000","last_became_active":"2024-04-22T07:20:53.875017+0000","last_became_peered":"2024-04-22T07:20:53.875017+0000","last_unstale":"2024-04-22T07:20:54.979018+0000","last_undegraded":"2024-04-22T07:20:54.979018+0000","last_fullsized":"2024-04-22T07:20:54.979018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:07.080135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863086+0000","last_change":"2024-04-22T07:20:53.869174+0000","last_active":"2024-04-22T07:20:54.863086+0000","last_peered":"2024-04-22T07:20:54.863086+0000","last_clean":"2024-04-22T07:20:54.863086+0000","last_became_active":"2024-04-22T07:20:53.868906+0000","last_became_peered":"2024-04-22T07:20:53.868906+0000","last_unstale":"2024-04-22T07:20:54.863086+0000","last_undegraded":"2024-04-22T07:20:54.863086+0000","last_fullsized":"2024-04-22T07:20:54.863086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977893+0000","last_change":"2024-04-22T07:20:53.874933+0000","last_active":"2024-04-22T07:20:54.977893+0000","last_peered":"2024-04-22T07:20:54.977893+0000","last_clean":"2024-04-22T07:20:54.977893+0000","last_became_active":"2024-04-22T07:20:53.874673+0000","last_became_peered":"2024-04-22T07:20:53.874673+0000","last_unstale":"2024-04-22T07:20:54.977893+0000","last_undegraded":"2024-04-22T07:20:54.977893+0000","last_fullsized":"2024-04-22T07:20:54.977893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977684+0000","last_change":"2024-04-22T07:20:53.874909+0000","last_active":"2024-04-22T07:20:54.977684+0000","last_peered":"2024-04-22T07:20:54.977684+0000","last_clean":"2024-04-22T07:20:54.977684+0000","last_became_active":"2024-04-22T07:20:53.873945+0000","last_became_peered":"2024-04-22T07:20:53.873945+0000","last_unstale":"2024-04-22T07:20:54.977684+0000","last_undegraded":"2024-04-22T07:20:54.977684+0000","last_fullsized":"2024-04-22T07:20:54.977684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:53.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977652+0000","last_change":"2024-04-22T07:20:53.878344+0000","last_active":"2024-04-22T07:20:54.977652+0000","last_peered":"2024-04-22T07:20:54.977652+0000","last_clean":"2024-04-22T07:20:54.977652+0000","last_became_active":"2024-04-22T07:20:53.877192+0000","last_became_peered":"2024-04-22T07:20:53.877192+0000","last_unstale":"2024-04-22T07:20:54.977652+0000","last_undegraded":"2024-04-22T07:20:54.977652+0000","last_fullsized":"2024-04-22T07:20:54.977652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:42:03.637655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979583+0000","last_change":"2024-04-22T07:20:53.879419+0000","last_active":"2024-04-22T07:20:54.979583+0000","last_peered":"2024-04-22T07:20:54.979583+0000","last_clean":"2024-04-22T07:20:54.979583+0000","last_became_active":"2024-04-22T07:20:53.879070+0000","last_became_peered":"2024-04-22T07:20:53.879070+0000","last_unstale":"2024-04-22T07:20:54.979583+0000","last_undegraded":"2024-04-22T07:20:54.979583+0000","last_fullsized":"2024-04-22T07:20:54.979583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979592+0000","last_change":"2024-04-22T07:20:53.877395+0000","last_active":"2024-04-22T07:20:54.979592+0000","last_peered":"2024-04-22T07:20:54.979592+0000","last_clean":"2024-04-22T07:20:54.979592+0000","last_became_active":"2024-04-22T07:20:53.877116+0000","last_became_peered":"2024-04-22T07:20:53.877116+0000","last_unstale":"2024-04-22T07:20:54.979592+0000","last_undegraded":"2024-04-22T07:20:54.979592+0000","last_fullsized":"2024-04-22T07:20:54.979592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:21:25.001413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979310+0000","last_change":"2024-04-22T07:20:53.875156+0000","last_active":"2024-04-22T07:20:54.979310+0000","last_peered":"2024-04-22T07:20:54.979310+0000","last_clean":"2024-04-22T07:20:54.979310+0000","last_became_active":"2024-04-22T07:20:53.874468+0000","last_became_peered":"2024-04-22T07:20:53.874468+0000","last_unstale":"2024-04-22T07:20:54.979310+0000","last_undegraded":"2024-04-22T07:20:54.979310+0000","last_fullsized":"2024-04-22T07:20:54.979310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:42:03.637655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862585+0000","last_change":"2024-04-22T07:20:53.867178+0000","last_active":"2024-04-22T07:20:54.862585+0000","last_peered":"2024-04-22T07:20:54.862585+0000","last_clean":"2024-04-22T07:20:54.862585+0000","last_became_active":"2024-04-22T07:20:53.865491+0000","last_became_peered":"2024-04-22T07:20:53.865491+0000","last_unstale":"2024-04-22T07:20:54.862585+0000","last_undegraded":"2024-04-22T07:20:54.862585+0000","last_fullsized":"2024-04-22T07:20:54.862585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863583+0000","last_change":"2024-04-22T07:20:53.876797+0000","last_active":"2024-04-22T07:20:54.863583+0000","last_peered":"2024-04-22T07:20:54.863583+0000","last_clean":"2024-04-22T07:20:54.863583+0000","last_became_active":"2024-04-22T07:20:53.876321+0000","last_became_peered":"2024-04-22T07:20:53.876321+0000","last_unstale":"2024-04-22T07:20:54.863583+0000","last_undegraded":"2024-04-22T07:20:54.863583+0000","last_fullsized":"2024-04-22T07:20:54.863583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:22:45.699676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980360+0000","last_change":"2024-04-22T07:20:53.868760+0000","last_active":"2024-04-22T07:20:54.980360+0000","last_peered":"2024-04-22T07:20:54.980360+0000","last_clean":"2024-04-22T07:20:54.980360+0000","last_became_active":"2024-04-22T07:20:53.868441+0000","last_became_peered":"2024-04-22T07:20:53.868441+0000","last_unstale":"2024-04-22T07:20:54.980360+0000","last_undegraded":"2024-04-22T07:20:54.980360+0000","last_fullsized":"2024-04-22T07:20:54.980360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863503+0000","last_change":"2024-04-22T07:20:53.864806+0000","last_active":"2024-04-22T07:20:54.863503+0000","last_peered":"2024-04-22T07:20:54.863503+0000","last_clean":"2024-04-22T07:20:54.863503+0000","last_became_active":"2024-04-22T07:20:53.864535+0000","last_became_peered":"2024-04-22T07:20:53.864535+0000","last_unstale":"2024-04-22T07:20:54.863503+0000","last_undegraded":"2024-04-22T07:20:54.863503+0000","last_fullsized":"2024-04-22T07:20:54.863503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:22:07.227993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977721+0000","last_change":"2024-04-22T07:20:53.878013+0000","last_active":"2024-04-22T07:20:54.977721+0000","last_peered":"2024-04-22T07:20:54.977721+0000","last_clean":"2024-04-22T07:20:54.977721+0000","last_became_active":"2024-04-22T07:20:53.876641+0000","last_became_peered":"2024-04-22T07:20:53.876641+0000","last_unstale":"2024-04-22T07:20:54.977721+0000","last_undegraded":"2024-04-22T07:20:54.977721+0000","last_fullsized":"2024-04-22T07:20:54.977721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:45:15.519469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978885+0000","last_change":"2024-04-22T07:20:53.868319+0000","last_active":"2024-04-22T07:20:54.978885+0000","last_peered":"2024-04-22T07:20:54.978885+0000","last_clean":"2024-04-22T07:20:54.978885+0000","last_became_active":"2024-04-22T07:20:53.868014+0000","last_became_peered":"2024-04-22T07:20:53.868014+0000","last_unstale":"2024-04-22T07:20:54.978885+0000","last_undegraded":"2024-04-22T07:20:54.978885+0000","last_fullsized":"2024-04-22T07:20:54.978885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:09:27.178992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862823+0000","last_change":"2024-04-22T07:20:53.867684+0000","last_active":"2024-04-22T07:20:54.862823+0000","last_peered":"2024-04-22T07:20:54.862823+0000","last_clean":"2024-04-22T07:20:54.862823+0000","last_became_active":"2024-04-22T07:20:53.867403+0000","last_became_peered":"2024-04-22T07:20:53.867403+0000","last_unstale":"2024-04-22T07:20:54.862823+0000","last_undegraded":"2024-04-22T07:20:54.862823+0000","last_fullsized":"2024-04-22T07:20:54.862823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979253+0000","last_change":"2024-04-22T07:20:53.869595+0000","last_active":"2024-04-22T07:20:54.979253+0000","last_peered":"2024-04-22T07:20:54.979253+0000","last_clean":"2024-04-22T07:20:54.979253+0000","last_became_active":"2024-04-22T07:20:53.868519+0000","last_became_peered":"2024-04-22T07:20:53.868519+0000","last_unstale":"2024-04-22T07:20:54.979253+0000","last_undegraded":"2024-04-22T07:20:54.979253+0000","last_fullsized":"2024-04-22T07:20:54.979253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:35:26.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862610+0000","last_change":"2024-04-22T07:20:53.865275+0000","last_active":"2024-04-22T07:20:54.862610+0000","last_peered":"2024-04-22T07:20:54.862610+0000","last_clean":"2024-04-22T07:20:54.862610+0000","last_became_active":"2024-04-22T07:20:53.865026+0000","last_became_peered":"2024-04-22T07:20:53.865026+0000","last_unstale":"2024-04-22T07:20:54.862610+0000","last_undegraded":"2024-04-22T07:20:54.862610+0000","last_fullsized":"2024-04-22T07:20:54.862610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:48:40.630407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979451+0000","last_change":"2024-04-22T07:20:53.873457+0000","last_active":"2024-04-22T07:20:54.979451+0000","last_peered":"2024-04-22T07:20:54.979451+0000","last_clean":"2024-04-22T07:20:54.979451+0000","last_became_active":"2024-04-22T07:20:53.873147+0000","last_became_peered":"2024-04-22T07:20:53.873147+0000","last_unstale":"2024-04-22T07:20:54.979451+0000","last_undegraded":"2024-04-22T07:20:54.979451+0000","last_fullsized":"2024-04-22T07:20:54.979451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:53.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861933+0000","last_change":"2024-04-22T07:20:53.865327+0000","last_active":"2024-04-22T07:20:54.861933+0000","last_peered":"2024-04-22T07:20:54.861933+0000","last_clean":"2024-04-22T07:20:54.861933+0000","last_became_active":"2024-04-22T07:20:53.865030+0000","last_became_peered":"2024-04-22T07:20:53.865030+0000","last_unstale":"2024-04-22T07:20:54.861933+0000","last_undegraded":"2024-04-22T07:20:54.861933+0000","last_fullsized":"2024-04-22T07:20:54.861933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979550+0000","last_change":"2024-04-22T07:20:53.876792+0000","last_active":"2024-04-22T07:20:54.979550+0000","last_peered":"2024-04-22T07:20:54.979550+0000","last_clean":"2024-04-22T07:20:54.979550+0000","last_became_active":"2024-04-22T07:20:53.876446+0000","last_became_peered":"2024-04-22T07:20:53.876446+0000","last_unstale":"2024-04-22T07:20:54.979550+0000","last_undegraded":"2024-04-22T07:20:54.979550+0000","last_fullsized":"2024-04-22T07:20:54.979550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:34.943561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979292+0000","last_change":"2024-04-22T07:20:53.878147+0000","last_active":"2024-04-22T07:20:54.979292+0000","last_peered":"2024-04-22T07:20:54.979292+0000","last_clean":"2024-04-22T07:20:54.979292+0000","last_became_active":"2024-04-22T07:20:53.877867+0000","last_became_peered":"2024-04-22T07:20:53.877867+0000","last_unstale":"2024-04-22T07:20:54.979292+0000","last_undegraded":"2024-04-22T07:20:54.979292+0000","last_fullsized":"2024-04-22T07:20:54.979292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979201+0000","last_change":"2024-04-22T07:20:53.872447+0000","last_active":"2024-04-22T07:20:54.979201+0000","last_peered":"2024-04-22T07:20:54.979201+0000","last_clean":"2024-04-22T07:20:54.979201+0000","last_became_active":"2024-04-22T07:20:53.871862+0000","last_became_peered":"2024-04-22T07:20:53.871862+0000","last_unstale":"2024-04-22T07:20:54.979201+0000","last_undegraded":"2024-04-22T07:20:54.979201+0000","last_fullsized":"2024-04-22T07:20:54.979201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:08:33.063318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862747+0000","last_change":"2024-04-22T07:20:53.862483+0000","last_active":"2024-04-22T07:20:54.862747+0000","last_peered":"2024-04-22T07:20:54.862747+0000","last_clean":"2024-04-22T07:20:54.862747+0000","last_became_active":"2024-04-22T07:20:53.862199+0000","last_became_peered":"2024-04-22T07:20:53.862199+0000","last_unstale":"2024-04-22T07:20:54.862747+0000","last_undegraded":"2024-04-22T07:20:54.862747+0000","last_fullsized":"2024-04-22T07:20:54.862747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:10:12.276510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979743+0000","last_change":"2024-04-22T07:20:53.872507+0000","last_active":"2024-04-22T07:20:54.979743+0000","last_peered":"2024-04-22T07:20:54.979743+0000","last_clean":"2024-04-22T07:20:54.979743+0000","last_became_active":"2024-04-22T07:20:53.872199+0000","last_became_peered":"2024-04-22T07:20:53.872199+0000","last_unstale":"2024-04-22T07:20:54.979743+0000","last_undegraded":"2024-04-22T07:20:54.979743+0000","last_fullsized":"2024-04-22T07:20:54.979743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:09.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861399+0000","last_change":"2024-04-22T07:20:53.863946+0000","last_active":"2024-04-22T07:20:54.861399+0000","last_peered":"2024-04-22T07:20:54.861399+0000","last_clean":"2024-04-22T07:20:54.861399+0000","last_became_active":"2024-04-22T07:20:53.863688+0000","last_became_peered":"2024-04-22T07:20:53.863688+0000","last_unstale":"2024-04-22T07:20:54.861399+0000","last_undegraded":"2024-04-22T07:20:54.861399+0000","last_fullsized":"2024-04-22T07:20:54.861399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862947+0000","last_change":"2024-04-22T07:20:53.874785+0000","last_active":"2024-04-22T07:20:54.862947+0000","last_peered":"2024-04-22T07:20:54.862947+0000","last_clean":"2024-04-22T07:20:54.862947+0000","last_became_active":"2024-04-22T07:20:53.874524+0000","last_became_peered":"2024-04-22T07:20:53.874524+0000","last_unstale":"2024-04-22T07:20:54.862947+0000","last_undegraded":"2024-04-22T07:20:54.862947+0000","last_fullsized":"2024-04-22T07:20:54.862947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.787613+0000","last_change":"2024-04-22T07:20:52.860712+0000","last_active":"2024-04-22T07:20:55.787613+0000","last_peered":"2024-04-22T07:20:55.787613+0000","last_clean":"2024-04-22T07:20:55.787613+0000","last_became_active":"2024-04-22T07:20:52.860015+0000","last_became_peered":"2024-04-22T07:20:52.860015+0000","last_unstale":"2024-04-22T07:20:55.787613+0000","last_undegraded":"2024-04-22T07:20:55.787613+0000","last_fullsized":"2024-04-22T07:20:55.787613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:59:32.487127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980495+0000","last_change":"2024-04-22T07:20:53.879570+0000","last_active":"2024-04-22T07:20:54.980495+0000","last_peered":"2024-04-22T07:20:54.980495+0000","last_clean":"2024-04-22T07:20:54.980495+0000","last_became_active":"2024-04-22T07:20:53.879191+0000","last_became_peered":"2024-04-22T07:20:53.879191+0000","last_unstale":"2024-04-22T07:20:54.980495+0000","last_undegraded":"2024-04-22T07:20:54.980495+0000","last_fullsized":"2024-04-22T07:20:54.980495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:34:52.306691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.787136+0000","last_change":"2024-04-22T07:20:52.862510+0000","last_active":"2024-04-22T07:20:55.787136+0000","last_peered":"2024-04-22T07:20:55.787136+0000","last_clean":"2024-04-22T07:20:55.787136+0000","last_became_active":"2024-04-22T07:20:52.862228+0000","last_became_peered":"2024-04-22T07:20:52.862228+0000","last_unstale":"2024-04-22T07:20:55.787136+0000","last_undegraded":"2024-04-22T07:20:55.787136+0000","last_fullsized":"2024-04-22T07:20:55.787136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:51.683021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979012+0000","last_change":"2024-04-22T07:20:52.856651+0000","last_active":"2024-04-22T07:20:54.979012+0000","last_peered":"2024-04-22T07:20:54.979012+0000","last_clean":"2024-04-22T07:20:54.979012+0000","last_became_active":"2024-04-22T07:20:52.856096+0000","last_became_peered":"2024-04-22T07:20:52.856096+0000","last_unstale":"2024-04-22T07:20:54.979012+0000","last_undegraded":"2024-04-22T07:20:54.979012+0000","last_fullsized":"2024-04-22T07:20:54.979012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:04.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979658+0000","last_change":"2024-04-22T07:20:53.873708+0000","last_active":"2024-04-22T07:20:54.979658+0000","last_peered":"2024-04-22T07:20:54.979658+0000","last_clean":"2024-04-22T07:20:54.979658+0000","last_became_active":"2024-04-22T07:20:53.872793+0000","last_became_peered":"2024-04-22T07:20:53.872793+0000","last_unstale":"2024-04-22T07:20:54.979658+0000","last_undegraded":"2024-04-22T07:20:54.979658+0000","last_fullsized":"2024-04-22T07:20:54.979658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:52.686229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862729+0000","last_change":"2024-04-22T07:20:52.861133+0000","last_active":"2024-04-22T07:20:54.862729+0000","last_peered":"2024-04-22T07:20:54.862729+0000","last_clean":"2024-04-22T07:20:54.862729+0000","last_became_active":"2024-04-22T07:20:52.860736+0000","last_became_peered":"2024-04-22T07:20:52.860736+0000","last_unstale":"2024-04-22T07:20:54.862729+0000","last_undegraded":"2024-04-22T07:20:54.862729+0000","last_fullsized":"2024-04-22T07:20:54.862729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:06.123308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980308+0000","last_change":"2024-04-22T07:20:53.867477+0000","last_active":"2024-04-22T07:20:54.980308+0000","last_peered":"2024-04-22T07:20:54.980308+0000","last_clean":"2024-04-22T07:20:54.980308+0000","last_became_active":"2024-04-22T07:20:53.867086+0000","last_became_peered":"2024-04-22T07:20:53.867086+0000","last_unstale":"2024-04-22T07:20:54.980308+0000","last_undegraded":"2024-04-22T07:20:54.980308+0000","last_fullsized":"2024-04-22T07:20:54.980308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:56:55.644168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863067+0000","last_change":"2024-04-22T07:20:52.863567+0000","last_active":"2024-04-22T07:20:54.863067+0000","last_peered":"2024-04-22T07:20:54.863067+0000","last_clean":"2024-04-22T07:20:54.863067+0000","last_became_active":"2024-04-22T07:20:52.863285+0000","last_became_peered":"2024-04-22T07:20:52.863285+0000","last_unstale":"2024-04-22T07:20:54.863067+0000","last_undegraded":"2024-04-22T07:20:54.863067+0000","last_fullsized":"2024-04-22T07:20:54.863067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861976+0000","last_change":"2024-04-22T07:20:53.864955+0000","last_active":"2024-04-22T07:20:54.861976+0000","last_peered":"2024-04-22T07:20:54.861976+0000","last_clean":"2024-04-22T07:20:54.861976+0000","last_became_active":"2024-04-22T07:20:53.864694+0000","last_became_peered":"2024-04-22T07:20:53.864694+0000","last_unstale":"2024-04-22T07:20:54.861976+0000","last_undegraded":"2024-04-22T07:20:54.861976+0000","last_fullsized":"2024-04-22T07:20:54.861976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977898+0000","last_change":"2024-04-22T07:20:52.858761+0000","last_active":"2024-04-22T07:20:54.977898+0000","last_peered":"2024-04-22T07:20:54.977898+0000","last_clean":"2024-04-22T07:20:54.977898+0000","last_became_active":"2024-04-22T07:20:52.856815+0000","last_became_peered":"2024-04-22T07:20:52.856815+0000","last_unstale":"2024-04-22T07:20:54.977898+0000","last_undegraded":"2024-04-22T07:20:54.977898+0000","last_fullsized":"2024-04-22T07:20:54.977898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:06.123308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979798+0000","last_change":"2024-04-22T07:20:53.867290+0000","last_active":"2024-04-22T07:20:54.979798+0000","last_peered":"2024-04-22T07:20:54.979798+0000","last_clean":"2024-04-22T07:20:54.979798+0000","last_became_active":"2024-04-22T07:20:53.866955+0000","last_became_peered":"2024-04-22T07:20:53.866955+0000","last_unstale":"2024-04-22T07:20:54.979798+0000","last_undegraded":"2024-04-22T07:20:54.979798+0000","last_fullsized":"2024-04-22T07:20:54.979798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:43.442316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.870244+0000","last_change":"2024-04-22T07:20:52.863670+0000","last_active":"2024-04-22T07:20:58.870244+0000","last_peered":"2024-04-22T07:20:58.870244+0000","last_clean":"2024-04-22T07:20:58.870244+0000","last_became_active":"2024-04-22T07:20:52.863320+0000","last_became_peered":"2024-04-22T07:20:52.863320+0000","last_unstale":"2024-04-22T07:20:58.870244+0000","last_undegraded":"2024-04-22T07:20:58.870244+0000","last_fullsized":"2024-04-22T07:20:58.870244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:04.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862589+0000","last_change":"2024-04-22T07:20:53.868286+0000","last_active":"2024-04-22T07:20:54.862589+0000","last_peered":"2024-04-22T07:20:54.862589+0000","last_clean":"2024-04-22T07:20:54.862589+0000","last_became_active":"2024-04-22T07:20:53.862811+0000","last_became_peered":"2024-04-22T07:20:53.862811+0000","last_unstale":"2024-04-22T07:20:54.862589+0000","last_undegraded":"2024-04-22T07:20:54.862589+0000","last_fullsized":"2024-04-22T07:20:54.862589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"23'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:21:14.945657+0000","last_change":"2024-04-22T07:20:52.863638+0000","last_active":"2024-04-22T07:21:14.945657+0000","last_peered":"2024-04-22T07:21:14.945657+0000","last_clean":"2024-04-22T07:21:14.945657+0000","last_became_active":"2024-04-22T07:20:52.863244+0000","last_became_peered":"2024-04-22T07:20:52.863244+0000","last_unstale":"2024-04-22T07:21:14.945657+0000","last_undegraded":"2024-04-22T07:21:14.945657+0000","last_fullsized":"2024-04-22T07:21:14.945657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:36:49.017537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1868,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977713+0000","last_change":"2024-04-22T07:20:53.875162+0000","last_active":"2024-04-22T07:20:54.977713+0000","last_peered":"2024-04-22T07:20:54.977713+0000","last_clean":"2024-04-22T07:20:54.977713+0000","last_became_active":"2024-04-22T07:20:53.874612+0000","last_became_peered":"2024-04-22T07:20:53.874612+0000","last_unstale":"2024-04-22T07:20:54.977713+0000","last_undegraded":"2024-04-22T07:20:54.977713+0000","last_fullsized":"2024-04-22T07:20:54.977713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:13:12.303505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.869961+0000","last_change":"2024-04-22T07:20:52.855194+0000","last_active":"2024-04-22T07:20:58.869961+0000","last_peered":"2024-04-22T07:20:58.869961+0000","last_clean":"2024-04-22T07:20:58.869961+0000","last_became_active":"2024-04-22T07:20:52.854915+0000","last_became_peered":"2024-04-22T07:20:52.854915+0000","last_unstale":"2024-04-22T07:20:58.869961+0000","last_undegraded":"2024-04-22T07:20:58.869961+0000","last_fullsized":"2024-04-22T07:20:58.869961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979725+0000","last_change":"2024-04-22T07:20:53.868695+0000","last_active":"2024-04-22T07:20:54.979725+0000","last_peered":"2024-04-22T07:20:54.979725+0000","last_clean":"2024-04-22T07:20:54.979725+0000","last_became_active":"2024-04-22T07:20:53.868400+0000","last_became_peered":"2024-04-22T07:20:53.868400+0000","last_unstale":"2024-04-22T07:20:54.979725+0000","last_undegraded":"2024-04-22T07:20:54.979725+0000","last_fullsized":"2024-04-22T07:20:54.979725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:30:23.352871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863163+0000","last_change":"2024-04-22T07:20:52.861884+0000","last_active":"2024-04-22T07:20:54.863163+0000","last_peered":"2024-04-22T07:20:54.863163+0000","last_clean":"2024-04-22T07:20:54.863163+0000","last_became_active":"2024-04-22T07:20:52.861546+0000","last_became_peered":"2024-04-22T07:20:52.861546+0000","last_unstale":"2024-04-22T07:20:54.863163+0000","last_undegraded":"2024-04-22T07:20:54.863163+0000","last_fullsized":"2024-04-22T07:20:54.863163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:37.283262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862882+0000","last_change":"2024-04-22T07:20:53.863071+0000","last_active":"2024-04-22T07:20:54.862882+0000","last_peered":"2024-04-22T07:20:54.862882+0000","last_clean":"2024-04-22T07:20:54.862882+0000","last_became_active":"2024-04-22T07:20:53.862763+0000","last_became_peered":"2024-04-22T07:20:53.862763+0000","last_unstale":"2024-04-22T07:20:54.862882+0000","last_undegraded":"2024-04-22T07:20:54.862882+0000","last_fullsized":"2024-04-22T07:20:54.862882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:19:57.432323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977415+0000","last_change":"2024-04-22T07:20:52.865285+0000","last_active":"2024-04-22T07:20:54.977415+0000","last_peered":"2024-04-22T07:20:54.977415+0000","last_clean":"2024-04-22T07:20:54.977415+0000","last_became_active":"2024-04-22T07:20:52.864725+0000","last_became_peered":"2024-04-22T07:20:52.864725+0000","last_unstale":"2024-04-22T07:20:54.977415+0000","last_undegraded":"2024-04-22T07:20:54.977415+0000","last_fullsized":"2024-04-22T07:20:54.977415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:23:28.850031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862533+0000","last_change":"2024-04-22T07:20:53.875479+0000","last_active":"2024-04-22T07:20:54.862533+0000","last_peered":"2024-04-22T07:20:54.862533+0000","last_clean":"2024-04-22T07:20:54.862533+0000","last_became_active":"2024-04-22T07:20:53.874567+0000","last_became_peered":"2024-04-22T07:20:53.874567+0000","last_unstale":"2024-04-22T07:20:54.862533+0000","last_undegraded":"2024-04-22T07:20:54.862533+0000","last_fullsized":"2024-04-22T07:20:54.862533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.871647+0000","last_change":"2024-04-22T07:20:52.860646+0000","last_active":"2024-04-22T07:20:58.871647+0000","last_peered":"2024-04-22T07:20:58.871647+0000","last_clean":"2024-04-22T07:20:58.871647+0000","last_became_active":"2024-04-22T07:20:52.860347+0000","last_became_peered":"2024-04-22T07:20:52.860347+0000","last_unstale":"2024-04-22T07:20:58.871647+0000","last_undegraded":"2024-04-22T07:20:58.871647+0000","last_fullsized":"2024-04-22T07:20:58.871647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:53:20.912264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862635+0000","last_change":"2024-04-22T07:20:53.859641+0000","last_active":"2024-04-22T07:20:54.862635+0000","last_peered":"2024-04-22T07:20:54.862635+0000","last_clean":"2024-04-22T07:20:54.862635+0000","last_became_active":"2024-04-22T07:20:53.859365+0000","last_became_peered":"2024-04-22T07:20:53.859365+0000","last_unstale":"2024-04-22T07:20:54.862635+0000","last_undegraded":"2024-04-22T07:20:54.862635+0000","last_fullsized":"2024-04-22T07:20:54.862635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:46:50.322722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.788730+0000","last_change":"2024-04-22T07:20:52.866960+0000","last_active":"2024-04-22T07:20:55.788730+0000","last_peered":"2024-04-22T07:20:55.788730+0000","last_clean":"2024-04-22T07:20:55.788730+0000","last_became_active":"2024-04-22T07:20:52.866654+0000","last_became_peered":"2024-04-22T07:20:52.866654+0000","last_unstale":"2024-04-22T07:20:55.788730+0000","last_undegraded":"2024-04-22T07:20:55.788730+0000","last_fullsized":"2024-04-22T07:20:55.788730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:51.683021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862087+0000","last_change":"2024-04-22T07:20:53.874775+0000","last_active":"2024-04-22T07:20:54.862087+0000","last_peered":"2024-04-22T07:20:54.862087+0000","last_clean":"2024-04-22T07:20:54.862087+0000","last_became_active":"2024-04-22T07:20:53.874499+0000","last_became_peered":"2024-04-22T07:20:53.874499+0000","last_unstale":"2024-04-22T07:20:54.862087+0000","last_undegraded":"2024-04-22T07:20:54.862087+0000","last_fullsized":"2024-04-22T07:20:54.862087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:23.268067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.871021+0000","last_change":"2024-04-22T07:20:52.867201+0000","last_active":"2024-04-22T07:20:58.871021+0000","last_peered":"2024-04-22T07:20:58.871021+0000","last_clean":"2024-04-22T07:20:58.871021+0000","last_became_active":"2024-04-22T07:20:52.866627+0000","last_became_peered":"2024-04-22T07:20:52.866627+0000","last_unstale":"2024-04-22T07:20:58.871021+0000","last_undegraded":"2024-04-22T07:20:58.871021+0000","last_fullsized":"2024-04-22T07:20:58.871021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:09:08.908298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977901+0000","last_change":"2024-04-22T07:20:53.871645+0000","last_active":"2024-04-22T07:20:54.977901+0000","last_peered":"2024-04-22T07:20:54.977901+0000","last_clean":"2024-04-22T07:20:54.977901+0000","last_became_active":"2024-04-22T07:20:53.871353+0000","last_became_peered":"2024-04-22T07:20:53.871353+0000","last_unstale":"2024-04-22T07:20:54.977901+0000","last_undegraded":"2024-04-22T07:20:54.977901+0000","last_fullsized":"2024-04-22T07:20:54.977901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:48:40.630407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.787667+0000","last_change":"2024-04-22T07:20:52.866996+0000","last_active":"2024-04-22T07:20:55.787667+0000","last_peered":"2024-04-22T07:20:55.787667+0000","last_clean":"2024-04-22T07:20:55.787667+0000","last_became_active":"2024-04-22T07:20:52.866677+0000","last_became_peered":"2024-04-22T07:20:52.866677+0000","last_unstale":"2024-04-22T07:20:55.787667+0000","last_undegraded":"2024-04-22T07:20:55.787667+0000","last_fullsized":"2024-04-22T07:20:55.787667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977832+0000","last_change":"2024-04-22T07:20:53.871064+0000","last_active":"2024-04-22T07:20:54.977832+0000","last_peered":"2024-04-22T07:20:54.977832+0000","last_clean":"2024-04-22T07:20:54.977832+0000","last_became_active":"2024-04-22T07:20:53.866968+0000","last_became_peered":"2024-04-22T07:20:53.866968+0000","last_unstale":"2024-04-22T07:20:54.977832+0000","last_undegraded":"2024-04-22T07:20:54.977832+0000","last_fullsized":"2024-04-22T07:20:54.977832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:43.442316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979659+0000","last_change":"2024-04-22T07:20:52.856958+0000","last_active":"2024-04-22T07:20:54.979659+0000","last_peered":"2024-04-22T07:20:54.979659+0000","last_clean":"2024-04-22T07:20:54.979659+0000","last_became_active":"2024-04-22T07:20:52.856289+0000","last_became_peered":"2024-04-22T07:20:52.856289+0000","last_unstale":"2024-04-22T07:20:54.979659+0000","last_undegraded":"2024-04-22T07:20:54.979659+0000","last_fullsized":"2024-04-22T07:20:54.979659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863352+0000","last_change":"2024-04-22T07:20:53.872915+0000","last_active":"2024-04-22T07:20:54.863352+0000","last_peered":"2024-04-22T07:20:54.863352+0000","last_clean":"2024-04-22T07:20:54.863352+0000","last_became_active":"2024-04-22T07:20:53.872005+0000","last_became_peered":"2024-04-22T07:20:53.872005+0000","last_unstale":"2024-04-22T07:20:54.863352+0000","last_undegraded":"2024-04-22T07:20:54.863352+0000","last_fullsized":"2024-04-22T07:20:54.863352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:53:29.242632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862549+0000","last_change":"2024-04-22T07:20:43.747396+0000","last_active":"2024-04-22T07:20:54.862549+0000","last_peered":"2024-04-22T07:20:54.862549+0000","last_clean":"2024-04-22T07:20:54.862549+0000","last_became_active":"2024-04-22T07:20:43.746332+0000","last_became_peered":"2024-04-22T07:20:43.746332+0000","last_unstale":"2024-04-22T07:20:54.862549+0000","last_undegraded":"2024-04-22T07:20:54.862549+0000","last_fullsized":"2024-04-22T07:20:54.862549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:42.732916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:42.732916+0000","last_clean_scrub_stamp":"2024-04-22T07:20:42.732916+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:02:55.086445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863049+0000","last_change":"2024-04-22T07:20:52.862492+0000","last_active":"2024-04-22T07:20:54.863049+0000","last_peered":"2024-04-22T07:20:54.863049+0000","last_clean":"2024-04-22T07:20:54.863049+0000","last_became_active":"2024-04-22T07:20:52.862201+0000","last_became_peered":"2024-04-22T07:20:52.862201+0000","last_unstale":"2024-04-22T07:20:54.863049+0000","last_undegraded":"2024-04-22T07:20:54.863049+0000","last_fullsized":"2024-04-22T07:20:54.863049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:52.015227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979807+0000","last_change":"2024-04-22T07:20:53.868797+0000","last_active":"2024-04-22T07:20:54.979807+0000","last_peered":"2024-04-22T07:20:54.979807+0000","last_clean":"2024-04-22T07:20:54.979807+0000","last_became_active":"2024-04-22T07:20:53.868335+0000","last_became_peered":"2024-04-22T07:20:53.868335+0000","last_unstale":"2024-04-22T07:20:54.979807+0000","last_undegraded":"2024-04-22T07:20:54.979807+0000","last_fullsized":"2024-04-22T07:20:54.979807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:43:02.116289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862731+0000","last_change":"2024-04-22T07:20:52.867622+0000","last_active":"2024-04-22T07:20:54.862731+0000","last_peered":"2024-04-22T07:20:54.862731+0000","last_clean":"2024-04-22T07:20:54.862731+0000","last_became_active":"2024-04-22T07:20:52.866996+0000","last_became_peered":"2024-04-22T07:20:52.866996+0000","last_unstale":"2024-04-22T07:20:54.862731+0000","last_undegraded":"2024-04-22T07:20:54.862731+0000","last_fullsized":"2024-04-22T07:20:54.862731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:08.286530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978392+0000","last_change":"2024-04-22T07:20:53.871576+0000","last_active":"2024-04-22T07:20:54.978392+0000","last_peered":"2024-04-22T07:20:54.978392+0000","last_clean":"2024-04-22T07:20:54.978392+0000","last_became_active":"2024-04-22T07:20:53.871239+0000","last_became_peered":"2024-04-22T07:20:53.871239+0000","last_unstale":"2024-04-22T07:20:54.978392+0000","last_undegraded":"2024-04-22T07:20:54.978392+0000","last_fullsized":"2024-04-22T07:20:54.978392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979845+0000","last_change":"2024-04-22T07:20:52.866974+0000","last_active":"2024-04-22T07:20:54.979845+0000","last_peered":"2024-04-22T07:20:54.979845+0000","last_clean":"2024-04-22T07:20:54.979845+0000","last_became_active":"2024-04-22T07:20:52.866581+0000","last_became_peered":"2024-04-22T07:20:52.866581+0000","last_unstale":"2024-04-22T07:20:54.979845+0000","last_undegraded":"2024-04-22T07:20:54.979845+0000","last_fullsized":"2024-04-22T07:20:54.979845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979503+0000","last_change":"2024-04-22T07:20:53.865035+0000","last_active":"2024-04-22T07:20:54.979503+0000","last_peered":"2024-04-22T07:20:54.979503+0000","last_clean":"2024-04-22T07:20:54.979503+0000","last_became_active":"2024-04-22T07:20:53.864523+0000","last_became_peered":"2024-04-22T07:20:53.864523+0000","last_unstale":"2024-04-22T07:20:54.979503+0000","last_undegraded":"2024-04-22T07:20:54.979503+0000","last_fullsized":"2024-04-22T07:20:54.979503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:13:12.303505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863169+0000","last_change":"2024-04-22T07:20:52.858498+0000","last_active":"2024-04-22T07:20:54.863169+0000","last_peered":"2024-04-22T07:20:54.863169+0000","last_clean":"2024-04-22T07:20:54.863169+0000","last_became_active":"2024-04-22T07:20:52.858139+0000","last_became_peered":"2024-04-22T07:20:52.858139+0000","last_unstale":"2024-04-22T07:20:54.863169+0000","last_undegraded":"2024-04-22T07:20:54.863169+0000","last_fullsized":"2024-04-22T07:20:54.863169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:45.382709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977943+0000","last_change":"2024-04-22T07:20:53.877595+0000","last_active":"2024-04-22T07:20:54.977943+0000","last_peered":"2024-04-22T07:20:54.977943+0000","last_clean":"2024-04-22T07:20:54.977943+0000","last_became_active":"2024-04-22T07:20:53.877208+0000","last_became_peered":"2024-04-22T07:20:53.877208+0000","last_unstale":"2024-04-22T07:20:54.977943+0000","last_undegraded":"2024-04-22T07:20:54.977943+0000","last_fullsized":"2024-04-22T07:20:54.977943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:46:50.322722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979001+0000","last_change":"2024-04-22T07:20:52.866224+0000","last_active":"2024-04-22T07:20:54.979001+0000","last_peered":"2024-04-22T07:20:54.979001+0000","last_clean":"2024-04-22T07:20:54.979001+0000","last_became_active":"2024-04-22T07:20:52.865903+0000","last_became_peered":"2024-04-22T07:20:52.865903+0000","last_unstale":"2024-04-22T07:20:54.979001+0000","last_undegraded":"2024-04-22T07:20:54.979001+0000","last_fullsized":"2024-04-22T07:20:54.979001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.861395+0000","last_change":"2024-04-22T07:20:53.873266+0000","last_active":"2024-04-22T07:20:54.861395+0000","last_peered":"2024-04-22T07:20:54.861395+0000","last_clean":"2024-04-22T07:20:54.861395+0000","last_became_active":"2024-04-22T07:20:53.872915+0000","last_became_peered":"2024-04-22T07:20:53.872915+0000","last_unstale":"2024-04-22T07:20:54.861395+0000","last_undegraded":"2024-04-22T07:20:54.861395+0000","last_fullsized":"2024-04-22T07:20:54.861395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:09.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863471+0000","last_change":"2024-04-22T07:20:52.863593+0000","last_active":"2024-04-22T07:20:54.863471+0000","last_peered":"2024-04-22T07:20:54.863471+0000","last_clean":"2024-04-22T07:20:54.863471+0000","last_became_active":"2024-04-22T07:20:52.863296+0000","last_became_peered":"2024-04-22T07:20:52.863296+0000","last_unstale":"2024-04-22T07:20:54.863471+0000","last_undegraded":"2024-04-22T07:20:54.863471+0000","last_fullsized":"2024-04-22T07:20:54.863471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:22.261683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979540+0000","last_change":"2024-04-22T07:20:53.874491+0000","last_active":"2024-04-22T07:20:54.979540+0000","last_peered":"2024-04-22T07:20:54.979540+0000","last_clean":"2024-04-22T07:20:54.979540+0000","last_became_active":"2024-04-22T07:20:53.874202+0000","last_became_peered":"2024-04-22T07:20:53.874202+0000","last_unstale":"2024-04-22T07:20:54.979540+0000","last_undegraded":"2024-04-22T07:20:54.979540+0000","last_fullsized":"2024-04-22T07:20:54.979540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:23.268067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980655+0000","last_change":"2024-04-22T07:20:52.865905+0000","last_active":"2024-04-22T07:20:54.980655+0000","last_peered":"2024-04-22T07:20:54.980655+0000","last_clean":"2024-04-22T07:20:54.980655+0000","last_became_active":"2024-04-22T07:20:52.865566+0000","last_became_peered":"2024-04-22T07:20:52.865566+0000","last_unstale":"2024-04-22T07:20:54.980655+0000","last_undegraded":"2024-04-22T07:20:54.980655+0000","last_fullsized":"2024-04-22T07:20:54.980655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:38:31.271879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980566+0000","last_change":"2024-04-22T07:20:53.869951+0000","last_active":"2024-04-22T07:20:54.980566+0000","last_peered":"2024-04-22T07:20:54.980566+0000","last_clean":"2024-04-22T07:20:54.980566+0000","last_became_active":"2024-04-22T07:20:53.869613+0000","last_became_peered":"2024-04-22T07:20:53.869613+0000","last_unstale":"2024-04-22T07:20:54.980566+0000","last_undegraded":"2024-04-22T07:20:54.980566+0000","last_fullsized":"2024-04-22T07:20:54.980566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:14:09.372107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.867345+0000","last_change":"2024-04-22T07:20:52.864740+0000","last_active":"2024-04-22T07:20:58.867345+0000","last_peered":"2024-04-22T07:20:58.867345+0000","last_clean":"2024-04-22T07:20:58.867345+0000","last_became_active":"2024-04-22T07:20:52.864434+0000","last_became_peered":"2024-04-22T07:20:52.864434+0000","last_unstale":"2024-04-22T07:20:58.867345+0000","last_undegraded":"2024-04-22T07:20:58.867345+0000","last_fullsized":"2024-04-22T07:20:58.867345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:33.937176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980498+0000","last_change":"2024-04-22T07:20:53.871156+0000","last_active":"2024-04-22T07:20:54.980498+0000","last_peered":"2024-04-22T07:20:54.980498+0000","last_clean":"2024-04-22T07:20:54.980498+0000","last_became_active":"2024-04-22T07:20:53.870664+0000","last_became_peered":"2024-04-22T07:20:53.870664+0000","last_unstale":"2024-04-22T07:20:54.980498+0000","last_undegraded":"2024-04-22T07:20:54.980498+0000","last_fullsized":"2024-04-22T07:20:54.980498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:01:02.139458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.977319+0000","last_change":"2024-04-22T07:20:52.854668+0000","last_active":"2024-04-22T07:20:54.977319+0000","last_peered":"2024-04-22T07:20:54.977319+0000","last_clean":"2024-04-22T07:20:54.977319+0000","last_became_active":"2024-04-22T07:20:52.854395+0000","last_became_peered":"2024-04-22T07:20:52.854395+0000","last_unstale":"2024-04-22T07:20:54.977319+0000","last_undegraded":"2024-04-22T07:20:54.977319+0000","last_fullsized":"2024-04-22T07:20:54.977319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:59:32.487127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862797+0000","last_change":"2024-04-22T07:20:53.870972+0000","last_active":"2024-04-22T07:20:54.862797+0000","last_peered":"2024-04-22T07:20:54.862797+0000","last_clean":"2024-04-22T07:20:54.862797+0000","last_became_active":"2024-04-22T07:20:53.870674+0000","last_became_peered":"2024-04-22T07:20:53.870674+0000","last_unstale":"2024-04-22T07:20:54.862797+0000","last_undegraded":"2024-04-22T07:20:54.862797+0000","last_fullsized":"2024-04-22T07:20:54.862797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:10.431906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980374+0000","last_change":"2024-04-22T07:20:52.866003+0000","last_active":"2024-04-22T07:20:54.980374+0000","last_peered":"2024-04-22T07:20:54.980374+0000","last_clean":"2024-04-22T07:20:54.980374+0000","last_became_active":"2024-04-22T07:20:52.865606+0000","last_became_peered":"2024-04-22T07:20:52.865606+0000","last_unstale":"2024-04-22T07:20:54.980374+0000","last_undegraded":"2024-04-22T07:20:54.980374+0000","last_fullsized":"2024-04-22T07:20:54.980374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:58:06.713204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.978351+0000","last_change":"2024-04-22T07:20:53.870737+0000","last_active":"2024-04-22T07:20:54.978351+0000","last_peered":"2024-04-22T07:20:54.978351+0000","last_clean":"2024-04-22T07:20:54.978351+0000","last_became_active":"2024-04-22T07:20:53.870402+0000","last_became_peered":"2024-04-22T07:20:53.870402+0000","last_unstale":"2024-04-22T07:20:54.978351+0000","last_undegraded":"2024-04-22T07:20:54.978351+0000","last_fullsized":"2024-04-22T07:20:54.978351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:30:17.845591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979784+0000","last_change":"2024-04-22T07:20:52.861048+0000","last_active":"2024-04-22T07:20:54.979784+0000","last_peered":"2024-04-22T07:20:54.979784+0000","last_clean":"2024-04-22T07:20:54.979784+0000","last_became_active":"2024-04-22T07:20:52.860702+0000","last_became_peered":"2024-04-22T07:20:52.860702+0000","last_unstale":"2024-04-22T07:20:54.979784+0000","last_undegraded":"2024-04-22T07:20:54.979784+0000","last_fullsized":"2024-04-22T07:20:54.979784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979324+0000","last_change":"2024-04-22T07:20:53.868782+0000","last_active":"2024-04-22T07:20:54.979324+0000","last_peered":"2024-04-22T07:20:54.979324+0000","last_clean":"2024-04-22T07:20:54.979324+0000","last_became_active":"2024-04-22T07:20:53.868509+0000","last_became_peered":"2024-04-22T07:20:53.868509+0000","last_unstale":"2024-04-22T07:20:54.979324+0000","last_undegraded":"2024-04-22T07:20:54.979324+0000","last_fullsized":"2024-04-22T07:20:54.979324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:07.129692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.867515+0000","last_change":"2024-04-22T07:20:52.858508+0000","last_active":"2024-04-22T07:20:58.867515+0000","last_peered":"2024-04-22T07:20:58.867515+0000","last_clean":"2024-04-22T07:20:58.867515+0000","last_became_active":"2024-04-22T07:20:52.858215+0000","last_became_peered":"2024-04-22T07:20:52.858215+0000","last_unstale":"2024-04-22T07:20:58.867515+0000","last_undegraded":"2024-04-22T07:20:58.867515+0000","last_fullsized":"2024-04-22T07:20:58.867515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:26.618434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862971+0000","last_change":"2024-04-22T07:20:53.867977+0000","last_active":"2024-04-22T07:20:54.862971+0000","last_peered":"2024-04-22T07:20:54.862971+0000","last_clean":"2024-04-22T07:20:54.862971+0000","last_became_active":"2024-04-22T07:20:53.867447+0000","last_became_peered":"2024-04-22T07:20:53.867447+0000","last_unstale":"2024-04-22T07:20:54.862971+0000","last_undegraded":"2024-04-22T07:20:54.862971+0000","last_fullsized":"2024-04-22T07:20:54.862971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:48:52.934171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.863377+0000","last_change":"2024-04-22T07:20:53.875681+0000","last_active":"2024-04-22T07:20:54.863377+0000","last_peered":"2024-04-22T07:20:54.863377+0000","last_clean":"2024-04-22T07:20:54.863377+0000","last_became_active":"2024-04-22T07:20:53.875305+0000","last_became_peered":"2024-04-22T07:20:53.875305+0000","last_unstale":"2024-04-22T07:20:54.863377+0000","last_undegraded":"2024-04-22T07:20:54.863377+0000","last_fullsized":"2024-04-22T07:20:54.863377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:22:34.452869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.866736+0000","last_change":"2024-04-22T07:20:52.857445+0000","last_active":"2024-04-22T07:20:58.866736+0000","last_peered":"2024-04-22T07:20:58.866736+0000","last_clean":"2024-04-22T07:20:58.866736+0000","last_became_active":"2024-04-22T07:20:52.856293+0000","last_became_peered":"2024-04-22T07:20:52.856293+0000","last_unstale":"2024-04-22T07:20:58.866736+0000","last_undegraded":"2024-04-22T07:20:58.866736+0000","last_fullsized":"2024-04-22T07:20:58.866736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:10.640191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.862780+0000","last_change":"2024-04-22T07:20:53.870827+0000","last_active":"2024-04-22T07:20:54.862780+0000","last_peered":"2024-04-22T07:20:54.862780+0000","last_clean":"2024-04-22T07:20:54.862780+0000","last_became_active":"2024-04-22T07:20:53.870548+0000","last_became_peered":"2024-04-22T07:20:53.870548+0000","last_unstale":"2024-04-22T07:20:54.862780+0000","last_undegraded":"2024-04-22T07:20:54.862780+0000","last_fullsized":"2024-04-22T07:20:54.862780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:27.624819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.867037+0000","last_change":"2024-04-22T07:20:52.856933+0000","last_active":"2024-04-22T07:20:58.867037+0000","last_peered":"2024-04-22T07:20:58.867037+0000","last_clean":"2024-04-22T07:20:58.867037+0000","last_became_active":"2024-04-22T07:20:52.856617+0000","last_became_peered":"2024-04-22T07:20:52.856617+0000","last_unstale":"2024-04-22T07:20:58.867037+0000","last_undegraded":"2024-04-22T07:20:58.867037+0000","last_fullsized":"2024-04-22T07:20:58.867037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:08.286530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.979619+0000","last_change":"2024-04-22T07:20:53.866552+0000","last_active":"2024-04-22T07:20:54.979619+0000","last_peered":"2024-04-22T07:20:54.979619+0000","last_clean":"2024-04-22T07:20:54.979619+0000","last_became_active":"2024-04-22T07:20:53.866286+0000","last_became_peered":"2024-04-22T07:20:53.866286+0000","last_unstale":"2024-04-22T07:20:54.979619+0000","last_undegraded":"2024-04-22T07:20:54.979619+0000","last_fullsized":"2024-04-22T07:20:54.979619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:45:15.519469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:55.787690+0000","last_change":"2024-04-22T07:20:52.863291+0000","last_active":"2024-04-22T07:20:55.787690+0000","last_peered":"2024-04-22T07:20:55.787690+0000","last_clean":"2024-04-22T07:20:55.787690+0000","last_became_active":"2024-04-22T07:20:52.862967+0000","last_became_peered":"2024-04-22T07:20:52.862967+0000","last_unstale":"2024-04-22T07:20:55.787690+0000","last_undegraded":"2024-04-22T07:20:55.787690+0000","last_fullsized":"2024-04-22T07:20:55.787690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:10.640191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:54.980150+0000","last_change":"2024-04-22T07:20:53.871045+0000","last_active":"2024-04-22T07:20:54.980150+0000","last_peered":"2024-04-22T07:20:54.980150+0000","last_clean":"2024-04-22T07:20:54.980150+0000","last_became_active":"2024-04-22T07:20:53.870715+0000","last_became_peered":"2024-04-22T07:20:53.870715+0000","last_unstale":"2024-04-22T07:20:54.980150+0000","last_undegraded":"2024-04-22T07:20:54.980150+0000","last_fullsized":"2024-04-22T07:20:54.980150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-22T07:20:58.870910+0000","last_change":"2024-04-22T07:20:52.869553+0000","last_active":"2024-04-22T07:20:58.870910+0000","last_peered":"2024-04-22T07:20:58.870910+0000","last_clean":"2024-04-22T07:20:58.870910+0000","last_became_active":"2024-04-22T07:20:52.869300+0000","last_became_peered":"2024-04-22T07:20:52.869300+0000","last_unstale":"2024-04-22T07:20:58.870910+0000","last_undegraded":"2024-04-22T07:20:58.870910+0000","last_fullsized":"2024-04-22T07:20:58.870910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:27.709073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2666,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":81359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":835584,"data_stored":671695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":83103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":831488,"data_stored":671673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":241664,"data_stored":81291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":253952,"data_stored":83519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T07:21:18.881 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:21:19.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.022+0000 7f2c95398640 1 Processor -- start 2024-04-22T07:21:19.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.022+0000 7f2c95398640 1 -- start start 2024-04-22T07:21:19.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.023+0000 7f2c95398640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2c900d0590 0x7f2c900d09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:19.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.023+0000 7f2c95398640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c9015e6e0 con 0x7f2c9015b3e0 2024-04-22T07:21:19.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.023+0000 7f2c95398640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c9015e9c0 con 0x7f2c90154f50 2024-04-22T07:21:19.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.023+0000 7f2c95398640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f2c9015af50 con 0x7f2c900d0590 2024-04-22T07:21:19.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.023+0000 7f2c8f7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2c9015b3e0 0x7f2c9015b850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37776/0 (socket says 172.21.15.40:37776) 2024-04-22T07:21:19.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.023+0000 7f2c8f7fe640 1 -- 172.21.15.40:0/770362506 learned_addr learned my addr 172.21.15.40:0/770362506 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:19.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.023+0000 7f2c87fff640 1 --2- 172.21.15.40:0/770362506 >> v2:172.21.15.62:3300/0 conn(0x7f2c900d0590 0x7f2c900d09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:19.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.023+0000 7f2c8e7fc640 1 -- 172.21.15.40:0/770362506 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1959674037 0 0) 0x7f2c9015e6e0 con 0x7f2c9015b3e0 2024-04-22T07:21:19.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.023+0000 7f2c8e7fc640 1 -- 172.21.15.40:0/770362506 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c7c003520 con 0x7f2c9015b3e0 2024-04-22T07:21:19.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.023+0000 7f2c87fff640 1 -- 172.21.15.40:0/770362506 >> v1:172.21.15.62:6789/0 conn(0x7f2c90154f50 legacy=0x7f2c900cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:19.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.023+0000 7f2c87fff640 1 -- 172.21.15.40:0/770362506 >> v1:172.21.15.40:6789/0 conn(0x7f2c9015b3e0 legacy=0x7f2c9015b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:19.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.023+0000 7f2c87fff640 1 -- 172.21.15.40:0/770362506 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c9015eca0 con 0x7f2c900d0590 2024-04-22T07:21:19.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.024+0000 7f2c87fff640 1 --2- 172.21.15.40:0/770362506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c900d0590 0x7f2c900d09e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2c780097a0 tx=0x7f2c7802b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f547292250c32c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:19.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.024+0000 7f2c8e7fc640 1 -- 172.21.15.40:0/770362506 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7802f810 con 0x7f2c900d0590 2024-04-22T07:21:19.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.024+0000 7f2c8e7fc640 1 -- 172.21.15.40:0/770362506 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c7802f9b0 con 0x7f2c900d0590 2024-04-22T07:21:19.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.024+0000 7f2c8e7fc640 1 -- 172.21.15.40:0/770362506 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7802fd60 con 0x7f2c900d0590 2024-04-22T07:21:19.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.025+0000 7f2c95398640 1 -- 172.21.15.40:0/770362506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c900d0590 msgr2=0x7f2c900d09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:19.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.025+0000 7f2c95398640 1 --2- 172.21.15.40:0/770362506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c900d0590 0x7f2c900d09e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2c780097a0 tx=0x7f2c7802b9f0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.025+0000 7f2c95398640 1 -- 172.21.15.40:0/770362506 shutdown_connections 2024-04-22T07:21:19.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.025+0000 7f2c95398640 1 --2- 172.21.15.40:0/770362506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c900d0590 0x7f2c900d09e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.025+0000 7f2c95398640 1 -- 172.21.15.40:0/770362506 >> 172.21.15.40:0/770362506 conn(0x7f2c900676b0 msgr2=0x7f2c90067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:19.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.025+0000 7f2c95398640 1 -- 172.21.15.40:0/770362506 shutdown_connections 2024-04-22T07:21:19.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.025+0000 7f2c95398640 1 -- 172.21.15.40:0/770362506 wait complete. 2024-04-22T07:21:19.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.026+0000 7f2c95398640 1 Processor -- start 2024-04-22T07:21:19.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.026+0000 7f2c95398640 1 -- start start 2024-04-22T07:21:19.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.027+0000 7f2c95398640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c900d0590 0x7f2c901f4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:19.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.027+0000 7f2c95398640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c90154f50 0x7f2c901f0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:19.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.027+0000 7f2c95398640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2c9015b3e0 0x7f2c9014a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:19.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.027+0000 7f2c95398640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9015e3a0 con 0x7f2c90154f50 2024-04-22T07:21:19.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.027+0000 7f2c95398640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9015f260 con 0x7f2c900d0590 2024-04-22T07:21:19.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.027+0000 7f2c95398640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f2c900cc770 con 0x7f2c9015b3e0 2024-04-22T07:21:19.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.027+0000 7f2c87fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c90154f50 0x7f2c901f0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:19.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.027+0000 7f2c87fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c90154f50 0x7f2c901f0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55914/0 (socket says 172.21.15.40:55914) 2024-04-22T07:21:19.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.027+0000 7f2c87fff640 1 -- 172.21.15.40:0/3811947993 learned_addr learned my addr 172.21.15.40:0/3811947993 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:19.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.027+0000 7f2c87fff640 1 -- 172.21.15.40:0/3811947993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2c9015b3e0 msgr2=0x7f2c9014a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:19.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.027+0000 7f2c87fff640 1 --2- 172.21.15.40:0/3811947993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2c9015b3e0 0x7f2c9014a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.027+0000 7f2c87fff640 1 -- 172.21.15.40:0/3811947993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c900d0590 msgr2=0x7f2c901f4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:19.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.027+0000 7f2c87fff640 1 --2- 172.21.15.40:0/3811947993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c900d0590 0x7f2c901f4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.027+0000 7f2c87fff640 1 -- 172.21.15.40:0/3811947993 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c90159070 con 0x7f2c90154f50 2024-04-22T07:21:19.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.027+0000 7f2c87fff640 1 --2- 172.21.15.40:0/3811947993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c90154f50 0x7f2c901f0d80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2c780098c0 tx=0x7f2c780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:19.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.027+0000 7f2c877fe640 1 -- 172.21.15.40:0/3811947993 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78047070 con 0x7f2c90154f50 2024-04-22T07:21:19.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.028+0000 7f2c877fe640 1 -- 172.21.15.40:0/3811947993 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c78004250 con 0x7f2c90154f50 2024-04-22T07:21:19.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.028+0000 7f2c95398640 1 -- 172.21.15.40:0/3811947993 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c90153eb0 con 0x7f2c90154f50 2024-04-22T07:21:19.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.028+0000 7f2c877fe640 1 -- 172.21.15.40:0/3811947993 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78003610 con 0x7f2c90154f50 2024-04-22T07:21:19.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.028+0000 7f2c95398640 1 -- 172.21.15.40:0/3811947993 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c901f42f0 con 0x7f2c90154f50 2024-04-22T07:21:19.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.028+0000 7f2c95398640 1 -- 172.21.15.40:0/3811947993 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c900c7360 con 0x7f2c90154f50 2024-04-22T07:21:19.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.029+0000 7f2c877fe640 1 -- 172.21.15.40:0/3811947993 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2c7804a070 con 0x7f2c90154f50 2024-04-22T07:21:19.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.029+0000 7f2c877fe640 1 --2- 172.21.15.40:0/3811947993 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2c7006c920 0x7f2c7006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:19.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.030+0000 7f2c877fe640 1 -- 172.21.15.40:0/3811947993 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2c780ad0b0 con 0x7f2c90154f50 2024-04-22T07:21:19.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.030+0000 7f2c8effd640 1 --2- 172.21.15.40:0/3811947993 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2c7006c920 0x7f2c7006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:19.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.030+0000 7f2c8effd640 1 --2- 172.21.15.40:0/3811947993 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2c7006c920 0x7f2c7006ede0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2c80000f60 tx=0x7f2c800079d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:19.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.034+0000 7f2c877fe640 1 -- 172.21.15.40:0/3811947993 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2c900c7360 con 0x7f2c90154f50 2024-04-22T07:21:19.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.256+0000 7f2c95398640 1 -- 172.21.15.40:0/3811947993 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c90069d40 con 0x7f2c90154f50 2024-04-22T07:21:19.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.256+0000 7f2c877fe640 1 -- 172.21.15.40:0/3811947993 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6821 (secure 0 0 0) 0x7f2c78033030 con 0x7f2c90154f50 2024-04-22T07:21:19.254 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:21:19.254 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1193926607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1193926607},{"type":"v1","addr":"172.21.15.62:6835","nonce":1193926607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/602167189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":602167189},{"type":"v1","addr":"172.21.15.62:6837","nonce":602167189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2062933254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2062933254},{"type":"v1","addr":"172.21.15.40:6835","nonce":2062933254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3873524978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3873524978},{"type":"v1","addr":"172.21.15.40:6837","nonce":3873524978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/1922761385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":1922761385},{"type":"v1","addr":"172.21.15.40:6839","nonce":1922761385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:20:53.216204+0000","modified":"2024-04-22T07:20:58.875393+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.62:6836/2884673656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2884673656},{"type":"v1","addr":"172.21.15.62:6836","nonce":2884673656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4305]},"id":1}]} 2024-04-22T07:21:19.255 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-04-22T07:21:19.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.258+0000 7f2c95398640 1 -- 172.21.15.40:0/3811947993 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2c7006c920 msgr2=0x7f2c7006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:19.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.258+0000 7f2c95398640 1 --2- 172.21.15.40:0/3811947993 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2c7006c920 0x7f2c7006ede0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2c80000f60 tx=0x7f2c800079d0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.258+0000 7f2c95398640 1 -- 172.21.15.40:0/3811947993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c90154f50 msgr2=0x7f2c901f0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:19.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.258+0000 7f2c95398640 1 --2- 172.21.15.40:0/3811947993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c90154f50 0x7f2c901f0d80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2c780098c0 tx=0x7f2c780046c0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.258+0000 7f2c95398640 1 -- 172.21.15.40:0/3811947993 shutdown_connections 2024-04-22T07:21:19.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.258+0000 7f2c95398640 1 --2- 172.21.15.40:0/3811947993 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2c9015b3e0 0x7f2c9014a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.258+0000 7f2c95398640 1 --2- 172.21.15.40:0/3811947993 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2c7006c920 0x7f2c7006ede0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.258+0000 7f2c95398640 1 --2- 172.21.15.40:0/3811947993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c90154f50 0x7f2c901f0d80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.258+0000 7f2c95398640 1 --2- 172.21.15.40:0/3811947993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c900d0590 0x7f2c901f4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.258+0000 7f2c95398640 1 -- 172.21.15.40:0/3811947993 >> 172.21.15.40:0/3811947993 conn(0x7f2c900676b0 msgr2=0x7f2c90067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:19.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.259+0000 7f2c95398640 1 -- 172.21.15.40:0/3811947993 shutdown_connections 2024-04-22T07:21:19.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.259+0000 7f2c95398640 1 -- 172.21.15.40:0/3811947993 wait complete. 2024-04-22T07:21:19.267 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:21:19.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.371+0000 7f212e26d640 1 Processor -- start 2024-04-22T07:21:19.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.371+0000 7f212e26d640 1 -- start start 2024-04-22T07:21:19.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.371+0000 7f212e26d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2128154ff0 0x7f212815b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:19.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.371+0000 7f212e26d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f21280cb360 0x7f21280c5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:19.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.371+0000 7f212e26d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21280c5ac0 con 0x7f212815ef30 2024-04-22T07:21:19.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.371+0000 7f212e26d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f212815eaa0 con 0x7f2128154ff0 2024-04-22T07:21:19.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.371+0000 7f212e26d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f212815bcc0 con 0x7f21280cb360 2024-04-22T07:21:19.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.371+0000 7f2127fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2128154ff0 0x7f212815b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:19.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.372+0000 7f212c80a640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f212815ef30 0x7f21280d0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37792/0 (socket says 172.21.15.40:37792) 2024-04-22T07:21:19.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.372+0000 7f212c80a640 1 -- 172.21.15.40:0/326867012 learned_addr learned my addr 172.21.15.40:0/326867012 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:19.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.372+0000 7f21277fe640 1 --2- 172.21.15.40:0/326867012 >> v2:172.21.15.62:3300/0 conn(0x7f21280cb360 0x7f21280c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:19.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.372+0000 7f2126ffd640 1 -- 172.21.15.40:0/326867012 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4220751101 0 0) 0x7f21280c5ac0 con 0x7f212815ef30 2024-04-22T07:21:19.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.372+0000 7f2126ffd640 1 -- 172.21.15.40:0/326867012 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2114003520 con 0x7f212815ef30 2024-04-22T07:21:19.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.372+0000 7f2127fff640 1 -- 172.21.15.40:0/326867012 >> v2:172.21.15.62:3300/0 conn(0x7f21280cb360 msgr2=0x7f21280c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:19.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.372+0000 7f2127fff640 1 --2- 172.21.15.40:0/326867012 >> v2:172.21.15.62:3300/0 conn(0x7f21280cb360 0x7f21280c5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.372+0000 7f2127fff640 1 -- 172.21.15.40:0/326867012 >> v1:172.21.15.40:6789/0 conn(0x7f212815ef30 legacy=0x7f21280d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:19.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.372+0000 7f2127fff640 1 -- 172.21.15.40:0/326867012 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21280cbc90 con 0x7f2128154ff0 2024-04-22T07:21:19.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.373+0000 7f2127fff640 1 --2- 172.21.15.40:0/326867012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2128154ff0 0x7f212815b780 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f21280cbb00 tx=0x7f211002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=501ad97a650de5ad server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:19.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.373+0000 7f2126ffd640 1 -- 172.21.15.40:0/326867012 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2110034070 con 0x7f2128154ff0 2024-04-22T07:21:19.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.373+0000 7f2126ffd640 1 -- 172.21.15.40:0/326867012 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2110030610 con 0x7f2128154ff0 2024-04-22T07:21:19.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.373+0000 7f2126ffd640 1 -- 172.21.15.40:0/326867012 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21100309e0 con 0x7f2128154ff0 2024-04-22T07:21:19.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.373+0000 7f212e26d640 1 -- 172.21.15.40:0/326867012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2128154ff0 msgr2=0x7f212815b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:19.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.373+0000 7f212e26d640 1 --2- 172.21.15.40:0/326867012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2128154ff0 0x7f212815b780 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f21280cbb00 tx=0x7f211002b960 comp rx=0 tx=0).stop 2024-04-22T07:21:19.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.373+0000 7f212e26d640 1 -- 172.21.15.40:0/326867012 shutdown_connections 2024-04-22T07:21:19.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.373+0000 7f212e26d640 1 --2- 172.21.15.40:0/326867012 >> v2:172.21.15.62:3300/0 conn(0x7f21280cb360 0x7f21280c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.373+0000 7f212e26d640 1 --2- 172.21.15.40:0/326867012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2128154ff0 0x7f212815b780 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.373+0000 7f212e26d640 1 -- 172.21.15.40:0/326867012 >> 172.21.15.40:0/326867012 conn(0x7f2128067890 msgr2=0x7f212806ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:19.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.373+0000 7f212e26d640 1 -- 172.21.15.40:0/326867012 shutdown_connections 2024-04-22T07:21:19.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.373+0000 7f212e26d640 1 -- 172.21.15.40:0/326867012 wait complete. 2024-04-22T07:21:19.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.375+0000 7f212e26d640 1 Processor -- start 2024-04-22T07:21:19.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.375+0000 7f212e26d640 1 -- start start 2024-04-22T07:21:19.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.375+0000 7f212e26d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21280cb360 0x7f212814a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:19.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.375+0000 7f212e26d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2128154ff0 0x7f21281450d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:19.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.375+0000 7f212e26d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f212815ef30 0x7f2128145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:19.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.375+0000 7f212e26d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f21280ccbf0 con 0x7f212815ef30 2024-04-22T07:21:19.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.375+0000 7f212e26d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f21280cc950 con 0x7f2128154ff0 2024-04-22T07:21:19.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.375+0000 7f212e26d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f212815e730 con 0x7f21280cb360 2024-04-22T07:21:19.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.376+0000 7f212c80a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f212815ef30 0x7f2128145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:19.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.376+0000 7f212c80a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f212815ef30 0x7f2128145610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55926/0 (socket says 172.21.15.40:55926) 2024-04-22T07:21:19.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.376+0000 7f212c80a640 1 -- 172.21.15.40:0/2971163592 learned_addr learned my addr 172.21.15.40:0/2971163592 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:19.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.376+0000 7f21277fe640 1 --2- 172.21.15.40:0/2971163592 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2128154ff0 0x7f21281450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:19.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.376+0000 7f2127fff640 1 --2- 172.21.15.40:0/2971163592 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21280cb360 0x7f212814a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:19.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.376+0000 7f212c80a640 1 -- 172.21.15.40:0/2971163592 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21280cb360 msgr2=0x7f212814a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:19.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.376+0000 7f212c80a640 1 --2- 172.21.15.40:0/2971163592 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21280cb360 0x7f212814a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.376+0000 7f212c80a640 1 -- 172.21.15.40:0/2971163592 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2128154ff0 msgr2=0x7f21281450d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:19.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.376+0000 7f212c80a640 1 --2- 172.21.15.40:0/2971163592 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2128154ff0 0x7f21281450d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.376+0000 7f212c80a640 1 -- 172.21.15.40:0/2971163592 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21281f0ee0 con 0x7f212815ef30 2024-04-22T07:21:19.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.376+0000 7f212c80a640 1 --2- 172.21.15.40:0/2971163592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f212815ef30 0x7f2128145610 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f212000caa0 tx=0x7f212000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:19.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.376+0000 7f2124ff9640 1 -- 172.21.15.40:0/2971163592 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2120017070 con 0x7f212815ef30 2024-04-22T07:21:19.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.376+0000 7f2124ff9640 1 -- 172.21.15.40:0/2971163592 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f212000ac00 con 0x7f212815ef30 2024-04-22T07:21:19.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.376+0000 7f2124ff9640 1 -- 172.21.15.40:0/2971163592 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2120012400 con 0x7f212815ef30 2024-04-22T07:21:19.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.376+0000 7f212e26d640 1 -- 172.21.15.40:0/2971163592 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21281f11c0 con 0x7f212815ef30 2024-04-22T07:21:19.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.376+0000 7f212e26d640 1 -- 172.21.15.40:0/2971163592 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21281f1780 con 0x7f212815ef30 2024-04-22T07:21:19.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.377+0000 7f212e26d640 1 -- 172.21.15.40:0/2971163592 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21281553d0 con 0x7f212815ef30 2024-04-22T07:21:19.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.378+0000 7f2124ff9640 1 -- 172.21.15.40:0/2971163592 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f212001a070 con 0x7f212815ef30 2024-04-22T07:21:19.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.378+0000 7f2124ff9640 1 --2- 172.21.15.40:0/2971163592 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f210806c8f0 0x7f210806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:19.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.378+0000 7f2124ff9640 1 -- 172.21.15.40:0/2971163592 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f212008b900 con 0x7f212815ef30 2024-04-22T07:21:19.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.378+0000 7f2127fff640 1 --2- 172.21.15.40:0/2971163592 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f210806c8f0 0x7f210806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:19.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.379+0000 7f2127fff640 1 --2- 172.21.15.40:0/2971163592 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f210806c8f0 0x7f210806edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2110036000 tx=0x7f211003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:19.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.383+0000 7f2124ff9640 1 -- 172.21.15.40:0/2971163592 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f21281553d0 con 0x7f212815ef30 2024-04-22T07:21:19.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.567+0000 7f212e26d640 1 -- 172.21.15.40:0/2971163592 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f21281542d0 con 0x7f212815ef30 2024-04-22T07:21:19.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.568+0000 7f2124ff9640 1 -- 172.21.15.40:0/2971163592 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16537 (secure 0 0 0) 0x7f21281542d0 con 0x7f212815ef30 2024-04-22T07:21:19.566 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:21:19.566 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":23,"fsid":"dd5b16e4-89fe-4602-b37f-062846793158","created":"2024-04-22T07:20:29.488892+0000","modified":"2024-04-22T07:20:54.858120+0000","last_up_change":"2024-04-22T07:20:40.397383+0000","last_in_change":"2024-04-22T07:20:31.702551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:20:41.793179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:20:51.815779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:20:52.164265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32238b7e-228b-4a67-bfca-16e8f0020a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6801","nonce":1526385055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6803","nonce":1526385055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6807","nonce":1526385055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6805","nonce":1526385055}]},"public_addr":"172.21.15.40:6801/1526385055","cluster_addr":"172.21.15.40:6803/1526385055","heartbeat_back_addr":"172.21.15.40:6807/1526385055","heartbeat_front_addr":"172.21.15.40:6805/1526385055","state":["exists","up"]},{"osd":1,"uuid":"5ad8da43-39b1-4295-b4d1-0f1e1d06fc0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6809","nonce":623026645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6811","nonce":623026645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6815","nonce":623026645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6813","nonce":623026645}]},"public_addr":"172.21.15.40:6809/623026645","cluster_addr":"172.21.15.40:6811/623026645","heartbeat_back_addr":"172.21.15.40:6815/623026645","heartbeat_front_addr":"172.21.15.40:6813/623026645","state":["exists","up"]},{"osd":2,"uuid":"7d2c6d50-719d-4232-ad47-f04dcf1a8bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6820","nonce":1885686505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6824","nonce":1885686505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6831","nonce":1885686505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6828","nonce":1885686505}]},"public_addr":"172.21.15.40:6820/1885686505","cluster_addr":"172.21.15.40:6824/1885686505","heartbeat_back_addr":"172.21.15.40:6831/1885686505","heartbeat_front_addr":"172.21.15.40:6828/1885686505","state":["exists","up"]},{"osd":3,"uuid":"af42e7d6-a6bf-403e-92e7-162d7c4fbf0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6817","nonce":130276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6819","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6821","nonce":130276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6829","nonce":130276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6823","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6825","nonce":130276746}]},"public_addr":"172.21.15.40:6817/130276746","cluster_addr":"172.21.15.40:6821/130276746","heartbeat_back_addr":"172.21.15.40:6829/130276746","heartbeat_front_addr":"172.21.15.40:6825/130276746","state":["exists","up"]},{"osd":4,"uuid":"f8e89e0d-be96-4f19-88c0-69c408df7d98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6801","nonce":2251435758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6803","nonce":2251435758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6807","nonce":2251435758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6805","nonce":2251435758}]},"public_addr":"172.21.15.62:6801/2251435758","cluster_addr":"172.21.15.62:6803/2251435758","heartbeat_back_addr":"172.21.15.62:6807/2251435758","heartbeat_front_addr":"172.21.15.62:6805/2251435758","state":["exists","up"]},{"osd":5,"uuid":"ba6dc1bc-272b-4f80-b55f-40bc4a0c3ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6809","nonce":3509322231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6811","nonce":3509322231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6815","nonce":3509322231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6813","nonce":3509322231}]},"public_addr":"172.21.15.62:6809/3509322231","cluster_addr":"172.21.15.62:6811/3509322231","heartbeat_back_addr":"172.21.15.62:6815/3509322231","heartbeat_front_addr":"172.21.15.62:6813/3509322231","state":["exists","up"]},{"osd":6,"uuid":"834fcd74-14bf-45ec-a10a-0374f4ce9bf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6825","nonce":3094315954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6827","nonce":3094315954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6831","nonce":3094315954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6829","nonce":3094315954}]},"public_addr":"172.21.15.62:6825/3094315954","cluster_addr":"172.21.15.62:6827/3094315954","heartbeat_back_addr":"172.21.15.62:6831/3094315954","heartbeat_front_addr":"172.21.15.62:6829/3094315954","state":["exists","up"]},{"osd":7,"uuid":"831c9a73-960e-4d2e-b86a-33a6916be059","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6817","nonce":147453972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6819","nonce":147453972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6823","nonce":147453972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6821","nonce":147453972}]},"public_addr":"172.21.15.62:6817/147453972","cluster_addr":"172.21.15.62:6819/147453972","heartbeat_back_addr":"172.21.15.62:6823/147453972","heartbeat_front_addr":"172.21.15.62:6821/147453972","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.828738+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.873471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.908090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.894782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:37.686796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.801123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.852323+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.812139+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:21:19.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.570+0000 7f212e26d640 1 -- 172.21.15.40:0/2971163592 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f210806c8f0 msgr2=0x7f210806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:19.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.570+0000 7f212e26d640 1 --2- 172.21.15.40:0/2971163592 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f210806c8f0 0x7f210806edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2110036000 tx=0x7f211003b040 comp rx=0 tx=0).stop 2024-04-22T07:21:19.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.570+0000 7f212e26d640 1 -- 172.21.15.40:0/2971163592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f212815ef30 msgr2=0x7f2128145610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:19.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.570+0000 7f212e26d640 1 --2- 172.21.15.40:0/2971163592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f212815ef30 0x7f2128145610 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f212000caa0 tx=0x7f212000cf60 comp rx=0 tx=0).stop 2024-04-22T07:21:19.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.570+0000 7f212e26d640 1 -- 172.21.15.40:0/2971163592 shutdown_connections 2024-04-22T07:21:19.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.570+0000 7f212e26d640 1 --2- 172.21.15.40:0/2971163592 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f210806c8f0 0x7f210806edb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.570+0000 7f212e26d640 1 --2- 172.21.15.40:0/2971163592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f212815ef30 0x7f2128145610 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.570+0000 7f212e26d640 1 --2- 172.21.15.40:0/2971163592 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2128154ff0 0x7f21281450d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.570+0000 7f212e26d640 1 --2- 172.21.15.40:0/2971163592 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21280cb360 0x7f212814a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.570+0000 7f212e26d640 1 -- 172.21.15.40:0/2971163592 >> 172.21.15.40:0/2971163592 conn(0x7f2128067890 msgr2=0x7f21280c67a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:19.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.570+0000 7f212e26d640 1 -- 172.21.15.40:0/2971163592 shutdown_connections 2024-04-22T07:21:19.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.570+0000 7f212e26d640 1 -- 172.21.15.40:0/2971163592 wait complete. 2024-04-22T07:21:19.579 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T07:20:41.793179+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-22T07:20:51.815779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-22T07:20:52.164265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-22T07:21:19.579 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T07:21:19.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.686+0000 7fdaf8b15640 1 Processor -- start 2024-04-22T07:21:19.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.686+0000 7fdaf8b15640 1 -- start start 2024-04-22T07:21:19.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.686+0000 7fdaf8b15640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdaf4152d40 0x7fdaf406f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:19.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.686+0000 7fdaf8b15640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdaf40c4a50 0x7fdaf406f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:19.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.686+0000 7fdaf8b15640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaf40c8580 con 0x7fdaf415c0f0 2024-04-22T07:21:19.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.686+0000 7fdaf8b15640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fdaf406efd0 con 0x7fdaf4152d40 2024-04-22T07:21:19.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.686+0000 7fdaf8b15640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fdaf40c8820 con 0x7fdaf40c4a50 2024-04-22T07:21:19.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.687+0000 7fdaf259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdaf4152d40 0x7fdaf406f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:19.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.687+0000 7fdaf2d9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fdaf415c0f0 0x7fdaf415c540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47914/0 (socket says 172.21.15.40:47914) 2024-04-22T07:21:19.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.687+0000 7fdaf2d9d640 1 -- 172.21.15.40:0/1095639005 learned_addr learned my addr 172.21.15.40:0/1095639005 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:19.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.687+0000 7fdaf259c640 1 -- 172.21.15.40:0/1095639005 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdaf40c4a50 msgr2=0x7fdaf406f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:19.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.687+0000 7fdaf1d9b640 1 --2- 172.21.15.40:0/1095639005 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdaf40c4a50 0x7fdaf406f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:19.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.687+0000 7fdaf259c640 1 --2- 172.21.15.40:0/1095639005 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdaf40c4a50 0x7fdaf406f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.687+0000 7fdaf159a640 1 -- 172.21.15.40:0/1095639005 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 646698134 0 0) 0x7fdaf40c8580 con 0x7fdaf415c0f0 2024-04-22T07:21:19.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.687+0000 7fdaf259c640 1 -- 172.21.15.40:0/1095639005 >> v1:172.21.15.40:6789/0 conn(0x7fdaf415c0f0 legacy=0x7fdaf415c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:19.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.687+0000 7fdaf259c640 1 -- 172.21.15.40:0/1095639005 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf40c8b00 con 0x7fdaf4152d40 2024-04-22T07:21:19.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.687+0000 7fdaf1d9b640 1 --2- 172.21.15.40:0/1095639005 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdaf40c4a50 0x7fdaf406f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:19.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.688+0000 7fdaf259c640 1 --2- 172.21.15.40:0/1095639005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaf4152d40 0x7fdaf406f460 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdae40097a0 tx=0x7fdae402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b8059bda113199 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:19.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.688+0000 7fdaf159a640 1 -- 172.21.15.40:0/1095639005 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae4034070 con 0x7fdaf4152d40 2024-04-22T07:21:19.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.688+0000 7fdaf159a640 1 -- 172.21.15.40:0/1095639005 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdae4030610 con 0x7fdaf4152d40 2024-04-22T07:21:19.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.688+0000 7fdaf159a640 1 -- 172.21.15.40:0/1095639005 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae40309e0 con 0x7fdaf4152d40 2024-04-22T07:21:19.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.688+0000 7fdaf8b15640 1 -- 172.21.15.40:0/1095639005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaf4152d40 msgr2=0x7fdaf406f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:19.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.688+0000 7fdaf8b15640 1 --2- 172.21.15.40:0/1095639005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaf4152d40 0x7fdaf406f460 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdae40097a0 tx=0x7fdae402b960 comp rx=0 tx=0).stop 2024-04-22T07:21:19.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.689+0000 7fdaf8b15640 1 -- 172.21.15.40:0/1095639005 shutdown_connections 2024-04-22T07:21:19.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.689+0000 7fdaf8b15640 1 --2- 172.21.15.40:0/1095639005 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdaf40c4a50 0x7fdaf406f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.689+0000 7fdaf8b15640 1 --2- 172.21.15.40:0/1095639005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaf4152d40 0x7fdaf406f460 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.689+0000 7fdaf8b15640 1 -- 172.21.15.40:0/1095639005 >> 172.21.15.40:0/1095639005 conn(0x7fdaf40cc2c0 msgr2=0x7fdaf40cc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:19.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.689+0000 7fdaf8b15640 1 -- 172.21.15.40:0/1095639005 shutdown_connections 2024-04-22T07:21:19.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.689+0000 7fdaf8b15640 1 -- 172.21.15.40:0/1095639005 wait complete. 2024-04-22T07:21:19.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.690+0000 7fdaf8b15640 1 Processor -- start 2024-04-22T07:21:19.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.690+0000 7fdaf8b15640 1 -- start start 2024-04-22T07:21:19.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.690+0000 7fdaf8b15640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaf40c4a50 0x7fdaf415b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:19.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.690+0000 7fdaf8b15640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdaf4152d40 0x7fdaf4071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:19.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.690+0000 7fdaf8b15640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdaf415c0f0 0x7fdaf41f46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:19.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.691+0000 7fdaf8b15640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf4153120 con 0x7fdaf40c4a50 2024-04-22T07:21:19.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.691+0000 7fdaf8b15640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf40701e0 con 0x7fdaf4152d40 2024-04-22T07:21:19.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.691+0000 7fdaf8b15640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fdaf40c5000 con 0x7fdaf415c0f0 2024-04-22T07:21:19.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.691+0000 7fdaf259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaf40c4a50 0x7fdaf415b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:19.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.691+0000 7fdaf259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaf40c4a50 0x7fdaf415b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56282/0 (socket says 172.21.15.40:56282) 2024-04-22T07:21:19.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.691+0000 7fdaf259c640 1 -- 172.21.15.40:0/4018500207 learned_addr learned my addr 172.21.15.40:0/4018500207 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:19.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.691+0000 7fdaf259c640 1 -- 172.21.15.40:0/4018500207 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdaf415c0f0 msgr2=0x7fdaf41f46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:19.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.691+0000 7fdaf259c640 1 --2- 172.21.15.40:0/4018500207 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdaf415c0f0 0x7fdaf41f46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.691+0000 7fdaf1d9b640 1 --2- 172.21.15.40:0/4018500207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdaf4152d40 0x7fdaf4071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:19.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.691+0000 7fdaf259c640 1 -- 172.21.15.40:0/4018500207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdaf4152d40 msgr2=0x7fdaf4071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:19.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.691+0000 7fdaf259c640 1 --2- 172.21.15.40:0/4018500207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdaf4152d40 0x7fdaf4071ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.691+0000 7fdaf259c640 1 -- 172.21.15.40:0/4018500207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf40c7470 con 0x7fdaf40c4a50 2024-04-22T07:21:19.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.691+0000 7fdaf259c640 1 --2- 172.21.15.40:0/4018500207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaf40c4a50 0x7fdaf415b840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdae4000c00 tx=0x7fdae40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:19.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.691+0000 7fdae2ffd640 1 -- 172.21.15.40:0/4018500207 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae4034040 con 0x7fdaf40c4a50 2024-04-22T07:21:19.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.691+0000 7fdae2ffd640 1 -- 172.21.15.40:0/4018500207 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdae4004030 con 0x7fdaf40c4a50 2024-04-22T07:21:19.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.691+0000 7fdaf8b15640 1 -- 172.21.15.40:0/4018500207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaf40cac70 con 0x7fdaf40c4a50 2024-04-22T07:21:19.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.691+0000 7fdae2ffd640 1 -- 172.21.15.40:0/4018500207 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae4004400 con 0x7fdaf40c4a50 2024-04-22T07:21:19.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.691+0000 7fdaf8b15640 1 -- 172.21.15.40:0/4018500207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaf40cb230 con 0x7fdaf40c4a50 2024-04-22T07:21:19.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.692+0000 7fdaf8b15640 1 -- 172.21.15.40:0/4018500207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaf4069610 con 0x7fdaf40c4a50 2024-04-22T07:21:19.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.693+0000 7fdae2ffd640 1 -- 172.21.15.40:0/4018500207 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdae404c060 con 0x7fdaf40c4a50 2024-04-22T07:21:19.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.693+0000 7fdae2ffd640 1 --2- 172.21.15.40:0/4018500207 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fdad406c920 0x7fdad406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:19.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.693+0000 7fdae2ffd640 1 -- 172.21.15.40:0/4018500207 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fdae40ad810 con 0x7fdaf40c4a50 2024-04-22T07:21:19.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.693+0000 7fdaf1d9b640 1 --2- 172.21.15.40:0/4018500207 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fdad406c920 0x7fdad406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:19.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.694+0000 7fdaf1d9b640 1 --2- 172.21.15.40:0/4018500207 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fdad406c920 0x7fdad406ede0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4151bb0 tx=0x7fdae8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:19.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.698+0000 7fdae2ffd640 1 -- 172.21.15.40:0/4018500207 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdae407bb90 con 0x7fdaf40c4a50 2024-04-22T07:21:19.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.884+0000 7fdaf8b15640 1 -- 172.21.15.40:0/4018500207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdaf40c3c10 con 0x7fdaf40c4a50 2024-04-22T07:21:19.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.884+0000 7fdae2ffd640 1 -- 172.21.15.40:0/4018500207 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fdae407b490 con 0x7fdaf40c4a50 2024-04-22T07:21:19.882 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-04-22T07:21:19.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.886+0000 7fdaf8b15640 1 -- 172.21.15.40:0/4018500207 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fdad406c920 msgr2=0x7fdad406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:19.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.886+0000 7fdaf8b15640 1 --2- 172.21.15.40:0/4018500207 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fdad406c920 0x7fdad406ede0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4151bb0 tx=0x7fdae8008040 comp rx=0 tx=0).stop 2024-04-22T07:21:19.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.886+0000 7fdaf8b15640 1 -- 172.21.15.40:0/4018500207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaf40c4a50 msgr2=0x7fdaf415b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:19.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.886+0000 7fdaf8b15640 1 --2- 172.21.15.40:0/4018500207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaf40c4a50 0x7fdaf415b840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdae4000c00 tx=0x7fdae40046c0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.886+0000 7fdaf8b15640 1 -- 172.21.15.40:0/4018500207 shutdown_connections 2024-04-22T07:21:19.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.886+0000 7fdaf8b15640 1 --2- 172.21.15.40:0/4018500207 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdaf415c0f0 0x7fdaf41f46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.886+0000 7fdaf8b15640 1 --2- 172.21.15.40:0/4018500207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdaf4152d40 0x7fdaf4071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.886+0000 7fdaf8b15640 1 --2- 172.21.15.40:0/4018500207 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fdad406c920 0x7fdad406ede0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.886+0000 7fdaf8b15640 1 --2- 172.21.15.40:0/4018500207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaf40c4a50 0x7fdaf415b840 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:19.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.886+0000 7fdaf8b15640 1 -- 172.21.15.40:0/4018500207 >> 172.21.15.40:0/4018500207 conn(0x7fdaf40cc2c0 msgr2=0x7fdaf406f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:19.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.886+0000 7fdaf8b15640 1 -- 172.21.15.40:0/4018500207 shutdown_connections 2024-04-22T07:21:19.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:19.887+0000 7fdaf8b15640 1 -- 172.21.15.40:0/4018500207 wait complete. 2024-04-22T07:21:19.895 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-22T07:21:20.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.002+0000 7f2493c74640 1 Processor -- start 2024-04-22T07:21:20.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.002+0000 7f2493c74640 1 -- start start 2024-04-22T07:21:20.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.003+0000 7f2493c74640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f248c0c9080 0x7f248c0c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:20.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.003+0000 7f2493c74640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f248c0c75f0 0x7f248c0ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:20.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.003+0000 7f2493c74640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f248c152150 con 0x7f248c15b970 2024-04-22T07:21:20.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.003+0000 7f2493c74640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f248c15b4e0 con 0x7f248c0c9080 2024-04-22T07:21:20.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.003+0000 7f2493c74640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f248c15bdb0 con 0x7f248c0c75f0 2024-04-22T07:21:20.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.003+0000 7f2491a10640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f248c0c9080 0x7f248c0c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:20.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.003+0000 7f249120f640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f248c15b970 0x7f248c15e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47918/0 (socket says 172.21.15.40:47918) 2024-04-22T07:21:20.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.003+0000 7f249120f640 1 -- 172.21.15.40:0/2659333874 learned_addr learned my addr 172.21.15.40:0/2659333874 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:20.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.003+0000 7f2492211640 1 --2- 172.21.15.40:0/2659333874 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f248c0c75f0 0x7f248c0ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:20.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.003+0000 7f2491a10640 1 -- 172.21.15.40:0/2659333874 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f248c0c75f0 msgr2=0x7f248c0ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:20.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.003+0000 7f2491a10640 1 --2- 172.21.15.40:0/2659333874 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f248c0c75f0 0x7f248c0ccb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.003+0000 7f2491a10640 1 -- 172.21.15.40:0/2659333874 >> v1:172.21.15.40:6789/0 conn(0x7f248c15b970 legacy=0x7f248c15e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:20.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.003+0000 7f2491a10640 1 -- 172.21.15.40:0/2659333874 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248c15aeb0 con 0x7f248c0c9080 2024-04-22T07:21:20.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.003+0000 7f2490a0e640 1 -- 172.21.15.40:0/2659333874 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 407876924 0 0) 0x7f248c152150 con 0x7f248c15b970 2024-04-22T07:21:20.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.003+0000 7f2492211640 1 --2- 172.21.15.40:0/2659333874 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f248c0c75f0 0x7f248c0ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:20.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.004+0000 7f2491a10640 1 --2- 172.21.15.40:0/2659333874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f248c0c9080 0x7f248c0c80f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f24880097a0 tx=0x7f248802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4189d47979929fcc server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:20.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.004+0000 7f2490a0e640 1 -- 172.21.15.40:0/2659333874 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488035020 con 0x7f248c0c9080 2024-04-22T07:21:20.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.004+0000 7f2490a0e640 1 -- 172.21.15.40:0/2659333874 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2488031810 con 0x7f248c0c9080 2024-04-22T07:21:20.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.004+0000 7f2490a0e640 1 -- 172.21.15.40:0/2659333874 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488031be0 con 0x7f248c0c9080 2024-04-22T07:21:20.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.005+0000 7f2493c74640 1 -- 172.21.15.40:0/2659333874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f248c0c9080 msgr2=0x7f248c0c80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:20.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.005+0000 7f2493c74640 1 --2- 172.21.15.40:0/2659333874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f248c0c9080 0x7f248c0c80f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f24880097a0 tx=0x7f248802b8b0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.005+0000 7f2493c74640 1 -- 172.21.15.40:0/2659333874 shutdown_connections 2024-04-22T07:21:20.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.005+0000 7f2493c74640 1 --2- 172.21.15.40:0/2659333874 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f248c0c75f0 0x7f248c0ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.005+0000 7f2493c74640 1 --2- 172.21.15.40:0/2659333874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f248c0c9080 0x7f248c0c80f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.005+0000 7f2493c74640 1 -- 172.21.15.40:0/2659333874 >> 172.21.15.40:0/2659333874 conn(0x7f248c067ce0 msgr2=0x7f248c06b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:20.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.005+0000 7f2493c74640 1 -- 172.21.15.40:0/2659333874 shutdown_connections 2024-04-22T07:21:20.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.005+0000 7f2493c74640 1 -- 172.21.15.40:0/2659333874 wait complete. 2024-04-22T07:21:20.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.006+0000 7f2493c74640 1 Processor -- start 2024-04-22T07:21:20.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.006+0000 7f2493c74640 1 -- start start 2024-04-22T07:21:20.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.007+0000 7f2493c74640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f248c0c75f0 0x7f248c14c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:20.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.007+0000 7f2493c74640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f248c0c9080 0x7f248c1f4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:20.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.007+0000 7f2493c74640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f248c15b970 0x7f248c1f47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:20.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.007+0000 7f2493c74640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f248c15f1b0 con 0x7f248c0c9080 2024-04-22T07:21:20.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.007+0000 7f2493c74640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f248c15eed0 con 0x7f248c15b970 2024-04-22T07:21:20.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.007+0000 7f2493c74640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f248c15b170 con 0x7f248c0c75f0 2024-04-22T07:21:20.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.007+0000 7f249120f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f248c0c9080 0x7f248c1f4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:20.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.007+0000 7f249120f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f248c0c9080 0x7f248c1f4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56310/0 (socket says 172.21.15.40:56310) 2024-04-22T07:21:20.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.007+0000 7f249120f640 1 -- 172.21.15.40:0/759900113 learned_addr learned my addr 172.21.15.40:0/759900113 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:20.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.007+0000 7f2491a10640 1 --2- 172.21.15.40:0/759900113 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f248c0c75f0 0x7f248c14c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:20.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.007+0000 7f2492211640 1 --2- 172.21.15.40:0/759900113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f248c15b970 0x7f248c1f47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:20.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.007+0000 7f249120f640 1 -- 172.21.15.40:0/759900113 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f248c0c75f0 msgr2=0x7f248c14c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:20.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.007+0000 7f249120f640 1 --2- 172.21.15.40:0/759900113 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f248c0c75f0 0x7f248c14c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.007+0000 7f249120f640 1 -- 172.21.15.40:0/759900113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f248c15b970 msgr2=0x7f248c1f47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:20.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.007+0000 7f249120f640 1 --2- 172.21.15.40:0/759900113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f248c15b970 0x7f248c1f47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.007+0000 7f249120f640 1 -- 172.21.15.40:0/759900113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248c1e81c0 con 0x7f248c0c9080 2024-04-22T07:21:20.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.007+0000 7f249120f640 1 --2- 172.21.15.40:0/759900113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f248c0c9080 0x7f248c1f4280 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f247c00c460 tx=0x7f247c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:20.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.008+0000 7f24827fc640 1 -- 172.21.15.40:0/759900113 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c018070 con 0x7f248c0c9080 2024-04-22T07:21:20.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.008+0000 7f24827fc640 1 -- 172.21.15.40:0/759900113 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f247c007500 con 0x7f248c0c9080 2024-04-22T07:21:20.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.008+0000 7f2493c74640 1 -- 172.21.15.40:0/759900113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f248c158b10 con 0x7f248c0c9080 2024-04-22T07:21:20.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.008+0000 7f24827fc640 1 -- 172.21.15.40:0/759900113 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c004a20 con 0x7f248c0c9080 2024-04-22T07:21:20.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.008+0000 7f2493c74640 1 -- 172.21.15.40:0/759900113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f248c0c23d0 con 0x7f248c0c9080 2024-04-22T07:21:20.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.009+0000 7f2493c74640 1 -- 172.21.15.40:0/759900113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f248c04fdc0 con 0x7f248c0c9080 2024-04-22T07:21:20.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.009+0000 7f24827fc640 1 -- 172.21.15.40:0/759900113 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f247c01b070 con 0x7f248c0c9080 2024-04-22T07:21:20.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.009+0000 7f24827fc640 1 --2- 172.21.15.40:0/759900113 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f247006c920 0x7f247006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:20.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.010+0000 7f24827fc640 1 -- 172.21.15.40:0/759900113 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f247c08ad10 con 0x7f248c0c9080 2024-04-22T07:21:20.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.010+0000 7f2491a10640 1 --2- 172.21.15.40:0/759900113 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f247006c920 0x7f247006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:20.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.010+0000 7f2491a10640 1 --2- 172.21.15.40:0/759900113 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f247006c920 0x7f247006ede0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2488036000 tx=0x7f2488008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:20.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.014+0000 7f24827fc640 1 -- 172.21.15.40:0/759900113 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f247c058af0 con 0x7f248c0c9080 2024-04-22T07:21:20.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.196+0000 7f2493c74640 1 -- 172.21.15.40:0/759900113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f248c0c7ed0 con 0x7f248c0c9080 2024-04-22T07:21:20.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.197+0000 7f24827fc640 1 -- 172.21.15.40:0/759900113 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f247c05cdf0 con 0x7f248c0c9080 2024-04-22T07:21:20.195 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-22T07:21:20.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.198+0000 7f2493c74640 1 -- 172.21.15.40:0/759900113 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f247006c920 msgr2=0x7f247006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.198+0000 7f2493c74640 1 --2- 172.21.15.40:0/759900113 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f247006c920 0x7f247006ede0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2488036000 tx=0x7f2488008030 comp rx=0 tx=0).stop 2024-04-22T07:21:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.198+0000 7f2493c74640 1 -- 172.21.15.40:0/759900113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f248c0c9080 msgr2=0x7f248c1f4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.198+0000 7f2493c74640 1 --2- 172.21.15.40:0/759900113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f248c0c9080 0x7f248c1f4280 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f247c00c460 tx=0x7f247c00c920 comp rx=0 tx=0).stop 2024-04-22T07:21:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.198+0000 7f2493c74640 1 -- 172.21.15.40:0/759900113 shutdown_connections 2024-04-22T07:21:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.198+0000 7f2493c74640 1 --2- 172.21.15.40:0/759900113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f248c15b970 0x7f248c1f47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.198+0000 7f2493c74640 1 --2- 172.21.15.40:0/759900113 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f247006c920 0x7f247006ede0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.198+0000 7f2493c74640 1 --2- 172.21.15.40:0/759900113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f248c0c9080 0x7f248c1f4280 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.198+0000 7f2493c74640 1 --2- 172.21.15.40:0/759900113 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f248c0c75f0 0x7f248c14c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.198+0000 7f2493c74640 1 -- 172.21.15.40:0/759900113 >> 172.21.15.40:0/759900113 conn(0x7f248c067ce0 msgr2=0x7f248c0c30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.199+0000 7f2493c74640 1 -- 172.21.15.40:0/759900113 shutdown_connections 2024-04-22T07:21:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.199+0000 7f2493c74640 1 -- 172.21.15.40:0/759900113 wait complete. 2024-04-22T07:21:20.207 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-22T07:21:20.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.314+0000 7fe3d652e640 1 Processor -- start 2024-04-22T07:21:20.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.314+0000 7fe3d652e640 1 -- start start 2024-04-22T07:21:20.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.315+0000 7fe3d652e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3d00caef0 0x7fe3d00d0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:20.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.315+0000 7fe3d652e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3d015ac50 con 0x7fe3d00d08c0 2024-04-22T07:21:20.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.315+0000 7fe3d652e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3d015af10 con 0x7fe3d00cd380 2024-04-22T07:21:20.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.315+0000 7fe3d652e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe3d00ccef0 con 0x7fe3d00caef0 2024-04-22T07:21:20.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.315+0000 7fe3cffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe3d00d08c0 0x7fe3d00cbd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47920/0 (socket says 172.21.15.40:47920) 2024-04-22T07:21:20.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.315+0000 7fe3cffff640 1 -- 172.21.15.40:0/97021235 learned_addr learned my addr 172.21.15.40:0/97021235 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:20.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.315+0000 7fe3cf7fe640 1 --2- 172.21.15.40:0/97021235 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3d00caef0 0x7fe3d00d0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:20.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.315+0000 7fe3ceffd640 1 -- 172.21.15.40:0/97021235 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 333903193 0 0) 0x7fe3d015ac50 con 0x7fe3d00d08c0 2024-04-22T07:21:20.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.315+0000 7fe3ceffd640 1 -- 172.21.15.40:0/97021235 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3bc003520 con 0x7fe3d00d08c0 2024-04-22T07:21:20.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.315+0000 7fe3ceffd640 1 -- 172.21.15.40:0/97021235 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2574677230 0 0) 0x7fe3bc003520 con 0x7fe3d00d08c0 2024-04-22T07:21:20.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.315+0000 7fe3ceffd640 1 -- 172.21.15.40:0/97021235 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3d00caef0 msgr2=0x7fe3d00d0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:20.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.315+0000 7fe3ceffd640 1 --2- 172.21.15.40:0/97021235 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3d00caef0 0x7fe3d00d0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.315+0000 7fe3ceffd640 1 -- 172.21.15.40:0/97021235 >> v1:172.21.15.62:6789/0 conn(0x7fe3d00cd380 legacy=0x7fe3d00cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:20.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.315+0000 7fe3ceffd640 1 -- 172.21.15.40:0/97021235 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d015b1f0 con 0x7fe3d00d08c0 2024-04-22T07:21:20.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.315+0000 7fe3ceffd640 1 -- 172.21.15.40:0/97021235 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7fe3c0001670 con 0x7fe3d00d08c0 2024-04-22T07:21:20.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.315+0000 7fe3ceffd640 1 -- 172.21.15.40:0/97021235 >> v1:172.21.15.40:6789/0 conn(0x7fe3d00d08c0 legacy=0x7fe3d00cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:20.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.316+0000 7fe3ceffd640 1 --2- 172.21.15.40:0/97021235 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3bc0039e0 0x7fe3bc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:20.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.316+0000 7fe3ceffd640 1 --2- 172.21.15.40:0/97021235 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3d00caef0 0x7fe3bc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:20.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.316+0000 7fe3ceffd640 1 --2- 172.21.15.40:0/97021235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3bc004d40 0x7fe3bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:20.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.316+0000 7fe3ceffd640 1 -- 172.21.15.40:0/97021235 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d00ccef0 con 0x7fe3bc004d40 2024-04-22T07:21:20.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.316+0000 7fe3ceffd640 1 -- 172.21.15.40:0/97021235 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc00b9c0 con 0x7fe3bc0039e0 2024-04-22T07:21:20.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.316+0000 7fe3ceffd640 1 -- 172.21.15.40:0/97021235 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe3bc00bbc0 con 0x7fe3d00caef0 2024-04-22T07:21:20.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.316+0000 7fe3d4acb640 1 --2- 172.21.15.40:0/97021235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3bc004d40 0x7fe3bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:20.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.316+0000 7fe3cffff640 1 --2- 172.21.15.40:0/97021235 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3bc0039e0 0x7fe3bc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:20.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.316+0000 7fe3cf7fe640 1 --2- 172.21.15.40:0/97021235 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3d00caef0 0x7fe3bc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:20.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.316+0000 7fe3d4acb640 1 -- 172.21.15.40:0/97021235 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3d00caef0 msgr2=0x7fe3bc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:20.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.316+0000 7fe3d4acb640 1 --2- 172.21.15.40:0/97021235 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3d00caef0 0x7fe3bc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.316+0000 7fe3d4acb640 1 -- 172.21.15.40:0/97021235 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3bc0039e0 msgr2=0x7fe3bc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:20.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.316+0000 7fe3d4acb640 1 --2- 172.21.15.40:0/97021235 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3bc0039e0 0x7fe3bc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.316+0000 7fe3d4acb640 1 -- 172.21.15.40:0/97021235 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3bc003520 con 0x7fe3bc004d40 2024-04-22T07:21:20.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.317+0000 7fe3d4acb640 1 --2- 172.21.15.40:0/97021235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3bc004d40 0x7fe3bc0051c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8001f60 tx=0x7fe3bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd7163da68ee9a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:20.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.317+0000 7fe3ceffd640 1 -- 172.21.15.40:0/97021235 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8001b30 con 0x7fe3bc004d40 2024-04-22T07:21:20.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.317+0000 7fe3ceffd640 1 -- 172.21.15.40:0/97021235 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3c802d710 con 0x7fe3bc004d40 2024-04-22T07:21:20.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.317+0000 7fe3ceffd640 1 -- 172.21.15.40:0/97021235 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c802db00 con 0x7fe3bc004d40 2024-04-22T07:21:20.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.317+0000 7fe3d652e640 1 -- 172.21.15.40:0/97021235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3bc004d40 msgr2=0x7fe3bc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:20.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.317+0000 7fe3d652e640 1 --2- 172.21.15.40:0/97021235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3bc004d40 0x7fe3bc0051c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8001f60 tx=0x7fe3bc005830 comp rx=0 tx=0).stop 2024-04-22T07:21:20.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.317+0000 7fe3d4acb640 1 -- 172.21.15.40:0/97021235 reap_dead start 2024-04-22T07:21:20.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.317+0000 7fe3d652e640 1 -- 172.21.15.40:0/97021235 shutdown_connections 2024-04-22T07:21:20.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.317+0000 7fe3d652e640 1 -- 172.21.15.40:0/97021235 >> 172.21.15.40:0/97021235 conn(0x7fe3d006ce70 msgr2=0x7fe3d006d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:20.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.317+0000 7fe3d652e640 1 -- 172.21.15.40:0/97021235 shutdown_connections 2024-04-22T07:21:20.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.317+0000 7fe3d652e640 1 -- 172.21.15.40:0/97021235 wait complete. 2024-04-22T07:21:20.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.319+0000 7fe3d652e640 1 Processor -- start 2024-04-22T07:21:20.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.319+0000 7fe3d652e640 1 -- start start 2024-04-22T07:21:20.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.319+0000 7fe3d652e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3bc004d40 0x7fe3d014a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:20.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.319+0000 7fe3d652e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d00d0170 0x7fe3d0158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:20.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.319+0000 7fe3d652e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3d00cf510 0x7fe3d0159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:20.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.319+0000 7fe3d652e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d015ba90 con 0x7fe3d00d0170 2024-04-22T07:21:20.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.319+0000 7fe3d652e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d015b7b0 con 0x7fe3d00cf510 2024-04-22T07:21:20.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.319+0000 7fe3d652e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe3d0072eb0 con 0x7fe3bc004d40 2024-04-22T07:21:20.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.320+0000 7fe3cf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d00d0170 0x7fe3d0158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:20.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.320+0000 7fe3cf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d00d0170 0x7fe3d0158e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56324/0 (socket says 172.21.15.40:56324) 2024-04-22T07:21:20.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.320+0000 7fe3cf7fe640 1 -- 172.21.15.40:0/2143839599 learned_addr learned my addr 172.21.15.40:0/2143839599 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:20.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.320+0000 7fe3d4acb640 1 --2- 172.21.15.40:0/2143839599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3d00cf510 0x7fe3d0159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:20.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.320+0000 7fe3cffff640 1 --2- 172.21.15.40:0/2143839599 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3bc004d40 0x7fe3d014a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:20.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.320+0000 7fe3cf7fe640 1 -- 172.21.15.40:0/2143839599 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3bc004d40 msgr2=0x7fe3d014a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:20.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.320+0000 7fe3cf7fe640 1 --2- 172.21.15.40:0/2143839599 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3bc004d40 0x7fe3d014a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.320+0000 7fe3cf7fe640 1 -- 172.21.15.40:0/2143839599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3d00cf510 msgr2=0x7fe3d0159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:20.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.320+0000 7fe3cf7fe640 1 --2- 172.21.15.40:0/2143839599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3d00cf510 0x7fe3d0159380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.320+0000 7fe3cf7fe640 1 -- 172.21.15.40:0/2143839599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d01e6960 con 0x7fe3d00d0170 2024-04-22T07:21:20.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.320+0000 7fe3d4acb640 1 --2- 172.21.15.40:0/2143839599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3d00cf510 0x7fe3d0159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:20.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.320+0000 7fe3cf7fe640 1 --2- 172.21.15.40:0/2143839599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d00d0170 0x7fe3d0158e40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe3b80119d0 tx=0x7fe3b8011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:20.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.320+0000 7fe3ccff9640 1 -- 172.21.15.40:0/2143839599 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b800fb50 con 0x7fe3d00d0170 2024-04-22T07:21:20.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.320+0000 7fe3ccff9640 1 -- 172.21.15.40:0/2143839599 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3b800fcf0 con 0x7fe3d00d0170 2024-04-22T07:21:20.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.320+0000 7fe3d652e640 1 -- 172.21.15.40:0/2143839599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d01e6c40 con 0x7fe3d00d0170 2024-04-22T07:21:20.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.320+0000 7fe3ccff9640 1 -- 172.21.15.40:0/2143839599 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b800fea0 con 0x7fe3d00d0170 2024-04-22T07:21:20.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.320+0000 7fe3d652e640 1 -- 172.21.15.40:0/2143839599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d01e63a0 con 0x7fe3d00d0170 2024-04-22T07:21:20.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.321+0000 7fe3d652e640 1 -- 172.21.15.40:0/2143839599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3d015f050 con 0x7fe3d00d0170 2024-04-22T07:21:20.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.322+0000 7fe3ccff9640 1 -- 172.21.15.40:0/2143839599 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe3b8012040 con 0x7fe3d00d0170 2024-04-22T07:21:20.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.322+0000 7fe3ccff9640 1 --2- 172.21.15.40:0/2143839599 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe3b006c920 0x7fe3b006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:20.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.322+0000 7fe3ccff9640 1 -- 172.21.15.40:0/2143839599 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe3b808c270 con 0x7fe3d00d0170 2024-04-22T07:21:20.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.322+0000 7fe3cffff640 1 --2- 172.21.15.40:0/2143839599 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe3b006c920 0x7fe3b006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:20.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.322+0000 7fe3cffff640 1 --2- 172.21.15.40:0/2143839599 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe3b006c920 0x7fe3b006ede0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0007cb0 tx=0x7fe3c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:20.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.326+0000 7fe3ccff9640 1 -- 172.21.15.40:0/2143839599 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe3b8019030 con 0x7fe3d00d0170 2024-04-22T07:21:20.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.510+0000 7fe3d652e640 1 -- 172.21.15.40:0/2143839599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe3d004fdc0 con 0x7fe3d00d0170 2024-04-22T07:21:20.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.511+0000 7fe3ccff9640 1 -- 172.21.15.40:0/2143839599 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7fe3b805a620 con 0x7fe3d00d0170 2024-04-22T07:21:20.508 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-04-22T07:21:20.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.512+0000 7fe3d652e640 1 -- 172.21.15.40:0/2143839599 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe3b006c920 msgr2=0x7fe3b006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:20.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.512+0000 7fe3d652e640 1 --2- 172.21.15.40:0/2143839599 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe3b006c920 0x7fe3b006ede0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0007cb0 tx=0x7fe3c0009040 comp rx=0 tx=0).stop 2024-04-22T07:21:20.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.512+0000 7fe3d652e640 1 -- 172.21.15.40:0/2143839599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d00d0170 msgr2=0x7fe3d0158e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:20.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.512+0000 7fe3d652e640 1 --2- 172.21.15.40:0/2143839599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d00d0170 0x7fe3d0158e40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe3b80119d0 tx=0x7fe3b8011e90 comp rx=0 tx=0).stop 2024-04-22T07:21:20.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.512+0000 7fe3d652e640 1 -- 172.21.15.40:0/2143839599 shutdown_connections 2024-04-22T07:21:20.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.512+0000 7fe3d652e640 1 --2- 172.21.15.40:0/2143839599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3d00cf510 0x7fe3d0159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.512+0000 7fe3d652e640 1 --2- 172.21.15.40:0/2143839599 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe3b006c920 0x7fe3b006ede0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.512+0000 7fe3d652e640 1 --2- 172.21.15.40:0/2143839599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d00d0170 0x7fe3d0158e40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.513+0000 7fe3d652e640 1 --2- 172.21.15.40:0/2143839599 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe3bc004d40 0x7fe3d014a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.513+0000 7fe3d652e640 1 -- 172.21.15.40:0/2143839599 >> 172.21.15.40:0/2143839599 conn(0x7fe3d006ce70 msgr2=0x7fe3d0152000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:20.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.513+0000 7fe3d652e640 1 -- 172.21.15.40:0/2143839599 shutdown_connections 2024-04-22T07:21:20.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.513+0000 7fe3d652e640 1 -- 172.21.15.40:0/2143839599 wait complete. 2024-04-22T07:21:20.521 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:21:20.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.624+0000 7fd16dd3b640 1 Processor -- start 2024-04-22T07:21:20.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.624+0000 7fd16dd3b640 1 -- start start 2024-04-22T07:21:20.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.625+0000 7fd16dd3b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd168155040 0x7fd1680c9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:20.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.625+0000 7fd16dd3b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd16806bac0 con 0x7fd16806c050 2024-04-22T07:21:20.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.625+0000 7fd16dd3b640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd16806bd60 con 0x7fd168155420 2024-04-22T07:21:20.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.625+0000 7fd16dd3b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fd16806c5b0 con 0x7fd168155040 2024-04-22T07:21:20.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.625+0000 7fd167fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd16806c050 0x7fd16815b280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47932/0 (socket says 172.21.15.40:47932) 2024-04-22T07:21:20.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.625+0000 7fd167fff640 1 -- 172.21.15.40:0/3504871222 learned_addr learned my addr 172.21.15.40:0/3504871222 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:20.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.625+0000 7fd1677fe640 1 --2- 172.21.15.40:0/3504871222 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd168155040 0x7fd1680c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:20.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.625+0000 7fd1667fc640 1 -- 172.21.15.40:0/3504871222 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1293057132 0 0) 0x7fd16806bac0 con 0x7fd16806c050 2024-04-22T07:21:20.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.625+0000 7fd1667fc640 1 -- 172.21.15.40:0/3504871222 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd150003520 con 0x7fd16806c050 2024-04-22T07:21:20.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.625+0000 7fd1667fc640 1 -- 172.21.15.40:0/3504871222 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1183145854 0 0) 0x7fd150003520 con 0x7fd16806c050 2024-04-22T07:21:20.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.625+0000 7fd1667fc640 1 -- 172.21.15.40:0/3504871222 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd168155040 msgr2=0x7fd1680c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:20.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.625+0000 7fd1667fc640 1 --2- 172.21.15.40:0/3504871222 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd168155040 0x7fd1680c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.625+0000 7fd1667fc640 1 -- 172.21.15.40:0/3504871222 >> v1:172.21.15.62:6789/0 conn(0x7fd168155420 legacy=0x7fd1680676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:20.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.625+0000 7fd1667fc640 1 -- 172.21.15.40:0/3504871222 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd16806cc30 con 0x7fd16806c050 2024-04-22T07:21:20.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.625+0000 7fd1667fc640 1 -- 172.21.15.40:0/3504871222 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7fd1600019f0 con 0x7fd16806c050 2024-04-22T07:21:20.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.625+0000 7fd1667fc640 1 -- 172.21.15.40:0/3504871222 >> v1:172.21.15.40:6789/0 conn(0x7fd16806c050 legacy=0x7fd16815b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:20.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.625+0000 7fd1667fc640 1 --2- 172.21.15.40:0/3504871222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1500039e0 0x7fd150003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:20.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.626+0000 7fd1667fc640 1 --2- 172.21.15.40:0/3504871222 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd168155040 0x7fd150004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:20.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.626+0000 7fd1667fc640 1 --2- 172.21.15.40:0/3504871222 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd150004d40 0x7fd1500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:20.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.626+0000 7fd1667fc640 1 -- 172.21.15.40:0/3504871222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd16806c5b0 con 0x7fd1500039e0 2024-04-22T07:21:20.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.626+0000 7fd1667fc640 1 -- 172.21.15.40:0/3504871222 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd15000bb00 con 0x7fd150004d40 2024-04-22T07:21:20.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.626+0000 7fd1667fc640 1 -- 172.21.15.40:0/3504871222 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fd15000bd00 con 0x7fd168155040 2024-04-22T07:21:20.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.626+0000 7fd1677fe640 1 --2- 172.21.15.40:0/3504871222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1500039e0 0x7fd150003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:20.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.626+0000 7fd166ffd640 1 --2- 172.21.15.40:0/3504871222 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd168155040 0x7fd150004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:20.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.626+0000 7fd167fff640 1 --2- 172.21.15.40:0/3504871222 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd150004d40 0x7fd1500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:20.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.626+0000 7fd1677fe640 1 -- 172.21.15.40:0/3504871222 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd168155040 msgr2=0x7fd150004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:20.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.626+0000 7fd1677fe640 1 --2- 172.21.15.40:0/3504871222 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd168155040 0x7fd150004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.626+0000 7fd1677fe640 1 -- 172.21.15.40:0/3504871222 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd150004d40 msgr2=0x7fd1500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:20.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.626+0000 7fd1677fe640 1 --2- 172.21.15.40:0/3504871222 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd150004d40 0x7fd1500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.626+0000 7fd1677fe640 1 -- 172.21.15.40:0/3504871222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd150003520 con 0x7fd1500039e0 2024-04-22T07:21:20.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.626+0000 7fd166ffd640 1 --2- 172.21.15.40:0/3504871222 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd168155040 0x7fd150004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:20.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.627+0000 7fd1677fe640 1 --2- 172.21.15.40:0/3504871222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1500039e0 0x7fd150003e00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd158009a90 tx=0x7fd150005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9d02aa51c1be7e server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:20.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.627+0000 7fd1667fc640 1 -- 172.21.15.40:0/3504871222 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd158039070 con 0x7fd1500039e0 2024-04-22T07:21:20.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.627+0000 7fd1667fc640 1 -- 172.21.15.40:0/3504871222 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd15802c680 con 0x7fd1500039e0 2024-04-22T07:21:20.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.627+0000 7fd1667fc640 1 -- 172.21.15.40:0/3504871222 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd158009690 con 0x7fd1500039e0 2024-04-22T07:21:20.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.627+0000 7fd16dd3b640 1 -- 172.21.15.40:0/3504871222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1500039e0 msgr2=0x7fd150003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:20.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.627+0000 7fd16dd3b640 1 --2- 172.21.15.40:0/3504871222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1500039e0 0x7fd150003e00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd158009a90 tx=0x7fd150005830 comp rx=0 tx=0).stop 2024-04-22T07:21:20.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.627+0000 7fd167fff640 1 -- 172.21.15.40:0/3504871222 reap_dead start 2024-04-22T07:21:20.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.627+0000 7fd16dd3b640 1 -- 172.21.15.40:0/3504871222 shutdown_connections 2024-04-22T07:21:20.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.627+0000 7fd16dd3b640 1 -- 172.21.15.40:0/3504871222 >> 172.21.15.40:0/3504871222 conn(0x7fd1680cdb70 msgr2=0x7fd1680c9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:20.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.627+0000 7fd16dd3b640 1 -- 172.21.15.40:0/3504871222 shutdown_connections 2024-04-22T07:21:20.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.627+0000 7fd16dd3b640 1 -- 172.21.15.40:0/3504871222 wait complete. 2024-04-22T07:21:20.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.628+0000 7fd16dd3b640 1 Processor -- start 2024-04-22T07:21:20.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.629+0000 7fd16dd3b640 1 -- start start 2024-04-22T07:21:20.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.629+0000 7fd16dd3b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1500039e0 0x7fd168159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:20.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.629+0000 7fd16dd3b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd168155820 0x7fd16815a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:20.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.629+0000 7fd16dd3b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1681f1580 0x7fd1681f1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:20.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.629+0000 7fd16dd3b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd168067dc0 con 0x7fd1681f1580 2024-04-22T07:21:20.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.629+0000 7fd16dd3b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd16806d280 con 0x7fd1500039e0 2024-04-22T07:21:20.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.629+0000 7fd16dd3b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fd168067f40 con 0x7fd168155820 2024-04-22T07:21:20.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.629+0000 7fd167fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1681f1580 0x7fd1681f1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:20.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.630+0000 7fd167fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1681f1580 0x7fd1681f1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56332/0 (socket says 172.21.15.40:56332) 2024-04-22T07:21:20.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.630+0000 7fd167fff640 1 -- 172.21.15.40:0/3473189722 learned_addr learned my addr 172.21.15.40:0/3473189722 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:20.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.630+0000 7fd166ffd640 1 --2- 172.21.15.40:0/3473189722 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd168155820 0x7fd16815a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:20.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.630+0000 7fd1677fe640 1 --2- 172.21.15.40:0/3473189722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1500039e0 0x7fd168159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:20.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.630+0000 7fd167fff640 1 -- 172.21.15.40:0/3473189722 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd168155820 msgr2=0x7fd16815a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:20.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.630+0000 7fd167fff640 1 --2- 172.21.15.40:0/3473189722 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd168155820 0x7fd16815a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.630+0000 7fd167fff640 1 -- 172.21.15.40:0/3473189722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1500039e0 msgr2=0x7fd168159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:20.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.630+0000 7fd167fff640 1 --2- 172.21.15.40:0/3473189722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1500039e0 0x7fd168159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.630+0000 7fd167fff640 1 -- 172.21.15.40:0/3473189722 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd16814ee90 con 0x7fd1681f1580 2024-04-22T07:21:20.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.630+0000 7fd167fff640 1 --2- 172.21.15.40:0/3473189722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1681f1580 0x7fd1681f1a00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd1680c4880 tx=0x7fd16000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:20.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.630+0000 7fd14ffff640 1 -- 172.21.15.40:0/3473189722 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16000ebb0 con 0x7fd1681f1580 2024-04-22T07:21:20.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.630+0000 7fd14ffff640 1 -- 172.21.15.40:0/3473189722 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd16000ed70 con 0x7fd1681f1580 2024-04-22T07:21:20.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.630+0000 7fd14ffff640 1 -- 172.21.15.40:0/3473189722 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd160014670 con 0x7fd1681f1580 2024-04-22T07:21:20.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.630+0000 7fd16dd3b640 1 -- 172.21.15.40:0/3473189722 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1681f47a0 con 0x7fd1681f1580 2024-04-22T07:21:20.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.630+0000 7fd16dd3b640 1 -- 172.21.15.40:0/3473189722 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1681f4d60 con 0x7fd1681f1580 2024-04-22T07:21:20.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.631+0000 7fd16dd3b640 1 -- 172.21.15.40:0/3473189722 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd168069d40 con 0x7fd1681f1580 2024-04-22T07:21:20.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.632+0000 7fd14ffff640 1 -- 172.21.15.40:0/3473189722 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd160014810 con 0x7fd1681f1580 2024-04-22T07:21:20.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.632+0000 7fd14ffff640 1 --2- 172.21.15.40:0/3473189722 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fd15406c8f0 0x7fd15406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:20.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.632+0000 7fd14ffff640 1 -- 172.21.15.40:0/3473189722 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd16008b850 con 0x7fd1681f1580 2024-04-22T07:21:20.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.632+0000 7fd1677fe640 1 --2- 172.21.15.40:0/3473189722 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fd15406c8f0 0x7fd15406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:20.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.633+0000 7fd1677fe640 1 --2- 172.21.15.40:0/3473189722 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fd15406c8f0 0x7fd15406edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd158036000 tx=0x7fd158030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:20.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.637+0000 7fd14ffff640 1 -- 172.21.15.40:0/3473189722 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd16814ee90 con 0x7fd1681f1580 2024-04-22T07:21:20.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.858+0000 7fd16dd3b640 1 -- 172.21.15.40:0/3473189722 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd16815f3c0 con 0x7fd1681f1580 2024-04-22T07:21:20.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.859+0000 7fd14ffff640 1 -- 172.21.15.40:0/3473189722 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6821 (secure 0 0 0) 0x7fd1600595a0 con 0x7fd1681f1580 2024-04-22T07:21:20.857 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:21:20.857 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1193926607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1193926607},{"type":"v1","addr":"172.21.15.62:6835","nonce":1193926607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/602167189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":602167189},{"type":"v1","addr":"172.21.15.62:6837","nonce":602167189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2062933254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2062933254},{"type":"v1","addr":"172.21.15.40:6835","nonce":2062933254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3873524978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3873524978},{"type":"v1","addr":"172.21.15.40:6837","nonce":3873524978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/1922761385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":1922761385},{"type":"v1","addr":"172.21.15.40:6839","nonce":1922761385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:20:53.216204+0000","modified":"2024-04-22T07:20:58.875393+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.62:6836/2884673656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2884673656},{"type":"v1","addr":"172.21.15.62:6836","nonce":2884673656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4305]},"id":1}]} 2024-04-22T07:21:20.857 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-04-22T07:21:20.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.861+0000 7fd16dd3b640 1 -- 172.21.15.40:0/3473189722 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fd15406c8f0 msgr2=0x7fd15406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:20.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.861+0000 7fd16dd3b640 1 --2- 172.21.15.40:0/3473189722 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fd15406c8f0 0x7fd15406edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd158036000 tx=0x7fd158030000 comp rx=0 tx=0).stop 2024-04-22T07:21:20.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.861+0000 7fd16dd3b640 1 -- 172.21.15.40:0/3473189722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1681f1580 msgr2=0x7fd1681f1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:20.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.861+0000 7fd16dd3b640 1 --2- 172.21.15.40:0/3473189722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1681f1580 0x7fd1681f1a00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd1680c4880 tx=0x7fd16000e530 comp rx=0 tx=0).stop 2024-04-22T07:21:20.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.861+0000 7fd16dd3b640 1 -- 172.21.15.40:0/3473189722 shutdown_connections 2024-04-22T07:21:20.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.861+0000 7fd16dd3b640 1 --2- 172.21.15.40:0/3473189722 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fd15406c8f0 0x7fd15406edb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.861+0000 7fd16dd3b640 1 --2- 172.21.15.40:0/3473189722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1681f1580 0x7fd1681f1a00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.861+0000 7fd16dd3b640 1 --2- 172.21.15.40:0/3473189722 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd168155820 0x7fd16815a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.861+0000 7fd16dd3b640 1 --2- 172.21.15.40:0/3473189722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1500039e0 0x7fd168159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.861+0000 7fd16dd3b640 1 -- 172.21.15.40:0/3473189722 >> 172.21.15.40:0/3473189722 conn(0x7fd1680cdb70 msgr2=0x7fd168154210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:20.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.861+0000 7fd16dd3b640 1 -- 172.21.15.40:0/3473189722 shutdown_connections 2024-04-22T07:21:20.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.861+0000 7fd16dd3b640 1 -- 172.21.15.40:0/3473189722 wait complete. 2024-04-22T07:21:20.870 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:21:20.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.973+0000 7f5716211640 1 Processor -- start 2024-04-22T07:21:20.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.974+0000 7f5716211640 1 -- start start 2024-04-22T07:21:20.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.974+0000 7f5716211640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5710158700 0x7f571006b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:20.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.974+0000 7f5716211640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f57100c9090 0x7f571015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:20.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.974+0000 7f5716211640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57100ca0a0 con 0x7f571006cbb0 2024-04-22T07:21:20.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.974+0000 7f5716211640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f57100ca380 con 0x7f57100c9090 2024-04-22T07:21:20.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.974+0000 7f5716211640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f57100ca660 con 0x7f5710158700 2024-04-22T07:21:20.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.974+0000 7f570ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f57100c9090 0x7f571015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:20.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.974+0000 7f570effd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f571006cbb0 0x7f571006f820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47946/0 (socket says 172.21.15.40:47946) 2024-04-22T07:21:20.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.974+0000 7f570effd640 1 -- 172.21.15.40:0/3524446185 learned_addr learned my addr 172.21.15.40:0/3524446185 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:20.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.975+0000 7f570ffff640 1 -- 172.21.15.40:0/3524446185 >> v2:172.21.15.62:3300/0 conn(0x7f5710158700 msgr2=0x7f571006b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:20.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.975+0000 7f570f7fe640 1 --2- 172.21.15.40:0/3524446185 >> v2:172.21.15.62:3300/0 conn(0x7f5710158700 0x7f571006b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:20.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.975+0000 7f570e7fc640 1 -- 172.21.15.40:0/3524446185 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1161589938 0 0) 0x7f57100ca0a0 con 0x7f571006cbb0 2024-04-22T07:21:20.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.975+0000 7f570ffff640 1 --2- 172.21.15.40:0/3524446185 >> v2:172.21.15.62:3300/0 conn(0x7f5710158700 0x7f571006b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.975+0000 7f570ffff640 1 -- 172.21.15.40:0/3524446185 >> v1:172.21.15.40:6789/0 conn(0x7f571006cbb0 legacy=0x7f571006f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:20.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.975+0000 7f570ffff640 1 -- 172.21.15.40:0/3524446185 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57100ca940 con 0x7f57100c9090 2024-04-22T07:21:20.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.976+0000 7f570ffff640 1 --2- 172.21.15.40:0/3524446185 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57100c9090 0x7f571015e920 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f57100cb680 tx=0x7f570802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b76458ff5cb36a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:20.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.976+0000 7f570e7fc640 1 -- 172.21.15.40:0/3524446185 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5708039070 con 0x7f57100c9090 2024-04-22T07:21:20.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.976+0000 7f570e7fc640 1 -- 172.21.15.40:0/3524446185 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f570802cd00 con 0x7f57100c9090 2024-04-22T07:21:20.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.976+0000 7f570e7fc640 1 -- 172.21.15.40:0/3524446185 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5708034660 con 0x7f57100c9090 2024-04-22T07:21:20.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.976+0000 7f5716211640 1 -- 172.21.15.40:0/3524446185 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57100c9090 msgr2=0x7f571015e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:20.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.976+0000 7f5716211640 1 --2- 172.21.15.40:0/3524446185 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57100c9090 0x7f571015e920 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f57100cb680 tx=0x7f570802bf50 comp rx=0 tx=0).stop 2024-04-22T07:21:20.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.976+0000 7f5716211640 1 -- 172.21.15.40:0/3524446185 shutdown_connections 2024-04-22T07:21:20.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.976+0000 7f5716211640 1 --2- 172.21.15.40:0/3524446185 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57100c9090 0x7f571015e920 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.976+0000 7f5716211640 1 --2- 172.21.15.40:0/3524446185 >> v2:172.21.15.62:3300/0 conn(0x7f5710158700 0x7f571006b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.976+0000 7f5716211640 1 -- 172.21.15.40:0/3524446185 >> 172.21.15.40:0/3524446185 conn(0x7f571006dd10 msgr2=0x7f571006e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:20.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.976+0000 7f5716211640 1 -- 172.21.15.40:0/3524446185 shutdown_connections 2024-04-22T07:21:20.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.976+0000 7f5716211640 1 -- 172.21.15.40:0/3524446185 wait complete. 2024-04-22T07:21:20.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.977+0000 7f5716211640 1 Processor -- start 2024-04-22T07:21:20.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.978+0000 7f5716211640 1 -- start start 2024-04-22T07:21:20.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.978+0000 7f5716211640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f571006cbb0 0x7f571014e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:20.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.978+0000 7f5716211640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57100c9090 0x7f5710156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:20.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.978+0000 7f5716211640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5710158700 0x7f5710157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:20.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.978+0000 7f5716211640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f57100700b0 con 0x7f57100c9090 2024-04-22T07:21:20.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.978+0000 7f5716211640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f571006ff30 con 0x7f571006cbb0 2024-04-22T07:21:20.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.978+0000 7f5716211640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f571015ee60 con 0x7f5710158700 2024-04-22T07:21:20.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.978+0000 7f570effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57100c9090 0x7f5710156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:20.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.979+0000 7f570effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57100c9090 0x7f5710156ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56358/0 (socket says 172.21.15.40:56358) 2024-04-22T07:21:20.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.979+0000 7f570effd640 1 -- 172.21.15.40:0/233467588 learned_addr learned my addr 172.21.15.40:0/233467588 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:20.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.979+0000 7f570f7fe640 1 --2- 172.21.15.40:0/233467588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f571006cbb0 0x7f571014e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:20.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.979+0000 7f570ffff640 1 --2- 172.21.15.40:0/233467588 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5710158700 0x7f5710157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:20.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.979+0000 7f570effd640 1 -- 172.21.15.40:0/233467588 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5710158700 msgr2=0x7f5710157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:20.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.979+0000 7f570effd640 1 --2- 172.21.15.40:0/233467588 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5710158700 0x7f5710157410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.979+0000 7f570effd640 1 -- 172.21.15.40:0/233467588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f571006cbb0 msgr2=0x7f571014e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:20.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.979+0000 7f570effd640 1 --2- 172.21.15.40:0/233467588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f571006cbb0 0x7f571014e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:20.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.979+0000 7f570effd640 1 -- 172.21.15.40:0/233467588 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571015e3a0 con 0x7f57100c9090 2024-04-22T07:21:20.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.979+0000 7f570ffff640 1 --2- 172.21.15.40:0/233467588 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5710158700 0x7f5710157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:20.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.979+0000 7f570f7fe640 1 --2- 172.21.15.40:0/233467588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f571006cbb0 0x7f571014e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:20.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.979+0000 7f570effd640 1 --2- 172.21.15.40:0/233467588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57100c9090 0x7f5710156ed0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f570400c500 tx=0x7f570400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:20.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.979+0000 7f56f7fff640 1 -- 172.21.15.40:0/233467588 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5704018070 con 0x7f57100c9090 2024-04-22T07:21:20.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.979+0000 7f56f7fff640 1 -- 172.21.15.40:0/233467588 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5704007580 con 0x7f57100c9090 2024-04-22T07:21:20.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.979+0000 7f5716211640 1 -- 172.21.15.40:0/233467588 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5710150510 con 0x7f57100c9090 2024-04-22T07:21:20.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.979+0000 7f56f7fff640 1 -- 172.21.15.40:0/233467588 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5704004a20 con 0x7f57100c9090 2024-04-22T07:21:20.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.979+0000 7f5716211640 1 -- 172.21.15.40:0/233467588 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57101569b0 con 0x7f57100c9090 2024-04-22T07:21:20.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.980+0000 7f5716211640 1 -- 172.21.15.40:0/233467588 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5710150a30 con 0x7f57100c9090 2024-04-22T07:21:20.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.981+0000 7f56f7fff640 1 -- 172.21.15.40:0/233467588 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f570401b070 con 0x7f57100c9090 2024-04-22T07:21:20.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.981+0000 7f56f7fff640 1 --2- 172.21.15.40:0/233467588 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f56fc06c8f0 0x7f56fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:20.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.981+0000 7f56f7fff640 1 -- 172.21.15.40:0/233467588 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f570408aeb0 con 0x7f57100c9090 2024-04-22T07:21:20.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.981+0000 7f570f7fe640 1 --2- 172.21.15.40:0/233467588 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f56fc06c8f0 0x7f56fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:20.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.982+0000 7f570f7fe640 1 --2- 172.21.15.40:0/233467588 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f56fc06c8f0 0x7f56fc06edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f570000b820 tx=0x7f5700008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:20.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:20.985+0000 7f56f7fff640 1 -- 172.21.15.40:0/233467588 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5710150a30 con 0x7f57100c9090 2024-04-22T07:21:21.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.171+0000 7f5716211640 1 -- 172.21.15.40:0/233467588 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5710068b20 con 0x7f57100c9090 2024-04-22T07:21:21.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.172+0000 7f56f7fff640 1 -- 172.21.15.40:0/233467588 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16537 (secure 0 0 0) 0x7f57040592e0 con 0x7f57100c9090 2024-04-22T07:21:21.171 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:21:21.171 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":23,"fsid":"dd5b16e4-89fe-4602-b37f-062846793158","created":"2024-04-22T07:20:29.488892+0000","modified":"2024-04-22T07:20:54.858120+0000","last_up_change":"2024-04-22T07:20:40.397383+0000","last_in_change":"2024-04-22T07:20:31.702551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:20:41.793179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:20:51.815779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:20:52.164265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32238b7e-228b-4a67-bfca-16e8f0020a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6801","nonce":1526385055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6803","nonce":1526385055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6807","nonce":1526385055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6805","nonce":1526385055}]},"public_addr":"172.21.15.40:6801/1526385055","cluster_addr":"172.21.15.40:6803/1526385055","heartbeat_back_addr":"172.21.15.40:6807/1526385055","heartbeat_front_addr":"172.21.15.40:6805/1526385055","state":["exists","up"]},{"osd":1,"uuid":"5ad8da43-39b1-4295-b4d1-0f1e1d06fc0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6809","nonce":623026645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6811","nonce":623026645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6815","nonce":623026645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6813","nonce":623026645}]},"public_addr":"172.21.15.40:6809/623026645","cluster_addr":"172.21.15.40:6811/623026645","heartbeat_back_addr":"172.21.15.40:6815/623026645","heartbeat_front_addr":"172.21.15.40:6813/623026645","state":["exists","up"]},{"osd":2,"uuid":"7d2c6d50-719d-4232-ad47-f04dcf1a8bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6820","nonce":1885686505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6824","nonce":1885686505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6831","nonce":1885686505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6828","nonce":1885686505}]},"public_addr":"172.21.15.40:6820/1885686505","cluster_addr":"172.21.15.40:6824/1885686505","heartbeat_back_addr":"172.21.15.40:6831/1885686505","heartbeat_front_addr":"172.21.15.40:6828/1885686505","state":["exists","up"]},{"osd":3,"uuid":"af42e7d6-a6bf-403e-92e7-162d7c4fbf0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6817","nonce":130276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6819","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6821","nonce":130276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6829","nonce":130276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6823","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6825","nonce":130276746}]},"public_addr":"172.21.15.40:6817/130276746","cluster_addr":"172.21.15.40:6821/130276746","heartbeat_back_addr":"172.21.15.40:6829/130276746","heartbeat_front_addr":"172.21.15.40:6825/130276746","state":["exists","up"]},{"osd":4,"uuid":"f8e89e0d-be96-4f19-88c0-69c408df7d98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6801","nonce":2251435758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6803","nonce":2251435758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6807","nonce":2251435758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6805","nonce":2251435758}]},"public_addr":"172.21.15.62:6801/2251435758","cluster_addr":"172.21.15.62:6803/2251435758","heartbeat_back_addr":"172.21.15.62:6807/2251435758","heartbeat_front_addr":"172.21.15.62:6805/2251435758","state":["exists","up"]},{"osd":5,"uuid":"ba6dc1bc-272b-4f80-b55f-40bc4a0c3ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6809","nonce":3509322231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6811","nonce":3509322231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6815","nonce":3509322231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6813","nonce":3509322231}]},"public_addr":"172.21.15.62:6809/3509322231","cluster_addr":"172.21.15.62:6811/3509322231","heartbeat_back_addr":"172.21.15.62:6815/3509322231","heartbeat_front_addr":"172.21.15.62:6813/3509322231","state":["exists","up"]},{"osd":6,"uuid":"834fcd74-14bf-45ec-a10a-0374f4ce9bf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6825","nonce":3094315954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6827","nonce":3094315954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6831","nonce":3094315954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6829","nonce":3094315954}]},"public_addr":"172.21.15.62:6825/3094315954","cluster_addr":"172.21.15.62:6827/3094315954","heartbeat_back_addr":"172.21.15.62:6831/3094315954","heartbeat_front_addr":"172.21.15.62:6829/3094315954","state":["exists","up"]},{"osd":7,"uuid":"831c9a73-960e-4d2e-b86a-33a6916be059","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6817","nonce":147453972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6819","nonce":147453972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6823","nonce":147453972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6821","nonce":147453972}]},"public_addr":"172.21.15.62:6817/147453972","cluster_addr":"172.21.15.62:6819/147453972","heartbeat_back_addr":"172.21.15.62:6823/147453972","heartbeat_front_addr":"172.21.15.62:6821/147453972","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.828738+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.873471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.908090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.894782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:37.686796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.801123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.852323+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.812139+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:21:21.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.174+0000 7f5716211640 1 -- 172.21.15.40:0/233467588 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f56fc06c8f0 msgr2=0x7f56fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:21.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.174+0000 7f5716211640 1 --2- 172.21.15.40:0/233467588 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f56fc06c8f0 0x7f56fc06edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f570000b820 tx=0x7f5700008040 comp rx=0 tx=0).stop 2024-04-22T07:21:21.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.174+0000 7f5716211640 1 -- 172.21.15.40:0/233467588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57100c9090 msgr2=0x7f5710156ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:21.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.174+0000 7f5716211640 1 --2- 172.21.15.40:0/233467588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57100c9090 0x7f5710156ed0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f570400c500 tx=0x7f570400c9c0 comp rx=0 tx=0).stop 2024-04-22T07:21:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.174+0000 7f5716211640 1 -- 172.21.15.40:0/233467588 shutdown_connections 2024-04-22T07:21:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.174+0000 7f5716211640 1 --2- 172.21.15.40:0/233467588 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5710158700 0x7f5710157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.174+0000 7f5716211640 1 --2- 172.21.15.40:0/233467588 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f56fc06c8f0 0x7f56fc06edb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.174+0000 7f5716211640 1 --2- 172.21.15.40:0/233467588 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f57100c9090 0x7f5710156ed0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.174+0000 7f5716211640 1 --2- 172.21.15.40:0/233467588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f571006cbb0 0x7f571014e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.174+0000 7f5716211640 1 -- 172.21.15.40:0/233467588 >> 172.21.15.40:0/233467588 conn(0x7f571006dd10 msgr2=0x7f57100c3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.174+0000 7f5716211640 1 -- 172.21.15.40:0/233467588 shutdown_connections 2024-04-22T07:21:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.175+0000 7f5716211640 1 -- 172.21.15.40:0/233467588 wait complete. 2024-04-22T07:21:21.184 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with random seed 780919 2024-04-22T07:21:21.184 DEBUG:tasks.quiescer:Yielding 2024-04-22T07:21:21.185 INFO:teuthology.run_tasks:Running task workunit... 2024-04-22T07:21:21.198 INFO:tasks.workunit:Pulling workunits from ref 86f7587a5a09af35f0895e1a2d08527638fae697 2024-04-22T07:21:21.198 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-22T07:21:21.198 INFO:tasks.workunit:timeout=3h 2024-04-22T07:21:21.198 INFO:tasks.workunit:cleanup=True 2024-04-22T07:21:21.198 DEBUG:teuthology.orchestra.run.smithi040:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-22T07:21:21.199 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:21:21.215 INFO:teuthology.orchestra.run.smithi040.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-22T07:21:21.215 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-22T07:21:21.215 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 2bh/43d Inode: 1 Links: 2 2024-04-22T07:21:21.216 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-22T07:21:21.216 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-22T07:21:21.216 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-22T07:21:21.216 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-04-22 07:20:58.861260596 +0000 2024-04-22T07:21:21.216 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-04-22 07:21:14.971958563 +0000 2024-04-22T07:21:21.216 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-04-22 07:20:58.861260596 +0000 2024-04-22T07:21:21.216 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-22T07:21:21.217 DEBUG:teuthology.orchestra.run.smithi040:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-22T07:21:21.284 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 86f7587a5a09af35f0895e1a2d08527638fae697 2024-04-22T07:21:21.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.303+0000 7f239c14b640 1 Processor -- start 2024-04-22T07:21:21.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.303+0000 7f239c14b640 1 -- start start 2024-04-22T07:21:21.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.304+0000 7f239c14b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2394154f50 0x7f23940cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:21.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.304+0000 7f239c14b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f239415b3e0 0x7f239415b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:21.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.304+0000 7f239c14b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f239415bd90 con 0x7f23940cc5a0 2024-04-22T07:21:21.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.304+0000 7f239c14b640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f239415af50 con 0x7f239415b3e0 2024-04-22T07:21:21.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.304+0000 7f239c14b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f239415e6e0 con 0x7f2394154f50 2024-04-22T07:21:21.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.304+0000 7f23996e6640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f23940cc5a0 0x7f23940d0590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47962/0 (socket says 172.21.15.40:47962) 2024-04-22T07:21:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.304+0000 7f23996e6640 1 -- 172.21.15.40:0/545356901 learned_addr learned my addr 172.21.15.40:0/545356901 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.304+0000 7f239a6e8640 1 --2- 172.21.15.40:0/545356901 >> v2:172.21.15.62:3300/0 conn(0x7f239415b3e0 0x7f239415b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.304+0000 7f2399ee7640 1 --2- 172.21.15.40:0/545356901 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2394154f50 0x7f23940cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.304+0000 7f2398ee5640 1 -- 172.21.15.40:0/545356901 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3773046842 0 0) 0x7f2384001110 con 0x7f23940cc5a0 2024-04-22T07:21:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.304+0000 7f2398ee5640 1 -- 172.21.15.40:0/545356901 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2380003520 con 0x7f23940cc5a0 2024-04-22T07:21:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.304+0000 7f2398ee5640 1 -- 172.21.15.40:0/545356901 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 390581197 0 0) 0x7f2380003520 con 0x7f23940cc5a0 2024-04-22T07:21:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.304+0000 7f2398ee5640 1 -- 172.21.15.40:0/545356901 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2394154f50 msgr2=0x7f23940cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.304+0000 7f2398ee5640 1 --2- 172.21.15.40:0/545356901 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2394154f50 0x7f23940cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.304+0000 7f2398ee5640 1 -- 172.21.15.40:0/545356901 >> v2:172.21.15.62:3300/0 conn(0x7f239415b3e0 msgr2=0x7f239415b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.304+0000 7f2398ee5640 1 --2- 172.21.15.40:0/545356901 >> v2:172.21.15.62:3300/0 conn(0x7f239415b3e0 0x7f239415b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.304+0000 7f2398ee5640 1 -- 172.21.15.40:0/545356901 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f239415e9c0 con 0x7f23940cc5a0 2024-04-22T07:21:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.304+0000 7f2398ee5640 1 -- 172.21.15.40:0/545356901 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7f2384001840 con 0x7f23940cc5a0 2024-04-22T07:21:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.305+0000 7f2398ee5640 1 -- 172.21.15.40:0/545356901 >> v1:172.21.15.40:6789/0 conn(0x7f23940cc5a0 legacy=0x7f23940d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:21.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.305+0000 7f2398ee5640 1 --2- 172.21.15.40:0/545356901 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2394154f50 0x7f23800039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.305+0000 7f2398ee5640 1 --2- 172.21.15.40:0/545356901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2380003f30 0x7f2380004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.305+0000 7f2398ee5640 1 --2- 172.21.15.40:0/545356901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2380004d40 0x7f23800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.305+0000 7f2398ee5640 1 -- 172.21.15.40:0/545356901 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f239415af50 con 0x7f2380004d40 2024-04-22T07:21:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.305+0000 7f2398ee5640 1 -- 172.21.15.40:0/545356901 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f239415e6e0 con 0x7f2380003f30 2024-04-22T07:21:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.305+0000 7f2398ee5640 1 -- 172.21.15.40:0/545356901 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f238000b9f0 con 0x7f2394154f50 2024-04-22T07:21:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.305+0000 7f239a6e8640 1 --2- 172.21.15.40:0/545356901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2380004d40 0x7f23800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.305+0000 7f23996e6640 1 --2- 172.21.15.40:0/545356901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2380003f30 0x7f2380004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.305+0000 7f2399ee7640 1 --2- 172.21.15.40:0/545356901 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2394154f50 0x7f23800039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.305+0000 7f239a6e8640 1 -- 172.21.15.40:0/545356901 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2394154f50 msgr2=0x7f23800039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.305+0000 7f239a6e8640 1 --2- 172.21.15.40:0/545356901 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2394154f50 0x7f23800039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.305+0000 7f239a6e8640 1 -- 172.21.15.40:0/545356901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2380003f30 msgr2=0x7f2380004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.305+0000 7f239a6e8640 1 --2- 172.21.15.40:0/545356901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2380003f30 0x7f2380004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.305+0000 7f239a6e8640 1 -- 172.21.15.40:0/545356901 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2380003520 con 0x7f2380004d40 2024-04-22T07:21:21.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.306+0000 7f239a6e8640 1 --2- 172.21.15.40:0/545356901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2380004d40 0x7f23800051c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f238c009fc0 tx=0x7f2380005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a772595c6acae330 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:21.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.306+0000 7f2398ee5640 1 -- 172.21.15.40:0/545356901 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c039070 con 0x7f2380004d40 2024-04-22T07:21:21.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.306+0000 7f2398ee5640 1 -- 172.21.15.40:0/545356901 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f238c02cc60 con 0x7f2380004d40 2024-04-22T07:21:21.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.306+0000 7f2398ee5640 1 -- 172.21.15.40:0/545356901 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c009c10 con 0x7f2380004d40 2024-04-22T07:21:21.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.307+0000 7f239c14b640 1 -- 172.21.15.40:0/545356901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2380004d40 msgr2=0x7f23800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:21.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.307+0000 7f239c14b640 1 --2- 172.21.15.40:0/545356901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2380004d40 0x7f23800051c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f238c009fc0 tx=0x7f2380005830 comp rx=0 tx=0).stop 2024-04-22T07:21:21.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.307+0000 7f239a6e8640 1 -- 172.21.15.40:0/545356901 reap_dead start 2024-04-22T07:21:21.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.307+0000 7f239c14b640 1 -- 172.21.15.40:0/545356901 shutdown_connections 2024-04-22T07:21:21.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.307+0000 7f239c14b640 1 -- 172.21.15.40:0/545356901 >> 172.21.15.40:0/545356901 conn(0x7f23940676b0 msgr2=0x7f2394067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:21.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.307+0000 7f239c14b640 1 -- 172.21.15.40:0/545356901 shutdown_connections 2024-04-22T07:21:21.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.307+0000 7f239c14b640 1 -- 172.21.15.40:0/545356901 wait complete. 2024-04-22T07:21:21.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.308+0000 7f239c14b640 1 Processor -- start 2024-04-22T07:21:21.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.308+0000 7f239c14b640 1 -- start start 2024-04-22T07:21:21.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.309+0000 7f239c14b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2380004d40 0x7f23941541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:21.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.309+0000 7f239c14b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23941f3d20 0x7f239414a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:21.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.309+0000 7f239c14b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23940b47d0 0x7f2394144f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:21.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.309+0000 7f239c14b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f239415f260 con 0x7f23940b47d0 2024-04-22T07:21:21.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.309+0000 7f239c14b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f239415ef80 con 0x7f23941f3d20 2024-04-22T07:21:21.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.309+0000 7f239c14b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f239415e3a0 con 0x7f2380004d40 2024-04-22T07:21:21.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.309+0000 7f239a6e8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23940b47d0 0x7f2394144f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:21.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.309+0000 7f239a6e8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23940b47d0 0x7f2394144f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56386/0 (socket says 172.21.15.40:56386) 2024-04-22T07:21:21.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.309+0000 7f239a6e8640 1 -- 172.21.15.40:0/243445683 learned_addr learned my addr 172.21.15.40:0/243445683 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:21.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.309+0000 7f23996e6640 1 --2- 172.21.15.40:0/243445683 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23941f3d20 0x7f239414a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:21.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.309+0000 7f2399ee7640 1 --2- 172.21.15.40:0/243445683 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2380004d40 0x7f23941541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.309+0000 7f239a6e8640 1 -- 172.21.15.40:0/243445683 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2380004d40 msgr2=0x7f23941541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.309+0000 7f239a6e8640 1 --2- 172.21.15.40:0/243445683 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2380004d40 0x7f23941541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.309+0000 7f239a6e8640 1 -- 172.21.15.40:0/243445683 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23941f3d20 msgr2=0x7f239414a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.309+0000 7f239a6e8640 1 --2- 172.21.15.40:0/243445683 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23941f3d20 0x7f239414a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.309+0000 7f239a6e8640 1 -- 172.21.15.40:0/243445683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f239414b090 con 0x7f23940b47d0 2024-04-22T07:21:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.310+0000 7f239a6e8640 1 --2- 172.21.15.40:0/243445683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23940b47d0 0x7f2394144f50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f238c00e230 tx=0x7f238c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.310+0000 7f238a7fc640 1 -- 172.21.15.40:0/243445683 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c039030 con 0x7f23940b47d0 2024-04-22T07:21:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.310+0000 7f238a7fc640 1 -- 172.21.15.40:0/243445683 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f238c03a040 con 0x7f23940b47d0 2024-04-22T07:21:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.310+0000 7f239c14b640 1 -- 172.21.15.40:0/243445683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2394154700 con 0x7f23940b47d0 2024-04-22T07:21:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.310+0000 7f238a7fc640 1 -- 172.21.15.40:0/243445683 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c009c10 con 0x7f23940b47d0 2024-04-22T07:21:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.310+0000 7f239c14b640 1 -- 172.21.15.40:0/243445683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23940b6050 con 0x7f23940b47d0 2024-04-22T07:21:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.311+0000 7f239c14b640 1 -- 172.21.15.40:0/243445683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2394069d40 con 0x7f23940b47d0 2024-04-22T07:21:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.311+0000 7f238a7fc640 1 -- 172.21.15.40:0/243445683 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f238c045030 con 0x7f23940b47d0 2024-04-22T07:21:21.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.312+0000 7f238a7fc640 1 --2- 172.21.15.40:0/243445683 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f237806c8f0 0x7f237806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:21.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.312+0000 7f238a7fc640 1 -- 172.21.15.40:0/243445683 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f238c0ad810 con 0x7f23940b47d0 2024-04-22T07:21:21.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.312+0000 7f2399ee7640 1 --2- 172.21.15.40:0/243445683 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f237806c8f0 0x7f237806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:21.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.312+0000 7f2399ee7640 1 --2- 172.21.15.40:0/243445683 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f237806c8f0 0x7f237806edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2390009bc0 tx=0x7f2390009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:21.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.316+0000 7f238a7fc640 1 -- 172.21.15.40:0/243445683 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f238c04c060 con 0x7f23940b47d0 2024-04-22T07:21:21.317 INFO:tasks.workunit.client.0.smithi040.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-22T07:21:21.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.545+0000 7f239c14b640 1 -- 172.21.15.40:0/243445683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f239414efd0 con 0x7f23940b47d0 2024-04-22T07:21:21.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.545+0000 7f238a7fc640 1 -- 172.21.15.40:0/243445683 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6821 (secure 0 0 0) 0x7f238c07bcf0 con 0x7f23940b47d0 2024-04-22T07:21:21.543 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:21:21.543 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1193926607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1193926607},{"type":"v1","addr":"172.21.15.62:6835","nonce":1193926607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/602167189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":602167189},{"type":"v1","addr":"172.21.15.62:6837","nonce":602167189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2062933254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2062933254},{"type":"v1","addr":"172.21.15.40:6835","nonce":2062933254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3873524978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3873524978},{"type":"v1","addr":"172.21.15.40:6837","nonce":3873524978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/1922761385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":1922761385},{"type":"v1","addr":"172.21.15.40:6839","nonce":1922761385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:20:53.216204+0000","modified":"2024-04-22T07:20:58.875393+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.62:6836/2884673656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2884673656},{"type":"v1","addr":"172.21.15.62:6836","nonce":2884673656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4305]},"id":1}]} 2024-04-22T07:21:21.544 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-04-22T07:21:21.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.547+0000 7f239c14b640 1 -- 172.21.15.40:0/243445683 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f237806c8f0 msgr2=0x7f237806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:21.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.547+0000 7f239c14b640 1 --2- 172.21.15.40:0/243445683 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f237806c8f0 0x7f237806edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2390009bc0 tx=0x7f2390009190 comp rx=0 tx=0).stop 2024-04-22T07:21:21.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.547+0000 7f239c14b640 1 -- 172.21.15.40:0/243445683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23940b47d0 msgr2=0x7f2394144f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:21.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.547+0000 7f239c14b640 1 --2- 172.21.15.40:0/243445683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23940b47d0 0x7f2394144f50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f238c00e230 tx=0x7f238c009750 comp rx=0 tx=0).stop 2024-04-22T07:21:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.547+0000 7f239c14b640 1 -- 172.21.15.40:0/243445683 shutdown_connections 2024-04-22T07:21:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.547+0000 7f239c14b640 1 --2- 172.21.15.40:0/243445683 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f237806c8f0 0x7f237806edb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.547+0000 7f239c14b640 1 --2- 172.21.15.40:0/243445683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23940b47d0 0x7f2394144f50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.547+0000 7f239c14b640 1 --2- 172.21.15.40:0/243445683 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23941f3d20 0x7f239414a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.547+0000 7f239c14b640 1 --2- 172.21.15.40:0/243445683 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2380004d40 0x7f23941541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.547+0000 7f239c14b640 1 -- 172.21.15.40:0/243445683 >> 172.21.15.40:0/243445683 conn(0x7f23940676b0 msgr2=0x7f23940c5e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:21.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.547+0000 7f239c14b640 1 -- 172.21.15.40:0/243445683 shutdown_connections 2024-04-22T07:21:21.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:21.548+0000 7f239c14b640 1 -- 172.21.15.40:0/243445683 wait complete. 2024-04-22T07:21:22.161 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-22T07:20:53.216204+0000', 'modified': '2024-04-22T07:20:58.875393+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4305}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4305': {'gid': 4305, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.62:6836/2884673656', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6833', 'nonce': 2884673656}, {'type': 'v1', 'addr': '172.21.15.62:6836', 'nonce': 2884673656}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4305, 'qdb_cluster': [4305]} 2024-04-22T07:21:22.161 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-22T07:21:22.161 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-22T07:21:22.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.269+0000 7f011a1b2640 1 Processor -- start 2024-04-22T07:21:22.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.270+0000 7f011a1b2640 1 -- start start 2024-04-22T07:21:22.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.270+0000 7f011a1b2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f011415ed20 0x7f01140c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:22.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.270+0000 7f011a1b2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f011406b920 0x7f011406f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:22.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.270+0000 7f011a1b2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f011415f1f0 con 0x7f0114070290 2024-04-22T07:21:22.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.270+0000 7f011a1b2640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f011415ada0 con 0x7f011415ed20 2024-04-22T07:21:22.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.270+0000 7f011a1b2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f01140c90a0 con 0x7f011406b920 2024-04-22T07:21:22.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.270+0000 7f0112ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f011415ed20 0x7f01140c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:22.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.271+0000 7f0112ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f011415ed20 0x7f01140c4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56400/0 (socket says 172.21.15.40:56400) 2024-04-22T07:21:22.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.271+0000 7f0112ffd640 1 -- 172.21.15.40:0/735585319 learned_addr learned my addr 172.21.15.40:0/735585319 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:22.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.271+0000 7f0113fff640 1 --2- 172.21.15.40:0/735585319 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f011406b920 0x7f011406f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:22.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.271+0000 7f0112ffd640 1 -- 172.21.15.40:0/735585319 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f011406b920 msgr2=0x7f011406f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:22.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.271+0000 7f0112ffd640 1 --2- 172.21.15.40:0/735585319 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f011406b920 0x7f011406f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.271+0000 7f0112ffd640 1 -- 172.21.15.40:0/735585319 >> v1:172.21.15.62:6789/0 conn(0x7f0114070290 legacy=0x7f011406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:22.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.271+0000 7f0112ffd640 1 -- 172.21.15.40:0/735585319 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01140c9380 con 0x7f011415ed20 2024-04-22T07:21:22.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.272+0000 7f0112ffd640 1 --2- 172.21.15.40:0/735585319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f011415ed20 0x7f01140c4e70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0108009870 tx=0x7f010802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887cc7df4e5b3b01 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:22.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.272+0000 7f01127fc640 1 -- 172.21.15.40:0/735585319 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0108035020 con 0x7f011415ed20 2024-04-22T07:21:22.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.272+0000 7f01127fc640 1 -- 172.21.15.40:0/735585319 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0108031640 con 0x7f011415ed20 2024-04-22T07:21:22.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.272+0000 7f01127fc640 1 -- 172.21.15.40:0/735585319 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010802d040 con 0x7f011415ed20 2024-04-22T07:21:22.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.272+0000 7f011a1b2640 1 -- 172.21.15.40:0/735585319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f011415ed20 msgr2=0x7f01140c4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:22.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.272+0000 7f011a1b2640 1 --2- 172.21.15.40:0/735585319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f011415ed20 0x7f01140c4e70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0108009870 tx=0x7f010802b8f0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.272+0000 7f011a1b2640 1 -- 172.21.15.40:0/735585319 shutdown_connections 2024-04-22T07:21:22.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.272+0000 7f011a1b2640 1 --2- 172.21.15.40:0/735585319 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f011406b920 0x7f011406f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.272+0000 7f011a1b2640 1 --2- 172.21.15.40:0/735585319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f011415ed20 0x7f01140c4e70 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.272+0000 7f011a1b2640 1 -- 172.21.15.40:0/735585319 >> 172.21.15.40:0/735585319 conn(0x7f011406db30 msgr2=0x7f011406df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:22.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.272+0000 7f011a1b2640 1 -- 172.21.15.40:0/735585319 shutdown_connections 2024-04-22T07:21:22.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.272+0000 7f011a1b2640 1 -- 172.21.15.40:0/735585319 wait complete. 2024-04-22T07:21:22.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.273+0000 7f011a1b2640 1 Processor -- start 2024-04-22T07:21:22.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.274+0000 7f011a1b2640 1 -- start start 2024-04-22T07:21:22.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.274+0000 7f011a1b2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f011406b920 0x7f0114157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:22.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.274+0000 7f011a1b2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0114070290 0x7f01141f0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:22.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.274+0000 7f011a1b2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f011415ed20 0x7f0114159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:22.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.274+0000 7f011a1b2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f011406ca40 con 0x7f011406b920 2024-04-22T07:21:22.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.274+0000 7f011a1b2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f011415b340 con 0x7f0114070290 2024-04-22T07:21:22.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.274+0000 7f011a1b2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f011406cbc0 con 0x7f011415ed20 2024-04-22T07:21:22.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.274+0000 7f01137fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f011406b920 0x7f0114157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:22.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.274+0000 7f01137fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f011406b920 0x7f0114157880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56412/0 (socket says 172.21.15.40:56412) 2024-04-22T07:21:22.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.274+0000 7f01137fe640 1 -- 172.21.15.40:0/1402892555 learned_addr learned my addr 172.21.15.40:0/1402892555 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:22.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.275+0000 7f0113fff640 1 --2- 172.21.15.40:0/1402892555 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f011415ed20 0x7f0114159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:22.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.275+0000 7f0112ffd640 1 --2- 172.21.15.40:0/1402892555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0114070290 0x7f01141f0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:22.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.275+0000 7f01137fe640 1 -- 172.21.15.40:0/1402892555 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f011415ed20 msgr2=0x7f0114159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:22.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.275+0000 7f01137fe640 1 --2- 172.21.15.40:0/1402892555 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f011415ed20 0x7f0114159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.275+0000 7f01137fe640 1 -- 172.21.15.40:0/1402892555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0114070290 msgr2=0x7f01141f0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:22.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.275+0000 7f01137fe640 1 --2- 172.21.15.40:0/1402892555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0114070290 0x7f01141f0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.275+0000 7f01137fe640 1 -- 172.21.15.40:0/1402892555 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01141e52d0 con 0x7f011406b920 2024-04-22T07:21:22.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.275+0000 7f0113fff640 1 --2- 172.21.15.40:0/1402892555 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f011415ed20 0x7f0114159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:22.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.275+0000 7f0112ffd640 1 --2- 172.21.15.40:0/1402892555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0114070290 0x7f01141f0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:22.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.275+0000 7f01137fe640 1 --2- 172.21.15.40:0/1402892555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f011406b920 0x7f0114157880 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f010400c3c0 tx=0x7f010400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:22.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.275+0000 7f00fbfff640 1 -- 172.21.15.40:0/1402892555 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01040052d0 con 0x7f011406b920 2024-04-22T07:21:22.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.275+0000 7f00fbfff640 1 -- 172.21.15.40:0/1402892555 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0104005490 con 0x7f011406b920 2024-04-22T07:21:22.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.275+0000 7f011a1b2640 1 -- 172.21.15.40:0/1402892555 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01141e4cc0 con 0x7f011406b920 2024-04-22T07:21:22.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.275+0000 7f00fbfff640 1 -- 172.21.15.40:0/1402892555 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0104007260 con 0x7f011406b920 2024-04-22T07:21:22.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.275+0000 7f011a1b2640 1 -- 172.21.15.40:0/1402892555 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01141f40e0 con 0x7f011406b920 2024-04-22T07:21:22.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.277+0000 7f00fbfff640 1 -- 172.21.15.40:0/1402892555 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0104007400 con 0x7f011406b920 2024-04-22T07:21:22.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.277+0000 7f00fbfff640 1 --2- 172.21.15.40:0/1402892555 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f010006c920 0x7f010006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:22.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.277+0000 7f00fbfff640 1 -- 172.21.15.40:0/1402892555 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f010408b070 con 0x7f011406b920 2024-04-22T07:21:22.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.277+0000 7f0112ffd640 1 --2- 172.21.15.40:0/1402892555 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f010006c920 0x7f010006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:22.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.278+0000 7f0112ffd640 1 --2- 172.21.15.40:0/1402892555 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f010006c920 0x7f010006ede0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0108036000 tx=0x7f0108008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:22.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.278+0000 7f011cd9e740 1 Processor -- start 2024-04-22T07:21:22.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.278+0000 7f011cd9e740 1 -- start start 2024-04-22T07:21:22.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.279+0000 7f011cd9e740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55dae2dfee40 0x55dae2e07f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:22.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.279+0000 7f011cd9e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dae2dbfec0 0x55dae2e084a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:22.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.279+0000 7f011cd9e740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dae2dbbca0 0x55dae2de3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:22.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.279+0000 7f011cd9e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55dae2d22b10 con 0x55dae2dbfec0 2024-04-22T07:21:22.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.279+0000 7f011cd9e740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55dae2cc0240 con 0x55dae2dbbca0 2024-04-22T07:21:22.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.279+0000 7f011cd9e740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55dae2d1ead0 con 0x55dae2dfee40 2024-04-22T07:21:22.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.279+0000 7f0112ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dae2dbfec0 0x55dae2e084a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:22.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.279+0000 7f0112ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dae2dbfec0 0x55dae2e084a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56428/0 (socket says 172.21.15.40:56428) 2024-04-22T07:21:22.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.279+0000 7f0112ffd640 1 -- 172.21.15.40:0/3003688154 learned_addr learned my addr 172.21.15.40:0/3003688154 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:22.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.279+0000 7f01137fe640 1 --2- 172.21.15.40:0/3003688154 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55dae2dfee40 0x55dae2e07f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:22.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.279+0000 7f0113fff640 1 --2- 172.21.15.40:0/3003688154 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dae2dbbca0 0x55dae2de3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:22.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.279+0000 7f0112ffd640 1 -- 172.21.15.40:0/3003688154 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55dae2dfee40 msgr2=0x55dae2e07f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:22.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.279+0000 7f0112ffd640 1 --2- 172.21.15.40:0/3003688154 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55dae2dfee40 0x55dae2e07f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.279+0000 7f0112ffd640 1 -- 172.21.15.40:0/3003688154 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dae2dbbca0 msgr2=0x55dae2de3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:22.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.279+0000 7f0112ffd640 1 --2- 172.21.15.40:0/3003688154 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dae2dbbca0 0x55dae2de3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.279+0000 7f0112ffd640 1 -- 172.21.15.40:0/3003688154 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dae2a352d0 con 0x55dae2dbfec0 2024-04-22T07:21:22.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.279+0000 7f0112ffd640 1 --2- 172.21.15.40:0/3003688154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dae2dbfec0 0x55dae2e084a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0108000c00 tx=0x7f0108030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9019d96861bbb110 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:22.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.280+0000 7f00f97fa640 1 -- 172.21.15.40:0/3003688154 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0108035040 con 0x55dae2dbfec0 2024-04-22T07:21:22.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.280+0000 7f00f97fa640 1 -- 172.21.15.40:0/3003688154 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f010803a620 con 0x55dae2dbfec0 2024-04-22T07:21:22.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.280+0000 7f00f97fa640 1 -- 172.21.15.40:0/3003688154 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010803aa10 con 0x55dae2dbfec0 2024-04-22T07:21:22.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.280+0000 7f011cd9e740 1 -- 172.21.15.40:0/3003688154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dae2dbfec0 msgr2=0x55dae2e084a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:22.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.280+0000 7f011cd9e740 1 --2- 172.21.15.40:0/3003688154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dae2dbfec0 0x55dae2e084a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0108000c00 tx=0x7f0108030000 comp rx=0 tx=0).stop 2024-04-22T07:21:22.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.280+0000 7f011cd9e740 1 -- 172.21.15.40:0/3003688154 shutdown_connections 2024-04-22T07:21:22.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.280+0000 7f011cd9e740 1 --2- 172.21.15.40:0/3003688154 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dae2dbbca0 0x55dae2de3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.280+0000 7f011cd9e740 1 --2- 172.21.15.40:0/3003688154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dae2dbfec0 0x55dae2e084a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.280+0000 7f011cd9e740 1 --2- 172.21.15.40:0/3003688154 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55dae2dfee40 0x55dae2e07f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.280+0000 7f011cd9e740 1 -- 172.21.15.40:0/3003688154 >> 172.21.15.40:0/3003688154 conn(0x55dae2dba990 msgr2=0x55dae2dbd290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:22.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.280+0000 7f011cd9e740 1 -- 172.21.15.40:0/3003688154 shutdown_connections 2024-04-22T07:21:22.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.281+0000 7f011cd9e740 1 -- 172.21.15.40:0/3003688154 wait complete. 2024-04-22T07:21:22.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.281+0000 7f011cd9e740 1 -- start start 2024-04-22T07:21:22.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.281+0000 7f011cd9e740 1 Processor -- start 2024-04-22T07:21:22.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.282+0000 7f011cd9e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dae2dbfec0 0x55dae2e06a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:22.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.282+0000 7f011cd9e740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55dae2dfee40 0x55dae2e12b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:22.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.282+0000 7f011cd9e740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dae2dfc940 0x55dae2e130c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:22.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.282+0000 7f011cd9e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55dae2dbe250 con 0x55dae2dbfec0 2024-04-22T07:21:22.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.282+0000 7f011cd9e740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55dae2cab190 con 0x55dae2dfc940 2024-04-22T07:21:22.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.282+0000 7f011cd9e740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55dae2dbe530 con 0x55dae2dfee40 2024-04-22T07:21:22.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.282+0000 7f011cd9e740 10 client.0 _ll_register_callbacks cb 0x55dae2ca68b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:21:22.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.282+0000 7f01137fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dae2dbfec0 0x55dae2e06a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:22.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.282+0000 7f01137fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dae2dbfec0 0x55dae2e06a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56436/0 (socket says 172.21.15.40:56436) 2024-04-22T07:21:22.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.282+0000 7f01137fe640 1 -- 172.21.15.40:0/2238740433 learned_addr learned my addr 172.21.15.40:0/2238740433 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:22.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.282+0000 7f0112ffd640 1 --2- 172.21.15.40:0/2238740433 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55dae2dfee40 0x55dae2e12b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:22.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.282+0000 7f0113fff640 1 --2- 172.21.15.40:0/2238740433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dae2dfc940 0x55dae2e130c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:22.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.282+0000 7f01137fe640 1 -- 172.21.15.40:0/2238740433 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55dae2dfee40 msgr2=0x55dae2e12b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:22.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.282+0000 7f01137fe640 1 --2- 172.21.15.40:0/2238740433 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55dae2dfee40 0x55dae2e12b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.282+0000 7f01137fe640 1 -- 172.21.15.40:0/2238740433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dae2dfc940 msgr2=0x55dae2e130c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:22.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.282+0000 7f01137fe640 1 --2- 172.21.15.40:0/2238740433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dae2dfc940 0x55dae2e130c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.282+0000 7f01137fe640 1 -- 172.21.15.40:0/2238740433 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dae2aff6b0 con 0x55dae2dbfec0 2024-04-22T07:21:22.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.282+0000 7f01137fe640 1 --2- 172.21.15.40:0/2238740433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dae2dbfec0 0x55dae2e06a90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f01040895c0 tx=0x7f0104059420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce4b64143635472 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:22.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.282+0000 7f00f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-04-22T07:21:22.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.282+0000 7f00f27fc640 1 -- 172.21.15.40:0/2238740433 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010405d0d0 con 0x55dae2dbfec0 2024-04-22T07:21:22.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.282+0000 7f00f27fc640 1 -- 172.21.15.40:0/2238740433 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f010406ede0 con 0x55dae2dbfec0 2024-04-22T07:21:22.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.282+0000 7f011cd9e740 1 -- 172.21.15.40:0/2238740433 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f010803a620 con 0x55dae2dbfec0 2024-04-22T07:21:22.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.283+0000 7f00f27fc640 1 -- 172.21.15.40:0/2238740433 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f0104076050 con 0x55dae2dbfec0 2024-04-22T07:21:22.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.283+0000 7f011cd9e740 10 client.4881 fetch_fsmap learned FSMap version 8 2024-04-22T07:21:22.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.283+0000 7f011cd9e740 1 -- 172.21.15.40:0/2238740433 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55dae2e06570 con 0x55dae2dbfec0 2024-04-22T07:21:22.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.283+0000 7f00f27fc640 1 -- 172.21.15.40:0/2238740433 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f010803a620 con 0x55dae2dbfec0 2024-04-22T07:21:22.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.283+0000 7f00f27fc640 1 -- 172.21.15.40:0/2238740433 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f0104055390 con 0x55dae2dbfec0 2024-04-22T07:21:22.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.283+0000 7f011cd9e740 10 client.4881 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:21:22.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.283+0000 7f011cd9e740 10 client.4881 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-22T07:21:22.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.283+0000 7f011cd9e740 20 client.4881 populate_metadata read hostname 'smithi040' 2024-04-22T07:21:22.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.283+0000 7f011cd9e740 1 --2- 172.21.15.40:0/2238740433 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55dae2e1a1f0 0x55dae2e1ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:22.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.283+0000 7f011cd9e740 4 client.4881 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T07:21:22.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.283+0000 7f011cd9e740 1 -- 172.21.15.40:0/2238740433 --> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dae2d30530 con 0x55dae2e1a1f0 2024-04-22T07:21:22.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.283+0000 7f0112ffd640 1 --2- 172.21.15.40:0/2238740433 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55dae2e1a1f0 0x55dae2e1ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:22.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.284+0000 7f00f27fc640 10 client.4881 ms_handle_connect on v2:172.21.15.62:6833/2884673656 2024-04-22T07:21:22.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.284+0000 7f0112ffd640 1 --2- 172.21.15.40:0/2238740433 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55dae2e1a1f0 0x55dae2e1ec50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f6d337276e4d87c server_cookie=9fe2c9fc44ed0809 in_seq=0 out_seq=0 2024-04-22T07:21:22.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.284+0000 7f00f27fc640 1 -- 172.21.15.40:0/2238740433 <== mds.0 v2:172.21.15.62:6833/2884673656 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55dae2d30530 con 0x55dae2e1a1f0 2024-04-22T07:21:22.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.284+0000 7f00f27fc640 10 client.4881 handle_command_reply: tid=0 2024-04-22T07:21:22.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.284+0000 7f011cd9e740 1 client.4881 shutdown 2024-04-22T07:21:22.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.284+0000 7f011cd9e740 1 -- 172.21.15.40:0/2238740433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dae2dbfec0 msgr2=0x55dae2e06a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:22.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.284+0000 7f011cd9e740 1 --2- 172.21.15.40:0/2238740433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dae2dbfec0 0x55dae2e06a90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f01040895c0 tx=0x7f0104059420 comp rx=0 tx=0).stop 2024-04-22T07:21:22.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.284+0000 7f011cd9e740 1 -- 172.21.15.40:0/2238740433 shutdown_connections 2024-04-22T07:21:22.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.284+0000 7f011cd9e740 1 --2- 172.21.15.40:0/2238740433 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55dae2e1a1f0 0x55dae2e1ec50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.284+0000 7f011cd9e740 1 --2- 172.21.15.40:0/2238740433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dae2dfc940 0x55dae2e130c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.284+0000 7f011cd9e740 1 --2- 172.21.15.40:0/2238740433 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55dae2dfee40 0x55dae2e12b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.284+0000 7f00f27fc640 0 client.4881 ms_handle_reset on v2:172.21.15.62:6833/2884673656 2024-04-22T07:21:22.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.284+0000 7f011cd9e740 1 --2- 172.21.15.40:0/2238740433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dae2dbfec0 0x55dae2e06a90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.285+0000 7f011cd9e740 1 -- 172.21.15.40:0/2238740433 >> 172.21.15.40:0/2238740433 conn(0x55dae2dbbca0 msgr2=0x55dae2dff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:22.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.285+0000 7f011cd9e740 1 -- 172.21.15.40:0/2238740433 shutdown_connections 2024-04-22T07:21:22.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.285+0000 7f011cd9e740 1 -- 172.21.15.40:0/2238740433 wait complete. 2024-04-22T07:21:22.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.285+0000 7f011cd9e740 20 client.4881 trim_cache size 0 max 16384 2024-04-22T07:21:22.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.303+0000 7f011cd9e740 1 Processor -- start 2024-04-22T07:21:22.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.303+0000 7f011cd9e740 1 -- start start 2024-04-22T07:21:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.304+0000 7f011cd9e740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55dae2dbfec0 0x55dae2db82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.304+0000 7f011cd9e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dae2dfc940 0x55dae2db87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.304+0000 7f011cd9e740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dae2dfee40 0x55dae2e22c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.304+0000 7f011cd9e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f011414f540 con 0x55dae2dfc940 2024-04-22T07:21:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.304+0000 7f011cd9e740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55dae2ddbc90 con 0x55dae2dfee40 2024-04-22T07:21:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.304+0000 7f011cd9e740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55dae2e072d0 con 0x55dae2dbfec0 2024-04-22T07:21:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.304+0000 7f0112ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dae2dfc940 0x55dae2db87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.304+0000 7f0112ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dae2dfc940 0x55dae2db87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56444/0 (socket says 172.21.15.40:56444) 2024-04-22T07:21:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.304+0000 7f0112ffd640 1 -- 172.21.15.40:0/92262046 learned_addr learned my addr 172.21.15.40:0/92262046 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.304+0000 7f0112ffd640 1 -- 172.21.15.40:0/92262046 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55dae2dbfec0 msgr2=0x55dae2db82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.304+0000 7f0112ffd640 1 --2- 172.21.15.40:0/92262046 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55dae2dbfec0 0x55dae2db82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.304+0000 7f0112ffd640 1 -- 172.21.15.40:0/92262046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dae2dfee40 msgr2=0x55dae2e22c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.304+0000 7f0112ffd640 1 --2- 172.21.15.40:0/92262046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dae2dfee40 0x55dae2e22c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.304+0000 7f0112ffd640 1 -- 172.21.15.40:0/92262046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dae2dbb720 con 0x55dae2dfc940 2024-04-22T07:21:22.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.304+0000 7f0112ffd640 1 --2- 172.21.15.40:0/92262046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dae2dfc940 0x55dae2db87f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f01080090b0 tx=0x7f0108009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25cb17d1d9e8935 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.304+0000 7f00f8ff9640 1 -- 172.21.15.40:0/92262046 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0108035040 con 0x55dae2dfc940 2024-04-22T07:21:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.304+0000 7f00f8ff9640 1 -- 172.21.15.40:0/92262046 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0108058d50 con 0x55dae2dfc940 2024-04-22T07:21:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.304+0000 7f00f8ff9640 1 -- 172.21.15.40:0/92262046 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0108058540 con 0x55dae2dfc940 2024-04-22T07:21:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.305+0000 7f011cd9e740 1 -- 172.21.15.40:0/92262046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dae2dfc940 msgr2=0x55dae2db87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.305+0000 7f011cd9e740 1 --2- 172.21.15.40:0/92262046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dae2dfc940 0x55dae2db87f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f01080090b0 tx=0x7f0108009240 comp rx=0 tx=0).stop 2024-04-22T07:21:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.305+0000 7f011cd9e740 1 -- 172.21.15.40:0/92262046 shutdown_connections 2024-04-22T07:21:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.305+0000 7f011cd9e740 1 --2- 172.21.15.40:0/92262046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dae2dfee40 0x55dae2e22c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.305+0000 7f011cd9e740 1 --2- 172.21.15.40:0/92262046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dae2dfc940 0x55dae2db87f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.305+0000 7f011cd9e740 1 --2- 172.21.15.40:0/92262046 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55dae2dbfec0 0x55dae2db82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.305+0000 7f011cd9e740 1 -- 172.21.15.40:0/92262046 >> 172.21.15.40:0/92262046 conn(0x55dae2dbbca0 msgr2=0x55dae2dbd290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.305+0000 7f011cd9e740 1 -- 172.21.15.40:0/92262046 shutdown_connections 2024-04-22T07:21:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.305+0000 7f011cd9e740 1 -- 172.21.15.40:0/92262046 wait complete. 2024-04-22T07:21:22.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.306+0000 7f011cd9e740 1 -- start start 2024-04-22T07:21:22.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.306+0000 7f011cd9e740 1 Processor -- start 2024-04-22T07:21:22.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.306+0000 7f011cd9e740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dae2dbfec0 0x55dae2e15ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:22.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.306+0000 7f011cd9e740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55dae2dfc940 0x55dae2ddf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:22.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.306+0000 7f011cd9e740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dae2dfee40 0x55dae2e17260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:22.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.306+0000 7f011cd9e740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55dae2e1a6c0 con 0x55dae2dbfec0 2024-04-22T07:21:22.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.306+0000 7f011cd9e740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55dae2e1a070 con 0x55dae2dfee40 2024-04-22T07:21:22.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.306+0000 7f011cd9e740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55dae2e1ad70 con 0x55dae2dfc940 2024-04-22T07:21:22.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.306+0000 7f011cd9e740 10 client.0 _ll_register_callbacks cb 0x7f0104058af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:21:22.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.306+0000 7f01137fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dae2dbfec0 0x55dae2e15ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:22.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.306+0000 7f01137fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dae2dbfec0 0x55dae2e15ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56446/0 (socket says 172.21.15.40:56446) 2024-04-22T07:21:22.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.306+0000 7f01137fe640 1 -- 172.21.15.40:0/3088403095 learned_addr learned my addr 172.21.15.40:0/3088403095 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:22.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.307+0000 7f0113fff640 1 --2- 172.21.15.40:0/3088403095 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dae2dfee40 0x55dae2e17260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:22.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.307+0000 7f0112ffd640 1 --2- 172.21.15.40:0/3088403095 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55dae2dfc940 0x55dae2ddf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.307+0000 7f01137fe640 1 -- 172.21.15.40:0/3088403095 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55dae2dfc940 msgr2=0x55dae2ddf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.307+0000 7f01137fe640 1 --2- 172.21.15.40:0/3088403095 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55dae2dfc940 0x55dae2ddf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.307+0000 7f01137fe640 1 -- 172.21.15.40:0/3088403095 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dae2dfee40 msgr2=0x55dae2e17260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.307+0000 7f01137fe640 1 --2- 172.21.15.40:0/3088403095 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dae2dfee40 0x55dae2e17260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.307+0000 7f01137fe640 1 -- 172.21.15.40:0/3088403095 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dae2e16420 con 0x55dae2dbfec0 2024-04-22T07:21:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.307+0000 7f0113fff640 1 --2- 172.21.15.40:0/3088403095 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dae2dfee40 0x55dae2e17260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.307+0000 7f0112ffd640 1 --2- 172.21.15.40:0/3088403095 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55dae2dfc940 0x55dae2ddf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.307+0000 7f01137fe640 1 --2- 172.21.15.40:0/3088403095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dae2dbfec0 0x55dae2e15ee0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0104055130 tx=0x7f0104000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0670376b4906c7b server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.307+0000 7f00f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-04-22T07:21:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.307+0000 7f00f27fc640 1 -- 172.21.15.40:0/3088403095 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0104086070 con 0x55dae2dbfec0 2024-04-22T07:21:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.307+0000 7f00f27fc640 1 -- 172.21.15.40:0/3088403095 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f010406ede0 con 0x55dae2dbfec0 2024-04-22T07:21:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.307+0000 7f011cd9e740 1 -- 172.21.15.40:0/3088403095 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0108058d50 con 0x55dae2dbfec0 2024-04-22T07:21:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.307+0000 7f00f27fc640 1 -- 172.21.15.40:0/3088403095 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f010405d0d0 con 0x55dae2dbfec0 2024-04-22T07:21:22.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.307+0000 7f011cd9e740 10 client.4887 fetch_fsmap learned FSMap version 8 2024-04-22T07:21:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.307+0000 7f011cd9e740 1 -- 172.21.15.40:0/3088403095 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55dae2ddff50 con 0x55dae2dbfec0 2024-04-22T07:21:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.307+0000 7f00f27fc640 1 -- 172.21.15.40:0/3088403095 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0108058d50 con 0x55dae2dbfec0 2024-04-22T07:21:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.308+0000 7f00f27fc640 1 -- 172.21.15.40:0/3088403095 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f0104089030 con 0x55dae2dbfec0 2024-04-22T07:21:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.308+0000 7f011cd9e740 10 client.4887 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:21:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.308+0000 7f011cd9e740 10 client.4887 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-22T07:21:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.308+0000 7f011cd9e740 20 client.4887 populate_metadata read hostname 'smithi040' 2024-04-22T07:21:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.308+0000 7f011cd9e740 1 --2- 172.21.15.40:0/3088403095 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55dae2e7e820 0x55dae2e87090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.308+0000 7f011cd9e740 4 client.4887 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-22T07:21:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.308+0000 7f011cd9e740 1 -- 172.21.15.40:0/3088403095 --> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] -- command(tid 0: {"prefix": "status"}) -- 0x55dae2d2a3a0 con 0x55dae2e7e820 2024-04-22T07:21:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.308+0000 7f0112ffd640 1 --2- 172.21.15.40:0/3088403095 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55dae2e7e820 0x55dae2e87090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.308+0000 7f0112ffd640 1 --2- 172.21.15.40:0/3088403095 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55dae2e7e820 0x55dae2e87090 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa522e2e6966f7d8 server_cookie=45c4bfa358f11c47 in_seq=0 out_seq=0 2024-04-22T07:21:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.308+0000 7f00f27fc640 10 client.4887 ms_handle_connect on v2:172.21.15.62:6833/2884673656 2024-04-22T07:21:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.308+0000 7f00f27fc640 1 -- 172.21.15.40:0/3088403095 <== mds.0 v2:172.21.15.62:6833/2884673656 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55dae2d2a3a0 con 0x55dae2e7e820 2024-04-22T07:21:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.308+0000 7f00f27fc640 10 client.4887 handle_command_reply: tid=0 2024-04-22T07:21:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.308+0000 7f011cd9e740 1 client.4887 shutdown 2024-04-22T07:21:22.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.308+0000 7f011cd9e740 1 -- 172.21.15.40:0/3088403095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dae2dbfec0 msgr2=0x55dae2e15ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:22.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.308+0000 7f011cd9e740 1 --2- 172.21.15.40:0/3088403095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dae2dbfec0 0x55dae2e15ee0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0104055130 tx=0x7f0104000bc0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.309+0000 7f011cd9e740 1 -- 172.21.15.40:0/3088403095 shutdown_connections 2024-04-22T07:21:22.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.309+0000 7f011cd9e740 1 --2- 172.21.15.40:0/3088403095 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55dae2e7e820 0x55dae2e87090 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.309+0000 7f011cd9e740 1 --2- 172.21.15.40:0/3088403095 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dae2dfee40 0x55dae2e17260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.309+0000 7f011cd9e740 1 --2- 172.21.15.40:0/3088403095 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55dae2dfc940 0x55dae2ddf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.309+0000 7f011cd9e740 1 --2- 172.21.15.40:0/3088403095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55dae2dbfec0 0x55dae2e15ee0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.309+0000 7f00f27fc640 0 client.4887 ms_handle_reset on v2:172.21.15.62:6833/2884673656 2024-04-22T07:21:22.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.309+0000 7f011cd9e740 1 -- 172.21.15.40:0/3088403095 >> 172.21.15.40:0/3088403095 conn(0x55dae2dbbca0 msgr2=0x55dae2db82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:22.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.309+0000 7f011cd9e740 1 -- 172.21.15.40:0/3088403095 shutdown_connections 2024-04-22T07:21:22.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.309+0000 7f011cd9e740 1 -- 172.21.15.40:0/3088403095 wait complete. 2024-04-22T07:21:22.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.309+0000 7f011cd9e740 20 client.4887 trim_cache size 0 max 16384 2024-04-22T07:21:22.313 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-22T07:21:22.314 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "dd5b16e4-89fe-4602-b37f-062846793158", 2024-04-22T07:21:22.314 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2024-04-22T07:21:22.314 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4305, 2024-04-22T07:21:22.314 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-04-22T07:21:22.314 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-04-22T07:21:22.314 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-04-22T07:21:22.314 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 28.449703309, 2024-04-22T07:21:22.314 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 8, 2024-04-22T07:21:22.315 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 23, 2024-04-22T07:21:22.315 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 23, 2024-04-22T07:21:22.315 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 34.993206397999998 2024-04-22T07:21:22.315 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-22T07:21:22.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.309+0000 7f011a1b2640 1 -- 172.21.15.40:0/1402892555 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f010006c920 msgr2=0x7f010006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:22.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.309+0000 7f011a1b2640 1 --2- 172.21.15.40:0/1402892555 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f010006c920 0x7f010006ede0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0108036000 tx=0x7f0108008030 comp rx=0 tx=0).stop 2024-04-22T07:21:22.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.309+0000 7f011a1b2640 1 -- 172.21.15.40:0/1402892555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f011406b920 msgr2=0x7f0114157880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:22.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.309+0000 7f011a1b2640 1 --2- 172.21.15.40:0/1402892555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f011406b920 0x7f0114157880 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f010400c3c0 tx=0x7f010400c880 comp rx=0 tx=0).stop 2024-04-22T07:21:22.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.309+0000 7f011a1b2640 1 -- 172.21.15.40:0/1402892555 shutdown_connections 2024-04-22T07:21:22.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.309+0000 7f011a1b2640 1 --2- 172.21.15.40:0/1402892555 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f011415ed20 0x7f0114159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.309+0000 7f011a1b2640 1 --2- 172.21.15.40:0/1402892555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0114070290 0x7f01141f0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.309+0000 7f011a1b2640 1 --2- 172.21.15.40:0/1402892555 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f010006c920 0x7f010006ede0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.309+0000 7f011a1b2640 1 --2- 172.21.15.40:0/1402892555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f011406b920 0x7f0114157880 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:22.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.309+0000 7f011a1b2640 1 -- 172.21.15.40:0/1402892555 >> 172.21.15.40:0/1402892555 conn(0x7f011406db30 msgr2=0x7f01141e6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:22.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.309+0000 7f011a1b2640 1 -- 172.21.15.40:0/1402892555 shutdown_connections 2024-04-22T07:21:22.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:22.309+0000 7f011a1b2640 1 -- 172.21.15.40:0/1402892555 wait complete. 2024-04-22T07:21:22.320 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-04-22T07:21:23.519 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:21:23.522 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:21:37.321 INFO:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 23.2 2024-04-22T07:21:37.321 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:21:37.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.438+0000 7f7fc3596640 1 Processor -- start 2024-04-22T07:21:37.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.438+0000 7f7fc3596640 1 -- start start 2024-04-22T07:21:37.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.439+0000 7f7fc3596640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fbc15ee70 0x7f7fbc0cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:37.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.439+0000 7f7fc3596640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fbc06bc60 con 0x7f7fbc0c8fe0 2024-04-22T07:21:37.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.439+0000 7f7fc3596640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fbc06bf40 con 0x7f7fbc06d700 2024-04-22T07:21:37.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.439+0000 7f7fc3596640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f7fbc15e3f0 con 0x7f7fbc15ee70 2024-04-22T07:21:37.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.439+0000 7f7fc0b31640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7fbc0c8fe0 0x7f7fbc0ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49412/0 (socket says 172.21.15.40:49412) 2024-04-22T07:21:37.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.439+0000 7f7fc0b31640 1 -- 172.21.15.40:0/2620062772 learned_addr learned my addr 172.21.15.40:0/2620062772 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:21:37.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.439+0000 7f7fc1332640 1 --2- 172.21.15.40:0/2620062772 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fbc15ee70 0x7f7fbc0cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:37.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.439+0000 7f7fb3fff640 1 -- 172.21.15.40:0/2620062772 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4184002754 0 0) 0x7f7fbc06bc60 con 0x7f7fbc0c8fe0 2024-04-22T07:21:37.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.439+0000 7f7fb3fff640 1 -- 172.21.15.40:0/2620062772 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fa8003520 con 0x7f7fbc0c8fe0 2024-04-22T07:21:37.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.440+0000 7f7fb3fff640 1 -- 172.21.15.40:0/2620062772 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4059936306 0 0) 0x7f7fbc06bf40 con 0x7f7fbc06d700 2024-04-22T07:21:37.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.440+0000 7f7fb3fff640 1 -- 172.21.15.40:0/2620062772 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fbc06bc60 con 0x7f7fbc06d700 2024-04-22T07:21:37.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.440+0000 7f7fb3fff640 1 -- 172.21.15.40:0/2620062772 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2201654186 0 0) 0x7f7fa8003520 con 0x7f7fbc0c8fe0 2024-04-22T07:21:37.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.440+0000 7f7fb3fff640 1 -- 172.21.15.40:0/2620062772 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fbc15ee70 msgr2=0x7f7fbc0cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:37.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.440+0000 7f7fb3fff640 1 --2- 172.21.15.40:0/2620062772 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fbc15ee70 0x7f7fbc0cd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.440+0000 7f7fb3fff640 1 -- 172.21.15.40:0/2620062772 >> v1:172.21.15.62:6789/0 conn(0x7f7fbc06d700 legacy=0x7f7fbc165720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:37.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.440+0000 7f7fb3fff640 1 -- 172.21.15.40:0/2620062772 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fbc0c99a0 con 0x7f7fbc0c8fe0 2024-04-22T07:21:37.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.440+0000 7f7fb3fff640 1 -- 172.21.15.40:0/2620062772 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7f7fac001670 con 0x7f7fbc0c8fe0 2024-04-22T07:21:37.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.440+0000 7f7fc1332640 1 --2- 172.21.15.40:0/2620062772 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fbc15ee70 0x7f7fbc0cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:21:37.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.440+0000 7f7fb3fff640 1 -- 172.21.15.40:0/2620062772 >> v1:172.21.15.40:6789/0 conn(0x7f7fbc0c8fe0 legacy=0x7f7fbc0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:37.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.440+0000 7f7fb3fff640 1 --2- 172.21.15.40:0/2620062772 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fbc15ee70 0x7f7fa8003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:37.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.440+0000 7f7fb3fff640 1 --2- 172.21.15.40:0/2620062772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fa80040b0 0x7f7fa8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:37.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.440+0000 7f7fb3fff640 1 --2- 172.21.15.40:0/2620062772 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fa8004d40 0x7f7fa80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:37.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.440+0000 7f7fb3fff640 1 -- 172.21.15.40:0/2620062772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa800ba70 con 0x7f7fa80040b0 2024-04-22T07:21:37.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.440+0000 7f7fb3fff640 1 -- 172.21.15.40:0/2620062772 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa800bbf0 con 0x7f7fa8004d40 2024-04-22T07:21:37.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.440+0000 7f7fb3fff640 1 -- 172.21.15.40:0/2620062772 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f7fa800bdf0 con 0x7f7fbc15ee70 2024-04-22T07:21:37.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.440+0000 7f7fc0b31640 1 --2- 172.21.15.40:0/2620062772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fa80040b0 0x7f7fa8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:37.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.440+0000 7f7fc1332640 1 --2- 172.21.15.40:0/2620062772 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fbc15ee70 0x7f7fa8003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:37.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.440+0000 7f7fc1b33640 1 --2- 172.21.15.40:0/2620062772 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fa8004d40 0x7f7fa80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:37.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.440+0000 7f7fc0b31640 1 -- 172.21.15.40:0/2620062772 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fbc15ee70 msgr2=0x7f7fa8003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:37.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.440+0000 7f7fc0b31640 1 --2- 172.21.15.40:0/2620062772 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fbc15ee70 0x7f7fa8003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.440+0000 7f7fc0b31640 1 -- 172.21.15.40:0/2620062772 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fa8004d40 msgr2=0x7f7fa80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:37.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.440+0000 7f7fc0b31640 1 --2- 172.21.15.40:0/2620062772 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fa8004d40 0x7f7fa80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.440+0000 7f7fc0b31640 1 -- 172.21.15.40:0/2620062772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa8003520 con 0x7f7fa80040b0 2024-04-22T07:21:37.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.441+0000 7f7fc0b31640 1 --2- 172.21.15.40:0/2620062772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fa80040b0 0x7f7fa8004800 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7fac007fd0 tx=0x7f7fa8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e65b7ca36870a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:37.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.441+0000 7f7fb3fff640 1 -- 172.21.15.40:0/2620062772 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fac007ca0 con 0x7f7fa80040b0 2024-04-22T07:21:37.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.441+0000 7f7fb3fff640 1 -- 172.21.15.40:0/2620062772 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fac030070 con 0x7f7fa80040b0 2024-04-22T07:21:37.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.441+0000 7f7fb3fff640 1 -- 172.21.15.40:0/2620062772 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fac005d30 con 0x7f7fa80040b0 2024-04-22T07:21:37.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.442+0000 7f7fc3596640 1 -- 172.21.15.40:0/2620062772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fa80040b0 msgr2=0x7f7fa8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:37.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.442+0000 7f7fc3596640 1 --2- 172.21.15.40:0/2620062772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fa80040b0 0x7f7fa8004800 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7fac007fd0 tx=0x7f7fa8005830 comp rx=0 tx=0).stop 2024-04-22T07:21:37.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.442+0000 7f7fc1b33640 1 -- 172.21.15.40:0/2620062772 reap_dead start 2024-04-22T07:21:37.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.442+0000 7f7fc3596640 1 -- 172.21.15.40:0/2620062772 shutdown_connections 2024-04-22T07:21:37.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.442+0000 7f7fc3596640 1 -- 172.21.15.40:0/2620062772 >> 172.21.15.40:0/2620062772 conn(0x7f7fbc06df50 msgr2=0x7f7fbc06e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:37.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.442+0000 7f7fc3596640 1 -- 172.21.15.40:0/2620062772 shutdown_connections 2024-04-22T07:21:37.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.442+0000 7f7fc3596640 1 -- 172.21.15.40:0/2620062772 wait complete. 2024-04-22T07:21:37.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.443+0000 7f7fc3596640 1 Processor -- start 2024-04-22T07:21:37.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.443+0000 7f7fc3596640 1 -- start start 2024-04-22T07:21:37.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.444+0000 7f7fc3596640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fa80040b0 0x7f7fbc15c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:37.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.444+0000 7f7fc3596640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fbc15b910 0x7f7fbc158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:37.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.444+0000 7f7fc3596640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fbc159230 0x7f7fbc15d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:37.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.444+0000 7f7fc3596640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7fbc0c9750 con 0x7f7fa80040b0 2024-04-22T07:21:37.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.444+0000 7f7fc3596640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7fbc15f250 con 0x7f7fbc15b910 2024-04-22T07:21:37.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.444+0000 7f7fc3596640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f7fbc06b920 con 0x7f7fbc159230 2024-04-22T07:21:37.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.444+0000 7f7fc1332640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fa80040b0 0x7f7fbc15c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:37.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.444+0000 7f7fc1332640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fa80040b0 0x7f7fbc15c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47150/0 (socket says 172.21.15.40:47150) 2024-04-22T07:21:37.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.444+0000 7f7fc1332640 1 -- 172.21.15.40:0/3118615835 learned_addr learned my addr 172.21.15.40:0/3118615835 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:37.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.444+0000 7f7fc1b33640 1 --2- 172.21.15.40:0/3118615835 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fbc159230 0x7f7fbc15d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:37.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.444+0000 7f7fc0b31640 1 --2- 172.21.15.40:0/3118615835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fbc15b910 0x7f7fbc158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:37.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.444+0000 7f7fc1332640 1 -- 172.21.15.40:0/3118615835 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fbc159230 msgr2=0x7f7fbc15d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:37.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.444+0000 7f7fc1332640 1 --2- 172.21.15.40:0/3118615835 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fbc159230 0x7f7fbc15d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.444+0000 7f7fc1332640 1 -- 172.21.15.40:0/3118615835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fbc15b910 msgr2=0x7f7fbc158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:37.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.444+0000 7f7fc1332640 1 --2- 172.21.15.40:0/3118615835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fbc15b910 0x7f7fbc158cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.444+0000 7f7fc1332640 1 -- 172.21.15.40:0/3118615835 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fbc1f0b70 con 0x7f7fa80040b0 2024-04-22T07:21:37.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.444+0000 7f7fc0b31640 1 --2- 172.21.15.40:0/3118615835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fbc15b910 0x7f7fbc158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:21:37.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.444+0000 7f7fc1332640 1 --2- 172.21.15.40:0/3118615835 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fa80040b0 0x7f7fbc15c1c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8011a30 tx=0x7f7fb8011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:37.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.445+0000 7f7fb1ffb640 1 -- 172.21.15.40:0/3118615835 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb800fbb0 con 0x7f7fa80040b0 2024-04-22T07:21:37.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.445+0000 7f7fb1ffb640 1 -- 172.21.15.40:0/3118615835 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb800fd50 con 0x7f7fa80040b0 2024-04-22T07:21:37.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.445+0000 7f7fb1ffb640 1 -- 172.21.15.40:0/3118615835 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8014680 con 0x7f7fa80040b0 2024-04-22T07:21:37.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.445+0000 7f7fc3596640 1 -- 172.21.15.40:0/3118615835 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fbc1f0e10 con 0x7f7fa80040b0 2024-04-22T07:21:37.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.445+0000 7f7fc3596640 1 -- 172.21.15.40:0/3118615835 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fbc1f13d0 con 0x7f7fa80040b0 2024-04-22T07:21:37.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.446+0000 7f7fc3596640 1 -- 172.21.15.40:0/3118615835 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fbc159610 con 0x7f7fa80040b0 2024-04-22T07:21:37.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.447+0000 7f7fb1ffb640 1 -- 172.21.15.40:0/3118615835 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7fb8012040 con 0x7f7fa80040b0 2024-04-22T07:21:37.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.447+0000 7f7fb1ffb640 1 --2- 172.21.15.40:0/3118615835 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f7fa006c8f0 0x7f7fa006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:37.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.447+0000 7f7fb1ffb640 1 -- 172.21.15.40:0/3118615835 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f7fb808c180 con 0x7f7fa80040b0 2024-04-22T07:21:37.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.447+0000 7f7fc0b31640 1 --2- 172.21.15.40:0/3118615835 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f7fa006c8f0 0x7f7fa006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:37.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.448+0000 7f7fc0b31640 1 --2- 172.21.15.40:0/3118615835 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f7fa006c8f0 0x7f7fa006edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7fac007fd0 tx=0x7f7fac007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:37.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.452+0000 7f7fb1ffb640 1 -- 172.21.15.40:0/3118615835 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7fb8019030 con 0x7f7fa80040b0 2024-04-22T07:21:37.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.676+0000 7f7fc3596640 1 -- 172.21.15.40:0/3118615835 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7fbc069d40 con 0x7f7fa80040b0 2024-04-22T07:21:37.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.676+0000 7f7fb1ffb640 1 -- 172.21.15.40:0/3118615835 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6821 (secure 0 0 0) 0x7f7fb805a590 con 0x7f7fa80040b0 2024-04-22T07:21:37.674 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:21:37.674 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1193926607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1193926607},{"type":"v1","addr":"172.21.15.62:6835","nonce":1193926607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/602167189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":602167189},{"type":"v1","addr":"172.21.15.62:6837","nonce":602167189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2062933254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2062933254},{"type":"v1","addr":"172.21.15.40:6835","nonce":2062933254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3873524978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3873524978},{"type":"v1","addr":"172.21.15.40:6837","nonce":3873524978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/1922761385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":1922761385},{"type":"v1","addr":"172.21.15.40:6839","nonce":1922761385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:20:53.216204+0000","modified":"2024-04-22T07:20:58.875393+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.62:6836/2884673656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2884673656},{"type":"v1","addr":"172.21.15.62:6836","nonce":2884673656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4305]},"id":1}]} 2024-04-22T07:21:37.674 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-04-22T07:21:37.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.679+0000 7f7fc3596640 1 -- 172.21.15.40:0/3118615835 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f7fa006c8f0 msgr2=0x7f7fa006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:37.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.679+0000 7f7fc3596640 1 --2- 172.21.15.40:0/3118615835 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f7fa006c8f0 0x7f7fa006edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7fac007fd0 tx=0x7f7fac007000 comp rx=0 tx=0).stop 2024-04-22T07:21:37.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.679+0000 7f7fc3596640 1 -- 172.21.15.40:0/3118615835 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fa80040b0 msgr2=0x7f7fbc15c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:37.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.679+0000 7f7fc3596640 1 --2- 172.21.15.40:0/3118615835 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fa80040b0 0x7f7fbc15c1c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8011a30 tx=0x7f7fb8011ef0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.679+0000 7f7fc3596640 1 -- 172.21.15.40:0/3118615835 shutdown_connections 2024-04-22T07:21:37.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.679+0000 7f7fc3596640 1 --2- 172.21.15.40:0/3118615835 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fbc159230 0x7f7fbc15d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.679+0000 7f7fc3596640 1 --2- 172.21.15.40:0/3118615835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fbc15b910 0x7f7fbc158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.679+0000 7f7fc3596640 1 --2- 172.21.15.40:0/3118615835 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f7fa006c8f0 0x7f7fa006edb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.679+0000 7f7fc3596640 1 --2- 172.21.15.40:0/3118615835 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7fa80040b0 0x7f7fbc15c1c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.679+0000 7f7fc3596640 1 -- 172.21.15.40:0/3118615835 >> 172.21.15.40:0/3118615835 conn(0x7f7fbc06df50 msgr2=0x7f7fbc0cea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:37.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.679+0000 7f7fc3596640 1 -- 172.21.15.40:0/3118615835 shutdown_connections 2024-04-22T07:21:37.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.679+0000 7f7fc3596640 1 -- 172.21.15.40:0/3118615835 wait complete. 2024-04-22T07:21:37.687 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4305 quiesce db / --timeout 60 --expiration 83.2 --await' 2024-04-22T07:21:37.688 DEBUG:teuthology.orchestra.run.smithi040:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4305 quiesce db / --timeout 60 --expiration 83.2 --await 2024-04-22T07:21:37.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.799+0000 7fdeb3938640 1 Processor -- start 2024-04-22T07:21:37.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.799+0000 7fdeb3938640 1 -- start start 2024-04-22T07:21:37.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.800+0000 7fdeb3938640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdeac0d08c0 0x7fdeac0caef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:37.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.800+0000 7fdeb3938640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdeac0cd380 0x7fdeac0cd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:37.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.800+0000 7fdeb3938640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdeac0cdd50 con 0x7fdeac0d0ca0 2024-04-22T07:21:37.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.800+0000 7fdeb3938640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fdeac0ccef0 con 0x7fdeac0cd380 2024-04-22T07:21:37.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.800+0000 7fdeb3938640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fdeac15ac50 con 0x7fdeac0d08c0 2024-04-22T07:21:37.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.800+0000 7fdeb1ed5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdeac0cd380 0x7fdeac0cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:37.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.800+0000 7fdeb1ed5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdeac0cd380 0x7fdeac0cd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47160/0 (socket says 172.21.15.40:47160) 2024-04-22T07:21:37.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.800+0000 7fdeb1ed5640 1 -- 172.21.15.40:0/3313113957 learned_addr learned my addr 172.21.15.40:0/3313113957 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:37.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.801+0000 7fdeb16d4640 1 --2- 172.21.15.40:0/3313113957 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdeac0d08c0 0x7fdeac0caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:37.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.801+0000 7fdeb1ed5640 1 -- 172.21.15.40:0/3313113957 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdeac0d08c0 msgr2=0x7fdeac0caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:37.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.801+0000 7fdeb1ed5640 1 --2- 172.21.15.40:0/3313113957 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdeac0d08c0 0x7fdeac0caef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.801+0000 7fdeb1ed5640 1 -- 172.21.15.40:0/3313113957 >> v1:172.21.15.62:6789/0 conn(0x7fdeac0d0ca0 legacy=0x7fdeac0cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:37.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.801+0000 7fdeb1ed5640 1 -- 172.21.15.40:0/3313113957 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeac15af10 con 0x7fdeac0cd380 2024-04-22T07:21:37.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.801+0000 7fdeb1ed5640 1 --2- 172.21.15.40:0/3313113957 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdeac0cd380 0x7fdeac0cd810 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdea4009e50 tx=0x7fdea402bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3c9d89c425409c server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:37.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.802+0000 7fdea3fff640 1 -- 172.21.15.40:0/3313113957 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea402cb90 con 0x7fdeac0cd380 2024-04-22T07:21:37.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.802+0000 7fdea3fff640 1 -- 172.21.15.40:0/3313113957 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdea402cd30 con 0x7fdeac0cd380 2024-04-22T07:21:37.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.802+0000 7fdea3fff640 1 -- 172.21.15.40:0/3313113957 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea4034610 con 0x7fdeac0cd380 2024-04-22T07:21:37.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.802+0000 7fdeb3938640 1 -- 172.21.15.40:0/3313113957 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdeac0cd380 msgr2=0x7fdeac0cd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:37.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.802+0000 7fdeb3938640 1 --2- 172.21.15.40:0/3313113957 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdeac0cd380 0x7fdeac0cd810 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdea4009e50 tx=0x7fdea402bff0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.802+0000 7fdeb3938640 1 -- 172.21.15.40:0/3313113957 shutdown_connections 2024-04-22T07:21:37.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.802+0000 7fdeb3938640 1 --2- 172.21.15.40:0/3313113957 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdeac0cd380 0x7fdeac0cd810 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.802+0000 7fdeb3938640 1 --2- 172.21.15.40:0/3313113957 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdeac0d08c0 0x7fdeac0caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.802+0000 7fdeb3938640 1 -- 172.21.15.40:0/3313113957 >> 172.21.15.40:0/3313113957 conn(0x7fdeac06ce70 msgr2=0x7fdeac06d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:37.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.802+0000 7fdeb3938640 1 -- 172.21.15.40:0/3313113957 shutdown_connections 2024-04-22T07:21:37.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.802+0000 7fdeb3938640 1 -- 172.21.15.40:0/3313113957 wait complete. 2024-04-22T07:21:37.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.803+0000 7fdeb3938640 1 Processor -- start 2024-04-22T07:21:37.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.804+0000 7fdeb3938640 1 -- start start 2024-04-22T07:21:37.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.804+0000 7fdeb3938640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdeac0cd380 0x7fdeac0c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:37.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.804+0000 7fdeb3938640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdeac0d08c0 0x7fdeac0c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:37.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.804+0000 7fdeb3938640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdeac0d0ca0 0x7fdeac0c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:37.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.804+0000 7fdeb3938640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdeac15b7b0 con 0x7fdeac0d0ca0 2024-04-22T07:21:37.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.804+0000 7fdeb3938640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdeac15b4d0 con 0x7fdeac0cd380 2024-04-22T07:21:37.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.804+0000 7fdeb3938640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fdeac15ba90 con 0x7fdeac0d08c0 2024-04-22T07:21:37.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.804+0000 7fdeb1ed5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdeac0d0ca0 0x7fdeac0c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:37.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.804+0000 7fdeb1ed5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdeac0d0ca0 0x7fdeac0c83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47162/0 (socket says 172.21.15.40:47162) 2024-04-22T07:21:37.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.804+0000 7fdeb1ed5640 1 -- 172.21.15.40:0/1318053807 learned_addr learned my addr 172.21.15.40:0/1318053807 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:37.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.804+0000 7fdeb16d4640 1 --2- 172.21.15.40:0/1318053807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdeac0cd380 0x7fdeac0c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:37.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.804+0000 7fdeb0ed3640 1 --2- 172.21.15.40:0/1318053807 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdeac0d08c0 0x7fdeac0c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:37.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.805+0000 7fdeb1ed5640 1 -- 172.21.15.40:0/1318053807 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdeac0d08c0 msgr2=0x7fdeac0c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:37.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.805+0000 7fdeb1ed5640 1 --2- 172.21.15.40:0/1318053807 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdeac0d08c0 0x7fdeac0c7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.805+0000 7fdeb1ed5640 1 -- 172.21.15.40:0/1318053807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdeac0cd380 msgr2=0x7fdeac0c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:37.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.805+0000 7fdeb1ed5640 1 --2- 172.21.15.40:0/1318053807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdeac0cd380 0x7fdeac0c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.805+0000 7fdeb1ed5640 1 -- 172.21.15.40:0/1318053807 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeac1f1110 con 0x7fdeac0d0ca0 2024-04-22T07:21:37.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.805+0000 7fdeb1ed5640 1 --2- 172.21.15.40:0/1318053807 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdeac0d0ca0 0x7fdeac0c83a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdea4036040 tx=0x7fdea4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:37.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.805+0000 7fdea1ffb640 1 -- 172.21.15.40:0/1318053807 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea4043020 con 0x7fdeac0d0ca0 2024-04-22T07:21:37.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.805+0000 7fdea1ffb640 1 -- 172.21.15.40:0/1318053807 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdea403e450 con 0x7fdeac0d0ca0 2024-04-22T07:21:37.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.805+0000 7fdeb3938640 1 -- 172.21.15.40:0/1318053807 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeac1f13f0 con 0x7fdeac0d0ca0 2024-04-22T07:21:37.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.805+0000 7fdea1ffb640 1 -- 172.21.15.40:0/1318053807 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea4009510 con 0x7fdeac0d0ca0 2024-04-22T07:21:37.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.805+0000 7fdeb3938640 1 -- 172.21.15.40:0/1318053807 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeac1f19b0 con 0x7fdeac0d0ca0 2024-04-22T07:21:37.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.807+0000 7fdea1ffb640 1 -- 172.21.15.40:0/1318053807 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdea4046020 con 0x7fdeac0d0ca0 2024-04-22T07:21:37.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.807+0000 7fdea1ffb640 1 --2- 172.21.15.40:0/1318053807 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fde9006c8f0 0x7fde9006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:37.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.807+0000 7fdea1ffb640 1 -- 172.21.15.40:0/1318053807 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fdea40ae180 con 0x7fdeac0d0ca0 2024-04-22T07:21:37.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.808+0000 7fdeb16d4640 1 --2- 172.21.15.40:0/1318053807 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fde9006c8f0 0x7fde9006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:37.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.808+0000 7fdeb16d4640 1 --2- 172.21.15.40:0/1318053807 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fde9006c8f0 0x7fde9006edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdea8006fd0 tx=0x7fdea8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:37.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.808+0000 7fdeb65fd740 1 Processor -- start 2024-04-22T07:21:37.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.808+0000 7fdeb65fd740 1 -- start start 2024-04-22T07:21:37.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.809+0000 7fdeb65fd740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f71c3b200 0x564f71c3b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:37.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.809+0000 7fdeb65fd740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f71c85080 0x564f71c3bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:37.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.809+0000 7fdeb65fd740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f71c39c60 0x564f71c7ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:37.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.809+0000 7fdeb65fd740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x564f71b9c0b0 con 0x564f71c85080 2024-04-22T07:21:37.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.809+0000 7fdeb65fd740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564f71b4d680 con 0x564f71c39c60 2024-04-22T07:21:37.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.809+0000 7fdeb65fd740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x564f71b59c60 con 0x564f71c3b200 2024-04-22T07:21:37.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.809+0000 7fdeb0ed3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f71c85080 0x564f71c3bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:37.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.809+0000 7fdeb0ed3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f71c85080 0x564f71c3bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47168/0 (socket says 172.21.15.40:47168) 2024-04-22T07:21:37.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.809+0000 7fdeb0ed3640 1 -- 172.21.15.40:0/1916188398 learned_addr learned my addr 172.21.15.40:0/1916188398 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:37.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.809+0000 7fdeb16d4640 1 --2- 172.21.15.40:0/1916188398 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f71c3b200 0x564f71c3b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:37.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.809+0000 7fdeb1ed5640 1 --2- 172.21.15.40:0/1916188398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f71c39c60 0x564f71c7ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:37.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.809+0000 7fdeb0ed3640 1 -- 172.21.15.40:0/1916188398 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f71c3b200 msgr2=0x564f71c3b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:37.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.809+0000 7fdeb0ed3640 1 --2- 172.21.15.40:0/1916188398 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f71c3b200 0x564f71c3b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.809+0000 7fdeb0ed3640 1 -- 172.21.15.40:0/1916188398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f71c39c60 msgr2=0x564f71c7ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:37.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.809+0000 7fdeb0ed3640 1 --2- 172.21.15.40:0/1916188398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f71c39c60 0x564f71c7ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.809+0000 7fdeb0ed3640 1 -- 172.21.15.40:0/1916188398 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f7197ec90 con 0x564f71c85080 2024-04-22T07:21:37.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.810+0000 7fdeb0ed3640 1 --2- 172.21.15.40:0/1916188398 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f71c85080 0x564f71c3bb20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fde9c001770 tx=0x7fde9c007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8481d82ac3ef5 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:37.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.810+0000 7fde96ffd640 1 -- 172.21.15.40:0/1916188398 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9c0052e0 con 0x564f71c85080 2024-04-22T07:21:37.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.810+0000 7fde96ffd640 1 -- 172.21.15.40:0/1916188398 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde9c018070 con 0x564f71c85080 2024-04-22T07:21:37.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.810+0000 7fde96ffd640 1 -- 172.21.15.40:0/1916188398 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9c00f9d0 con 0x564f71c85080 2024-04-22T07:21:37.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.810+0000 7fdeb65fd740 1 -- 172.21.15.40:0/1916188398 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f71c85080 msgr2=0x564f71c3bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:37.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.810+0000 7fdeb65fd740 1 --2- 172.21.15.40:0/1916188398 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f71c85080 0x564f71c3bb20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fde9c001770 tx=0x7fde9c007e30 comp rx=0 tx=0).stop 2024-04-22T07:21:37.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.810+0000 7fdeb65fd740 1 -- 172.21.15.40:0/1916188398 shutdown_connections 2024-04-22T07:21:37.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.810+0000 7fdeb65fd740 1 --2- 172.21.15.40:0/1916188398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f71c39c60 0x564f71c7ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.810+0000 7fdeb65fd740 1 --2- 172.21.15.40:0/1916188398 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f71c85080 0x564f71c3bb20 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.810+0000 7fdeb65fd740 1 --2- 172.21.15.40:0/1916188398 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f71c3b200 0x564f71c3b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.810+0000 7fdeb65fd740 1 -- 172.21.15.40:0/1916188398 >> 172.21.15.40:0/1916188398 conn(0x564f71c37c00 msgr2=0x564f71c3a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:37.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.811+0000 7fdeb65fd740 1 -- 172.21.15.40:0/1916188398 shutdown_connections 2024-04-22T07:21:37.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.811+0000 7fdeb65fd740 1 -- 172.21.15.40:0/1916188398 wait complete. 2024-04-22T07:21:37.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.811+0000 7fdeb65fd740 1 -- start start 2024-04-22T07:21:37.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.811+0000 7fdeb65fd740 1 Processor -- start 2024-04-22T07:21:37.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.812+0000 7fdeb65fd740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f71c3b200 0x564f71c63370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:37.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.812+0000 7fdeb65fd740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f71c85080 0x564f71c7bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:37.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.812+0000 7fdeb65fd740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f71c77800 0x564f71c76990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:37.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.812+0000 7fdeb65fd740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x564f71b9f400 con 0x564f71c3b200 2024-04-22T07:21:37.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.812+0000 7fdeb65fd740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564f71b5b840 con 0x564f71c77800 2024-04-22T07:21:37.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.812+0000 7fdeb65fd740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x564f71ba4720 con 0x564f71c85080 2024-04-22T07:21:37.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.812+0000 7fdeb65fd740 10 client.0 _ll_register_callbacks cb 0x564f71bacea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:21:37.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.812+0000 7fdeb16d4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f71c3b200 0x564f71c63370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:37.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.812+0000 7fdeb16d4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f71c3b200 0x564f71c63370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47172/0 (socket says 172.21.15.40:47172) 2024-04-22T07:21:37.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.812+0000 7fdeb16d4640 1 -- 172.21.15.40:0/2745987455 learned_addr learned my addr 172.21.15.40:0/2745987455 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:37.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.812+0000 7fdeb0ed3640 1 --2- 172.21.15.40:0/2745987455 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f71c85080 0x564f71c7bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:37.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.812+0000 7fdeb1ed5640 1 --2- 172.21.15.40:0/2745987455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f71c77800 0x564f71c76990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:37.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.812+0000 7fdeb16d4640 1 -- 172.21.15.40:0/2745987455 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f71c85080 msgr2=0x564f71c7bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:37.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.812+0000 7fdeb16d4640 1 --2- 172.21.15.40:0/2745987455 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f71c85080 0x564f71c7bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.812+0000 7fdeb16d4640 1 -- 172.21.15.40:0/2745987455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f71c77800 msgr2=0x564f71c76990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:37.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.812+0000 7fdeb16d4640 1 --2- 172.21.15.40:0/2745987455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f71c77800 0x564f71c76990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.812+0000 7fdeb16d4640 1 -- 172.21.15.40:0/2745987455 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f719df420 con 0x564f71c3b200 2024-04-22T07:21:37.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.813+0000 7fdeb16d4640 1 --2- 172.21.15.40:0/2745987455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f71c3b200 0x564f71c63370 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdea8016a60 tx=0x7fdea8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de68c42366aa5163 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:37.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.813+0000 7fde8bfff640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-04-22T07:21:37.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.813+0000 7fde8bfff640 1 -- 172.21.15.40:0/2745987455 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea8026020 con 0x564f71c3b200 2024-04-22T07:21:37.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.813+0000 7fde8bfff640 1 -- 172.21.15.40:0/2745987455 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fdea8010e40 con 0x564f71c3b200 2024-04-22T07:21:37.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.813+0000 7fdeb65fd740 1 -- 172.21.15.40:0/2745987455 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde9c018070 con 0x564f71c3b200 2024-04-22T07:21:37.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.813+0000 7fde8bfff640 1 -- 172.21.15.40:0/2745987455 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fdea8030050 con 0x564f71c3b200 2024-04-22T07:21:37.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.813+0000 7fdeb65fd740 10 client.4905 fetch_fsmap learned FSMap version 8 2024-04-22T07:21:37.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.813+0000 7fdeb65fd740 1 -- 172.21.15.40:0/2745987455 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x564f71872580 con 0x564f71c3b200 2024-04-22T07:21:37.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.813+0000 7fde8bfff640 1 -- 172.21.15.40:0/2745987455 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde9c018070 con 0x564f71c3b200 2024-04-22T07:21:37.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.813+0000 7fde8bfff640 1 -- 172.21.15.40:0/2745987455 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fdea8033020 con 0x564f71c3b200 2024-04-22T07:21:37.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.813+0000 7fdeb65fd740 10 client.4905 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:21:37.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.813+0000 7fdeb65fd740 10 client.4905 resolve_mds: validated gid 4305 aka daemon mds.b 2024-04-22T07:21:37.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.813+0000 7fdeb65fd740 20 client.4905 populate_metadata read hostname 'smithi040' 2024-04-22T07:21:37.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.813+0000 7fdeb65fd740 1 --2- 172.21.15.40:0/2745987455 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x564f71c8f3e0 0x564f71c8f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:37.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.813+0000 7fdeb65fd740 4 client.4905 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T07:21:37.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.813+0000 7fdeb65fd740 1 -- 172.21.15.40:0/2745987455 --> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f71badb10 con 0x564f71c8f3e0 2024-04-22T07:21:37.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.814+0000 7fdeb0ed3640 1 --2- 172.21.15.40:0/2745987455 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x564f71c8f3e0 0x564f71c8f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:37.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.814+0000 7fdeb0ed3640 1 --2- 172.21.15.40:0/2745987455 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x564f71c8f3e0 0x564f71c8f7e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82b4d74b5273ee4b server_cookie=6833fc16b9081522 in_seq=0 out_seq=0 2024-04-22T07:21:37.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.814+0000 7fde8bfff640 10 client.4905 ms_handle_connect on v2:172.21.15.62:6833/2884673656 2024-04-22T07:21:37.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.815+0000 7fde8bfff640 1 -- 172.21.15.40:0/2745987455 <== mds.0 v2:172.21.15.62:6833/2884673656 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564f71badb10 con 0x564f71c8f3e0 2024-04-22T07:21:37.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.815+0000 7fde8bfff640 10 client.4905 handle_command_reply: tid=0 2024-04-22T07:21:37.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.815+0000 7fdeb65fd740 1 client.4905 shutdown 2024-04-22T07:21:37.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.815+0000 7fdeb65fd740 1 -- 172.21.15.40:0/2745987455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f71c3b200 msgr2=0x564f71c63370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:37.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.815+0000 7fdeb65fd740 1 --2- 172.21.15.40:0/2745987455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f71c3b200 0x564f71c63370 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdea8016a60 tx=0x7fdea8004730 comp rx=0 tx=0).stop 2024-04-22T07:21:37.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.815+0000 7fdeb65fd740 1 -- 172.21.15.40:0/2745987455 shutdown_connections 2024-04-22T07:21:37.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.815+0000 7fdeb65fd740 1 --2- 172.21.15.40:0/2745987455 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x564f71c8f3e0 0x564f71c8f7e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.815+0000 7fdeb65fd740 1 --2- 172.21.15.40:0/2745987455 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f71c77800 0x564f71c76990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.815+0000 7fdeb65fd740 1 --2- 172.21.15.40:0/2745987455 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f71c85080 0x564f71c7bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.815+0000 7fde8bfff640 0 client.4905 ms_handle_reset on v2:172.21.15.62:6833/2884673656 2024-04-22T07:21:37.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.815+0000 7fdeb65fd740 1 --2- 172.21.15.40:0/2745987455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f71c3b200 0x564f71c63370 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.815+0000 7fdeb65fd740 1 -- 172.21.15.40:0/2745987455 >> 172.21.15.40:0/2745987455 conn(0x564f71c39c60 msgr2=0x564f71c34940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:37.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.815+0000 7fdeb65fd740 1 -- 172.21.15.40:0/2745987455 shutdown_connections 2024-04-22T07:21:37.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.815+0000 7fdeb65fd740 1 -- 172.21.15.40:0/2745987455 wait complete. 2024-04-22T07:21:37.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.815+0000 7fdeb65fd740 20 client.4905 trim_cache size 0 max 16384 2024-04-22T07:21:37.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.833+0000 7fdeb65fd740 1 Processor -- start 2024-04-22T07:21:37.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.833+0000 7fdeb65fd740 1 -- start start 2024-04-22T07:21:37.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.833+0000 7fdeb65fd740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f71c3b200 0x564f71c3b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:37.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.833+0000 7fdeb65fd740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f71c77800 0x564f71c9e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:37.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.833+0000 7fdeb65fd740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f71c85080 0x564f71c9ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:37.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.833+0000 7fdeb65fd740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdeac1fe130 con 0x564f71c77800 2024-04-22T07:21:37.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.833+0000 7fdeb65fd740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdeac1fd010 con 0x564f71c3b200 2024-04-22T07:21:37.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.833+0000 7fdeb65fd740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fdeac1fc940 con 0x564f71c85080 2024-04-22T07:21:37.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.833+0000 7fdeb0ed3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f71c77800 0x564f71c9e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:37.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.833+0000 7fdeb0ed3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f71c77800 0x564f71c9e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47186/0 (socket says 172.21.15.40:47186) 2024-04-22T07:21:37.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.833+0000 7fdeb0ed3640 1 -- 172.21.15.40:0/884716758 learned_addr learned my addr 172.21.15.40:0/884716758 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:37.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.834+0000 7fdeb1ed5640 1 --2- 172.21.15.40:0/884716758 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f71c85080 0x564f71c9ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:37.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.834+0000 7fdeb16d4640 1 --2- 172.21.15.40:0/884716758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f71c3b200 0x564f71c3b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:37.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.834+0000 7fdeb0ed3640 1 -- 172.21.15.40:0/884716758 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f71c85080 msgr2=0x564f71c9ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:37.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.834+0000 7fdeb0ed3640 1 --2- 172.21.15.40:0/884716758 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f71c85080 0x564f71c9ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.834+0000 7fdeb0ed3640 1 -- 172.21.15.40:0/884716758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f71c3b200 msgr2=0x564f71c3b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:37.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.834+0000 7fdeb0ed3640 1 --2- 172.21.15.40:0/884716758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f71c3b200 0x564f71c3b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.834+0000 7fdeb0ed3640 1 -- 172.21.15.40:0/884716758 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f71c793f0 con 0x564f71c77800 2024-04-22T07:21:37.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.834+0000 7fdeb1ed5640 1 --2- 172.21.15.40:0/884716758 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f71c85080 0x564f71c9ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:21:37.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.834+0000 7fdeb0ed3640 1 --2- 172.21.15.40:0/884716758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f71c77800 0x564f71c9e780 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fde9c014000 tx=0x7fde9c00a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf344c290851b79 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:37.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.834+0000 7fde967fc640 1 -- 172.21.15.40:0/884716758 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9c028600 con 0x564f71c77800 2024-04-22T07:21:37.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.834+0000 7fde967fc640 1 -- 172.21.15.40:0/884716758 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde9c018070 con 0x564f71c77800 2024-04-22T07:21:37.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.834+0000 7fde967fc640 1 -- 172.21.15.40:0/884716758 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9c007040 con 0x564f71c77800 2024-04-22T07:21:37.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.835+0000 7fdeb65fd740 1 -- 172.21.15.40:0/884716758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f71c77800 msgr2=0x564f71c9e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:37.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.835+0000 7fdeb65fd740 1 --2- 172.21.15.40:0/884716758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f71c77800 0x564f71c9e780 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fde9c014000 tx=0x7fde9c00a000 comp rx=0 tx=0).stop 2024-04-22T07:21:37.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.835+0000 7fdeb65fd740 1 -- 172.21.15.40:0/884716758 shutdown_connections 2024-04-22T07:21:37.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.835+0000 7fdeb65fd740 1 --2- 172.21.15.40:0/884716758 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f71c85080 0x564f71c9ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.835+0000 7fdeb65fd740 1 --2- 172.21.15.40:0/884716758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f71c77800 0x564f71c9e780 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.835+0000 7fdeb65fd740 1 --2- 172.21.15.40:0/884716758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f71c3b200 0x564f71c3b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.835+0000 7fdeb65fd740 1 -- 172.21.15.40:0/884716758 >> 172.21.15.40:0/884716758 conn(0x564f71c39c60 msgr2=0x564f71c31250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:37.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.835+0000 7fdeb65fd740 1 -- 172.21.15.40:0/884716758 shutdown_connections 2024-04-22T07:21:37.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.835+0000 7fdeb65fd740 1 -- 172.21.15.40:0/884716758 wait complete. 2024-04-22T07:21:37.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.835+0000 7fdeb65fd740 1 -- start start 2024-04-22T07:21:37.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.835+0000 7fdeb65fd740 1 Processor -- start 2024-04-22T07:21:37.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.836+0000 7fdeb65fd740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f71c3b200 0x564f71c95840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:37.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.836+0000 7fdeb65fd740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f71c77800 0x564f71c9e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:37.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.836+0000 7fdeb65fd740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f71c85080 0x564f71c9ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:37.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.836+0000 7fdeb65fd740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdeac1f4d80 con 0x564f71c85080 2024-04-22T07:21:37.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.836+0000 7fdeb65fd740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdeac1f4730 con 0x564f71c3b200 2024-04-22T07:21:37.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.836+0000 7fdeb65fd740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x564f71bad300 con 0x564f71c77800 2024-04-22T07:21:37.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.836+0000 7fdeb65fd740 10 client.0 _ll_register_callbacks cb 0x7fdea8006dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:21:37.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.836+0000 7fdeb1ed5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f71c85080 0x564f71c9ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:37.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.836+0000 7fdeb16d4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f71c3b200 0x564f71c95840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:37.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.836+0000 7fdeb1ed5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f71c85080 0x564f71c9ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47200/0 (socket says 172.21.15.40:47200) 2024-04-22T07:21:37.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.836+0000 7fdeb1ed5640 1 -- 172.21.15.40:0/337296783 learned_addr learned my addr 172.21.15.40:0/337296783 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:21:37.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.836+0000 7fdeb0ed3640 1 --2- 172.21.15.40:0/337296783 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f71c77800 0x564f71c9e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:37.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.837+0000 7fdeb1ed5640 1 -- 172.21.15.40:0/337296783 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f71c77800 msgr2=0x564f71c9e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:37.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.837+0000 7fdeb1ed5640 1 --2- 172.21.15.40:0/337296783 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f71c77800 0x564f71c9e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.837+0000 7fdeb1ed5640 1 -- 172.21.15.40:0/337296783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f71c3b200 msgr2=0x564f71c95840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:21:37.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.837+0000 7fdeb1ed5640 1 --2- 172.21.15.40:0/337296783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f71c3b200 0x564f71c95840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.837+0000 7fdeb1ed5640 1 -- 172.21.15.40:0/337296783 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f71c3c0c0 con 0x564f71c85080 2024-04-22T07:21:37.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.837+0000 7fdeb1ed5640 1 --2- 172.21.15.40:0/337296783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f71c85080 0x564f71c9ecc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdea40ac5f0 tx=0x7fdea407bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe4e526196ebc10 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:21:37.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.837+0000 7fde8bfff640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-04-22T07:21:37.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.837+0000 7fde8bfff640 1 -- 172.21.15.40:0/337296783 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea40849d0 con 0x564f71c85080 2024-04-22T07:21:37.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.837+0000 7fde8bfff640 1 -- 172.21.15.40:0/337296783 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fdea402cba0 con 0x564f71c85080 2024-04-22T07:21:37.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.837+0000 7fdeb65fd740 1 -- 172.21.15.40:0/337296783 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde9c018070 con 0x564f71c85080 2024-04-22T07:21:37.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.837+0000 7fde8bfff640 1 -- 172.21.15.40:0/337296783 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fdea4084540 con 0x564f71c85080 2024-04-22T07:21:37.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.837+0000 7fdeb65fd740 10 client.4911 fetch_fsmap learned FSMap version 8 2024-04-22T07:21:37.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.837+0000 7fdeb65fd740 1 -- 172.21.15.40:0/337296783 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x564f71c8ebc0 con 0x564f71c85080 2024-04-22T07:21:37.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.837+0000 7fde8bfff640 1 -- 172.21.15.40:0/337296783 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde9c018070 con 0x564f71c85080 2024-04-22T07:21:37.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.837+0000 7fde8bfff640 1 -- 172.21.15.40:0/337296783 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fdea4094100 con 0x564f71c85080 2024-04-22T07:21:37.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.837+0000 7fdeb65fd740 10 client.4911 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:21:37.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.837+0000 7fdeb65fd740 10 client.4911 resolve_mds: validated gid 4305 aka daemon mds.b 2024-04-22T07:21:37.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.837+0000 7fdeb65fd740 20 client.4911 populate_metadata read hostname 'smithi040' 2024-04-22T07:21:37.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.837+0000 7fdeb65fd740 1 --2- 172.21.15.40:0/337296783 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x564f71cf5dd0 0x564f71c77dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:21:37.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.837+0000 7fdeb65fd740 4 client.4911 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 83.2, "await": true}] 2024-04-22T07:21:37.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.837+0000 7fdeb65fd740 1 -- 172.21.15.40:0/337296783 --> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 83.2, "await": true}) -- 0x564f71ba7980 con 0x564f71cf5dd0 2024-04-22T07:21:37.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.838+0000 7fdeb16d4640 1 --2- 172.21.15.40:0/337296783 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x564f71cf5dd0 0x564f71c77dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:21:37.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.838+0000 7fdeb16d4640 1 --2- 172.21.15.40:0/337296783 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x564f71cf5dd0 0x564f71c77dc0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=450ee94497aec8bc server_cookie=afe8fae511be76d3 in_seq=0 out_seq=0 2024-04-22T07:21:37.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.838+0000 7fde8bfff640 10 client.4911 ms_handle_connect on v2:172.21.15.62:6833/2884673656 2024-04-22T07:21:37.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.842+0000 7fde8bfff640 1 -- 172.21.15.40:0/337296783 <== mds.0 v2:172.21.15.62:6833/2884673656 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x564f71ba7980 con 0x564f71cf5dd0 2024-04-22T07:21:37.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.842+0000 7fde8bfff640 10 client.4911 handle_command_reply: tid=0 2024-04-22T07:21:37.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.842+0000 7fdeb65fd740 1 client.4911 shutdown 2024-04-22T07:21:37.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.842+0000 7fdeb65fd740 1 -- 172.21.15.40:0/337296783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f71c85080 msgr2=0x564f71c9ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:37.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.842+0000 7fdeb65fd740 1 --2- 172.21.15.40:0/337296783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f71c85080 0x564f71c9ecc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdea40ac5f0 tx=0x7fdea407bea0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.842+0000 7fdeb65fd740 1 -- 172.21.15.40:0/337296783 shutdown_connections 2024-04-22T07:21:37.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.842+0000 7fdeb65fd740 1 --2- 172.21.15.40:0/337296783 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x564f71cf5dd0 0x564f71c77dc0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.842+0000 7fdeb65fd740 1 --2- 172.21.15.40:0/337296783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f71c85080 0x564f71c9ecc0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.842+0000 7fdeb65fd740 1 --2- 172.21.15.40:0/337296783 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f71c77800 0x564f71c9e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.842+0000 7fdeb65fd740 1 --2- 172.21.15.40:0/337296783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f71c3b200 0x564f71c95840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.842+0000 7fde8bfff640 0 client.4911 ms_handle_reset on v2:172.21.15.62:6833/2884673656 2024-04-22T07:21:37.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.842+0000 7fdeb65fd740 1 -- 172.21.15.40:0/337296783 >> 172.21.15.40:0/337296783 conn(0x564f71c39c60 msgr2=0x564f71c38700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:37.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.842+0000 7fdeb65fd740 1 -- 172.21.15.40:0/337296783 shutdown_connections 2024-04-22T07:21:37.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.842+0000 7fdeb65fd740 1 -- 172.21.15.40:0/337296783 wait complete. 2024-04-22T07:21:37.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.842+0000 7fdeb65fd740 20 client.4911 trim_cache size 0 max 16384 2024-04-22T07:21:37.842 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-22T07:21:37.842 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 8, 2024-04-22T07:21:37.842 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 4305, 2024-04-22T07:21:37.842 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 2, 2024-04-22T07:21:37.843 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-04-22T07:21:37.843 INFO:teuthology.orchestra.run.smithi040.stdout: "acf810c1": { 2024-04-22T07:21:37.843 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 2, 2024-04-22T07:21:37.843 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-04-22T07:21:37.843 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-04-22T07:21:37.843 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-04-22T07:21:37.843 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-04-22T07:21:37.843 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-22T07:21:37.843 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 60.0, 2024-04-22T07:21:37.843 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 83.2, 2024-04-22T07:21:37.843 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-04-22T07:21:37.843 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-04-22T07:21:37.843 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-04-22T07:21:37.843 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-04-22T07:21:37.844 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-04-22T07:21:37.844 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-04-22T07:21:37.844 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:21:37.844 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:21:37.844 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:21:37.844 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:21:37.844 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:21:37.844 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-22T07:21:37.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.843+0000 7fdeb3938640 1 -- 172.21.15.40:0/1318053807 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fde9006c8f0 msgr2=0x7fde9006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:37.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.843+0000 7fdeb3938640 1 --2- 172.21.15.40:0/1318053807 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fde9006c8f0 0x7fde9006edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdea8006fd0 tx=0x7fdea8008040 comp rx=0 tx=0).stop 2024-04-22T07:21:37.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.843+0000 7fdeb3938640 1 -- 172.21.15.40:0/1318053807 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdeac0d0ca0 msgr2=0x7fdeac0c83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:21:37.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.843+0000 7fdeb3938640 1 --2- 172.21.15.40:0/1318053807 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdeac0d0ca0 0x7fdeac0c83a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdea4036040 tx=0x7fdea4004a40 comp rx=0 tx=0).stop 2024-04-22T07:21:37.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.843+0000 7fdeb3938640 1 -- 172.21.15.40:0/1318053807 shutdown_connections 2024-04-22T07:21:37.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.843+0000 7fdeb3938640 1 --2- 172.21.15.40:0/1318053807 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fde9006c8f0 0x7fde9006edb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.843+0000 7fdeb3938640 1 --2- 172.21.15.40:0/1318053807 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdeac0d0ca0 0x7fdeac0c83a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.843+0000 7fdeb3938640 1 --2- 172.21.15.40:0/1318053807 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdeac0d08c0 0x7fdeac0c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.843+0000 7fdeb3938640 1 --2- 172.21.15.40:0/1318053807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdeac0cd380 0x7fdeac0c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:21:37.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.843+0000 7fdeb3938640 1 -- 172.21.15.40:0/1318053807 >> 172.21.15.40:0/1318053807 conn(0x7fdeac06ce70 msgr2=0x7fdeac0c54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:21:37.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.843+0000 7fdeb3938640 1 -- 172.21.15.40:0/1318053807 shutdown_connections 2024-04-22T07:21:37.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:21:37.843+0000 7fdeb3938640 1 -- 172.21.15.40:0/1318053807 wait complete. 2024-04-22T07:21:37.851 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced, set_id: acf810c1, quiesce took 0.5 seconds. Will release after: 23.2 2024-04-22T07:21:53.599 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:21:53.602 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:22:01.053 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:22:01.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.164+0000 7f94d39e6640 1 Processor -- start 2024-04-22T07:22:01.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.164+0000 7f94d39e6640 1 -- start start 2024-04-22T07:22:01.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.165+0000 7f94d39e6640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94cc158570 0x7f94cc06b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.165+0000 7f94d39e6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f94cc06cbb0 0x7f94cc06f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.165+0000 7f94d39e6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f94cc0c9090 0x7f94cc06fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.165+0000 7f94d39e6640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f94cc0ca0a0 con 0x7f94cc06cbb0 2024-04-22T07:22:01.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.165+0000 7f94d39e6640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f94cc0ca380 con 0x7f94cc0c9090 2024-04-22T07:22:01.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.165+0000 7f94d39e6640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f94cc0ca660 con 0x7f94cc158570 2024-04-22T07:22:01.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.165+0000 7f94d0f81640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f94cc06cbb0 0x7f94cc06f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.165+0000 7f94d0f81640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f94cc06cbb0 0x7f94cc06f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33638/0 (socket says 172.21.15.40:33638) 2024-04-22T07:22:01.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.165+0000 7f94d0f81640 1 -- 172.21.15.40:0/268261047 learned_addr learned my addr 172.21.15.40:0/268261047 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:22:01.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.165+0000 7f94d1f83640 1 --2- 172.21.15.40:0/268261047 >> v2:172.21.15.62:3300/0 conn(0x7f94cc0c9090 0x7f94cc06fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.165+0000 7f94d1782640 1 --2- 172.21.15.40:0/268261047 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94cc158570 0x7f94cc06b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.165+0000 7f94d0f81640 1 -- 172.21.15.40:0/268261047 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94cc158570 msgr2=0x7f94cc06b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:01.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.165+0000 7f94d0f81640 1 --2- 172.21.15.40:0/268261047 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94cc158570 0x7f94cc06b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.165+0000 7f94d0f81640 1 -- 172.21.15.40:0/268261047 >> v2:172.21.15.62:3300/0 conn(0x7f94cc0c9090 msgr2=0x7f94cc06fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:01.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.165+0000 7f94d0f81640 1 --2- 172.21.15.40:0/268261047 >> v2:172.21.15.62:3300/0 conn(0x7f94cc0c9090 0x7f94cc06fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.165+0000 7f94d0f81640 1 -- 172.21.15.40:0/268261047 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94cc0ca940 con 0x7f94cc06cbb0 2024-04-22T07:22:01.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.166+0000 7f94d0f81640 1 --2- 172.21.15.40:0/268261047 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94cc06cbb0 0x7f94cc06f7e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f94cc15c0e0 tx=0x7f94c002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f9226f4ea67b03 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:01.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.166+0000 7f94cbfff640 1 -- 172.21.15.40:0/268261047 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c0034070 con 0x7f94cc06cbb0 2024-04-22T07:22:01.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.166+0000 7f94cbfff640 1 -- 172.21.15.40:0/268261047 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94c0030860 con 0x7f94cc06cbb0 2024-04-22T07:22:01.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.166+0000 7f94cbfff640 1 -- 172.21.15.40:0/268261047 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c0030c30 con 0x7f94cc06cbb0 2024-04-22T07:22:01.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.167+0000 7f94d39e6640 1 -- 172.21.15.40:0/268261047 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94cc06cbb0 msgr2=0x7f94cc06f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:01.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.167+0000 7f94d39e6640 1 --2- 172.21.15.40:0/268261047 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94cc06cbb0 0x7f94cc06f7e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f94cc15c0e0 tx=0x7f94c002b9a0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.167+0000 7f94d39e6640 1 -- 172.21.15.40:0/268261047 shutdown_connections 2024-04-22T07:22:01.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.167+0000 7f94d39e6640 1 --2- 172.21.15.40:0/268261047 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94cc06cbb0 0x7f94cc06f7e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.167+0000 7f94d39e6640 1 --2- 172.21.15.40:0/268261047 >> v2:172.21.15.62:3300/0 conn(0x7f94cc0c9090 0x7f94cc06fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.167+0000 7f94d39e6640 1 --2- 172.21.15.40:0/268261047 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94cc158570 0x7f94cc06b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.167+0000 7f94d39e6640 1 -- 172.21.15.40:0/268261047 >> 172.21.15.40:0/268261047 conn(0x7f94cc06dd10 msgr2=0x7f94cc06e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:01.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.167+0000 7f94d39e6640 1 -- 172.21.15.40:0/268261047 shutdown_connections 2024-04-22T07:22:01.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.167+0000 7f94d39e6640 1 -- 172.21.15.40:0/268261047 wait complete. 2024-04-22T07:22:01.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.168+0000 7f94d39e6640 1 Processor -- start 2024-04-22T07:22:01.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.168+0000 7f94d39e6640 1 -- start start 2024-04-22T07:22:01.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.169+0000 7f94d39e6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94cc06cbb0 0x7f94cc0b1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.169+0000 7f94d39e6640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94cc0c9090 0x7f94cc153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.169+0000 7f94d39e6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94cc158570 0x7f94cc14d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.169+0000 7f94d39e6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f94cc15e920 con 0x7f94cc06cbb0 2024-04-22T07:22:01.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.169+0000 7f94d39e6640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f94cc158950 con 0x7f94cc158570 2024-04-22T07:22:01.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.169+0000 7f94d39e6640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f94cc15eaa0 con 0x7f94cc0c9090 2024-04-22T07:22:01.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.169+0000 7f94d1782640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94cc06cbb0 0x7f94cc0b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.169+0000 7f94d1782640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94cc06cbb0 0x7f94cc0b1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33646/0 (socket says 172.21.15.40:33646) 2024-04-22T07:22:01.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.169+0000 7f94d1782640 1 -- 172.21.15.40:0/3401605490 learned_addr learned my addr 172.21.15.40:0/3401605490 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:22:01.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.169+0000 7f94d0f81640 1 --2- 172.21.15.40:0/3401605490 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94cc0c9090 0x7f94cc153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.169+0000 7f94d1782640 1 -- 172.21.15.40:0/3401605490 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94cc0c9090 msgr2=0x7f94cc153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:01.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.169+0000 7f94d1f83640 1 --2- 172.21.15.40:0/3401605490 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94cc158570 0x7f94cc14d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.169+0000 7f94d1782640 1 --2- 172.21.15.40:0/3401605490 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94cc0c9090 0x7f94cc153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.169+0000 7f94d1782640 1 -- 172.21.15.40:0/3401605490 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94cc158570 msgr2=0x7f94cc14d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.169+0000 7f94d1782640 1 --2- 172.21.15.40:0/3401605490 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94cc158570 0x7f94cc14d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.169+0000 7f94d1782640 1 -- 172.21.15.40:0/3401605490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94cc0b44c0 con 0x7f94cc06cbb0 2024-04-22T07:22:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.169+0000 7f94d0f81640 1 --2- 172.21.15.40:0/3401605490 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94cc0c9090 0x7f94cc153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:22:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.170+0000 7f94d1782640 1 --2- 172.21.15.40:0/3401605490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94cc06cbb0 0x7f94cc0b1580 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f94c4009d10 tx=0x7f94c400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.170+0000 7f94c9ffb640 1 -- 172.21.15.40:0/3401605490 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c4018020 con 0x7f94cc06cbb0 2024-04-22T07:22:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.170+0000 7f94c9ffb640 1 -- 172.21.15.40:0/3401605490 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94c4014480 con 0x7f94cc06cbb0 2024-04-22T07:22:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.170+0000 7f94c9ffb640 1 -- 172.21.15.40:0/3401605490 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c4014830 con 0x7f94cc06cbb0 2024-04-22T07:22:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.170+0000 7f94d39e6640 1 -- 172.21.15.40:0/3401605490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94cc0b0800 con 0x7f94cc06cbb0 2024-04-22T07:22:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.170+0000 7f94d39e6640 1 -- 172.21.15.40:0/3401605490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94cc0b41e0 con 0x7f94cc06cbb0 2024-04-22T07:22:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.171+0000 7f94d39e6640 1 -- 172.21.15.40:0/3401605490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94cc068b20 con 0x7f94cc06cbb0 2024-04-22T07:22:01.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.172+0000 7f94c9ffb640 1 -- 172.21.15.40:0/3401605490 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f94c4005d10 con 0x7f94cc06cbb0 2024-04-22T07:22:01.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.172+0000 7f94c9ffb640 1 --2- 172.21.15.40:0/3401605490 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f94b806c920 0x7f94b806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.172+0000 7f94c9ffb640 1 -- 172.21.15.40:0/3401605490 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f94c408c5a0 con 0x7f94cc06cbb0 2024-04-22T07:22:01.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.172+0000 7f94d0f81640 1 --2- 172.21.15.40:0/3401605490 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f94b806c920 0x7f94b806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.173+0000 7f94d0f81640 1 --2- 172.21.15.40:0/3401605490 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f94b806c920 0x7f94b806ede0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f94c0036000 tx=0x7f94c003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:01.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.177+0000 7f94c9ffb640 1 -- 172.21.15.40:0/3401605490 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f94c4022070 con 0x7f94cc06cbb0 2024-04-22T07:22:01.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.413+0000 7f94d39e6640 1 -- 172.21.15.40:0/3401605490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94cc0b4760 con 0x7f94cc06cbb0 2024-04-22T07:22:01.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.413+0000 7f94c9ffb640 1 -- 172.21.15.40:0/3401605490 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6821 (secure 0 0 0) 0x7f94c4010040 con 0x7f94cc06cbb0 2024-04-22T07:22:01.412 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:22:01.412 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1193926607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1193926607},{"type":"v1","addr":"172.21.15.62:6835","nonce":1193926607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/602167189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":602167189},{"type":"v1","addr":"172.21.15.62:6837","nonce":602167189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2062933254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2062933254},{"type":"v1","addr":"172.21.15.40:6835","nonce":2062933254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3873524978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3873524978},{"type":"v1","addr":"172.21.15.40:6837","nonce":3873524978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/1922761385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":1922761385},{"type":"v1","addr":"172.21.15.40:6839","nonce":1922761385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:20:53.216204+0000","modified":"2024-04-22T07:20:58.875393+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.62:6836/2884673656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2884673656},{"type":"v1","addr":"172.21.15.62:6836","nonce":2884673656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4305]},"id":1}]} 2024-04-22T07:22:01.412 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-04-22T07:22:01.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.416+0000 7f94d39e6640 1 -- 172.21.15.40:0/3401605490 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f94b806c920 msgr2=0x7f94b806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:01.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.416+0000 7f94d39e6640 1 --2- 172.21.15.40:0/3401605490 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f94b806c920 0x7f94b806ede0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f94c0036000 tx=0x7f94c003b040 comp rx=0 tx=0).stop 2024-04-22T07:22:01.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.416+0000 7f94d39e6640 1 -- 172.21.15.40:0/3401605490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94cc06cbb0 msgr2=0x7f94cc0b1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:01.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.416+0000 7f94d39e6640 1 --2- 172.21.15.40:0/3401605490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94cc06cbb0 0x7f94cc0b1580 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f94c4009d10 tx=0x7f94c400c490 comp rx=0 tx=0).stop 2024-04-22T07:22:01.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.416+0000 7f94d39e6640 1 -- 172.21.15.40:0/3401605490 shutdown_connections 2024-04-22T07:22:01.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.416+0000 7f94d39e6640 1 --2- 172.21.15.40:0/3401605490 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94cc158570 0x7f94cc14d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.416+0000 7f94d39e6640 1 --2- 172.21.15.40:0/3401605490 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f94cc0c9090 0x7f94cc153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.416+0000 7f94d39e6640 1 --2- 172.21.15.40:0/3401605490 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f94b806c920 0x7f94b806ede0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.416+0000 7f94d39e6640 1 --2- 172.21.15.40:0/3401605490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94cc06cbb0 0x7f94cc0b1580 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.416+0000 7f94d39e6640 1 -- 172.21.15.40:0/3401605490 >> 172.21.15.40:0/3401605490 conn(0x7f94cc06dd10 msgr2=0x7f94cc06c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:01.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.416+0000 7f94d39e6640 1 -- 172.21.15.40:0/3401605490 shutdown_connections 2024-04-22T07:22:01.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.416+0000 7f94d39e6640 1 -- 172.21.15.40:0/3401605490 wait complete. 2024-04-22T07:22:01.426 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4305 quiesce db --set-id acf810c1 --release --await' 2024-04-22T07:22:01.426 DEBUG:teuthology.orchestra.run.smithi040:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4305 quiesce db --set-id acf810c1 --release --await 2024-04-22T07:22:01.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.537+0000 7f42b3c43640 1 Processor -- start 2024-04-22T07:22:01.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.537+0000 7f42b3c43640 1 -- start start 2024-04-22T07:22:01.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.538+0000 7f42b3c43640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42ac0cda90 0x7f42ac0d0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.538+0000 7f42b3c43640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42ac15ac50 con 0x7f42ac0caef0 2024-04-22T07:22:01.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.538+0000 7f42b3c43640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42ac15af10 con 0x7f42ac0d08c0 2024-04-22T07:22:01.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.538+0000 7f42b3c43640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f42ac0ccef0 con 0x7f42ac0cda90 2024-04-22T07:22:01.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.538+0000 7f42b11de640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f42ac0caef0 0x7f42ac0cd380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35700/0 (socket says 172.21.15.40:35700) 2024-04-22T07:22:01.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.538+0000 7f42b11de640 1 -- 172.21.15.40:0/2225736337 learned_addr learned my addr 172.21.15.40:0/2225736337 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:22:01.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.538+0000 7f42b09dd640 1 -- 172.21.15.40:0/2225736337 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1965751617 0 0) 0x7f42ac15ac50 con 0x7f42ac0caef0 2024-04-22T07:22:01.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.538+0000 7f42b09dd640 1 -- 172.21.15.40:0/2225736337 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4298003520 con 0x7f42ac0caef0 2024-04-22T07:22:01.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.538+0000 7f42b21e0640 1 --2- 172.21.15.40:0/2225736337 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42ac0cda90 0x7f42ac0d0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.539+0000 7f42b09dd640 1 -- 172.21.15.40:0/2225736337 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3533690847 0 0) 0x7f4298003520 con 0x7f42ac0caef0 2024-04-22T07:22:01.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.539+0000 7f42b09dd640 1 -- 172.21.15.40:0/2225736337 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42ac0cda90 msgr2=0x7f42ac0d0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:01.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.539+0000 7f42b09dd640 1 --2- 172.21.15.40:0/2225736337 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42ac0cda90 0x7f42ac0d0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.539+0000 7f42b09dd640 1 -- 172.21.15.40:0/2225736337 >> v1:172.21.15.62:6789/0 conn(0x7f42ac0d08c0 legacy=0x7f42ac0cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:01.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.539+0000 7f42b09dd640 1 -- 172.21.15.40:0/2225736337 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ac15b1f0 con 0x7f42ac0caef0 2024-04-22T07:22:01.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.539+0000 7f42b09dd640 1 -- 172.21.15.40:0/2225736337 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7f429c001670 con 0x7f42ac0caef0 2024-04-22T07:22:01.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.539+0000 7f42b09dd640 1 -- 172.21.15.40:0/2225736337 >> v1:172.21.15.40:6789/0 conn(0x7f42ac0caef0 legacy=0x7f42ac0cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:01.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.539+0000 7f42b09dd640 1 --2- 172.21.15.40:0/2225736337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42980039e0 0x7f4298003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.539+0000 7f42b09dd640 1 --2- 172.21.15.40:0/2225736337 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42ac0cda90 0x7f4298004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.539+0000 7f42b09dd640 1 --2- 172.21.15.40:0/2225736337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4298004d40 0x7f42980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.539+0000 7f42b09dd640 1 -- 172.21.15.40:0/2225736337 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac0ccef0 con 0x7f4298004d40 2024-04-22T07:22:01.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.539+0000 7f42b09dd640 1 -- 172.21.15.40:0/2225736337 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4298014310 con 0x7f42980039e0 2024-04-22T07:22:01.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.539+0000 7f42b09dd640 1 -- 172.21.15.40:0/2225736337 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f4298014510 con 0x7f42ac0cda90 2024-04-22T07:22:01.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.539+0000 7f42b21e0640 1 --2- 172.21.15.40:0/2225736337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4298004d40 0x7f42980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.539+0000 7f42b11de640 1 --2- 172.21.15.40:0/2225736337 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42ac0cda90 0x7f4298004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.539+0000 7f42b19df640 1 --2- 172.21.15.40:0/2225736337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42980039e0 0x7f4298003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.539+0000 7f42b21e0640 1 -- 172.21.15.40:0/2225736337 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42ac0cda90 msgr2=0x7f4298004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:01.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.539+0000 7f42b21e0640 1 --2- 172.21.15.40:0/2225736337 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42ac0cda90 0x7f4298004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.539+0000 7f42b21e0640 1 -- 172.21.15.40:0/2225736337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42980039e0 msgr2=0x7f4298003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:01.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.539+0000 7f42b21e0640 1 --2- 172.21.15.40:0/2225736337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42980039e0 0x7f4298003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.539+0000 7f42b21e0640 1 -- 172.21.15.40:0/2225736337 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4298003520 con 0x7f4298004d40 2024-04-22T07:22:01.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.540+0000 7f42b21e0640 1 --2- 172.21.15.40:0/2225736337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4298004d40 0x7f42980051c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f42a4009a90 tx=0x7f4298005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6390a367ce4831 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:01.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.540+0000 7f42b09dd640 1 -- 172.21.15.40:0/2225736337 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a4039070 con 0x7f4298004d40 2024-04-22T07:22:01.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.540+0000 7f42b09dd640 1 -- 172.21.15.40:0/2225736337 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42a402c680 con 0x7f4298004d40 2024-04-22T07:22:01.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.540+0000 7f42b09dd640 1 -- 172.21.15.40:0/2225736337 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a4009690 con 0x7f4298004d40 2024-04-22T07:22:01.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.541+0000 7f42b3c43640 1 -- 172.21.15.40:0/2225736337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4298004d40 msgr2=0x7f42980051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:01.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.541+0000 7f42b3c43640 1 --2- 172.21.15.40:0/2225736337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4298004d40 0x7f42980051c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f42a4009a90 tx=0x7f4298005830 comp rx=0 tx=0).stop 2024-04-22T07:22:01.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.541+0000 7f42b21e0640 1 -- 172.21.15.40:0/2225736337 reap_dead start 2024-04-22T07:22:01.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.541+0000 7f42b3c43640 1 -- 172.21.15.40:0/2225736337 shutdown_connections 2024-04-22T07:22:01.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.541+0000 7f42b3c43640 1 -- 172.21.15.40:0/2225736337 >> 172.21.15.40:0/2225736337 conn(0x7f42ac06ce70 msgr2=0x7f42ac06d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:01.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.541+0000 7f42b3c43640 1 -- 172.21.15.40:0/2225736337 shutdown_connections 2024-04-22T07:22:01.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.541+0000 7f42b3c43640 1 -- 172.21.15.40:0/2225736337 wait complete. 2024-04-22T07:22:01.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.542+0000 7f42b3c43640 1 Processor -- start 2024-04-22T07:22:01.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.542+0000 7f42b3c43640 1 -- start start 2024-04-22T07:22:01.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.543+0000 7f42b3c43640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42ac0b4580 0x7f42ac1ed3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.543+0000 7f42b3c43640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42ac158260 0x7f42ac156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.543+0000 7f42b3c43640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42ac0b2ea0 0x7f42ac156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.543+0000 7f42b3c43640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac15ba90 con 0x7f42ac158260 2024-04-22T07:22:01.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.543+0000 7f42b3c43640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac15b7b0 con 0x7f42ac0b2ea0 2024-04-22T07:22:01.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.543+0000 7f42b3c43640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f42ac072eb0 con 0x7f42ac0b4580 2024-04-22T07:22:01.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.543+0000 7f42b11de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42ac158260 0x7f42ac156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.543+0000 7f42b11de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42ac158260 0x7f42ac156590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33662/0 (socket says 172.21.15.40:33662) 2024-04-22T07:22:01.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.543+0000 7f42b11de640 1 -- 172.21.15.40:0/1564268997 learned_addr learned my addr 172.21.15.40:0/1564268997 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:22:01.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.543+0000 7f42b19df640 1 --2- 172.21.15.40:0/1564268997 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42ac0b4580 0x7f42ac1ed3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.543+0000 7f42b21e0640 1 --2- 172.21.15.40:0/1564268997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42ac0b2ea0 0x7f42ac156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.543+0000 7f42b11de640 1 -- 172.21.15.40:0/1564268997 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42ac0b4580 msgr2=0x7f42ac1ed3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:01.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.543+0000 7f42b11de640 1 --2- 172.21.15.40:0/1564268997 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42ac0b4580 0x7f42ac1ed3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.543+0000 7f42b11de640 1 -- 172.21.15.40:0/1564268997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42ac0b2ea0 msgr2=0x7f42ac156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:01.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.543+0000 7f42b11de640 1 --2- 172.21.15.40:0/1564268997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42ac0b2ea0 0x7f42ac156ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.543+0000 7f42b11de640 1 -- 172.21.15.40:0/1564268997 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ac1ed8e0 con 0x7f42ac158260 2024-04-22T07:22:01.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.543+0000 7f42b19df640 1 --2- 172.21.15.40:0/1564268997 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42ac0b4580 0x7f42ac1ed3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:22:01.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.543+0000 7f42b11de640 1 --2- 172.21.15.40:0/1564268997 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42ac158260 0x7f42ac156590 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f429c007290 tx=0x7f429c007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:01.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.543+0000 7f42a27fc640 1 -- 172.21.15.40:0/1564268997 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c00f920 con 0x7f42ac158260 2024-04-22T07:22:01.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.543+0000 7f42a27fc640 1 -- 172.21.15.40:0/1564268997 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f429c018070 con 0x7f42ac158260 2024-04-22T07:22:01.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.543+0000 7f42a27fc640 1 -- 172.21.15.40:0/1564268997 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c00fd20 con 0x7f42ac158260 2024-04-22T07:22:01.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.543+0000 7f42b3c43640 1 -- 172.21.15.40:0/1564268997 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42ac1586e0 con 0x7f42ac158260 2024-04-22T07:22:01.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.543+0000 7f42b3c43640 1 -- 172.21.15.40:0/1564268997 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42ac1f0470 con 0x7f42ac158260 2024-04-22T07:22:01.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.546+0000 7f42a27fc640 1 -- 172.21.15.40:0/1564268997 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f429c01d460 con 0x7f42ac158260 2024-04-22T07:22:01.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.546+0000 7f42a27fc640 1 --2- 172.21.15.40:0/1564268997 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f429006c8f0 0x7f429006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.546+0000 7f42a27fc640 1 -- 172.21.15.40:0/1564268997 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f429c08bcd0 con 0x7f42ac158260 2024-04-22T07:22:01.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.546+0000 7f42b19df640 1 --2- 172.21.15.40:0/1564268997 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f429006c8f0 0x7f429006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.547+0000 7f42b19df640 1 --2- 172.21.15.40:0/1564268997 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f429006c8f0 0x7f429006edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f42a8003fc0 tx=0x7f42a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:01.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.547+0000 7f42b6834740 1 Processor -- start 2024-04-22T07:22:01.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.547+0000 7f42b6834740 1 -- start start 2024-04-22T07:22:01.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.548+0000 7f42b6834740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55845dd1e7d0 0x55845dd1ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.548+0000 7f42b6834740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55845dd082d0 0x55845dd1f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.548+0000 7f42b6834740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55845dcdd810 0x55845dd1fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.548+0000 7f42b6834740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55845dc44500 con 0x55845dcdd810 2024-04-22T07:22:01.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.548+0000 7f42b6834740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55845dbea6a0 con 0x55845dd1e7d0 2024-04-22T07:22:01.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.548+0000 7f42b6834740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55845dc404c0 con 0x55845dd082d0 2024-04-22T07:22:01.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.548+0000 7f42b21e0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55845dcdd810 0x55845dd1fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.548+0000 7f42b21e0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55845dcdd810 0x55845dd1fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33672/0 (socket says 172.21.15.40:33672) 2024-04-22T07:22:01.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.548+0000 7f42b21e0640 1 -- 172.21.15.40:0/246071414 learned_addr learned my addr 172.21.15.40:0/246071414 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:22:01.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.548+0000 7f42b19df640 1 --2- 172.21.15.40:0/246071414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55845dd1e7d0 0x55845dd1ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.548+0000 7f42b11de640 1 --2- 172.21.15.40:0/246071414 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55845dd082d0 0x55845dd1f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.548+0000 7f42b21e0640 1 -- 172.21.15.40:0/246071414 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55845dd082d0 msgr2=0x55845dd1f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:01.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.548+0000 7f42b21e0640 1 --2- 172.21.15.40:0/246071414 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55845dd082d0 0x55845dd1f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.548+0000 7f42b21e0640 1 -- 172.21.15.40:0/246071414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55845dd1e7d0 msgr2=0x55845dd1ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:01.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.548+0000 7f42b21e0640 1 --2- 172.21.15.40:0/246071414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55845dd1e7d0 0x55845dd1ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.548+0000 7f42b21e0640 1 -- 172.21.15.40:0/246071414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55845dc095e0 con 0x55845dcdd810 2024-04-22T07:22:01.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.548+0000 7f42b11de640 1 --2- 172.21.15.40:0/246071414 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55845dd082d0 0x55845dd1f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:22:01.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.548+0000 7f42b21e0640 1 --2- 172.21.15.40:0/246071414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55845dcdd810 0x55845dd1fe40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f42a4009bb0 tx=0x7f42a402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d624842516308dd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:01.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.548+0000 7f428f7fe640 1 -- 172.21.15.40:0/246071414 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a4043070 con 0x55845dcdd810 2024-04-22T07:22:01.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.548+0000 7f428f7fe640 1 -- 172.21.15.40:0/246071414 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42a4004030 con 0x55845dcdd810 2024-04-22T07:22:01.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.548+0000 7f428f7fe640 1 -- 172.21.15.40:0/246071414 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a4039040 con 0x55845dcdd810 2024-04-22T07:22:01.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.549+0000 7f42b6834740 1 -- 172.21.15.40:0/246071414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55845dcdd810 msgr2=0x55845dd1fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:01.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.549+0000 7f42b6834740 1 --2- 172.21.15.40:0/246071414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55845dcdd810 0x55845dd1fe40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f42a4009bb0 tx=0x7f42a402e000 comp rx=0 tx=0).stop 2024-04-22T07:22:01.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.549+0000 7f42b6834740 1 -- 172.21.15.40:0/246071414 shutdown_connections 2024-04-22T07:22:01.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.549+0000 7f42b6834740 1 --2- 172.21.15.40:0/246071414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55845dcdd810 0x55845dd1fe40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.549+0000 7f42b6834740 1 --2- 172.21.15.40:0/246071414 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55845dd082d0 0x55845dd1f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.549+0000 7f42b6834740 1 --2- 172.21.15.40:0/246071414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55845dd1e7d0 0x55845dd1ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.549+0000 7f42b6834740 1 -- 172.21.15.40:0/246071414 >> 172.21.15.40:0/246071414 conn(0x55845dcdb550 msgr2=0x55845dcdde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:01.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.549+0000 7f42b6834740 1 -- 172.21.15.40:0/246071414 shutdown_connections 2024-04-22T07:22:01.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.549+0000 7f42b6834740 1 -- 172.21.15.40:0/246071414 wait complete. 2024-04-22T07:22:01.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.550+0000 7f42b6834740 1 -- start start 2024-04-22T07:22:01.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.550+0000 7f42b6834740 1 Processor -- start 2024-04-22T07:22:01.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.551+0000 7f42b6834740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55845dd082d0 0x55845dcf9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.551+0000 7f42b6834740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55845dd1e7d0 0x55845dd24e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.551+0000 7f42b6834740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55845dd26ad0 0x55845dcfb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.551+0000 7f42b6834740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55845dcdcc30 con 0x55845dd26ad0 2024-04-22T07:22:01.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.551+0000 7f42b6834740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55845dbfda60 con 0x55845dd082d0 2024-04-22T07:22:01.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.551+0000 7f42b6834740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55845dd087a0 con 0x55845dd1e7d0 2024-04-22T07:22:01.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.551+0000 7f42b6834740 10 client.0 _ll_register_callbacks cb 0x55845d956110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:22:01.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.551+0000 7f42b21e0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55845dd26ad0 0x55845dcfb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.551+0000 7f42b21e0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55845dd26ad0 0x55845dcfb3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33682/0 (socket says 172.21.15.40:33682) 2024-04-22T07:22:01.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.551+0000 7f42b21e0640 1 -- 172.21.15.40:0/2653405511 learned_addr learned my addr 172.21.15.40:0/2653405511 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:22:01.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.551+0000 7f42b11de640 1 --2- 172.21.15.40:0/2653405511 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55845dd1e7d0 0x55845dd24e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.551+0000 7f42b19df640 1 --2- 172.21.15.40:0/2653405511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55845dd082d0 0x55845dcf9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.551+0000 7f42b21e0640 1 -- 172.21.15.40:0/2653405511 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55845dd1e7d0 msgr2=0x55845dd24e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:01.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.551+0000 7f42b21e0640 1 --2- 172.21.15.40:0/2653405511 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55845dd1e7d0 0x55845dd24e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.551+0000 7f42b21e0640 1 -- 172.21.15.40:0/2653405511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55845dd082d0 msgr2=0x55845dcf9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:01.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.551+0000 7f42b21e0640 1 --2- 172.21.15.40:0/2653405511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55845dd082d0 0x55845dcf9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.551+0000 7f42b21e0640 1 -- 172.21.15.40:0/2653405511 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55845d956920 con 0x55845dd26ad0 2024-04-22T07:22:01.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.551+0000 7f42b21e0640 1 --2- 172.21.15.40:0/2653405511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55845dd26ad0 0x55845dcfb3f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f42a4006f80 tx=0x7f42a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d252842306124d server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:01.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.551+0000 7f428cff9640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-04-22T07:22:01.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.551+0000 7f428cff9640 1 -- 172.21.15.40:0/2653405511 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a404c060 con 0x55845dd26ad0 2024-04-22T07:22:01.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.551+0000 7f428cff9640 1 -- 172.21.15.40:0/2653405511 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f42a402c880 con 0x55845dd26ad0 2024-04-22T07:22:01.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.551+0000 7f42b6834740 1 -- 172.21.15.40:0/2653405511 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42a4004030 con 0x55845dd26ad0 2024-04-22T07:22:01.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.552+0000 7f428cff9640 1 -- 172.21.15.40:0/2653405511 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f42a4052050 con 0x55845dd26ad0 2024-04-22T07:22:01.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.552+0000 7f42b6834740 10 client.4929 fetch_fsmap learned FSMap version 8 2024-04-22T07:22:01.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.552+0000 7f42b6834740 1 -- 172.21.15.40:0/2653405511 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55845da22d30 con 0x55845dd26ad0 2024-04-22T07:22:01.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.552+0000 7f428cff9640 1 -- 172.21.15.40:0/2653405511 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42a4004030 con 0x55845dd26ad0 2024-04-22T07:22:01.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.552+0000 7f428cff9640 1 -- 172.21.15.40:0/2653405511 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f42a4055020 con 0x55845dd26ad0 2024-04-22T07:22:01.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.552+0000 7f42b6834740 10 client.4929 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:22:01.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.552+0000 7f42b6834740 10 client.4929 resolve_mds: validated gid 4305 aka daemon mds.b 2024-04-22T07:22:01.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.552+0000 7f42b6834740 20 client.4929 populate_metadata read hostname 'smithi040' 2024-04-22T07:22:01.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.552+0000 7f42b6834740 1 --2- 172.21.15.40:0/2653405511 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55845dcd9a10 0x55845dd21b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.552+0000 7f42b6834740 4 client.4929 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T07:22:01.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.552+0000 7f42b6834740 1 -- 172.21.15.40:0/2653405511 --> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55845dc17a10 con 0x55845dcd9a10 2024-04-22T07:22:01.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.552+0000 7f42b19df640 1 --2- 172.21.15.40:0/2653405511 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55845dcd9a10 0x55845dd21b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.552+0000 7f42b19df640 1 --2- 172.21.15.40:0/2653405511 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55845dcd9a10 0x55845dd21b70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5952f286c416923f server_cookie=268b645178a15ee5 in_seq=0 out_seq=0 2024-04-22T07:22:01.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.552+0000 7f428cff9640 10 client.4929 ms_handle_connect on v2:172.21.15.62:6833/2884673656 2024-04-22T07:22:01.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.553+0000 7f428cff9640 1 -- 172.21.15.40:0/2653405511 <== mds.0 v2:172.21.15.62:6833/2884673656 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55845dc17a10 con 0x55845dcd9a10 2024-04-22T07:22:01.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.553+0000 7f428cff9640 10 client.4929 handle_command_reply: tid=0 2024-04-22T07:22:01.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.553+0000 7f42b6834740 1 client.4929 shutdown 2024-04-22T07:22:01.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.553+0000 7f42b6834740 1 -- 172.21.15.40:0/2653405511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55845dd26ad0 msgr2=0x55845dcfb3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:01.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.553+0000 7f42b6834740 1 --2- 172.21.15.40:0/2653405511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55845dd26ad0 0x55845dcfb3f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f42a4006f80 tx=0x7f42a40046c0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.553+0000 7f42b6834740 1 -- 172.21.15.40:0/2653405511 shutdown_connections 2024-04-22T07:22:01.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.553+0000 7f42b6834740 1 --2- 172.21.15.40:0/2653405511 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55845dcd9a10 0x55845dd21b70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.553+0000 7f42b6834740 1 --2- 172.21.15.40:0/2653405511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55845dd26ad0 0x55845dcfb3f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.553+0000 7f42b6834740 1 --2- 172.21.15.40:0/2653405511 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55845dd1e7d0 0x55845dd24e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.553+0000 7f42b6834740 1 --2- 172.21.15.40:0/2653405511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55845dd082d0 0x55845dcf9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.553+0000 7f428cff9640 0 client.4929 ms_handle_reset on v2:172.21.15.62:6833/2884673656 2024-04-22T07:22:01.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.553+0000 7f42b6834740 1 -- 172.21.15.40:0/2653405511 >> 172.21.15.40:0/2653405511 conn(0x55845dcdd810 msgr2=0x55845dd1fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:01.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.553+0000 7f42b6834740 1 -- 172.21.15.40:0/2653405511 shutdown_connections 2024-04-22T07:22:01.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.553+0000 7f42b6834740 1 -- 172.21.15.40:0/2653405511 wait complete. 2024-04-22T07:22:01.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.554+0000 7f42b6834740 20 client.4929 trim_cache size 0 max 16384 2024-04-22T07:22:01.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.571+0000 7f42b6834740 1 Processor -- start 2024-04-22T07:22:01.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.571+0000 7f42b6834740 1 -- start start 2024-04-22T07:22:01.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.572+0000 7f42b6834740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55845dd082d0 0x55845dd433b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.572+0000 7f42b6834740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55845dd1e7d0 0x55845dd1f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.572+0000 7f42b6834740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55845dd26ad0 0x55845dd1ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.572+0000 7f42b6834740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55845dcffb80 con 0x55845dd1e7d0 2024-04-22T07:22:01.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.572+0000 7f42b6834740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac1fa630 con 0x55845dd082d0 2024-04-22T07:22:01.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.572+0000 7f42b6834740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f42ac1f9510 con 0x55845dd26ad0 2024-04-22T07:22:01.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.572+0000 7f42b11de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55845dd1e7d0 0x55845dd1f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.572+0000 7f42b11de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55845dd1e7d0 0x55845dd1f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33698/0 (socket says 172.21.15.40:33698) 2024-04-22T07:22:01.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.572+0000 7f42b11de640 1 -- 172.21.15.40:0/4228944162 learned_addr learned my addr 172.21.15.40:0/4228944162 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:22:01.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.572+0000 7f42b19df640 1 --2- 172.21.15.40:0/4228944162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55845dd082d0 0x55845dd433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.572+0000 7f42b21e0640 1 --2- 172.21.15.40:0/4228944162 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55845dd26ad0 0x55845dd1ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.572+0000 7f42b11de640 1 -- 172.21.15.40:0/4228944162 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55845dd26ad0 msgr2=0x55845dd1ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:01.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.572+0000 7f42b11de640 1 --2- 172.21.15.40:0/4228944162 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55845dd26ad0 0x55845dd1ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.572+0000 7f42b11de640 1 -- 172.21.15.40:0/4228944162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55845dd082d0 msgr2=0x55845dd433b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:01.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.572+0000 7f42b11de640 1 --2- 172.21.15.40:0/4228944162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55845dd082d0 0x55845dd433b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.572+0000 7f42b11de640 1 -- 172.21.15.40:0/4228944162 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55845dd1d580 con 0x55845dd1e7d0 2024-04-22T07:22:01.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.572+0000 7f42b11de640 1 --2- 172.21.15.40:0/4228944162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55845dd1e7d0 0x55845dd1f7e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f429c08a1e0 tx=0x7f429c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=787dba93aad36e9f server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:01.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.572+0000 7f428effd640 1 -- 172.21.15.40:0/4228944162 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c05dd90 con 0x55845dd1e7d0 2024-04-22T07:22:01.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.572+0000 7f428effd640 1 -- 172.21.15.40:0/4228944162 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f429c0625c0 con 0x55845dd1e7d0 2024-04-22T07:22:01.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.572+0000 7f428effd640 1 -- 172.21.15.40:0/4228944162 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c056050 con 0x55845dd1e7d0 2024-04-22T07:22:01.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.573+0000 7f42b6834740 1 -- 172.21.15.40:0/4228944162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55845dd1e7d0 msgr2=0x55845dd1f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:01.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.573+0000 7f42b6834740 1 --2- 172.21.15.40:0/4228944162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55845dd1e7d0 0x55845dd1f7e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f429c08a1e0 tx=0x7f429c009040 comp rx=0 tx=0).stop 2024-04-22T07:22:01.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.573+0000 7f42b6834740 1 -- 172.21.15.40:0/4228944162 shutdown_connections 2024-04-22T07:22:01.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.573+0000 7f42b6834740 1 --2- 172.21.15.40:0/4228944162 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55845dd26ad0 0x55845dd1ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.573+0000 7f42b6834740 1 --2- 172.21.15.40:0/4228944162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55845dd1e7d0 0x55845dd1f7e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.573+0000 7f42b6834740 1 --2- 172.21.15.40:0/4228944162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55845dd082d0 0x55845dd433b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.573+0000 7f42b6834740 1 -- 172.21.15.40:0/4228944162 >> 172.21.15.40:0/4228944162 conn(0x55845dcdd810 msgr2=0x55845dd077a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:01.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.573+0000 7f42b6834740 1 -- 172.21.15.40:0/4228944162 shutdown_connections 2024-04-22T07:22:01.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.573+0000 7f42b6834740 1 -- 172.21.15.40:0/4228944162 wait complete. 2024-04-22T07:22:01.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.573+0000 7f42b6834740 1 -- start start 2024-04-22T07:22:01.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.573+0000 7f42b6834740 1 Processor -- start 2024-04-22T07:22:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.574+0000 7f42b6834740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55845dd082d0 0x55845dcfc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.574+0000 7f42b6834740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55845dd1e7d0 0x55845dd93720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.574+0000 7f42b6834740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55845dd26ad0 0x55845dd93c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.574+0000 7f42b6834740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac1f8e40 con 0x55845dd1e7d0 2024-04-22T07:22:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.574+0000 7f42b6834740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac15dde0 con 0x55845dd082d0 2024-04-22T07:22:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.574+0000 7f42b6834740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f42ac15e430 con 0x55845dd26ad0 2024-04-22T07:22:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.575+0000 7f42b6834740 10 client.0 _ll_register_callbacks cb 0x7f42a4041070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:22:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.575+0000 7f42b11de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55845dd1e7d0 0x55845dd93720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.575+0000 7f42b11de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55845dd1e7d0 0x55845dd93720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33708/0 (socket says 172.21.15.40:33708) 2024-04-22T07:22:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.575+0000 7f42b11de640 1 -- 172.21.15.40:0/1061587676 learned_addr learned my addr 172.21.15.40:0/1061587676 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:22:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.575+0000 7f42b19df640 1 --2- 172.21.15.40:0/1061587676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55845dd082d0 0x55845dcfc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.575+0000 7f42b21e0640 1 --2- 172.21.15.40:0/1061587676 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55845dd26ad0 0x55845dd93c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.575+0000 7f42b11de640 1 -- 172.21.15.40:0/1061587676 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55845dd26ad0 msgr2=0x55845dd93c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:01.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.575+0000 7f42b11de640 1 --2- 172.21.15.40:0/1061587676 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55845dd26ad0 0x55845dd93c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.575+0000 7f42b11de640 1 -- 172.21.15.40:0/1061587676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55845dd082d0 msgr2=0x55845dcfc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:01.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.575+0000 7f42b11de640 1 --2- 172.21.15.40:0/1061587676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55845dd082d0 0x55845dcfc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.575+0000 7f42b11de640 1 -- 172.21.15.40:0/1061587676 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55845dd1d7e0 con 0x55845dd1e7d0 2024-04-22T07:22:01.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.575+0000 7f42b11de640 1 --2- 172.21.15.40:0/1061587676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55845dd1e7d0 0x55845dd93720 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f429c059970 tx=0x7f429c070070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2306e33b26458748 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:01.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.575+0000 7f428cff9640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-04-22T07:22:01.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.575+0000 7f428cff9640 1 -- 172.21.15.40:0/1061587676 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c083d40 con 0x55845dd1e7d0 2024-04-22T07:22:01.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.575+0000 7f428cff9640 1 -- 172.21.15.40:0/1061587676 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f429c058e30 con 0x55845dd1e7d0 2024-04-22T07:22:01.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.575+0000 7f42b6834740 1 -- 172.21.15.40:0/1061587676 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f429c0625c0 con 0x55845dd1e7d0 2024-04-22T07:22:01.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.575+0000 7f428cff9640 1 -- 172.21.15.40:0/1061587676 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f429c05dd90 con 0x55845dd1e7d0 2024-04-22T07:22:01.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.575+0000 7f42b6834740 10 client.4935 fetch_fsmap learned FSMap version 8 2024-04-22T07:22:01.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.575+0000 7f42b6834740 1 -- 172.21.15.40:0/1061587676 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55845dcdc2e0 con 0x55845dd1e7d0 2024-04-22T07:22:01.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.576+0000 7f428cff9640 1 -- 172.21.15.40:0/1061587676 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f429c0625c0 con 0x55845dd1e7d0 2024-04-22T07:22:01.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.576+0000 7f428cff9640 1 -- 172.21.15.40:0/1061587676 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f429c055730 con 0x55845dd1e7d0 2024-04-22T07:22:01.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.576+0000 7f42b6834740 10 client.4935 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:22:01.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.576+0000 7f42b6834740 10 client.4935 resolve_mds: validated gid 4305 aka daemon mds.b 2024-04-22T07:22:01.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.576+0000 7f42b6834740 20 client.4935 populate_metadata read hostname 'smithi040' 2024-04-22T07:22:01.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.576+0000 7f42b6834740 1 --2- 172.21.15.40:0/1061587676 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55845dcfc910 0x55845dd02da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:01.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.576+0000 7f42b6834740 4 client.4935 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "acf810c1", "release": true, "await": true}] 2024-04-22T07:22:01.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.576+0000 7f42b6834740 1 -- 172.21.15.40:0/1061587676 --> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] -- command(tid 0: {"prefix": "quiesce db", "set_id": "acf810c1", "release": true, "await": true}) -- 0x55845dc51f20 con 0x55845dcfc910 2024-04-22T07:22:01.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.576+0000 7f42b19df640 1 --2- 172.21.15.40:0/1061587676 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55845dcfc910 0x55845dd02da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:01.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.576+0000 7f42b19df640 1 --2- 172.21.15.40:0/1061587676 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55845dcfc910 0x55845dd02da0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bfea9f5c8971603 server_cookie=d7a8d27bba85b98c in_seq=0 out_seq=0 2024-04-22T07:22:01.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.576+0000 7f428cff9640 10 client.4935 ms_handle_connect on v2:172.21.15.62:6833/2884673656 2024-04-22T07:22:01.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.577+0000 7f428cff9640 1 -- 172.21.15.40:0/1061587676 <== mds.0 v2:172.21.15.62:6833/2884673656 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x55845dc51f20 con 0x55845dcfc910 2024-04-22T07:22:01.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.577+0000 7f428cff9640 10 client.4935 handle_command_reply: tid=0 2024-04-22T07:22:01.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.577+0000 7f42b6834740 1 client.4935 shutdown 2024-04-22T07:22:01.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.577+0000 7f42b6834740 1 -- 172.21.15.40:0/1061587676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55845dd1e7d0 msgr2=0x55845dd93720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:01.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.577+0000 7f42b6834740 1 --2- 172.21.15.40:0/1061587676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55845dd1e7d0 0x55845dd93720 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f429c059970 tx=0x7f429c070070 comp rx=0 tx=0).stop 2024-04-22T07:22:01.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.577+0000 7f42b6834740 1 -- 172.21.15.40:0/1061587676 shutdown_connections 2024-04-22T07:22:01.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.577+0000 7f42b6834740 1 --2- 172.21.15.40:0/1061587676 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55845dcfc910 0x55845dd02da0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.577+0000 7f42b6834740 1 --2- 172.21.15.40:0/1061587676 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55845dd26ad0 0x55845dd93c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.577+0000 7f428cff9640 0 client.4935 ms_handle_reset on v2:172.21.15.62:6833/2884673656 2024-04-22T07:22:01.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.577+0000 7f42b6834740 1 --2- 172.21.15.40:0/1061587676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55845dd1e7d0 0x55845dd93720 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.577+0000 7f42b6834740 1 --2- 172.21.15.40:0/1061587676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55845dd082d0 0x55845dcfc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.577+0000 7f42b6834740 1 -- 172.21.15.40:0/1061587676 >> 172.21.15.40:0/1061587676 conn(0x55845dcdd810 msgr2=0x55845dd1ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:01.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.577+0000 7f42b6834740 1 -- 172.21.15.40:0/1061587676 shutdown_connections 2024-04-22T07:22:01.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.577+0000 7f42b6834740 1 -- 172.21.15.40:0/1061587676 wait complete. 2024-04-22T07:22:01.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.577+0000 7f42b6834740 20 client.4935 trim_cache size 0 max 16384 2024-04-22T07:22:01.580 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-22T07:22:01.581 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 8, 2024-04-22T07:22:01.581 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 4305, 2024-04-22T07:22:01.581 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 4, 2024-04-22T07:22:01.581 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-04-22T07:22:01.581 INFO:teuthology.orchestra.run.smithi040.stdout: "acf810c1": { 2024-04-22T07:22:01.581 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 4, 2024-04-22T07:22:01.581 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-04-22T07:22:01.581 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-04-22T07:22:01.581 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-04-22T07:22:01.581 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-04-22T07:22:01.581 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-22T07:22:01.581 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 60.0, 2024-04-22T07:22:01.581 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 83.2, 2024-04-22T07:22:01.581 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-04-22T07:22:01.581 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-04-22T07:22:01.582 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-04-22T07:22:01.582 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-04-22T07:22:01.582 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-04-22T07:22:01.582 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-04-22T07:22:01.582 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:22:01.582 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:22:01.582 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:22:01.582 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:22:01.582 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:22:01.582 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-22T07:22:01.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.577+0000 7f42b3c43640 1 -- 172.21.15.40:0/1564268997 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f429006c8f0 msgr2=0x7f429006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:01.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.577+0000 7f42b3c43640 1 --2- 172.21.15.40:0/1564268997 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f429006c8f0 0x7f429006edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f42a8003fc0 tx=0x7f42a8009040 comp rx=0 tx=0).stop 2024-04-22T07:22:01.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.578+0000 7f42b3c43640 1 -- 172.21.15.40:0/1564268997 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42ac158260 msgr2=0x7f42ac156590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:01.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.578+0000 7f42b3c43640 1 --2- 172.21.15.40:0/1564268997 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42ac158260 0x7f42ac156590 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f429c007290 tx=0x7f429c007750 comp rx=0 tx=0).stop 2024-04-22T07:22:01.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.578+0000 7f42b3c43640 1 -- 172.21.15.40:0/1564268997 shutdown_connections 2024-04-22T07:22:01.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.578+0000 7f42b3c43640 1 --2- 172.21.15.40:0/1564268997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42ac0b2ea0 0x7f42ac156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.578+0000 7f42b3c43640 1 --2- 172.21.15.40:0/1564268997 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f429006c8f0 0x7f429006edb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.578+0000 7f42b3c43640 1 --2- 172.21.15.40:0/1564268997 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42ac158260 0x7f42ac156590 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.578+0000 7f42b3c43640 1 --2- 172.21.15.40:0/1564268997 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42ac0b4580 0x7f42ac1ed3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:01.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.578+0000 7f42b3c43640 1 -- 172.21.15.40:0/1564268997 >> 172.21.15.40:0/1564268997 conn(0x7f42ac06ce70 msgr2=0x7f42ac0cc430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:01.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.578+0000 7f42b3c43640 1 -- 172.21.15.40:0/1564268997 shutdown_connections 2024-04-22T07:22:01.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:01.578+0000 7f42b3c43640 1 -- 172.21.15.40:0/1564268997 wait complete. 2024-04-22T07:22:01.586 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set_id: acf810c1, seconds elapsed: 24.3 2024-04-22T07:22:23.663 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:22:23.666 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:22:44.384 INFO:tasks.workunit.client.0.smithi040.stderr:Updating files: 93% (11507/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-22T07:22:44.673 INFO:tasks.quiescer.fs.[cephfs]:Total duration (37.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-22T07:22:44.673 INFO:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.8 2024-04-22T07:22:44.674 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:22:44.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.777+0000 7f8ca7932640 1 Processor -- start 2024-04-22T07:22:44.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.778+0000 7f8ca7932640 1 -- start start 2024-04-22T07:22:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.778+0000 7f8ca7932640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8ca0154f50 0x7f8ca00cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.778+0000 7f8ca7932640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8ca00cc5a0 0x7f8ca00d0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.778+0000 7f8ca7932640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ca015e6e0 con 0x7f8ca00d0ad0 2024-04-22T07:22:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.778+0000 7f8ca7932640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f8ca015af50 con 0x7f8ca0154f50 2024-04-22T07:22:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.778+0000 7f8ca7932640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f8ca015e9c0 con 0x7f8ca00cc5a0 2024-04-22T07:22:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.779+0000 7f8ca56ce640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8ca0154f50 0x7f8ca00cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.779+0000 7f8ca5ecf640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8ca00d0ad0 0x7f8ca015b3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35318/0 (socket says 172.21.15.40:35318) 2024-04-22T07:22:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.779+0000 7f8ca5ecf640 1 -- 172.21.15.40:0/2805712204 learned_addr learned my addr 172.21.15.40:0/2805712204 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:22:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.779+0000 7f8ca4ecd640 1 --2- 172.21.15.40:0/2805712204 >> v2:172.21.15.62:3300/0 conn(0x7f8ca00cc5a0 0x7f8ca00d0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.779+0000 7f8ca56ce640 1 -- 172.21.15.40:0/2805712204 >> v2:172.21.15.62:3300/0 conn(0x7f8ca00cc5a0 msgr2=0x7f8ca00d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.779+0000 7f8ca56ce640 1 --2- 172.21.15.40:0/2805712204 >> v2:172.21.15.62:3300/0 conn(0x7f8ca00cc5a0 0x7f8ca00d0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.779+0000 7f8ca56ce640 1 -- 172.21.15.40:0/2805712204 >> v1:172.21.15.40:6789/0 conn(0x7f8ca00d0ad0 legacy=0x7f8ca015b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:44.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.779+0000 7f8ca56ce640 1 -- 172.21.15.40:0/2805712204 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca015eca0 con 0x7f8ca0154f50 2024-04-22T07:22:44.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.780+0000 7f8ca56ce640 1 --2- 172.21.15.40:0/2805712204 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ca0154f50 0x7f8ca00cc060 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8ca006c9e0 tx=0x7f8c9402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd57eadab8abb09 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:44.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.780+0000 7f8c93fff640 1 -- 172.21.15.40:0/2805712204 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c94034070 con 0x7f8ca0154f50 2024-04-22T07:22:44.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.780+0000 7f8c93fff640 1 -- 172.21.15.40:0/2805712204 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c94030610 con 0x7f8ca0154f50 2024-04-22T07:22:44.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.780+0000 7f8c93fff640 1 -- 172.21.15.40:0/2805712204 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c940309e0 con 0x7f8ca0154f50 2024-04-22T07:22:44.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.780+0000 7f8ca7932640 1 -- 172.21.15.40:0/2805712204 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ca0154f50 msgr2=0x7f8ca00cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:44.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.780+0000 7f8ca7932640 1 --2- 172.21.15.40:0/2805712204 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ca0154f50 0x7f8ca00cc060 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8ca006c9e0 tx=0x7f8c9402b960 comp rx=0 tx=0).stop 2024-04-22T07:22:44.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.781+0000 7f8ca7932640 1 -- 172.21.15.40:0/2805712204 shutdown_connections 2024-04-22T07:22:44.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.781+0000 7f8ca7932640 1 --2- 172.21.15.40:0/2805712204 >> v2:172.21.15.62:3300/0 conn(0x7f8ca00cc5a0 0x7f8ca00d0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:44.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.781+0000 7f8ca7932640 1 --2- 172.21.15.40:0/2805712204 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ca0154f50 0x7f8ca00cc060 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:44.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.781+0000 7f8ca7932640 1 -- 172.21.15.40:0/2805712204 >> 172.21.15.40:0/2805712204 conn(0x7f8ca00676b0 msgr2=0x7f8ca0067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:44.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.781+0000 7f8ca7932640 1 -- 172.21.15.40:0/2805712204 shutdown_connections 2024-04-22T07:22:44.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.781+0000 7f8ca7932640 1 -- 172.21.15.40:0/2805712204 wait complete. 2024-04-22T07:22:44.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.782+0000 7f8ca7932640 1 Processor -- start 2024-04-22T07:22:44.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.782+0000 7f8ca7932640 1 -- start start 2024-04-22T07:22:44.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.782+0000 7f8ca7932640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ca00cc5a0 0x7f8ca0159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:44.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.782+0000 7f8ca7932640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ca00d0ad0 0x7f8ca015d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:44.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.783+0000 7f8ca7932640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ca0154f50 0x7f8ca00b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:44.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.783+0000 7f8ca7932640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca015e3a0 con 0x7f8ca0154f50 2024-04-22T07:22:44.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.783+0000 7f8ca7932640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca015f260 con 0x7f8ca00cc5a0 2024-04-22T07:22:44.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.783+0000 7f8ca7932640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f8ca0155330 con 0x7f8ca00d0ad0 2024-04-22T07:22:44.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.783+0000 7f8ca5ecf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ca0154f50 0x7f8ca00b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:44.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.783+0000 7f8ca5ecf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ca0154f50 0x7f8ca00b5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41328/0 (socket says 172.21.15.40:41328) 2024-04-22T07:22:44.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.783+0000 7f8ca5ecf640 1 -- 172.21.15.40:0/1338184742 learned_addr learned my addr 172.21.15.40:0/1338184742 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:22:44.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.783+0000 7f8ca56ce640 1 --2- 172.21.15.40:0/1338184742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ca00cc5a0 0x7f8ca0159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:44.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.783+0000 7f8ca4ecd640 1 --2- 172.21.15.40:0/1338184742 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ca00d0ad0 0x7f8ca015d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:44.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.783+0000 7f8ca5ecf640 1 -- 172.21.15.40:0/1338184742 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ca00d0ad0 msgr2=0x7f8ca015d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:44.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.783+0000 7f8ca5ecf640 1 --2- 172.21.15.40:0/1338184742 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ca00d0ad0 0x7f8ca015d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:44.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.783+0000 7f8ca5ecf640 1 -- 172.21.15.40:0/1338184742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ca00cc5a0 msgr2=0x7f8ca0159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:44.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.783+0000 7f8ca5ecf640 1 --2- 172.21.15.40:0/1338184742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ca00cc5a0 0x7f8ca0159030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:44.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.783+0000 7f8ca5ecf640 1 -- 172.21.15.40:0/1338184742 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca01589f0 con 0x7f8ca0154f50 2024-04-22T07:22:44.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.783+0000 7f8ca56ce640 1 --2- 172.21.15.40:0/1338184742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ca00cc5a0 0x7f8ca0159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:22:44.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.783+0000 7f8ca5ecf640 1 --2- 172.21.15.40:0/1338184742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ca0154f50 0x7f8ca00b5790 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8c9800cbc0 tx=0x7f8c9800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:44.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.783+0000 7f8c91ffb640 1 -- 172.21.15.40:0/1338184742 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c98017070 con 0x7f8ca0154f50 2024-04-22T07:22:44.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.783+0000 7f8c91ffb640 1 -- 172.21.15.40:0/1338184742 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c9800ad40 con 0x7f8ca0154f50 2024-04-22T07:22:44.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.783+0000 7f8ca7932640 1 -- 172.21.15.40:0/1338184742 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ca00d0840 con 0x7f8ca0154f50 2024-04-22T07:22:44.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.783+0000 7f8c91ffb640 1 -- 172.21.15.40:0/1338184742 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c98012600 con 0x7f8ca0154f50 2024-04-22T07:22:44.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.784+0000 7f8ca7932640 1 -- 172.21.15.40:0/1338184742 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ca015c010 con 0x7f8ca0154f50 2024-04-22T07:22:44.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.785+0000 7f8ca7932640 1 -- 172.21.15.40:0/1338184742 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ca0069d40 con 0x7f8ca0154f50 2024-04-22T07:22:44.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.785+0000 7f8c91ffb640 1 -- 172.21.15.40:0/1338184742 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8c9801a070 con 0x7f8ca0154f50 2024-04-22T07:22:44.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.785+0000 7f8c91ffb640 1 --2- 172.21.15.40:0/1338184742 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8c8406c8f0 0x7f8c8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:44.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.785+0000 7f8c91ffb640 1 -- 172.21.15.40:0/1338184742 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f8c9808b8d0 con 0x7f8ca0154f50 2024-04-22T07:22:44.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.785+0000 7f8ca56ce640 1 --2- 172.21.15.40:0/1338184742 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8c8406c8f0 0x7f8c8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:44.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.786+0000 7f8ca56ce640 1 --2- 172.21.15.40:0/1338184742 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8c8406c8f0 0x7f8c8406edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8c94036000 tx=0x7f8c9403b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:44.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:44.794+0000 7f8c91ffb640 1 -- 172.21.15.40:0/1338184742 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8c98059600 con 0x7f8ca0154f50 2024-04-22T07:22:45.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.023+0000 7f8ca7932640 1 -- 172.21.15.40:0/1338184742 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ca00c62d0 con 0x7f8ca0154f50 2024-04-22T07:22:45.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.024+0000 7f8c91ffb640 1 -- 172.21.15.40:0/1338184742 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6821 (secure 0 0 0) 0x7f8c9805d900 con 0x7f8ca0154f50 2024-04-22T07:22:45.021 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:22:45.022 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1193926607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1193926607},{"type":"v1","addr":"172.21.15.62:6835","nonce":1193926607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/602167189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":602167189},{"type":"v1","addr":"172.21.15.62:6837","nonce":602167189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2062933254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2062933254},{"type":"v1","addr":"172.21.15.40:6835","nonce":2062933254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3873524978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3873524978},{"type":"v1","addr":"172.21.15.40:6837","nonce":3873524978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/1922761385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":1922761385},{"type":"v1","addr":"172.21.15.40:6839","nonce":1922761385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:20:53.216204+0000","modified":"2024-04-22T07:20:58.875393+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.62:6836/2884673656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2884673656},{"type":"v1","addr":"172.21.15.62:6836","nonce":2884673656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4305]},"id":1}]} 2024-04-22T07:22:45.022 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-04-22T07:22:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.026+0000 7f8ca7932640 1 -- 172.21.15.40:0/1338184742 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8c8406c8f0 msgr2=0x7f8c8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.026+0000 7f8ca7932640 1 --2- 172.21.15.40:0/1338184742 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8c8406c8f0 0x7f8c8406edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8c94036000 tx=0x7f8c9403b040 comp rx=0 tx=0).stop 2024-04-22T07:22:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.026+0000 7f8ca7932640 1 -- 172.21.15.40:0/1338184742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ca0154f50 msgr2=0x7f8ca00b5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.026+0000 7f8ca7932640 1 --2- 172.21.15.40:0/1338184742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ca0154f50 0x7f8ca00b5790 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8c9800cbc0 tx=0x7f8c9800a430 comp rx=0 tx=0).stop 2024-04-22T07:22:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.026+0000 7f8ca7932640 1 -- 172.21.15.40:0/1338184742 shutdown_connections 2024-04-22T07:22:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.026+0000 7f8ca7932640 1 --2- 172.21.15.40:0/1338184742 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8c8406c8f0 0x7f8c8406edb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.026+0000 7f8ca7932640 1 --2- 172.21.15.40:0/1338184742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8ca0154f50 0x7f8ca00b5790 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.026+0000 7f8ca7932640 1 --2- 172.21.15.40:0/1338184742 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ca00d0ad0 0x7f8ca015d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.026+0000 7f8ca7932640 1 --2- 172.21.15.40:0/1338184742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ca00cc5a0 0x7f8ca0159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.026+0000 7f8ca7932640 1 -- 172.21.15.40:0/1338184742 >> 172.21.15.40:0/1338184742 conn(0x7f8ca00676b0 msgr2=0x7f8ca015b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.026+0000 7f8ca7932640 1 -- 172.21.15.40:0/1338184742 shutdown_connections 2024-04-22T07:22:45.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.026+0000 7f8ca7932640 1 -- 172.21.15.40:0/1338184742 wait complete. 2024-04-22T07:22:45.035 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4305 quiesce db / --timeout 60 --expiration 78.8 --await' 2024-04-22T07:22:45.035 DEBUG:teuthology.orchestra.run.smithi040:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4305 quiesce db / --timeout 60 --expiration 78.8 --await 2024-04-22T07:22:45.036 INFO:tasks.workunit.client.0.smithi040.stderr:Note: switching to '86f7587a5a09af35f0895e1a2d08527638fae697'. 2024-04-22T07:22:45.036 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-04-22T07:22:45.036 INFO:tasks.workunit.client.0.smithi040.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-22T07:22:45.036 INFO:tasks.workunit.client.0.smithi040.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-22T07:22:45.036 INFO:tasks.workunit.client.0.smithi040.stderr:state without impacting any branches by switching back to a branch. 2024-04-22T07:22:45.036 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-04-22T07:22:45.036 INFO:tasks.workunit.client.0.smithi040.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-22T07:22:45.036 INFO:tasks.workunit.client.0.smithi040.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-22T07:22:45.036 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-04-22T07:22:45.036 INFO:tasks.workunit.client.0.smithi040.stderr: git switch -c 2024-04-22T07:22:45.036 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-04-22T07:22:45.036 INFO:tasks.workunit.client.0.smithi040.stderr:Or undo this operation with: 2024-04-22T07:22:45.037 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-04-22T07:22:45.037 INFO:tasks.workunit.client.0.smithi040.stderr: git switch - 2024-04-22T07:22:45.037 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-04-22T07:22:45.037 INFO:tasks.workunit.client.0.smithi040.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-22T07:22:45.037 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-04-22T07:22:45.037 INFO:tasks.workunit.client.0.smithi040.stderr:HEAD is now at 86f7587a5a0 qa/fsx: use the master branch to build the xfstest-dev 2024-04-22T07:22:45.040 DEBUG:teuthology.orchestra.run.smithi040:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-22T07:22:45.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.151+0000 7f8bc9efd640 1 Processor -- start 2024-04-22T07:22:45.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.151+0000 7f8bc9efd640 1 -- start start 2024-04-22T07:22:45.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.152+0000 7f8bc9efd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8bc406b920 0x7f8bc415b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:45.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.152+0000 7f8bc9efd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8bc40c3e40 0x7f8bc40c4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:45.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.152+0000 7f8bc9efd640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bc406c500 con 0x7f8bc406fd10 2024-04-22T07:22:45.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.152+0000 7f8bc9efd640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f8bc415b370 con 0x7f8bc40c3e40 2024-04-22T07:22:45.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.152+0000 7f8bc9efd640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f8bc40700f0 con 0x7f8bc406b920 2024-04-22T07:22:45.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.152+0000 7f8bc3fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8bc40c3e40 0x7f8bc40c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:45.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.152+0000 7f8bc3fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8bc40c3e40 0x7f8bc40c4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41338/0 (socket says 172.21.15.40:41338) 2024-04-22T07:22:45.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.152+0000 7f8bc3fff640 1 -- 172.21.15.40:0/443750738 learned_addr learned my addr 172.21.15.40:0/443750738 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:22:45.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.152+0000 7f8bc2ffd640 1 --2- 172.21.15.40:0/443750738 >> v2:172.21.15.62:3300/0 conn(0x7f8bc406b920 0x7f8bc415b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:45.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.152+0000 7f8bc3fff640 1 -- 172.21.15.40:0/443750738 >> v2:172.21.15.62:3300/0 conn(0x7f8bc406b920 msgr2=0x7f8bc415b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:45.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.152+0000 7f8bc3fff640 1 --2- 172.21.15.40:0/443750738 >> v2:172.21.15.62:3300/0 conn(0x7f8bc406b920 0x7f8bc415b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.152+0000 7f8bc3fff640 1 -- 172.21.15.40:0/443750738 >> v1:172.21.15.62:6789/0 conn(0x7f8bc406fd10 legacy=0x7f8bc40c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:45.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.152+0000 7f8bc3fff640 1 -- 172.21.15.40:0/443750738 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc406c7e0 con 0x7f8bc40c3e40 2024-04-22T07:22:45.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.153+0000 7f8bc3fff640 1 --2- 172.21.15.40:0/443750738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bc40c3e40 0x7f8bc40c4250 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4068340 tx=0x7f8bbc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80d821d657cc9990 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:45.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.153+0000 7f8bc27fc640 1 -- 172.21.15.40:0/443750738 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc02ca80 con 0x7f8bc40c3e40 2024-04-22T07:22:45.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.153+0000 7f8bc27fc640 1 -- 172.21.15.40:0/443750738 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bbc02cc20 con 0x7f8bc40c3e40 2024-04-22T07:22:45.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.153+0000 7f8bc27fc640 1 -- 172.21.15.40:0/443750738 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc0343f0 con 0x7f8bc40c3e40 2024-04-22T07:22:45.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.154+0000 7f8bc9efd640 1 -- 172.21.15.40:0/443750738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bc40c3e40 msgr2=0x7f8bc40c4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:45.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.154+0000 7f8bc9efd640 1 --2- 172.21.15.40:0/443750738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bc40c3e40 0x7f8bc40c4250 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4068340 tx=0x7f8bbc02bee0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.154+0000 7f8bc9efd640 1 -- 172.21.15.40:0/443750738 shutdown_connections 2024-04-22T07:22:45.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.154+0000 7f8bc9efd640 1 --2- 172.21.15.40:0/443750738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bc40c3e40 0x7f8bc40c4250 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.154+0000 7f8bc9efd640 1 --2- 172.21.15.40:0/443750738 >> v2:172.21.15.62:3300/0 conn(0x7f8bc406b920 0x7f8bc415b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.154+0000 7f8bc9efd640 1 -- 172.21.15.40:0/443750738 >> 172.21.15.40:0/443750738 conn(0x7f8bc4071530 msgr2=0x7f8bc4071910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:45.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.154+0000 7f8bc9efd640 1 -- 172.21.15.40:0/443750738 shutdown_connections 2024-04-22T07:22:45.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.154+0000 7f8bc9efd640 1 -- 172.21.15.40:0/443750738 wait complete. 2024-04-22T07:22:45.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.155+0000 7f8bc9efd640 1 Processor -- start 2024-04-22T07:22:45.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.155+0000 7f8bc9efd640 1 -- start start 2024-04-22T07:22:45.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.156+0000 7f8bc9efd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8bc406b920 0x7f8bc40afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:45.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.156+0000 7f8bc9efd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bc406fd10 0x7f8bc41f3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:45.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.156+0000 7f8bc9efd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8bc40c3e40 0x7f8bc4151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:45.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.156+0000 7f8bc9efd640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc406cda0 con 0x7f8bc406fd10 2024-04-22T07:22:45.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.156+0000 7f8bc9efd640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc415b000 con 0x7f8bc40c3e40 2024-04-22T07:22:45.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.156+0000 7f8bc9efd640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f8bc415bd40 con 0x7f8bc406b920 2024-04-22T07:22:45.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.156+0000 7f8bc2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bc406fd10 0x7f8bc41f3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:45.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.156+0000 7f8bc2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bc406fd10 0x7f8bc41f3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41342/0 (socket says 172.21.15.40:41342) 2024-04-22T07:22:45.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.156+0000 7f8bc2ffd640 1 -- 172.21.15.40:0/1155141305 learned_addr learned my addr 172.21.15.40:0/1155141305 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:22:45.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.156+0000 7f8bc3fff640 1 --2- 172.21.15.40:0/1155141305 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8bc40c3e40 0x7f8bc4151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:45.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.156+0000 7f8bc37fe640 1 --2- 172.21.15.40:0/1155141305 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8bc406b920 0x7f8bc40afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:45.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.156+0000 7f8bc2ffd640 1 -- 172.21.15.40:0/1155141305 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8bc406b920 msgr2=0x7f8bc40afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:45.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.156+0000 7f8bc2ffd640 1 --2- 172.21.15.40:0/1155141305 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8bc406b920 0x7f8bc40afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.156+0000 7f8bc2ffd640 1 -- 172.21.15.40:0/1155141305 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8bc40c3e40 msgr2=0x7f8bc4151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:45.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.156+0000 7f8bc2ffd640 1 --2- 172.21.15.40:0/1155141305 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8bc40c3e40 0x7f8bc4151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.156+0000 7f8bc2ffd640 1 -- 172.21.15.40:0/1155141305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc41f4870 con 0x7f8bc406fd10 2024-04-22T07:22:45.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.156+0000 7f8bc37fe640 1 --2- 172.21.15.40:0/1155141305 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8bc406b920 0x7f8bc40afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:22:45.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.156+0000 7f8bc2ffd640 1 --2- 172.21.15.40:0/1155141305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bc406fd10 0x7f8bc41f3fb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8bb800d830 tx=0x7f8bb800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:45.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.156+0000 7f8babfff640 1 -- 172.21.15.40:0/1155141305 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb800b6c0 con 0x7f8bc406fd10 2024-04-22T07:22:45.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.157+0000 7f8babfff640 1 -- 172.21.15.40:0/1155141305 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bb8019070 con 0x7f8bc406fd10 2024-04-22T07:22:45.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.157+0000 7f8bc9efd640 1 -- 172.21.15.40:0/1155141305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bc40c86a0 con 0x7f8bc406fd10 2024-04-22T07:22:45.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.157+0000 7f8babfff640 1 -- 172.21.15.40:0/1155141305 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb800baa0 con 0x7f8bc406fd10 2024-04-22T07:22:45.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.157+0000 7f8bc9efd640 1 -- 172.21.15.40:0/1155141305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bc40af700 con 0x7f8bc406fd10 2024-04-22T07:22:45.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.158+0000 7f8babfff640 1 -- 172.21.15.40:0/1155141305 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8bb801e460 con 0x7f8bc406fd10 2024-04-22T07:22:45.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.159+0000 7f8babfff640 1 --2- 172.21.15.40:0/1155141305 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8bb006c8f0 0x7f8bb006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:45.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.159+0000 7f8babfff640 1 -- 172.21.15.40:0/1155141305 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f8bb808c2a0 con 0x7f8bc406fd10 2024-04-22T07:22:45.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.159+0000 7f8bc37fe640 1 --2- 172.21.15.40:0/1155141305 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8bb006c8f0 0x7f8bb006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:45.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.159+0000 7f8bc37fe640 1 --2- 172.21.15.40:0/1155141305 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8bb006c8f0 0x7f8bb006edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4003eb0 tx=0x7f8bb4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:45.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.159+0000 7f8bccbc6740 1 Processor -- start 2024-04-22T07:22:45.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.160+0000 7f8bccbc6740 1 -- start start 2024-04-22T07:22:45.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.160+0000 7f8bccbc6740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563576a39200 0x563576a395e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:45.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.160+0000 7f8bccbc6740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x563576a83080 0x563576a39b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:45.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.160+0000 7f8bccbc6740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563576a37c60 0x563576a78b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:45.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.160+0000 7f8bccbc6740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56357699a0b0 con 0x563576a39200 2024-04-22T07:22:45.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.160+0000 7f8bccbc6740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56357694b680 con 0x563576a37c60 2024-04-22T07:22:45.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.160+0000 7f8bccbc6740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x563576957c60 con 0x563576a83080 2024-04-22T07:22:45.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.160+0000 7f8bc37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563576a39200 0x563576a395e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:45.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.161+0000 7f8bc37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563576a39200 0x563576a395e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41348/0 (socket says 172.21.15.40:41348) 2024-04-22T07:22:45.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.161+0000 7f8bc37fe640 1 -- 172.21.15.40:0/889084649 learned_addr learned my addr 172.21.15.40:0/889084649 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:22:45.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.161+0000 7f8bc3fff640 1 --2- 172.21.15.40:0/889084649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563576a37c60 0x563576a78b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:45.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.161+0000 7f8bc2ffd640 1 --2- 172.21.15.40:0/889084649 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x563576a83080 0x563576a39b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:45.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.161+0000 7f8bc37fe640 1 -- 172.21.15.40:0/889084649 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x563576a83080 msgr2=0x563576a39b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:45.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.161+0000 7f8bc37fe640 1 --2- 172.21.15.40:0/889084649 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x563576a83080 0x563576a39b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.161+0000 7f8bc37fe640 1 -- 172.21.15.40:0/889084649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563576a37c60 msgr2=0x563576a78b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:45.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.161+0000 7f8bc37fe640 1 --2- 172.21.15.40:0/889084649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563576a37c60 0x563576a78b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.161+0000 7f8bc37fe640 1 -- 172.21.15.40:0/889084649 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56357677cc90 con 0x563576a39200 2024-04-22T07:22:45.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.161+0000 7f8bc2ffd640 1 --2- 172.21.15.40:0/889084649 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x563576a83080 0x563576a39b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:22:45.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.161+0000 7f8bc37fe640 1 --2- 172.21.15.40:0/889084649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563576a39200 0x563576a395e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4003c90 tx=0x7f8bb4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa14b324e1c4ed9 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:45.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.161+0000 7f8ba97fa640 1 -- 172.21.15.40:0/889084649 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4005030 con 0x563576a39200 2024-04-22T07:22:45.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.161+0000 7f8ba97fa640 1 -- 172.21.15.40:0/889084649 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bb40051d0 con 0x563576a39200 2024-04-22T07:22:45.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.161+0000 7f8ba97fa640 1 -- 172.21.15.40:0/889084649 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb40069e0 con 0x563576a39200 2024-04-22T07:22:45.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.162+0000 7f8bccbc6740 1 -- 172.21.15.40:0/889084649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563576a39200 msgr2=0x563576a395e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:45.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.162+0000 7f8bccbc6740 1 --2- 172.21.15.40:0/889084649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563576a39200 0x563576a395e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4003c90 tx=0x7f8bb4011000 comp rx=0 tx=0).stop 2024-04-22T07:22:45.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.162+0000 7f8bccbc6740 1 -- 172.21.15.40:0/889084649 shutdown_connections 2024-04-22T07:22:45.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.162+0000 7f8bccbc6740 1 --2- 172.21.15.40:0/889084649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563576a37c60 0x563576a78b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.162+0000 7f8bccbc6740 1 --2- 172.21.15.40:0/889084649 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x563576a83080 0x563576a39b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.162+0000 7f8bccbc6740 1 --2- 172.21.15.40:0/889084649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563576a39200 0x563576a395e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.162+0000 7f8bccbc6740 1 -- 172.21.15.40:0/889084649 >> 172.21.15.40:0/889084649 conn(0x563576a35c00 msgr2=0x563576a382b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:45.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.162+0000 7f8bccbc6740 1 -- 172.21.15.40:0/889084649 shutdown_connections 2024-04-22T07:22:45.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.162+0000 7f8bccbc6740 1 -- 172.21.15.40:0/889084649 wait complete. 2024-04-22T07:22:45.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.163+0000 7f8bccbc6740 1 -- start start 2024-04-22T07:22:45.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.163+0000 7f8bccbc6740 1 Processor -- start 2024-04-22T07:22:45.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.163+0000 7f8bccbc6740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x563576a39200 0x563576a5b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:45.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.163+0000 7f8bccbc6740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563576a83080 0x563576a8db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:45.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.163+0000 7f8bccbc6740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563576a61930 0x563576a5e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:45.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.163+0000 7f8bccbc6740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x56357699d400 con 0x563576a83080 2024-04-22T07:22:45.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.163+0000 7f8bccbc6740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x563576959840 con 0x563576a61930 2024-04-22T07:22:45.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.163+0000 7f8bccbc6740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x5635769a2720 con 0x563576a39200 2024-04-22T07:22:45.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.163+0000 7f8bccbc6740 10 client.0 _ll_register_callbacks cb 0x5635769aaea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:22:45.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.163+0000 7f8bc2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563576a83080 0x563576a8db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:45.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.163+0000 7f8bc2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563576a83080 0x563576a8db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41350/0 (socket says 172.21.15.40:41350) 2024-04-22T07:22:45.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.163+0000 7f8bc2ffd640 1 -- 172.21.15.40:0/236759665 learned_addr learned my addr 172.21.15.40:0/236759665 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:22:45.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.164+0000 7f8bc37fe640 1 --2- 172.21.15.40:0/236759665 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x563576a39200 0x563576a5b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:45.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.164+0000 7f8bc3fff640 1 --2- 172.21.15.40:0/236759665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563576a61930 0x563576a5e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:45.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.164+0000 7f8bc2ffd640 1 -- 172.21.15.40:0/236759665 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x563576a39200 msgr2=0x563576a5b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:45.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.164+0000 7f8bc2ffd640 1 --2- 172.21.15.40:0/236759665 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x563576a39200 0x563576a5b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.164+0000 7f8bc2ffd640 1 -- 172.21.15.40:0/236759665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563576a61930 msgr2=0x563576a5e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:45.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.164+0000 7f8bc2ffd640 1 --2- 172.21.15.40:0/236759665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563576a61930 0x563576a5e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.164+0000 7f8bc2ffd640 1 -- 172.21.15.40:0/236759665 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635767dd420 con 0x563576a83080 2024-04-22T07:22:45.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.164+0000 7f8bc2ffd640 1 --2- 172.21.15.40:0/236759665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563576a83080 0x563576a8db50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8bb808a6b0 tx=0x7f8bb805a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a83caee9af0ec5c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:45.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.164+0000 7f8ba27fc640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-04-22T07:22:45.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.164+0000 7f8ba27fc640 1 -- 172.21.15.40:0/236759665 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8077060 con 0x563576a83080 2024-04-22T07:22:45.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.164+0000 7f8ba27fc640 1 -- 172.21.15.40:0/236759665 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f8bb8072210 con 0x563576a83080 2024-04-22T07:22:45.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.164+0000 7f8bccbc6740 1 -- 172.21.15.40:0/236759665 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bb40051d0 con 0x563576a83080 2024-04-22T07:22:45.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.164+0000 7f8ba27fc640 1 -- 172.21.15.40:0/236759665 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f8bb808a050 con 0x563576a83080 2024-04-22T07:22:45.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.164+0000 7f8bccbc6740 10 client.4956 fetch_fsmap learned FSMap version 8 2024-04-22T07:22:45.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.164+0000 7f8bccbc6740 1 -- 172.21.15.40:0/236759665 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x563576670580 con 0x563576a83080 2024-04-22T07:22:45.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.164+0000 7f8ba27fc640 1 -- 172.21.15.40:0/236759665 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bb40051d0 con 0x563576a83080 2024-04-22T07:22:45.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.164+0000 7f8ba27fc640 1 -- 172.21.15.40:0/236759665 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f8bb8013070 con 0x563576a83080 2024-04-22T07:22:45.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.165+0000 7f8bccbc6740 10 client.4956 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:22:45.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.165+0000 7f8bccbc6740 10 client.4956 resolve_mds: validated gid 4305 aka daemon mds.b 2024-04-22T07:22:45.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.165+0000 7f8bccbc6740 20 client.4956 populate_metadata read hostname 'smithi040' 2024-04-22T07:22:45.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.165+0000 7f8bccbc6740 1 --2- 172.21.15.40:0/236759665 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x563576a7a0a0 0x563576a89f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:45.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.165+0000 7f8bccbc6740 4 client.4956 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T07:22:45.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.165+0000 7f8bccbc6740 1 -- 172.21.15.40:0/236759665 --> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635769abb10 con 0x563576a7a0a0 2024-04-22T07:22:45.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.165+0000 7f8bc37fe640 1 --2- 172.21.15.40:0/236759665 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x563576a7a0a0 0x563576a89f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:45.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.165+0000 7f8bc37fe640 1 --2- 172.21.15.40:0/236759665 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x563576a7a0a0 0x563576a89f50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7bd2630e73bed6b server_cookie=f8b42fc9188d7c58 in_seq=0 out_seq=0 2024-04-22T07:22:45.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.165+0000 7f8ba27fc640 10 client.4956 ms_handle_connect on v2:172.21.15.62:6833/2884673656 2024-04-22T07:22:45.169 INFO:tasks.workunit.client.0.smithi040.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-22T07:22:45.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.166+0000 7f8ba27fc640 1 -- 172.21.15.40:0/236759665 <== mds.0 v2:172.21.15.62:6833/2884673656 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5635769abb10 con 0x563576a7a0a0 2024-04-22T07:22:45.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.166+0000 7f8ba27fc640 10 client.4956 handle_command_reply: tid=0 2024-04-22T07:22:45.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.166+0000 7f8bccbc6740 1 client.4956 shutdown 2024-04-22T07:22:45.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.166+0000 7f8bccbc6740 1 -- 172.21.15.40:0/236759665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563576a83080 msgr2=0x563576a8db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:45.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.166+0000 7f8bccbc6740 1 --2- 172.21.15.40:0/236759665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563576a83080 0x563576a8db50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8bb808a6b0 tx=0x7f8bb805a650 comp rx=0 tx=0).stop 2024-04-22T07:22:45.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.166+0000 7f8bccbc6740 1 -- 172.21.15.40:0/236759665 shutdown_connections 2024-04-22T07:22:45.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.166+0000 7f8bccbc6740 1 --2- 172.21.15.40:0/236759665 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x563576a7a0a0 0x563576a89f50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.166+0000 7f8bccbc6740 1 --2- 172.21.15.40:0/236759665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563576a61930 0x563576a5e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.166+0000 7f8bccbc6740 1 --2- 172.21.15.40:0/236759665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563576a83080 0x563576a8db50 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.166+0000 7f8ba27fc640 0 client.4956 ms_handle_reset on v2:172.21.15.62:6833/2884673656 2024-04-22T07:22:45.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.166+0000 7f8bccbc6740 1 --2- 172.21.15.40:0/236759665 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x563576a39200 0x563576a5b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.166+0000 7f8bccbc6740 1 -- 172.21.15.40:0/236759665 >> 172.21.15.40:0/236759665 conn(0x563576a37c60 msgr2=0x563576a32940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:45.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.166+0000 7f8bccbc6740 1 -- 172.21.15.40:0/236759665 shutdown_connections 2024-04-22T07:22:45.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.166+0000 7f8bccbc6740 1 -- 172.21.15.40:0/236759665 wait complete. 2024-04-22T07:22:45.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.166+0000 7f8bccbc6740 20 client.4956 trim_cache size 0 max 16384 2024-04-22T07:22:45.172 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-22T07:22:45.172 INFO:tasks.workunit.client.0.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-22T07:22:45.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.184+0000 7f8bccbc6740 1 Processor -- start 2024-04-22T07:22:45.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.184+0000 7f8bccbc6740 1 -- start start 2024-04-22T07:22:45.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.184+0000 7f8bccbc6740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563576a39200 0x563576a368f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:45.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.184+0000 7f8bccbc6740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x563576a61930 0x563576aef560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:45.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.184+0000 7f8bccbc6740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563576a83080 0x563576aefaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:45.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.184+0000 7f8bccbc6740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc41fded0 con 0x563576a39200 2024-04-22T07:22:45.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.184+0000 7f8bccbc6740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc41fcdb0 con 0x563576a83080 2024-04-22T07:22:45.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.184+0000 7f8bccbc6740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f8bc41fb370 con 0x563576a61930 2024-04-22T07:22:45.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.185+0000 7f8bc37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563576a39200 0x563576a368f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:45.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.185+0000 7f8bc37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563576a39200 0x563576a368f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41352/0 (socket says 172.21.15.40:41352) 2024-04-22T07:22:45.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.185+0000 7f8bc37fe640 1 -- 172.21.15.40:0/283991719 learned_addr learned my addr 172.21.15.40:0/283991719 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:22:45.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.185+0000 7f8bc3fff640 1 --2- 172.21.15.40:0/283991719 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563576a83080 0x563576aefaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:45.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.185+0000 7f8bc2ffd640 1 --2- 172.21.15.40:0/283991719 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x563576a61930 0x563576aef560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:45.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.185+0000 7f8bc37fe640 1 -- 172.21.15.40:0/283991719 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x563576a61930 msgr2=0x563576aef560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:45.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.185+0000 7f8bc37fe640 1 --2- 172.21.15.40:0/283991719 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x563576a61930 0x563576aef560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.185+0000 7f8bc37fe640 1 -- 172.21.15.40:0/283991719 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563576a83080 msgr2=0x563576aefaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:45.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.185+0000 7f8bc37fe640 1 --2- 172.21.15.40:0/283991719 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563576a83080 0x563576aefaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.185+0000 7f8bc37fe640 1 -- 172.21.15.40:0/283991719 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563576a359a0 con 0x563576a39200 2024-04-22T07:22:45.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.185+0000 7f8bc37fe640 1 --2- 172.21.15.40:0/283991719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563576a39200 0x563576a368f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4007650 tx=0x7f8bb401a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd5e83bc9ad904e server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:45.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.185+0000 7f8ba8ff9640 1 -- 172.21.15.40:0/283991719 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4005230 con 0x563576a39200 2024-04-22T07:22:45.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.185+0000 7f8ba8ff9640 1 -- 172.21.15.40:0/283991719 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bb40053f0 con 0x563576a39200 2024-04-22T07:22:45.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.185+0000 7f8ba8ff9640 1 -- 172.21.15.40:0/283991719 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb402bb50 con 0x563576a39200 2024-04-22T07:22:45.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.186+0000 7f8bccbc6740 1 -- 172.21.15.40:0/283991719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563576a39200 msgr2=0x563576a368f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:45.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.186+0000 7f8bccbc6740 1 --2- 172.21.15.40:0/283991719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563576a39200 0x563576a368f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4007650 tx=0x7f8bb401a070 comp rx=0 tx=0).stop 2024-04-22T07:22:45.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.186+0000 7f8bccbc6740 1 -- 172.21.15.40:0/283991719 shutdown_connections 2024-04-22T07:22:45.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.186+0000 7f8bccbc6740 1 --2- 172.21.15.40:0/283991719 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563576a83080 0x563576aefaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.186+0000 7f8bccbc6740 1 --2- 172.21.15.40:0/283991719 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x563576a61930 0x563576aef560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.186+0000 7f8bccbc6740 1 --2- 172.21.15.40:0/283991719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563576a39200 0x563576a368f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.186+0000 7f8bccbc6740 1 -- 172.21.15.40:0/283991719 >> 172.21.15.40:0/283991719 conn(0x563576a37c60 msgr2=0x563576a34950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:45.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.186+0000 7f8bccbc6740 1 -- 172.21.15.40:0/283991719 shutdown_connections 2024-04-22T07:22:45.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.186+0000 7f8bccbc6740 1 -- 172.21.15.40:0/283991719 wait complete. 2024-04-22T07:22:45.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.186+0000 7f8bccbc6740 1 -- start start 2024-04-22T07:22:45.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.187+0000 7f8bccbc6740 1 Processor -- start 2024-04-22T07:22:45.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.187+0000 7f8bccbc6740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x563576a39200 0x563576a62170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:45.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.187+0000 7f8bccbc6740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563576a61930 0x563576a57e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:45.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.187+0000 7f8bccbc6740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563576a83080 0x563576aedf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:45.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.187+0000 7f8bccbc6740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc41fb9c0 con 0x563576a61930 2024-04-22T07:22:45.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.187+0000 7f8bccbc6740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc41fc6e0 con 0x563576a83080 2024-04-22T07:22:45.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.187+0000 7f8bccbc6740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f8bc41fc010 con 0x563576a39200 2024-04-22T07:22:45.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.187+0000 7f8bccbc6740 10 client.0 _ll_register_callbacks cb 0x7f8bb80046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:22:45.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.187+0000 7f8bc2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563576a61930 0x563576a57e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:45.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.187+0000 7f8bc2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563576a61930 0x563576a57e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41356/0 (socket says 172.21.15.40:41356) 2024-04-22T07:22:45.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.187+0000 7f8bc2ffd640 1 -- 172.21.15.40:0/3773648106 learned_addr learned my addr 172.21.15.40:0/3773648106 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:22:45.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.187+0000 7f8bc37fe640 1 --2- 172.21.15.40:0/3773648106 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x563576a39200 0x563576a62170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:45.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.187+0000 7f8bc3fff640 1 --2- 172.21.15.40:0/3773648106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563576a83080 0x563576aedf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:45.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.188+0000 7f8bc2ffd640 1 -- 172.21.15.40:0/3773648106 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x563576a39200 msgr2=0x563576a62170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:45.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.188+0000 7f8bc2ffd640 1 --2- 172.21.15.40:0/3773648106 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x563576a39200 0x563576a62170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.188+0000 7f8bc2ffd640 1 -- 172.21.15.40:0/3773648106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563576a83080 msgr2=0x563576aedf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:22:45.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.188+0000 7f8bc2ffd640 1 --2- 172.21.15.40:0/3773648106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563576a83080 0x563576aedf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.188+0000 7f8bc2ffd640 1 -- 172.21.15.40:0/3773648106 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563576a2f680 con 0x563576a61930 2024-04-22T07:22:45.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.188+0000 7f8bc2ffd640 1 --2- 172.21.15.40:0/3773648106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563576a61930 0x563576a57e50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8bb80567c0 tx=0x7f8bb808a5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8405385c555bb18e server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:22:45.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.188+0000 7f8ba27fc640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-04-22T07:22:45.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.188+0000 7f8ba27fc640 1 -- 172.21.15.40:0/3773648106 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8072070 con 0x563576a61930 2024-04-22T07:22:45.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.188+0000 7f8ba27fc640 1 -- 172.21.15.40:0/3773648106 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f8bb8056500 con 0x563576a61930 2024-04-22T07:22:45.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.188+0000 7f8bccbc6740 1 -- 172.21.15.40:0/3773648106 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bb40053f0 con 0x563576a61930 2024-04-22T07:22:45.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.188+0000 7f8ba27fc640 1 -- 172.21.15.40:0/3773648106 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f8bb8067050 con 0x563576a61930 2024-04-22T07:22:45.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.188+0000 7f8bccbc6740 10 client.4962 fetch_fsmap learned FSMap version 8 2024-04-22T07:22:45.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.188+0000 7f8bccbc6740 1 -- 172.21.15.40:0/3773648106 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x563576a7d270 con 0x563576a61930 2024-04-22T07:22:45.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.188+0000 7f8ba27fc640 1 -- 172.21.15.40:0/3773648106 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bb40053f0 con 0x563576a61930 2024-04-22T07:22:45.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.188+0000 7f8ba27fc640 1 -- 172.21.15.40:0/3773648106 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f8bb806a020 con 0x563576a61930 2024-04-22T07:22:45.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.188+0000 7f8bccbc6740 10 client.4962 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:22:45.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.188+0000 7f8bccbc6740 10 client.4962 resolve_mds: validated gid 4305 aka daemon mds.b 2024-04-22T07:22:45.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.188+0000 7f8bccbc6740 20 client.4962 populate_metadata read hostname 'smithi040' 2024-04-22T07:22:45.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.188+0000 7f8bccbc6740 1 --2- 172.21.15.40:0/3773648106 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x563576aee490 0x563576a9cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:22:45.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.188+0000 7f8bccbc6740 4 client.4962 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.8, "await": true}] 2024-04-22T07:22:45.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.188+0000 7f8bccbc6740 1 -- 172.21.15.40:0/3773648106 --> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.8, "await": true}) -- 0x563576a36360 con 0x563576aee490 2024-04-22T07:22:45.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.189+0000 7f8bc37fe640 1 --2- 172.21.15.40:0/3773648106 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x563576aee490 0x563576a9cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:22:45.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.189+0000 7f8bc37fe640 1 --2- 172.21.15.40:0/3773648106 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x563576aee490 0x563576a9cbc0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63af5f978ea0eaa server_cookie=1eb3b74b56beff78 in_seq=0 out_seq=0 2024-04-22T07:22:45.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.189+0000 7f8ba27fc640 10 client.4962 ms_handle_connect on v2:172.21.15.62:6833/2884673656 2024-04-22T07:22:45.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.190+0000 7f8ba27fc640 1 -- 172.21.15.40:0/3773648106 <== mds.0 v2:172.21.15.62:6833/2884673656 1 ==== command_reply(tid 0: 0 ) ==== 8+0+585 (crc 0 0 0) 0x563576a36360 con 0x563576aee490 2024-04-22T07:22:45.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.190+0000 7f8ba27fc640 10 client.4962 handle_command_reply: tid=0 2024-04-22T07:22:45.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.190+0000 7f8bccbc6740 1 client.4962 shutdown 2024-04-22T07:22:45.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.191+0000 7f8bccbc6740 1 -- 172.21.15.40:0/3773648106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563576a61930 msgr2=0x563576a57e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:45.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.191+0000 7f8bccbc6740 1 --2- 172.21.15.40:0/3773648106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563576a61930 0x563576a57e50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8bb80567c0 tx=0x7f8bb808a5e0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.191+0000 7f8bccbc6740 1 -- 172.21.15.40:0/3773648106 shutdown_connections 2024-04-22T07:22:45.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.191+0000 7f8bccbc6740 1 --2- 172.21.15.40:0/3773648106 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x563576aee490 0x563576a9cbc0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.191+0000 7f8bccbc6740 1 --2- 172.21.15.40:0/3773648106 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563576a83080 0x563576aedf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.191+0000 7f8ba27fc640 0 client.4962 ms_handle_reset on v2:172.21.15.62:6833/2884673656 2024-04-22T07:22:45.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.191+0000 7f8bccbc6740 1 --2- 172.21.15.40:0/3773648106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563576a61930 0x563576a57e50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.191+0000 7f8bccbc6740 1 --2- 172.21.15.40:0/3773648106 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x563576a39200 0x563576a62170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.191+0000 7f8bccbc6740 1 -- 172.21.15.40:0/3773648106 >> 172.21.15.40:0/3773648106 conn(0x563576a37c60 msgr2=0x563576a5d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:45.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.191+0000 7f8bccbc6740 1 -- 172.21.15.40:0/3773648106 shutdown_connections 2024-04-22T07:22:45.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.191+0000 7f8bccbc6740 1 -- 172.21.15.40:0/3773648106 wait complete. 2024-04-22T07:22:45.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.191+0000 7f8bccbc6740 20 client.4962 trim_cache size 0 max 16384 2024-04-22T07:22:45.196 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-22T07:22:45.196 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 8, 2024-04-22T07:22:45.196 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 4305, 2024-04-22T07:22:45.197 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 6, 2024-04-22T07:22:45.197 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-04-22T07:22:45.197 INFO:teuthology.orchestra.run.smithi040.stdout: "73cec0c": { 2024-04-22T07:22:45.197 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 6, 2024-04-22T07:22:45.197 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-04-22T07:22:45.197 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-04-22T07:22:45.197 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-04-22T07:22:45.197 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-04-22T07:22:45.197 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-22T07:22:45.197 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 60.0, 2024-04-22T07:22:45.197 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 78.8, 2024-04-22T07:22:45.197 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-04-22T07:22:45.197 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-04-22T07:22:45.197 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-04-22T07:22:45.198 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-04-22T07:22:45.198 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-04-22T07:22:45.198 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-04-22T07:22:45.198 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:22:45.198 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:22:45.198 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:22:45.198 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:22:45.198 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:22:45.198 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-22T07:22:45.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.191+0000 7f8bc9efd640 1 -- 172.21.15.40:0/1155141305 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8bb006c8f0 msgr2=0x7f8bb006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:45.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.191+0000 7f8bc9efd640 1 --2- 172.21.15.40:0/1155141305 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8bb006c8f0 0x7f8bb006edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4003eb0 tx=0x7f8bb4009040 comp rx=0 tx=0).stop 2024-04-22T07:22:45.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.191+0000 7f8bc9efd640 1 -- 172.21.15.40:0/1155141305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bc406fd10 msgr2=0x7f8bc41f3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:22:45.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.191+0000 7f8bc9efd640 1 --2- 172.21.15.40:0/1155141305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bc406fd10 0x7f8bc41f3fb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8bb800d830 tx=0x7f8bb800dcf0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.191+0000 7f8bc9efd640 1 -- 172.21.15.40:0/1155141305 shutdown_connections 2024-04-22T07:22:45.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.191+0000 7f8bc9efd640 1 --2- 172.21.15.40:0/1155141305 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8bc40c3e40 0x7f8bc4151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.191+0000 7f8bc9efd640 1 --2- 172.21.15.40:0/1155141305 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f8bb006c8f0 0x7f8bb006edb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.191+0000 7f8bc9efd640 1 --2- 172.21.15.40:0/1155141305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bc406fd10 0x7f8bc41f3fb0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.191+0000 7f8bc9efd640 1 --2- 172.21.15.40:0/1155141305 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8bc406b920 0x7f8bc40afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:22:45.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.192+0000 7f8bc9efd640 1 -- 172.21.15.40:0/1155141305 >> 172.21.15.40:0/1155141305 conn(0x7f8bc4071530 msgr2=0x7f8bc40c9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:22:45.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.192+0000 7f8bc9efd640 1 -- 172.21.15.40:0/1155141305 shutdown_connections 2024-04-22T07:22:45.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:22:45.192+0000 7f8bc9efd640 1 -- 172.21.15.40:0/1155141305 wait complete. 2024-04-22T07:22:45.201 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced, set_id: 73cec0c, quiesce took 0.5 seconds. Will release after: 18.8 2024-04-22T07:22:45.746 INFO:tasks.workunit.client.0.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-22T07:22:45.804 INFO:tasks.workunit.client.0.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-22T07:22:45.845 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-22T07:22:45.846 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-22T07:22:45.846 INFO:tasks.workunit.client.0.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-22T07:22:45.889 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-22T07:22:45.893 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:22:45.893 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-22T07:22:45.909 INFO:tasks.workunit:Running workunits matching suites/iozone.sh on client.0... 2024-04-22T07:22:45.910 INFO:tasks.workunit:Running workunit suites/iozone.sh... 2024-04-22T07:22:45.910 DEBUG:teuthology.orchestra.run.smithi040:workunit test suites/iozone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=86f7587a5a09af35f0895e1a2d08527638fae697 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh 2024-04-22T07:22:53.730 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:22:53.733 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:23:04.001 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:23:04.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.118+0000 7fe754dce640 1 Processor -- start 2024-04-22T07:23:04.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.118+0000 7fe754dce640 1 -- start start 2024-04-22T07:23:04.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.119+0000 7fe754dce640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe750152eb0 0x7fe75006b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.119+0000 7fe754dce640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe7500c3e80 0x7fe750072db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.119+0000 7fe754dce640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe75006d150 con 0x7fe75015c1d0 2024-04-22T07:23:04.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.119+0000 7fe754dce640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fe7500732f0 con 0x7fe7500c3e80 2024-04-22T07:23:04.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.119+0000 7fe754dce640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fe7500c7fe0 con 0x7fe750152eb0 2024-04-22T07:23:04.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.119+0000 7fe74ed9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe7500c3e80 0x7fe750072db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.119+0000 7fe745d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe75015c1d0 0x7fe7500c6bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45218/0 (socket says 172.21.15.40:45218) 2024-04-22T07:23:04.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.119+0000 7fe745d9b640 1 -- 172.21.15.40:0/2780108090 learned_addr learned my addr 172.21.15.40:0/2780108090 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:23:04.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.119+0000 7fe74e59c640 1 --2- 172.21.15.40:0/2780108090 >> v2:172.21.15.62:3300/0 conn(0x7fe750152eb0 0x7fe75006b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.119+0000 7fe74ed9d640 1 -- 172.21.15.40:0/2780108090 >> v2:172.21.15.62:3300/0 conn(0x7fe750152eb0 msgr2=0x7fe75006b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:04.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.119+0000 7fe74ed9d640 1 --2- 172.21.15.40:0/2780108090 >> v2:172.21.15.62:3300/0 conn(0x7fe750152eb0 0x7fe75006b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.119+0000 7fe74ed9d640 1 -- 172.21.15.40:0/2780108090 >> v1:172.21.15.40:6789/0 conn(0x7fe75015c1d0 legacy=0x7fe7500c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:04.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.119+0000 7fe74dd9b640 1 -- 172.21.15.40:0/2780108090 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3305251467 0 0) 0x7fe75006d150 con 0x7fe75015c1d0 2024-04-22T07:23:04.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.119+0000 7fe74ed9d640 1 -- 172.21.15.40:0/2780108090 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7500c4680 con 0x7fe7500c3e80 2024-04-22T07:23:04.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.120+0000 7fe74ed9d640 1 --2- 172.21.15.40:0/2780108090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7500c3e80 0x7fe750072db0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe7500c7850 tx=0x7fe74802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc62675c0f84ff6 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:04.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.120+0000 7fe74dd9b640 1 -- 172.21.15.40:0/2780108090 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe748039070 con 0x7fe7500c3e80 2024-04-22T07:23:04.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.120+0000 7fe74dd9b640 1 -- 172.21.15.40:0/2780108090 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe74802cbf0 con 0x7fe7500c3e80 2024-04-22T07:23:04.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.120+0000 7fe74dd9b640 1 -- 172.21.15.40:0/2780108090 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe748034440 con 0x7fe7500c3e80 2024-04-22T07:23:04.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.121+0000 7fe754dce640 1 -- 172.21.15.40:0/2780108090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7500c3e80 msgr2=0x7fe750072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:04.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.121+0000 7fe754dce640 1 --2- 172.21.15.40:0/2780108090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7500c3e80 0x7fe750072db0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe7500c7850 tx=0x7fe74802be40 comp rx=0 tx=0).stop 2024-04-22T07:23:04.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.121+0000 7fe754dce640 1 -- 172.21.15.40:0/2780108090 shutdown_connections 2024-04-22T07:23:04.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.121+0000 7fe754dce640 1 --2- 172.21.15.40:0/2780108090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7500c3e80 0x7fe750072db0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.121+0000 7fe754dce640 1 --2- 172.21.15.40:0/2780108090 >> v2:172.21.15.62:3300/0 conn(0x7fe750152eb0 0x7fe75006b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.121+0000 7fe754dce640 1 -- 172.21.15.40:0/2780108090 >> 172.21.15.40:0/2780108090 conn(0x7fe7500cdb70 msgr2=0x7fe7500c9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:23:04.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.121+0000 7fe754dce640 1 -- 172.21.15.40:0/2780108090 shutdown_connections 2024-04-22T07:23:04.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.121+0000 7fe754dce640 1 -- 172.21.15.40:0/2780108090 wait complete. 2024-04-22T07:23:04.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.122+0000 7fe754dce640 1 Processor -- start 2024-04-22T07:23:04.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.122+0000 7fe754dce640 1 -- start start 2024-04-22T07:23:04.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.123+0000 7fe754dce640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7500c3e80 0x7fe7501f1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.123+0000 7fe754dce640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe750152eb0 0x7fe7501eefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.123+0000 7fe754dce640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe75015c1d0 0x7fe7500cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.123+0000 7fe754dce640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe7500c8560 con 0x7fe7500c3e80 2024-04-22T07:23:04.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.123+0000 7fe754dce640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe7500c8280 con 0x7fe75015c1d0 2024-04-22T07:23:04.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.123+0000 7fe754dce640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe750153290 con 0x7fe750152eb0 2024-04-22T07:23:04.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.123+0000 7fe74e59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7500c3e80 0x7fe7501f1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.123+0000 7fe74e59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7500c3e80 0x7fe7501f1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35900/0 (socket says 172.21.15.40:35900) 2024-04-22T07:23:04.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.123+0000 7fe74e59c640 1 -- 172.21.15.40:0/3372102933 learned_addr learned my addr 172.21.15.40:0/3372102933 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:23:04.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.123+0000 7fe74ed9d640 1 --2- 172.21.15.40:0/3372102933 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe75015c1d0 0x7fe7500cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.123+0000 7fe745d9b640 1 --2- 172.21.15.40:0/3372102933 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe750152eb0 0x7fe7501eefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.123+0000 7fe74e59c640 1 -- 172.21.15.40:0/3372102933 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe750152eb0 msgr2=0x7fe7501eefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:04.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.123+0000 7fe74e59c640 1 --2- 172.21.15.40:0/3372102933 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe750152eb0 0x7fe7501eefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.123+0000 7fe74e59c640 1 -- 172.21.15.40:0/3372102933 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe75015c1d0 msgr2=0x7fe7500cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:04.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.123+0000 7fe74e59c640 1 --2- 172.21.15.40:0/3372102933 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe75015c1d0 0x7fe7500cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.123+0000 7fe74e59c640 1 -- 172.21.15.40:0/3372102933 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7501f2240 con 0x7fe7500c3e80 2024-04-22T07:23:04.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.123+0000 7fe74ed9d640 1 --2- 172.21.15.40:0/3372102933 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe75015c1d0 0x7fe7500cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:23:04.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.124+0000 7fe74e59c640 1 --2- 172.21.15.40:0/3372102933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7500c3e80 0x7fe7501f1bb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe74000e8a0 tx=0x7fe74000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:04.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.124+0000 7fe7477fe640 1 -- 172.21.15.40:0/3372102933 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe740017070 con 0x7fe7500c3e80 2024-04-22T07:23:04.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.124+0000 7fe7477fe640 1 -- 172.21.15.40:0/3372102933 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe74000c940 con 0x7fe7500c3e80 2024-04-22T07:23:04.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.124+0000 7fe7477fe640 1 -- 172.21.15.40:0/3372102933 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74000cd30 con 0x7fe7500c3e80 2024-04-22T07:23:04.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.124+0000 7fe754dce640 1 -- 172.21.15.40:0/3372102933 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7501f2520 con 0x7fe7500c3e80 2024-04-22T07:23:04.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.124+0000 7fe754dce640 1 -- 172.21.15.40:0/3372102933 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7501ee7e0 con 0x7fe7500c3e80 2024-04-22T07:23:04.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.125+0000 7fe754dce640 1 -- 172.21.15.40:0/3372102933 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe750069d40 con 0x7fe7500c3e80 2024-04-22T07:23:04.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.125+0000 7fe7477fe640 1 -- 172.21.15.40:0/3372102933 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe74001a070 con 0x7fe7500c3e80 2024-04-22T07:23:04.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.126+0000 7fe7477fe640 1 --2- 172.21.15.40:0/3372102933 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe73006c8f0 0x7fe73006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.126+0000 7fe7477fe640 1 -- 172.21.15.40:0/3372102933 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fe74008be40 con 0x7fe7500c3e80 2024-04-22T07:23:04.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.126+0000 7fe745d9b640 1 --2- 172.21.15.40:0/3372102933 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe73006c8f0 0x7fe73006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.127+0000 7fe745d9b640 1 --2- 172.21.15.40:0/3372102933 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe73006c8f0 0x7fe73006edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe7500c7560 tx=0x7fe738007c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:04.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.131+0000 7fe7477fe640 1 -- 172.21.15.40:0/3372102933 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe74005a1c0 con 0x7fe7500c3e80 2024-04-22T07:23:04.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.355+0000 7fe754dce640 1 -- 172.21.15.40:0/3372102933 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7500734b0 con 0x7fe7500c3e80 2024-04-22T07:23:04.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.355+0000 7fe7477fe640 1 -- 172.21.15.40:0/3372102933 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6821 (secure 0 0 0) 0x7fe740059ac0 con 0x7fe7500c3e80 2024-04-22T07:23:04.353 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:23:04.353 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1193926607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1193926607},{"type":"v1","addr":"172.21.15.62:6835","nonce":1193926607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/602167189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":602167189},{"type":"v1","addr":"172.21.15.62:6837","nonce":602167189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2062933254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2062933254},{"type":"v1","addr":"172.21.15.40:6835","nonce":2062933254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3873524978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3873524978},{"type":"v1","addr":"172.21.15.40:6837","nonce":3873524978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/1922761385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":1922761385},{"type":"v1","addr":"172.21.15.40:6839","nonce":1922761385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:20:53.216204+0000","modified":"2024-04-22T07:20:58.875393+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.62:6836/2884673656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2884673656},{"type":"v1","addr":"172.21.15.62:6836","nonce":2884673656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4305]},"id":1}]} 2024-04-22T07:23:04.353 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-04-22T07:23:04.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.357+0000 7fe754dce640 1 -- 172.21.15.40:0/3372102933 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe73006c8f0 msgr2=0x7fe73006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:04.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.357+0000 7fe754dce640 1 --2- 172.21.15.40:0/3372102933 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe73006c8f0 0x7fe73006edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe7500c7560 tx=0x7fe738007c00 comp rx=0 tx=0).stop 2024-04-22T07:23:04.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.357+0000 7fe754dce640 1 -- 172.21.15.40:0/3372102933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7500c3e80 msgr2=0x7fe7501f1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:04.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.357+0000 7fe754dce640 1 --2- 172.21.15.40:0/3372102933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7500c3e80 0x7fe7501f1bb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe74000e8a0 tx=0x7fe74000ed60 comp rx=0 tx=0).stop 2024-04-22T07:23:04.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.357+0000 7fe754dce640 1 -- 172.21.15.40:0/3372102933 shutdown_connections 2024-04-22T07:23:04.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.357+0000 7fe754dce640 1 --2- 172.21.15.40:0/3372102933 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe75015c1d0 0x7fe7500cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.357+0000 7fe754dce640 1 --2- 172.21.15.40:0/3372102933 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe750152eb0 0x7fe7501eefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.357+0000 7fe754dce640 1 --2- 172.21.15.40:0/3372102933 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe73006c8f0 0x7fe73006edb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.357+0000 7fe754dce640 1 --2- 172.21.15.40:0/3372102933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7500c3e80 0x7fe7501f1bb0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.357+0000 7fe754dce640 1 -- 172.21.15.40:0/3372102933 >> 172.21.15.40:0/3372102933 conn(0x7fe7500cdb70 msgr2=0x7fe7500ca100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:23:04.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.357+0000 7fe754dce640 1 -- 172.21.15.40:0/3372102933 shutdown_connections 2024-04-22T07:23:04.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.357+0000 7fe754dce640 1 -- 172.21.15.40:0/3372102933 wait complete. 2024-04-22T07:23:04.366 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4305 quiesce db --set-id 73cec0c --release --await' 2024-04-22T07:23:04.366 DEBUG:teuthology.orchestra.run.smithi040:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4305 quiesce db --set-id 73cec0c --release --await 2024-04-22T07:23:04.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.476+0000 7f12a04b3640 1 Processor -- start 2024-04-22T07:23:04.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.476+0000 7f12a04b3640 1 -- start start 2024-04-22T07:23:04.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.477+0000 7f12a04b3640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1298154fb0 0x7f1298072d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.477+0000 7f12a04b3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f12980caee0 0x7f129815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.477+0000 7f12a04b3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12980ccd80 con 0x7f129815e830 2024-04-22T07:23:04.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.477+0000 7f12a04b3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f12980c5c50 con 0x7f12980caee0 2024-04-22T07:23:04.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.477+0000 7f12a04b3640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f12980cc7e0 con 0x7f1298154fb0 2024-04-22T07:23:04.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.477+0000 7f129da4e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f12980caee0 0x7f129815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.477+0000 7f129ea50640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f129815e830 0x7f12980d09f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45230/0 (socket says 172.21.15.40:45230) 2024-04-22T07:23:04.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.477+0000 7f129ea50640 1 -- 172.21.15.40:0/3924908817 learned_addr learned my addr 172.21.15.40:0/3924908817 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:23:04.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.477+0000 7f129e24f640 1 --2- 172.21.15.40:0/3924908817 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1298154fb0 0x7f1298072d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.477+0000 7f129da4e640 1 -- 172.21.15.40:0/3924908817 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1298154fb0 msgr2=0x7f1298072d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:04.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.477+0000 7f129da4e640 1 --2- 172.21.15.40:0/3924908817 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1298154fb0 0x7f1298072d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.477+0000 7f129da4e640 1 -- 172.21.15.40:0/3924908817 >> v1:172.21.15.40:6789/0 conn(0x7f129815e830 legacy=0x7f12980d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:04.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.477+0000 7f129da4e640 1 -- 172.21.15.40:0/3924908817 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12980ccaa0 con 0x7f12980caee0 2024-04-22T07:23:04.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.477+0000 7f129e24f640 1 --2- 172.21.15.40:0/3924908817 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1298154fb0 0x7f1298072d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:23:04.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.478+0000 7f129da4e640 1 --2- 172.21.15.40:0/3924908817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12980caee0 0x7f129815e2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f12880097a0 tx=0x7f128802b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3176f1d5aa22de40 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:04.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.478+0000 7f129d24d640 1 -- 172.21.15.40:0/3924908817 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1288034070 con 0x7f12980caee0 2024-04-22T07:23:04.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.478+0000 7f129d24d640 1 -- 172.21.15.40:0/3924908817 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1288030800 con 0x7f12980caee0 2024-04-22T07:23:04.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.478+0000 7f129d24d640 1 -- 172.21.15.40:0/3924908817 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1288030bd0 con 0x7f12980caee0 2024-04-22T07:23:04.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.479+0000 7f12a04b3640 1 -- 172.21.15.40:0/3924908817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12980caee0 msgr2=0x7f129815e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:04.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.479+0000 7f12a04b3640 1 --2- 172.21.15.40:0/3924908817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12980caee0 0x7f129815e2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f12880097a0 tx=0x7f128802b940 comp rx=0 tx=0).stop 2024-04-22T07:23:04.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.479+0000 7f12a04b3640 1 -- 172.21.15.40:0/3924908817 shutdown_connections 2024-04-22T07:23:04.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.479+0000 7f12a04b3640 1 --2- 172.21.15.40:0/3924908817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12980caee0 0x7f129815e2f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.479+0000 7f12a04b3640 1 --2- 172.21.15.40:0/3924908817 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1298154fb0 0x7f1298072d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.479+0000 7f12a04b3640 1 -- 172.21.15.40:0/3924908817 >> 172.21.15.40:0/3924908817 conn(0x7f12980676b0 msgr2=0x7f1298067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:23:04.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.479+0000 7f12a04b3640 1 -- 172.21.15.40:0/3924908817 shutdown_connections 2024-04-22T07:23:04.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.479+0000 7f12a04b3640 1 -- 172.21.15.40:0/3924908817 wait complete. 2024-04-22T07:23:04.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.480+0000 7f12a04b3640 1 Processor -- start 2024-04-22T07:23:04.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.480+0000 7f12a04b3640 1 -- start start 2024-04-22T07:23:04.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.480+0000 7f12a04b3640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12980caee0 0x7f1298149740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.480+0000 7f12a04b3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1298154fb0 0x7f12981f4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.481+0000 7f12a04b3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f129815e830 0x7f12981f0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.481+0000 7f12a04b3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f12980cbe90 con 0x7f1298154fb0 2024-04-22T07:23:04.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.481+0000 7f12a04b3640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f12980cbbb0 con 0x7f129815e830 2024-04-22T07:23:04.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.481+0000 7f12a04b3640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f12980cc170 con 0x7f12980caee0 2024-04-22T07:23:04.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.481+0000 7f129da4e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1298154fb0 0x7f12981f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.481+0000 7f129da4e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1298154fb0 0x7f12981f4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35918/0 (socket says 172.21.15.40:35918) 2024-04-22T07:23:04.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.481+0000 7f129da4e640 1 -- 172.21.15.40:0/2647826767 learned_addr learned my addr 172.21.15.40:0/2647826767 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:23:04.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.481+0000 7f129e24f640 1 --2- 172.21.15.40:0/2647826767 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12980caee0 0x7f1298149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.481+0000 7f129ea50640 1 --2- 172.21.15.40:0/2647826767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f129815e830 0x7f12981f0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.481+0000 7f129da4e640 1 -- 172.21.15.40:0/2647826767 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12980caee0 msgr2=0x7f1298149740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:04.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.481+0000 7f129da4e640 1 --2- 172.21.15.40:0/2647826767 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12980caee0 0x7f1298149740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.481+0000 7f129da4e640 1 -- 172.21.15.40:0/2647826767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f129815e830 msgr2=0x7f12981f0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:04.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.481+0000 7f129da4e640 1 --2- 172.21.15.40:0/2647826767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f129815e830 0x7f12981f0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.481+0000 7f129da4e640 1 -- 172.21.15.40:0/2647826767 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f129815e520 con 0x7f1298154fb0 2024-04-22T07:23:04.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.481+0000 7f129da4e640 1 --2- 172.21.15.40:0/2647826767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1298154fb0 0x7f12981f4510 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f128802bf50 tx=0x7f12880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:04.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.481+0000 7f128effd640 1 -- 172.21.15.40:0/2647826767 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1288034040 con 0x7f1298154fb0 2024-04-22T07:23:04.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.481+0000 7f128effd640 1 -- 172.21.15.40:0/2647826767 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1288030600 con 0x7f1298154fb0 2024-04-22T07:23:04.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.481+0000 7f128effd640 1 -- 172.21.15.40:0/2647826767 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12880423f0 con 0x7f1298154fb0 2024-04-22T07:23:04.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.481+0000 7f12a04b3640 1 -- 172.21.15.40:0/2647826767 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12981e40f0 con 0x7f1298154fb0 2024-04-22T07:23:04.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.481+0000 7f12a04b3640 1 -- 172.21.15.40:0/2647826767 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12981e46b0 con 0x7f1298154fb0 2024-04-22T07:23:04.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.483+0000 7f128effd640 1 -- 172.21.15.40:0/2647826767 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1288037070 con 0x7f1298154fb0 2024-04-22T07:23:04.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.484+0000 7f128effd640 1 --2- 172.21.15.40:0/2647826767 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f127c06c8f0 0x7f127c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.484+0000 7f129e24f640 1 --2- 172.21.15.40:0/2647826767 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f127c06c8f0 0x7f127c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.484+0000 7f128effd640 1 -- 172.21.15.40:0/2647826767 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f12880adc90 con 0x7f1298154fb0 2024-04-22T07:23:04.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.484+0000 7f129e24f640 1 --2- 172.21.15.40:0/2647826767 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f127c06c8f0 0x7f127c06edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f129400ab60 tx=0x7f1294008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:04.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.485+0000 7f12a317f740 1 Processor -- start 2024-04-22T07:23:04.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.485+0000 7f12a317f740 1 -- start start 2024-04-22T07:23:04.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.485+0000 7f12a317f740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d6c722f7d0 0x55d6c722fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.485+0000 7f12a317f740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55d6c72192d0 0x55d6c7230900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.485+0000 7f12a317f740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6c71ee810 0x55d6c7230e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.485+0000 7f12a317f740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55d6c7155500 con 0x55d6c71ee810 2024-04-22T07:23:04.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.485+0000 7f12a317f740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d6c70fb6a0 con 0x55d6c722f7d0 2024-04-22T07:23:04.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.485+0000 7f12a317f740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55d6c71514c0 con 0x55d6c72192d0 2024-04-22T07:23:04.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.486+0000 7f129ea50640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6c71ee810 0x55d6c7230e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.486+0000 7f129e24f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d6c722f7d0 0x55d6c722fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.486+0000 7f129ea50640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6c71ee810 0x55d6c7230e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35934/0 (socket says 172.21.15.40:35934) 2024-04-22T07:23:04.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.486+0000 7f129ea50640 1 -- 172.21.15.40:0/2295377558 learned_addr learned my addr 172.21.15.40:0/2295377558 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:23:04.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.486+0000 7f129da4e640 1 --2- 172.21.15.40:0/2295377558 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55d6c72192d0 0x55d6c7230900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.486+0000 7f129ea50640 1 -- 172.21.15.40:0/2295377558 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55d6c72192d0 msgr2=0x55d6c7230900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:04.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.486+0000 7f129ea50640 1 --2- 172.21.15.40:0/2295377558 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55d6c72192d0 0x55d6c7230900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.486+0000 7f129ea50640 1 -- 172.21.15.40:0/2295377558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d6c722f7d0 msgr2=0x55d6c722fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:04.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.486+0000 7f129ea50640 1 --2- 172.21.15.40:0/2295377558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d6c722f7d0 0x55d6c722fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.486+0000 7f129ea50640 1 -- 172.21.15.40:0/2295377558 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6c711a5e0 con 0x55d6c71ee810 2024-04-22T07:23:04.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.486+0000 7f129ea50640 1 --2- 172.21.15.40:0/2295377558 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6c71ee810 0x55d6c7230e40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1290002210 tx=0x7f1290001950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89f5c620a5a389b server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:04.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.486+0000 7f127bfff640 1 -- 172.21.15.40:0/2295377558 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12900070d0 con 0x55d6c71ee810 2024-04-22T07:23:04.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.486+0000 7f127bfff640 1 -- 172.21.15.40:0/2295377558 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1290018070 con 0x55d6c71ee810 2024-04-22T07:23:04.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.486+0000 7f127bfff640 1 -- 172.21.15.40:0/2295377558 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1290007470 con 0x55d6c71ee810 2024-04-22T07:23:04.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.487+0000 7f12a317f740 1 -- 172.21.15.40:0/2295377558 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6c71ee810 msgr2=0x55d6c7230e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:04.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.487+0000 7f12a317f740 1 --2- 172.21.15.40:0/2295377558 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6c71ee810 0x55d6c7230e40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1290002210 tx=0x7f1290001950 comp rx=0 tx=0).stop 2024-04-22T07:23:04.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.487+0000 7f12a317f740 1 -- 172.21.15.40:0/2295377558 shutdown_connections 2024-04-22T07:23:04.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.487+0000 7f12a317f740 1 --2- 172.21.15.40:0/2295377558 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6c71ee810 0x55d6c7230e40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.487+0000 7f12a317f740 1 --2- 172.21.15.40:0/2295377558 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55d6c72192d0 0x55d6c7230900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.487+0000 7f12a317f740 1 --2- 172.21.15.40:0/2295377558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d6c722f7d0 0x55d6c722fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.487+0000 7f12a317f740 1 -- 172.21.15.40:0/2295377558 >> 172.21.15.40:0/2295377558 conn(0x55d6c71ec550 msgr2=0x55d6c71eee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:23:04.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.487+0000 7f12a317f740 1 -- 172.21.15.40:0/2295377558 shutdown_connections 2024-04-22T07:23:04.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.487+0000 7f12a317f740 1 -- 172.21.15.40:0/2295377558 wait complete. 2024-04-22T07:23:04.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.487+0000 7f12a317f740 1 -- start start 2024-04-22T07:23:04.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.488+0000 7f12a317f740 1 Processor -- start 2024-04-22T07:23:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.488+0000 7f12a317f740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d6c72192d0 0x55d6c7234e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.488+0000 7f12a317f740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6c722f7d0 0x55d6c7236e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.488+0000 7f12a317f740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55d6c7237aa0 0x55d6c720d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.488+0000 7f12a317f740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55d6c71edc30 con 0x55d6c722f7d0 2024-04-22T07:23:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.488+0000 7f12a317f740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d6c710ea60 con 0x55d6c72192d0 2024-04-22T07:23:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.488+0000 7f12a317f740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55d6c72197a0 con 0x55d6c7237aa0 2024-04-22T07:23:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.488+0000 7f12a317f740 10 client.0 _ll_register_callbacks cb 0x55d6c6e67110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:23:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.489+0000 7f129da4e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6c722f7d0 0x55d6c7236e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.489+0000 7f129da4e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6c722f7d0 0x55d6c7236e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35946/0 (socket says 172.21.15.40:35946) 2024-04-22T07:23:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.489+0000 7f129da4e640 1 -- 172.21.15.40:0/4257603915 learned_addr learned my addr 172.21.15.40:0/4257603915 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:23:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.489+0000 7f129ea50640 1 --2- 172.21.15.40:0/4257603915 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55d6c7237aa0 0x55d6c720d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.489+0000 7f129e24f640 1 --2- 172.21.15.40:0/4257603915 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d6c72192d0 0x55d6c7234e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.489+0000 7f129da4e640 1 -- 172.21.15.40:0/4257603915 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55d6c7237aa0 msgr2=0x55d6c720d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:04.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.489+0000 7f129da4e640 1 --2- 172.21.15.40:0/4257603915 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55d6c7237aa0 0x55d6c720d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.489+0000 7f129da4e640 1 -- 172.21.15.40:0/4257603915 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d6c72192d0 msgr2=0x55d6c7234e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.489+0000 7f129da4e640 1 --2- 172.21.15.40:0/4257603915 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d6c72192d0 0x55d6c7234e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.489+0000 7f129da4e640 1 -- 172.21.15.40:0/4257603915 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6c6e67920 con 0x55d6c722f7d0 2024-04-22T07:23:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.489+0000 7f129ea50640 1 --2- 172.21.15.40:0/4257603915 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55d6c7237aa0 0x55d6c720d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:23:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.489+0000 7f129da4e640 1 --2- 172.21.15.40:0/4257603915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6c722f7d0 0x55d6c7236e60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1288077eb0 tx=0x7f12880307d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c3e96f9f18f68a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.489+0000 7f12797fa640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-04-22T07:23:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.489+0000 7f12797fa640 1 -- 172.21.15.40:0/4257603915 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1288003810 con 0x55d6c722f7d0 2024-04-22T07:23:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.489+0000 7f12797fa640 1 -- 172.21.15.40:0/4257603915 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f12880840f0 con 0x55d6c722f7d0 2024-04-22T07:23:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.489+0000 7f12a317f740 1 -- 172.21.15.40:0/4257603915 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1290018070 con 0x55d6c722f7d0 2024-04-22T07:23:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.489+0000 7f12797fa640 1 -- 172.21.15.40:0/4257603915 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f1288084580 con 0x55d6c722f7d0 2024-04-22T07:23:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.489+0000 7f12a317f740 10 client.4986 fetch_fsmap learned FSMap version 8 2024-04-22T07:23:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.490+0000 7f12a317f740 1 -- 172.21.15.40:0/4257603915 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55d6c6f33d30 con 0x55d6c722f7d0 2024-04-22T07:23:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.490+0000 7f12797fa640 1 -- 172.21.15.40:0/4257603915 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1288095080 con 0x55d6c722f7d0 2024-04-22T07:23:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.490+0000 7f12797fa640 1 -- 172.21.15.40:0/4257603915 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f1288041070 con 0x55d6c722f7d0 2024-04-22T07:23:04.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.490+0000 7f12a317f740 10 client.4986 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:23:04.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.490+0000 7f12a317f740 10 client.4986 resolve_mds: validated gid 4305 aka daemon mds.b 2024-04-22T07:23:04.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.490+0000 7f12a317f740 20 client.4986 populate_metadata read hostname 'smithi040' 2024-04-22T07:23:04.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.490+0000 7f12a317f740 1 --2- 172.21.15.40:0/4257603915 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55d6c720a900 0x55d6c7243da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.490+0000 7f12a317f740 4 client.4986 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T07:23:04.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.490+0000 7f12a317f740 1 -- 172.21.15.40:0/4257603915 --> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6c7128a10 con 0x55d6c720a900 2024-04-22T07:23:04.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.490+0000 7f129e24f640 1 --2- 172.21.15.40:0/4257603915 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55d6c720a900 0x55d6c7243da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.490+0000 7f12797fa640 10 client.4986 ms_handle_connect on v2:172.21.15.62:6833/2884673656 2024-04-22T07:23:04.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.490+0000 7f129e24f640 1 --2- 172.21.15.40:0/4257603915 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55d6c720a900 0x55d6c7243da0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=528a9cfdca68b6b0 server_cookie=a404474599b7e005 in_seq=0 out_seq=0 2024-04-22T07:23:04.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.491+0000 7f12797fa640 1 -- 172.21.15.40:0/4257603915 <== mds.0 v2:172.21.15.62:6833/2884673656 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d6c7128a10 con 0x55d6c720a900 2024-04-22T07:23:04.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.491+0000 7f12797fa640 10 client.4986 handle_command_reply: tid=0 2024-04-22T07:23:04.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.491+0000 7f12a317f740 1 client.4986 shutdown 2024-04-22T07:23:04.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.491+0000 7f12a317f740 1 -- 172.21.15.40:0/4257603915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6c722f7d0 msgr2=0x55d6c7236e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:04.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.491+0000 7f12a317f740 1 --2- 172.21.15.40:0/4257603915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6c722f7d0 0x55d6c7236e60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1288077eb0 tx=0x7f12880307d0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.491+0000 7f12a317f740 1 -- 172.21.15.40:0/4257603915 shutdown_connections 2024-04-22T07:23:04.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.491+0000 7f12a317f740 1 --2- 172.21.15.40:0/4257603915 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55d6c720a900 0x55d6c7243da0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.491+0000 7f12a317f740 1 --2- 172.21.15.40:0/4257603915 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55d6c7237aa0 0x55d6c720d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.491+0000 7f12a317f740 1 --2- 172.21.15.40:0/4257603915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6c722f7d0 0x55d6c7236e60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.491+0000 7f12a317f740 1 --2- 172.21.15.40:0/4257603915 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d6c72192d0 0x55d6c7234e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.491+0000 7f12797fa640 0 client.4986 ms_handle_reset on v2:172.21.15.62:6833/2884673656 2024-04-22T07:23:04.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.491+0000 7f12a317f740 1 -- 172.21.15.40:0/4257603915 >> 172.21.15.40:0/4257603915 conn(0x55d6c71ee810 msgr2=0x55d6c7230870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:23:04.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.491+0000 7f12a317f740 1 -- 172.21.15.40:0/4257603915 shutdown_connections 2024-04-22T07:23:04.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.491+0000 7f12a317f740 1 -- 172.21.15.40:0/4257603915 wait complete. 2024-04-22T07:23:04.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.492+0000 7f12a317f740 20 client.4986 trim_cache size 0 max 16384 2024-04-22T07:23:04.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.509+0000 7f12a317f740 1 Processor -- start 2024-04-22T07:23:04.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.509+0000 7f12a317f740 1 -- start start 2024-04-22T07:23:04.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.510+0000 7f12a317f740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55d6c72192d0 0x55d6c72340a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.510+0000 7f12a317f740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d6c722f7d0 0x55d6c7241e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.510+0000 7f12a317f740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6c7237aa0 0x55d6c7242360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.510+0000 7f12a317f740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f12981fe050 con 0x55d6c7237aa0 2024-04-22T07:23:04.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.510+0000 7f12a317f740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f12981fcf30 con 0x55d6c722f7d0 2024-04-22T07:23:04.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.510+0000 7f12a317f740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f12981e7c40 con 0x55d6c72192d0 2024-04-22T07:23:04.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.510+0000 7f129ea50640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6c7237aa0 0x55d6c7242360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.510+0000 7f129ea50640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6c7237aa0 0x55d6c7242360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35958/0 (socket says 172.21.15.40:35958) 2024-04-22T07:23:04.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.510+0000 7f129ea50640 1 -- 172.21.15.40:0/4043120533 learned_addr learned my addr 172.21.15.40:0/4043120533 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:23:04.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.510+0000 7f129ea50640 1 -- 172.21.15.40:0/4043120533 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55d6c72192d0 msgr2=0x55d6c72340a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:04.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.510+0000 7f129ea50640 1 --2- 172.21.15.40:0/4043120533 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55d6c72192d0 0x55d6c72340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.510+0000 7f129ea50640 1 -- 172.21.15.40:0/4043120533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d6c722f7d0 msgr2=0x55d6c7241e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:04.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.510+0000 7f129ea50640 1 --2- 172.21.15.40:0/4043120533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d6c722f7d0 0x55d6c7241e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.510+0000 7f129ea50640 1 -- 172.21.15.40:0/4043120533 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6c7235240 con 0x55d6c7237aa0 2024-04-22T07:23:04.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.510+0000 7f129ea50640 1 --2- 172.21.15.40:0/4043120533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6c7237aa0 0x55d6c7242360 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f129000faf0 tx=0x7f129000a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b87810fac368a75 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:04.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.510+0000 7f127b7fe640 1 -- 172.21.15.40:0/4043120533 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12900072e0 con 0x55d6c7237aa0 2024-04-22T07:23:04.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.511+0000 7f127b7fe640 1 -- 172.21.15.40:0/4043120533 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1290007480 con 0x55d6c7237aa0 2024-04-22T07:23:04.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.511+0000 7f127b7fe640 1 -- 172.21.15.40:0/4043120533 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1290007870 con 0x55d6c7237aa0 2024-04-22T07:23:04.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.511+0000 7f12a317f740 1 -- 172.21.15.40:0/4043120533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6c7237aa0 msgr2=0x55d6c7242360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:04.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.511+0000 7f12a317f740 1 --2- 172.21.15.40:0/4043120533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6c7237aa0 0x55d6c7242360 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f129000faf0 tx=0x7f129000a000 comp rx=0 tx=0).stop 2024-04-22T07:23:04.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.511+0000 7f12a317f740 1 -- 172.21.15.40:0/4043120533 shutdown_connections 2024-04-22T07:23:04.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.511+0000 7f12a317f740 1 --2- 172.21.15.40:0/4043120533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6c7237aa0 0x55d6c7242360 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.511+0000 7f12a317f740 1 --2- 172.21.15.40:0/4043120533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d6c722f7d0 0x55d6c7241e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.511+0000 7f12a317f740 1 --2- 172.21.15.40:0/4043120533 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55d6c72192d0 0x55d6c72340a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.511+0000 7f12a317f740 1 -- 172.21.15.40:0/4043120533 >> 172.21.15.40:0/4043120533 conn(0x55d6c71ee810 msgr2=0x55d6c720ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:23:04.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.511+0000 7f12a317f740 1 -- 172.21.15.40:0/4043120533 shutdown_connections 2024-04-22T07:23:04.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.511+0000 7f12a317f740 1 -- 172.21.15.40:0/4043120533 wait complete. 2024-04-22T07:23:04.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.512+0000 7f12a317f740 1 -- start start 2024-04-22T07:23:04.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.512+0000 7f12a317f740 1 Processor -- start 2024-04-22T07:23:04.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.513+0000 7f12a317f740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6c72192d0 0x55d6c720b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.513+0000 7f12a317f740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d6c722f7d0 0x55d6c72abe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.513+0000 7f12a317f740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55d6c7237aa0 0x55d6c7239f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.513+0000 7f12a317f740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f12980d09c0 con 0x55d6c72192d0 2024-04-22T07:23:04.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.513+0000 7f12a317f740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f12981fc860 con 0x55d6c722f7d0 2024-04-22T07:23:04.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.513+0000 7f12a317f740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f12981fc390 con 0x55d6c7237aa0 2024-04-22T07:23:04.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.513+0000 7f12a317f740 10 client.0 _ll_register_callbacks cb 0x7f1288009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:23:04.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.513+0000 7f129e24f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6c72192d0 0x55d6c720b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.513+0000 7f129e24f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6c72192d0 0x55d6c720b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35970/0 (socket says 172.21.15.40:35970) 2024-04-22T07:23:04.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.513+0000 7f129e24f640 1 -- 172.21.15.40:0/928453747 learned_addr learned my addr 172.21.15.40:0/928453747 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:23:04.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.513+0000 7f129da4e640 1 --2- 172.21.15.40:0/928453747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d6c722f7d0 0x55d6c72abe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.513+0000 7f129ea50640 1 --2- 172.21.15.40:0/928453747 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55d6c7237aa0 0x55d6c7239f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.513+0000 7f129e24f640 1 -- 172.21.15.40:0/928453747 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55d6c7237aa0 msgr2=0x55d6c7239f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:04.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.513+0000 7f129e24f640 1 --2- 172.21.15.40:0/928453747 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55d6c7237aa0 0x55d6c7239f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.513+0000 7f129e24f640 1 -- 172.21.15.40:0/928453747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d6c722f7d0 msgr2=0x55d6c72abe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:04.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.513+0000 7f129e24f640 1 --2- 172.21.15.40:0/928453747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d6c722f7d0 0x55d6c72abe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.513+0000 7f129e24f640 1 -- 172.21.15.40:0/928453747 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6c720d4c0 con 0x55d6c72192d0 2024-04-22T07:23:04.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.513+0000 7f129e24f640 1 --2- 172.21.15.40:0/928453747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6c72192d0 0x55d6c720b960 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f129400f6d0 tx=0x7f1294004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae1599e56001ac99 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:04.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.513+0000 7f12797fa640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-04-22T07:23:04.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.513+0000 7f12797fa640 1 -- 172.21.15.40:0/928453747 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129401b040 con 0x55d6c72192d0 2024-04-22T07:23:04.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.513+0000 7f12797fa640 1 -- 172.21.15.40:0/928453747 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f1294003df0 con 0x55d6c72192d0 2024-04-22T07:23:04.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.513+0000 7f12a317f740 1 -- 172.21.15.40:0/928453747 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1290007480 con 0x55d6c72192d0 2024-04-22T07:23:04.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.513+0000 7f12797fa640 1 -- 172.21.15.40:0/928453747 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f1294037050 con 0x55d6c72192d0 2024-04-22T07:23:04.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.513+0000 7f12a317f740 10 client.4992 fetch_fsmap learned FSMap version 8 2024-04-22T07:23:04.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.513+0000 7f12a317f740 1 -- 172.21.15.40:0/928453747 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55d6c7231090 con 0x55d6c72192d0 2024-04-22T07:23:04.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.514+0000 7f12797fa640 1 -- 172.21.15.40:0/928453747 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1290007480 con 0x55d6c72192d0 2024-04-22T07:23:04.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.514+0000 7f12797fa640 1 -- 172.21.15.40:0/928453747 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f129403a020 con 0x55d6c72192d0 2024-04-22T07:23:04.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.514+0000 7f12a317f740 10 client.4992 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:23:04.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.514+0000 7f12a317f740 10 client.4992 resolve_mds: validated gid 4305 aka daemon mds.b 2024-04-22T07:23:04.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.514+0000 7f12a317f740 20 client.4992 populate_metadata read hostname 'smithi040' 2024-04-22T07:23:04.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.514+0000 7f12a317f740 1 --2- 172.21.15.40:0/928453747 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55d6c723a460 0x55d6c72a5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.514+0000 7f12a317f740 4 client.4992 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "73cec0c", "release": true, "await": true}] 2024-04-22T07:23:04.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.514+0000 7f12a317f740 1 -- 172.21.15.40:0/928453747 --> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] -- command(tid 0: {"prefix": "quiesce db", "set_id": "73cec0c", "release": true, "await": true}) -- 0x55d6c7162f20 con 0x55d6c723a460 2024-04-22T07:23:04.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.514+0000 7f129da4e640 1 --2- 172.21.15.40:0/928453747 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55d6c723a460 0x55d6c72a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.514+0000 7f12797fa640 10 client.4992 ms_handle_connect on v2:172.21.15.62:6833/2884673656 2024-04-22T07:23:04.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.514+0000 7f129da4e640 1 --2- 172.21.15.40:0/928453747 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55d6c723a460 0x55d6c72a5070 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbd50108eb1d492c server_cookie=a8fee05a467da28d in_seq=0 out_seq=0 2024-04-22T07:23:04.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.515+0000 7f12797fa640 1 -- 172.21.15.40:0/928453747 <== mds.0 v2:172.21.15.62:6833/2884673656 1 ==== command_reply(tid 0: 0 ) ==== 8+0+585 (crc 0 0 0) 0x55d6c7162f20 con 0x55d6c723a460 2024-04-22T07:23:04.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.515+0000 7f12797fa640 10 client.4992 handle_command_reply: tid=0 2024-04-22T07:23:04.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.515+0000 7f12a317f740 1 client.4992 shutdown 2024-04-22T07:23:04.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.515+0000 7f12a317f740 1 -- 172.21.15.40:0/928453747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6c72192d0 msgr2=0x55d6c720b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:04.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.515+0000 7f12a317f740 1 --2- 172.21.15.40:0/928453747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6c72192d0 0x55d6c720b960 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f129400f6d0 tx=0x7f1294004730 comp rx=0 tx=0).stop 2024-04-22T07:23:04.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.515+0000 7f12a317f740 1 -- 172.21.15.40:0/928453747 shutdown_connections 2024-04-22T07:23:04.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.515+0000 7f12a317f740 1 --2- 172.21.15.40:0/928453747 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55d6c723a460 0x55d6c72a5070 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.515+0000 7f12a317f740 1 --2- 172.21.15.40:0/928453747 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55d6c7237aa0 0x55d6c7239f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.515+0000 7f12a317f740 1 --2- 172.21.15.40:0/928453747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d6c722f7d0 0x55d6c72abe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.515+0000 7f12a317f740 1 --2- 172.21.15.40:0/928453747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55d6c72192d0 0x55d6c720b960 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.515+0000 7f12797fa640 0 client.4992 ms_handle_reset on v2:172.21.15.62:6833/2884673656 2024-04-22T07:23:04.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.515+0000 7f12a317f740 1 -- 172.21.15.40:0/928453747 >> 172.21.15.40:0/928453747 conn(0x55d6c71ee810 msgr2=0x55d6c72340a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:23:04.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.515+0000 7f12a317f740 1 -- 172.21.15.40:0/928453747 shutdown_connections 2024-04-22T07:23:04.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.515+0000 7f12a317f740 1 -- 172.21.15.40:0/928453747 wait complete. 2024-04-22T07:23:04.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.515+0000 7f12a317f740 20 client.4992 trim_cache size 0 max 16384 2024-04-22T07:23:04.519 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-22T07:23:04.519 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 8, 2024-04-22T07:23:04.519 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 4305, 2024-04-22T07:23:04.519 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 8, 2024-04-22T07:23:04.519 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-04-22T07:23:04.519 INFO:teuthology.orchestra.run.smithi040.stdout: "73cec0c": { 2024-04-22T07:23:04.519 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 8, 2024-04-22T07:23:04.519 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-04-22T07:23:04.520 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-04-22T07:23:04.520 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-04-22T07:23:04.520 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-04-22T07:23:04.520 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-22T07:23:04.520 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 60.0, 2024-04-22T07:23:04.520 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 78.8, 2024-04-22T07:23:04.520 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-04-22T07:23:04.520 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-04-22T07:23:04.520 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-04-22T07:23:04.520 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-04-22T07:23:04.520 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-04-22T07:23:04.520 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-04-22T07:23:04.520 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:23:04.520 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:23:04.521 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:23:04.521 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:23:04.521 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:23:04.521 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-22T07:23:04.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.515+0000 7f12a04b3640 1 -- 172.21.15.40:0/2647826767 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f127c06c8f0 msgr2=0x7f127c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:04.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.515+0000 7f12a04b3640 1 --2- 172.21.15.40:0/2647826767 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f127c06c8f0 0x7f127c06edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f129400ab60 tx=0x7f1294008040 comp rx=0 tx=0).stop 2024-04-22T07:23:04.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.515+0000 7f12a04b3640 1 -- 172.21.15.40:0/2647826767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1298154fb0 msgr2=0x7f12981f4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:04.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.515+0000 7f12a04b3640 1 --2- 172.21.15.40:0/2647826767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1298154fb0 0x7f12981f4510 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f128802bf50 tx=0x7f12880046c0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.516+0000 7f12a04b3640 1 -- 172.21.15.40:0/2647826767 shutdown_connections 2024-04-22T07:23:04.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.516+0000 7f12a04b3640 1 --2- 172.21.15.40:0/2647826767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f129815e830 0x7f12981f0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.516+0000 7f12a04b3640 1 --2- 172.21.15.40:0/2647826767 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f127c06c8f0 0x7f127c06edb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.516+0000 7f12a04b3640 1 --2- 172.21.15.40:0/2647826767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1298154fb0 0x7f12981f4510 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.516+0000 7f12a04b3640 1 --2- 172.21.15.40:0/2647826767 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12980caee0 0x7f1298149740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.516+0000 7f12a04b3640 1 -- 172.21.15.40:0/2647826767 >> 172.21.15.40:0/2647826767 conn(0x7f12980676b0 msgr2=0x7f12980b47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:23:04.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.516+0000 7f12a04b3640 1 -- 172.21.15.40:0/2647826767 shutdown_connections 2024-04-22T07:23:04.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.516+0000 7f12a04b3640 1 -- 172.21.15.40:0/2647826767 wait complete. 2024-04-22T07:23:04.523 INFO:tasks.workunit.client.0.smithi040.stderr:+ iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-04-22T07:23:04.524 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set_id: 73cec0c, seconds elapsed: 19.9 2024-04-22T07:23:04.525 INFO:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.8 2024-04-22T07:23:04.525 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:23:04.595 INFO:tasks.workunit.client.0.smithi040.stdout: Iozone: Performance Test of File I/O 2024-04-22T07:23:04.595 INFO:tasks.workunit.client.0.smithi040.stdout: Version $Revision: 3.494 $ 2024-04-22T07:23:04.596 INFO:tasks.workunit.client.0.smithi040.stdout: Compiled for 64 bit mode. 2024-04-22T07:23:04.596 INFO:tasks.workunit.client.0.smithi040.stdout: Build: linux-AMD64 2024-04-22T07:23:04.596 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:23:04.596 INFO:tasks.workunit.client.0.smithi040.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-04-22T07:23:04.596 INFO:tasks.workunit.client.0.smithi040.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-04-22T07:23:04.596 INFO:tasks.workunit.client.0.smithi040.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-04-22T07:23:04.596 INFO:tasks.workunit.client.0.smithi040.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-04-22T07:23:04.596 INFO:tasks.workunit.client.0.smithi040.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-04-22T07:23:04.596 INFO:tasks.workunit.client.0.smithi040.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-04-22T07:23:04.596 INFO:tasks.workunit.client.0.smithi040.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-04-22T07:23:04.596 INFO:tasks.workunit.client.0.smithi040.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-04-22T07:23:04.596 INFO:tasks.workunit.client.0.smithi040.stdout: Alexey Skidanov, Sudhir Kumar. 2024-04-22T07:23:04.597 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:23:04.597 INFO:tasks.workunit.client.0.smithi040.stdout: Run began: Mon Apr 22 07:23:04 2024 2024-04-22T07:23:04.597 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:23:04.597 INFO:tasks.workunit.client.0.smithi040.stdout: Include close in write timing 2024-04-22T07:23:04.597 INFO:tasks.workunit.client.0.smithi040.stdout: Include fsync in write timing 2024-04-22T07:23:04.597 INFO:tasks.workunit.client.0.smithi040.stdout: File size set to 1048576 kB 2024-04-22T07:23:04.597 INFO:tasks.workunit.client.0.smithi040.stdout: Record Size 16 kB 2024-04-22T07:23:04.597 INFO:tasks.workunit.client.0.smithi040.stdout: Command line used: iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-04-22T07:23:04.597 INFO:tasks.workunit.client.0.smithi040.stdout: Output is in kBytes/sec 2024-04-22T07:23:04.597 INFO:tasks.workunit.client.0.smithi040.stdout: Time Resolution = 0.000001 seconds. 2024-04-22T07:23:04.597 INFO:tasks.workunit.client.0.smithi040.stdout: Processor cache size set to 1024 kBytes. 2024-04-22T07:23:04.597 INFO:tasks.workunit.client.0.smithi040.stdout: Processor cache line size set to 32 bytes. 2024-04-22T07:23:04.597 INFO:tasks.workunit.client.0.smithi040.stdout: File stride size set to 17 * record size. 2024-04-22T07:23:04.598 INFO:tasks.workunit.client.0.smithi040.stdout: Throughput test with 1 process 2024-04-22T07:23:04.598 INFO:tasks.workunit.client.0.smithi040.stdout: Each process writes a 1048576 kByte file in 16 kByte records 2024-04-22T07:23:04.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.632+0000 7f6a74214640 1 Processor -- start 2024-04-22T07:23:04.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.632+0000 7f6a74214640 1 -- start start 2024-04-22T07:23:04.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.633+0000 7f6a74214640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6a6c0d0590 0x7f6a6c0d09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.633+0000 7f6a74214640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a6c15e6e0 con 0x7f6a6c15b3e0 2024-04-22T07:23:04.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.633+0000 7f6a74214640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a6c15e9c0 con 0x7f6a6c154f50 2024-04-22T07:23:04.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.633+0000 7f6a74214640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f6a6c15af50 con 0x7f6a6c0d0590 2024-04-22T07:23:04.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.633+0000 7f6a727b1640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6a6c15b3e0 0x7f6a6c15b850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45232/0 (socket says 172.21.15.40:45232) 2024-04-22T07:23:04.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.633+0000 7f6a727b1640 1 -- 172.21.15.40:0/1835416498 learned_addr learned my addr 172.21.15.40:0/1835416498 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:23:04.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.633+0000 7f6a717af640 1 --2- 172.21.15.40:0/1835416498 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6a6c0d0590 0x7f6a6c0d09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.634+0000 7f6a70fae640 1 -- 172.21.15.40:0/1835416498 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3637099977 0 0) 0x7f6a6c15e6e0 con 0x7f6a6c15b3e0 2024-04-22T07:23:04.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.634+0000 7f6a70fae640 1 -- 172.21.15.40:0/1835416498 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a58003520 con 0x7f6a6c15b3e0 2024-04-22T07:23:04.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.634+0000 7f6a70fae640 1 -- 172.21.15.40:0/1835416498 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2567772226 0 0) 0x7f6a6c15e9c0 con 0x7f6a6c154f50 2024-04-22T07:23:04.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.634+0000 7f6a70fae640 1 -- 172.21.15.40:0/1835416498 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a6c15e6e0 con 0x7f6a6c154f50 2024-04-22T07:23:04.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.634+0000 7f6a717af640 1 -- 172.21.15.40:0/1835416498 >> v1:172.21.15.62:6789/0 conn(0x7f6a6c154f50 legacy=0x7f6a6c0cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:04.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.634+0000 7f6a717af640 1 -- 172.21.15.40:0/1835416498 >> v1:172.21.15.40:6789/0 conn(0x7f6a6c15b3e0 legacy=0x7f6a6c15b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:04.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.634+0000 7f6a717af640 1 -- 172.21.15.40:0/1835416498 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6c15eca0 con 0x7f6a6c0d0590 2024-04-22T07:23:04.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.635+0000 7f6a717af640 1 --2- 172.21.15.40:0/1835416498 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6a6c0d0590 0x7f6a6c0d09b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0097d0 tx=0x7f6a5c02b9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83e4a9e7230ca49b server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:04.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.635+0000 7f6a70fae640 1 -- 172.21.15.40:0/1835416498 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c034070 con 0x7f6a6c0d0590 2024-04-22T07:23:04.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.635+0000 7f6a70fae640 1 -- 172.21.15.40:0/1835416498 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a5c030890 con 0x7f6a6c0d0590 2024-04-22T07:23:04.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.635+0000 7f6a70fae640 1 -- 172.21.15.40:0/1835416498 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c030c40 con 0x7f6a6c0d0590 2024-04-22T07:23:04.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.636+0000 7f6a74214640 1 -- 172.21.15.40:0/1835416498 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6a6c0d0590 msgr2=0x7f6a6c0d09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:04.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.636+0000 7f6a74214640 1 --2- 172.21.15.40:0/1835416498 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6a6c0d0590 0x7f6a6c0d09b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0097d0 tx=0x7f6a5c02b9d0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.636+0000 7f6a74214640 1 -- 172.21.15.40:0/1835416498 shutdown_connections 2024-04-22T07:23:04.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.636+0000 7f6a74214640 1 --2- 172.21.15.40:0/1835416498 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6a6c0d0590 0x7f6a6c0d09b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.636+0000 7f6a74214640 1 -- 172.21.15.40:0/1835416498 >> 172.21.15.40:0/1835416498 conn(0x7f6a6c0676b0 msgr2=0x7f6a6c067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:23:04.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.636+0000 7f6a74214640 1 -- 172.21.15.40:0/1835416498 shutdown_connections 2024-04-22T07:23:04.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.636+0000 7f6a74214640 1 -- 172.21.15.40:0/1835416498 wait complete. 2024-04-22T07:23:04.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.637+0000 7f6a74214640 1 Processor -- start 2024-04-22T07:23:04.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.637+0000 7f6a74214640 1 -- start start 2024-04-22T07:23:04.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.638+0000 7f6a74214640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a6c0d0590 0x7f6a6c15a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.638+0000 7f6a74214640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6a6c154f50 0x7f6a6c1e6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.638+0000 7f6a74214640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a6c15b3e0 0x7f6a6c158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.638+0000 7f6a74214640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c15e3a0 con 0x7f6a6c0d0590 2024-04-22T07:23:04.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.638+0000 7f6a74214640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c15f260 con 0x7f6a6c15b3e0 2024-04-22T07:23:04.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.638+0000 7f6a74214640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f6a6c0cc770 con 0x7f6a6c154f50 2024-04-22T07:23:04.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.638+0000 7f6a71fb0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a6c0d0590 0x7f6a6c15a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.638+0000 7f6a71fb0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a6c0d0590 0x7f6a6c15a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35972/0 (socket says 172.21.15.40:35972) 2024-04-22T07:23:04.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.638+0000 7f6a71fb0640 1 -- 172.21.15.40:0/2145958355 learned_addr learned my addr 172.21.15.40:0/2145958355 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:23:04.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.638+0000 7f6a717af640 1 --2- 172.21.15.40:0/2145958355 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6a6c154f50 0x7f6a6c1e6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.638+0000 7f6a727b1640 1 --2- 172.21.15.40:0/2145958355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a6c15b3e0 0x7f6a6c158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.638+0000 7f6a71fb0640 1 -- 172.21.15.40:0/2145958355 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6a6c154f50 msgr2=0x7f6a6c1e6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:04.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.638+0000 7f6a71fb0640 1 --2- 172.21.15.40:0/2145958355 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6a6c154f50 0x7f6a6c1e6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.638+0000 7f6a71fb0640 1 -- 172.21.15.40:0/2145958355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a6c15b3e0 msgr2=0x7f6a6c158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:04.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.638+0000 7f6a71fb0640 1 --2- 172.21.15.40:0/2145958355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a6c15b3e0 0x7f6a6c158c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.638+0000 7f6a71fb0640 1 -- 172.21.15.40:0/2145958355 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6c0b4c80 con 0x7f6a6c0d0590 2024-04-22T07:23:04.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.638+0000 7f6a727b1640 1 --2- 172.21.15.40:0/2145958355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a6c15b3e0 0x7f6a6c158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:23:04.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.638+0000 7f6a71fb0640 1 --2- 172.21.15.40:0/2145958355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a6c0d0590 0x7f6a6c15a380 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6a6800c4c0 tx=0x7f6a6800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:04.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.639+0000 7f6a627fc640 1 -- 172.21.15.40:0/2145958355 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a680052d0 con 0x7f6a6c0d0590 2024-04-22T07:23:04.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.639+0000 7f6a74214640 1 -- 172.21.15.40:0/2145958355 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a6c0b5fd0 con 0x7f6a6c0d0590 2024-04-22T07:23:04.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.639+0000 7f6a627fc640 1 -- 172.21.15.40:0/2145958355 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a68005470 con 0x7f6a6c0d0590 2024-04-22T07:23:04.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.639+0000 7f6a627fc640 1 -- 172.21.15.40:0/2145958355 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a68012870 con 0x7f6a6c0d0590 2024-04-22T07:23:04.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.639+0000 7f6a74214640 1 -- 172.21.15.40:0/2145958355 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a6c0b6290 con 0x7f6a6c0d0590 2024-04-22T07:23:04.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.640+0000 7f6a74214640 1 -- 172.21.15.40:0/2145958355 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a6c0c6650 con 0x7f6a6c0d0590 2024-04-22T07:23:04.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.640+0000 7f6a627fc640 1 -- 172.21.15.40:0/2145958355 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6a68012a10 con 0x7f6a6c0d0590 2024-04-22T07:23:04.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.641+0000 7f6a627fc640 1 --2- 172.21.15.40:0/2145958355 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f6a5006c8f0 0x7f6a5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:04.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.641+0000 7f6a627fc640 1 -- 172.21.15.40:0/2145958355 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f6a6808b750 con 0x7f6a6c0d0590 2024-04-22T07:23:04.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.641+0000 7f6a717af640 1 --2- 172.21.15.40:0/2145958355 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f6a5006c8f0 0x7f6a5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:04.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.641+0000 7f6a717af640 1 --2- 172.21.15.40:0/2145958355 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f6a5006c8f0 0x7f6a5006edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c036000 tx=0x7f6a5c03b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:04.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.649+0000 7f6a627fc640 1 -- 172.21.15.40:0/2145958355 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6a6c0c6650 con 0x7f6a6c0d0590 2024-04-22T07:23:04.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.882+0000 7f6a74214640 1 -- 172.21.15.40:0/2145958355 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a6c0b56c0 con 0x7f6a6c0d0590 2024-04-22T07:23:04.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.883+0000 7f6a627fc640 1 -- 172.21.15.40:0/2145958355 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6821 (secure 0 0 0) 0x7f6a6c0b56c0 con 0x7f6a6c0d0590 2024-04-22T07:23:04.881 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:23:04.881 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1193926607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1193926607},{"type":"v1","addr":"172.21.15.62:6835","nonce":1193926607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/602167189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":602167189},{"type":"v1","addr":"172.21.15.62:6837","nonce":602167189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2062933254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2062933254},{"type":"v1","addr":"172.21.15.40:6835","nonce":2062933254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3873524978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3873524978},{"type":"v1","addr":"172.21.15.40:6837","nonce":3873524978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/1922761385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":1922761385},{"type":"v1","addr":"172.21.15.40:6839","nonce":1922761385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:20:53.216204+0000","modified":"2024-04-22T07:20:58.875393+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.62:6836/2884673656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2884673656},{"type":"v1","addr":"172.21.15.62:6836","nonce":2884673656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4305]},"id":1}]} 2024-04-22T07:23:04.881 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-04-22T07:23:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.885+0000 7f6a74214640 1 -- 172.21.15.40:0/2145958355 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f6a5006c8f0 msgr2=0x7f6a5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.885+0000 7f6a74214640 1 --2- 172.21.15.40:0/2145958355 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f6a5006c8f0 0x7f6a5006edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c036000 tx=0x7f6a5c03b040 comp rx=0 tx=0).stop 2024-04-22T07:23:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.885+0000 7f6a74214640 1 -- 172.21.15.40:0/2145958355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a6c0d0590 msgr2=0x7f6a6c15a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.885+0000 7f6a74214640 1 --2- 172.21.15.40:0/2145958355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a6c0d0590 0x7f6a6c15a380 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6a6800c4c0 tx=0x7f6a6800c980 comp rx=0 tx=0).stop 2024-04-22T07:23:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.885+0000 7f6a74214640 1 -- 172.21.15.40:0/2145958355 shutdown_connections 2024-04-22T07:23:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.885+0000 7f6a74214640 1 --2- 172.21.15.40:0/2145958355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a6c15b3e0 0x7f6a6c158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.885+0000 7f6a74214640 1 --2- 172.21.15.40:0/2145958355 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6a6c154f50 0x7f6a6c1e6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.885+0000 7f6a74214640 1 --2- 172.21.15.40:0/2145958355 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f6a5006c8f0 0x7f6a5006edb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.885+0000 7f6a74214640 1 --2- 172.21.15.40:0/2145958355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a6c0d0590 0x7f6a6c15a380 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:04.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.885+0000 7f6a74214640 1 -- 172.21.15.40:0/2145958355 >> 172.21.15.40:0/2145958355 conn(0x7f6a6c0676b0 msgr2=0x7f6a6c0cd050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:23:04.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.885+0000 7f6a74214640 1 -- 172.21.15.40:0/2145958355 shutdown_connections 2024-04-22T07:23:04.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:04.885+0000 7f6a74214640 1 -- 172.21.15.40:0/2145958355 wait complete. 2024-04-22T07:23:04.895 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4305 quiesce db / --timeout 60 --expiration 78.8 --await' 2024-04-22T07:23:04.895 DEBUG:teuthology.orchestra.run.smithi040:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4305 quiesce db / --timeout 60 --expiration 78.8 --await 2024-04-22T07:23:05.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.154+0000 7fa8e2e8c640 1 Processor -- start 2024-04-22T07:23:05.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.154+0000 7fa8e2e8c640 1 -- start start 2024-04-22T07:23:05.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.156+0000 7fa8e2e8c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8dc152b90 0x7fa8dc0ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:05.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.156+0000 7fa8e2e8c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8dc0c5600 con 0x7fa8dc0707a0 2024-04-22T07:23:05.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.156+0000 7fa8e2e8c640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8dc158c10 con 0x7fa8dc0cd690 2024-04-22T07:23:05.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.156+0000 7fa8e2e8c640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa8dc070d00 con 0x7fa8dc152b90 2024-04-22T07:23:05.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.156+0000 7fa8dbfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa8dc0707a0 0x7fa8dc15c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45240/0 (socket says 172.21.15.40:45240) 2024-04-22T07:23:05.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.156+0000 7fa8dbfff640 1 -- 172.21.15.40:0/3038064776 learned_addr learned my addr 172.21.15.40:0/3038064776 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:23:05.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.157+0000 7fa8e0c28640 1 --2- 172.21.15.40:0/3038064776 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8dc152b90 0x7fa8dc0ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:05.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.161+0000 7fa8e0c28640 1 -- 172.21.15.40:0/3038064776 >> v1:172.21.15.62:6789/0 conn(0x7fa8dc0cd690 legacy=0x7fa8dc0c33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:05.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.161+0000 7fa8e0c28640 1 -- 172.21.15.40:0/3038064776 >> v1:172.21.15.40:6789/0 conn(0x7fa8dc0707a0 legacy=0x7fa8dc15c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:05.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.161+0000 7fa8e0c28640 1 -- 172.21.15.40:0/3038064776 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8dc158ed0 con 0x7fa8dc152b90 2024-04-22T07:23:05.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.164+0000 7fa8e0c28640 1 --2- 172.21.15.40:0/3038064776 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8dc152b90 0x7fa8dc0ce8c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009dc0 tx=0x7fa8cc02bd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a072231b48f7a892 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:05.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.186+0000 7fa8db7fe640 1 -- 172.21.15.40:0/3038064776 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc039070 con 0x7fa8dc152b90 2024-04-22T07:23:05.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.186+0000 7fa8db7fe640 1 -- 172.21.15.40:0/3038064776 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8cc02ca80 con 0x7fa8dc152b90 2024-04-22T07:23:05.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.188+0000 7fa8e2e8c640 1 -- 172.21.15.40:0/3038064776 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8dc152b90 msgr2=0x7fa8dc0ce8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:05.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.188+0000 7fa8e2e8c640 1 --2- 172.21.15.40:0/3038064776 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8dc152b90 0x7fa8dc0ce8c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009dc0 tx=0x7fa8cc02bd50 comp rx=0 tx=0).stop 2024-04-22T07:23:05.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.189+0000 7fa8e2e8c640 1 -- 172.21.15.40:0/3038064776 shutdown_connections 2024-04-22T07:23:05.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.189+0000 7fa8e2e8c640 1 --2- 172.21.15.40:0/3038064776 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8dc152b90 0x7fa8dc0ce8c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.189+0000 7fa8e2e8c640 1 -- 172.21.15.40:0/3038064776 >> 172.21.15.40:0/3038064776 conn(0x7fa8dc0714f0 msgr2=0x7fa8dc0718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:23:05.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.189+0000 7fa8e2e8c640 1 -- 172.21.15.40:0/3038064776 shutdown_connections 2024-04-22T07:23:05.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.189+0000 7fa8e2e8c640 1 -- 172.21.15.40:0/3038064776 wait complete. 2024-04-22T07:23:05.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.192+0000 7fa8e2e8c640 1 Processor -- start 2024-04-22T07:23:05.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.192+0000 7fa8e2e8c640 1 -- start start 2024-04-22T07:23:05.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.193+0000 7fa8e2e8c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8dc0707a0 0x7fa8dc148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:05.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.194+0000 7fa8e2e8c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8dc0cd690 0x7fa8dc157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:05.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.194+0000 7fa8e2e8c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8dc152b90 0x7fa8dc0c7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:05.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.194+0000 7fa8e2e8c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc159770 con 0x7fa8dc0707a0 2024-04-22T07:23:05.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.194+0000 7fa8e2e8c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc159490 con 0x7fa8dc152b90 2024-04-22T07:23:05.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.194+0000 7fa8e2e8c640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa8dc152f70 con 0x7fa8dc0cd690 2024-04-22T07:23:05.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.195+0000 7fa8dbfff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8dc0cd690 0x7fa8dc157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:05.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.195+0000 7fa8dbfff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8dc0cd690 0x7fa8dc157210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.40:55060/0 (socket says 172.21.15.40:55060) 2024-04-22T07:23:05.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.195+0000 7fa8dbfff640 1 -- 172.21.15.40:0/4024424894 learned_addr learned my addr 172.21.15.40:0/4024424894 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:23:05.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.195+0000 7fa8e0c28640 1 --2- 172.21.15.40:0/4024424894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8dc0707a0 0x7fa8dc148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:05.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.195+0000 7fa8e1429640 1 --2- 172.21.15.40:0/4024424894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8dc152b90 0x7fa8dc0c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:05.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.196+0000 7fa8dbfff640 1 -- 172.21.15.40:0/4024424894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8dc152b90 msgr2=0x7fa8dc0c7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:05.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.196+0000 7fa8dbfff640 1 --2- 172.21.15.40:0/4024424894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8dc152b90 0x7fa8dc0c7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.196+0000 7fa8dbfff640 1 -- 172.21.15.40:0/4024424894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8dc0707a0 msgr2=0x7fa8dc148d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:05.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.196+0000 7fa8dbfff640 1 --2- 172.21.15.40:0/4024424894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8dc0707a0 0x7fa8dc148d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.196+0000 7fa8dbfff640 1 -- 172.21.15.40:0/4024424894 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8dc149350 con 0x7fa8dc0cd690 2024-04-22T07:23:05.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.196+0000 7fa8e0c28640 1 --2- 172.21.15.40:0/4024424894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8dc0707a0 0x7fa8dc148d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:23:05.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.197+0000 7fa8dbfff640 1 --2- 172.21.15.40:0/4024424894 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8dc0cd690 0x7fa8dc157210 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400c620 tx=0x7fa8c400cae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:05.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.198+0000 7fa8d97fa640 1 -- 172.21.15.40:0/4024424894 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4018070 con 0x7fa8dc0cd690 2024-04-22T07:23:05.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.198+0000 7fa8d97fa640 1 -- 172.21.15.40:0/4024424894 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8c40074e0 con 0x7fa8dc0cd690 2024-04-22T07:23:05.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.198+0000 7fa8d97fa640 1 -- 172.21.15.40:0/4024424894 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4007690 con 0x7fa8dc0cd690 2024-04-22T07:23:05.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.198+0000 7fa8e2e8c640 1 -- 172.21.15.40:0/4024424894 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8dc146f50 con 0x7fa8dc0cd690 2024-04-22T07:23:05.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.199+0000 7fa8e2e8c640 1 -- 172.21.15.40:0/4024424894 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8dc147510 con 0x7fa8dc0cd690 2024-04-22T07:23:05.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.212+0000 7fa8d97fa640 1 -- 172.21.15.40:0/4024424894 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa8c401b070 con 0x7fa8dc0cd690 2024-04-22T07:23:05.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.213+0000 7fa8e5a82740 1 Processor -- start 2024-04-22T07:23:05.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.213+0000 7fa8e5a82740 1 -- start start 2024-04-22T07:23:05.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.214+0000 7fa8d97fa640 1 --2- 172.21.15.40:0/4024424894 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fa8bc06c940 0x7fa8bc06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:05.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.214+0000 7fa8d97fa640 1 -- 172.21.15.40:0/4024424894 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fa8c408afc0 con 0x7fa8dc0cd690 2024-04-22T07:23:05.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.214+0000 7fa8e1429640 1 --2- 172.21.15.40:0/4024424894 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fa8bc06c940 0x7fa8bc06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:05.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.215+0000 7fa8e5a82740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aa053a8c00 0x55aa053a7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:05.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.216+0000 7fa8e0c28640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aa053a8c00 0x55aa053a7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:05.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.216+0000 7fa8e1429640 1 --2- 172.21.15.40:0/4024424894 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fa8bc06c940 0x7fa8bc06ee00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa8d400b4c0 tx=0x7fa8d40079d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:05.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.216+0000 7fa8e0c28640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aa053a8c00 0x55aa053a7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35986/0 (socket says 172.21.15.40:35986) 2024-04-22T07:23:05.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.216+0000 7fa8e0c28640 1 -- 172.21.15.40:0/4281273858 learned_addr learned my addr 172.21.15.40:0/4281273858 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:23:05.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.216+0000 7fa8e5a82740 1 --2- 172.21.15.40:0/4281273858 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55aa053a8fe0 0x55aa053a2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:05.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.216+0000 7fa8e5a82740 1 --2- 172.21.15.40:0/4281273858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55aa053e6a50 0x55aa053a4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:05.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.216+0000 7fa8e5a82740 1 -- 172.21.15.40:0/4281273858 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55aa053080b0 con 0x55aa053a8c00 2024-04-22T07:23:05.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.216+0000 7fa8e5a82740 1 -- 172.21.15.40:0/4281273858 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55aa052b9680 con 0x55aa053e6a50 2024-04-22T07:23:05.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.216+0000 7fa8e5a82740 1 -- 172.21.15.40:0/4281273858 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55aa052c5c60 con 0x55aa053a8fe0 2024-04-22T07:23:05.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.216+0000 7fa8e0c28640 1 -- 172.21.15.40:0/4281273858 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55aa053a8fe0 msgr2=0x55aa053a2aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-22T07:23:05.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.216+0000 7fa8e0c28640 1 --2- 172.21.15.40:0/4281273858 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55aa053a8fe0 0x55aa053a2aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.216+0000 7fa8e0c28640 1 -- 172.21.15.40:0/4281273858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55aa053e6a50 msgr2=0x55aa053a4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:05.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.216+0000 7fa8e0c28640 1 --2- 172.21.15.40:0/4281273858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55aa053e6a50 0x55aa053a4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.216+0000 7fa8e0c28640 1 -- 172.21.15.40:0/4281273858 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa050eac90 con 0x55aa053a8c00 2024-04-22T07:23:05.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.217+0000 7fa8e0c28640 1 --2- 172.21.15.40:0/4281273858 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aa053a8c00 0x55aa053a7220 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009ee0 tx=0x7fa8cc02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d146bccdb1e83d server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:05.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.218+0000 7fa8e2e8c640 1 -- 172.21.15.40:0/4281273858 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8cc051070 con 0x55aa053a8c00 2024-04-22T07:23:05.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.219+0000 7fa8e2e8c640 1 -- 172.21.15.40:0/4281273858 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8cc03a040 con 0x55aa053a8c00 2024-04-22T07:23:05.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.221+0000 7fa8e5a82740 1 -- 172.21.15.40:0/4281273858 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aa053a8c00 msgr2=0x55aa053a7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:05.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.221+0000 7fa8e5a82740 1 --2- 172.21.15.40:0/4281273858 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aa053a8c00 0x55aa053a7220 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009ee0 tx=0x7fa8cc02e000 comp rx=0 tx=0).stop 2024-04-22T07:23:05.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.222+0000 7fa8e5a82740 1 -- 172.21.15.40:0/4281273858 shutdown_connections 2024-04-22T07:23:05.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.222+0000 7fa8e5a82740 1 --2- 172.21.15.40:0/4281273858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55aa053e6a50 0x55aa053a4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.222+0000 7fa8e5a82740 1 --2- 172.21.15.40:0/4281273858 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55aa053a8fe0 0x55aa053a2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.222+0000 7fa8e5a82740 1 --2- 172.21.15.40:0/4281273858 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aa053a8c00 0x55aa053a7220 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.222+0000 7fa8e5a82740 1 -- 172.21.15.40:0/4281273858 >> 172.21.15.40:0/4281273858 conn(0x55aa053a3e10 msgr2=0x55aa053a64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:23:05.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.223+0000 7fa8e5a82740 1 -- 172.21.15.40:0/4281273858 shutdown_connections 2024-04-22T07:23:05.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.223+0000 7fa8e5a82740 1 -- 172.21.15.40:0/4281273858 wait complete. 2024-04-22T07:23:05.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.225+0000 7fa8e5a82740 1 -- start start 2024-04-22T07:23:05.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.226+0000 7fa8e5a82740 1 Processor -- start 2024-04-22T07:23:05.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.231+0000 7fa8e5a82740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55aa053a8fe0 0x55aa053e5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:05.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.232+0000 7fa8e5a82740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aa053e6a50 0x55aa053e48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:05.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.232+0000 7fa8dbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aa053e6a50 0x55aa053e48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:05.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.232+0000 7fa8dbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aa053e6a50 0x55aa053e48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36002/0 (socket says 172.21.15.40:36002) 2024-04-22T07:23:05.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.233+0000 7fa8dbfff640 1 -- 172.21.15.40:0/1218921157 learned_addr learned my addr 172.21.15.40:0/1218921157 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:23:05.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.233+0000 7fa8e0c28640 1 --2- 172.21.15.40:0/1218921157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55aa053a8fe0 0x55aa053e5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:05.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.233+0000 7fa8e5a82740 1 --2- 172.21.15.40:0/1218921157 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55aa053cc6d0 0x55aa053c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:05.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.234+0000 7fa8e5a82740 1 -- 172.21.15.40:0/1218921157 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55aa0530b400 con 0x55aa053e6a50 2024-04-22T07:23:05.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.234+0000 7fa8e1429640 1 --2- 172.21.15.40:0/1218921157 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55aa053cc6d0 0x55aa053c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:05.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.234+0000 7fa8e5a82740 1 -- 172.21.15.40:0/1218921157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55aa052c7840 con 0x55aa053a8fe0 2024-04-22T07:23:05.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.234+0000 7fa8e5a82740 1 -- 172.21.15.40:0/1218921157 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55aa05310720 con 0x55aa053cc6d0 2024-04-22T07:23:05.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.235+0000 7fa8dbfff640 1 -- 172.21.15.40:0/1218921157 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55aa053cc6d0 msgr2=0x55aa053c7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:05.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.235+0000 7fa8dbfff640 1 --2- 172.21.15.40:0/1218921157 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55aa053cc6d0 0x55aa053c7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.235+0000 7fa8dbfff640 1 -- 172.21.15.40:0/1218921157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55aa053a8fe0 msgr2=0x55aa053e5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:05.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.235+0000 7fa8dbfff640 1 --2- 172.21.15.40:0/1218921157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55aa053a8fe0 0x55aa053e5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.235+0000 7fa8dbfff640 1 -- 172.21.15.40:0/1218921157 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa0514b420 con 0x55aa053e6a50 2024-04-22T07:23:05.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.235+0000 7fa8e0c28640 1 --2- 172.21.15.40:0/1218921157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55aa053a8fe0 0x55aa053e5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:23:05.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.235+0000 7fa8e1429640 1 --2- 172.21.15.40:0/1218921157 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55aa053cc6d0 0x55aa053c7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:23:05.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.235+0000 7fa8e5a82740 10 client.0 _ll_register_callbacks cb 0x55aa05318ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:23:05.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.236+0000 7fa8e5a82740 1 -- 172.21.15.40:0/1218921157 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8cc03a040 con 0x55aa053e6a50 2024-04-22T07:23:05.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.236+0000 7fa8dbfff640 1 --2- 172.21.15.40:0/1218921157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aa053e6a50 0x55aa053e48f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400a060 tx=0x7fa8c4058830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f323d4d79e499854 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:05.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.236+0000 7fa8bb7fe640 10 client.5010 ms_handle_connect on v2:172.21.15.40:3300/0 2024-04-22T07:23:05.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.262+0000 7fa8bb7fe640 1 -- 172.21.15.40:0/1218921157 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4061990 con 0x55aa053e6a50 2024-04-22T07:23:05.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.262+0000 7fa8bb7fe640 1 -- 172.21.15.40:0/1218921157 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fa8c4071180 con 0x55aa053e6a50 2024-04-22T07:23:05.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.262+0000 7fa8bb7fe640 1 -- 172.21.15.40:0/1218921157 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fa8c4054b20 con 0x55aa053e6a50 2024-04-22T07:23:05.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.262+0000 7fa8e5a82740 10 client.5010 fetch_fsmap learned FSMap version 8 2024-04-22T07:23:05.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.262+0000 7fa8e5a82740 1 -- 172.21.15.40:0/1218921157 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({fsmap=8}) -- 0x55aa04fde580 con 0x55aa053e6a50 2024-04-22T07:23:05.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.263+0000 7fa8bb7fe640 1 -- 172.21.15.40:0/1218921157 <== mon.0 v2:172.21.15.40:3300/0 4 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fa8c4054cc0 con 0x55aa053e6a50 2024-04-22T07:23:05.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.263+0000 7fa8e5a82740 10 client.5010 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:23:05.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.263+0000 7fa8e5a82740 10 client.5010 resolve_mds: validated gid 4305 aka daemon mds.b 2024-04-22T07:23:05.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.263+0000 7fa8e5a82740 20 client.5010 populate_metadata read hostname 'smithi040' 2024-04-22T07:23:05.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.263+0000 7fa8e5a82740 1 --2- 172.21.15.40:0/1218921157 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55aa053fb0b0 0x55aa053fb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:05.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.263+0000 7fa8e5a82740 4 client.5010 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T07:23:05.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.263+0000 7fa8e5a82740 1 -- 172.21.15.40:0/1218921157 --> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa05319b10 con 0x55aa053fb0b0 2024-04-22T07:23:05.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.264+0000 7fa8e0c28640 1 --2- 172.21.15.40:0/1218921157 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55aa053fb0b0 0x55aa053fb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:05.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.266+0000 7fa8e0c28640 1 --2- 172.21.15.40:0/1218921157 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55aa053fb0b0 0x55aa053fb4e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b6e8b5e7f480fcb server_cookie=a1af008a49df78ed in_seq=0 out_seq=0 2024-04-22T07:23:05.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.266+0000 7fa8bb7fe640 10 client.5010 ms_handle_connect on v2:172.21.15.62:6833/2884673656 2024-04-22T07:23:05.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.270+0000 7fa8bb7fe640 1 -- 172.21.15.40:0/1218921157 <== mds.0 v2:172.21.15.62:6833/2884673656 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55aa05319b10 con 0x55aa053fb0b0 2024-04-22T07:23:05.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.270+0000 7fa8bb7fe640 10 client.5010 handle_command_reply: tid=0 2024-04-22T07:23:05.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.270+0000 7fa8e5a82740 1 client.5010 shutdown 2024-04-22T07:23:05.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.271+0000 7fa8e5a82740 1 -- 172.21.15.40:0/1218921157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aa053e6a50 msgr2=0x55aa053e48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:05.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.271+0000 7fa8e5a82740 1 --2- 172.21.15.40:0/1218921157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aa053e6a50 0x55aa053e48f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400a060 tx=0x7fa8c4058830 comp rx=0 tx=0).stop 2024-04-22T07:23:05.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.273+0000 7fa8e5a82740 1 -- 172.21.15.40:0/1218921157 shutdown_connections 2024-04-22T07:23:05.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.273+0000 7fa8e5a82740 1 --2- 172.21.15.40:0/1218921157 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55aa053fb0b0 0x55aa053fb4e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.273+0000 7fa8e5a82740 1 --2- 172.21.15.40:0/1218921157 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55aa053cc6d0 0x55aa053c7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.273+0000 7fa8e5a82740 1 --2- 172.21.15.40:0/1218921157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aa053e6a50 0x55aa053e48f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.273+0000 7fa8e5a82740 1 --2- 172.21.15.40:0/1218921157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55aa053a8fe0 0x55aa053e5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.273+0000 7fa8e5a82740 1 -- 172.21.15.40:0/1218921157 >> 172.21.15.40:0/1218921157 conn(0x55aa053a8c00 msgr2=0x55aa053a20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:23:05.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.273+0000 7fa8bb7fe640 0 client.5010 ms_handle_reset on v2:172.21.15.62:6833/2884673656 2024-04-22T07:23:05.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.273+0000 7fa8e5a82740 1 -- 172.21.15.40:0/1218921157 shutdown_connections 2024-04-22T07:23:05.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.273+0000 7fa8e5a82740 1 -- 172.21.15.40:0/1218921157 wait complete. 2024-04-22T07:23:05.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.274+0000 7fa8e5a82740 20 client.5010 trim_cache size 0 max 16384 2024-04-22T07:23:05.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.312+0000 7fa8e5a82740 1 Processor -- start 2024-04-22T07:23:05.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.312+0000 7fa8e5a82740 1 -- start start 2024-04-22T07:23:05.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.314+0000 7fa8e5a82740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55aa053a8fe0 0x55aa053a66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:05.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.314+0000 7fa8e5a82740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aa053cc6d0 0x55aa053e4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:05.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.315+0000 7fa8e5a82740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55aa053e6a50 0x55aa053e4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:05.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.315+0000 7fa8e0c28640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55aa053a8fe0 0x55aa053a66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:05.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.315+0000 7fa8e0c28640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55aa053a8fe0 0x55aa053a66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.40:57690/0 (socket says 172.21.15.40:57690) 2024-04-22T07:23:05.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.315+0000 7fa8dbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aa053cc6d0 0x55aa053e4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:05.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.315+0000 7fa8dbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aa053cc6d0 0x55aa053e4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36006/0 (socket says 172.21.15.40:36006) 2024-04-22T07:23:05.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.315+0000 7fa8e0c28640 1 -- 172.21.15.40:0/4266734700 learned_addr learned my addr 172.21.15.40:0/4266734700 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:23:05.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.316+0000 7fa8e5a82740 1 -- 172.21.15.40:0/4266734700 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc20ac40 con 0x55aa053cc6d0 2024-04-22T07:23:05.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.316+0000 7fa8e5a82740 1 -- 172.21.15.40:0/4266734700 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc141a90 con 0x55aa053a8fe0 2024-04-22T07:23:05.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.316+0000 7fa8e5a82740 1 -- 172.21.15.40:0/4266734700 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa8dc0c6610 con 0x55aa053e6a50 2024-04-22T07:23:05.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.316+0000 7fa8e1429640 1 --2- 172.21.15.40:0/4266734700 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55aa053e6a50 0x55aa053e4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:05.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.318+0000 7fa8dbfff640 1 -- 172.21.15.40:0/4266734700 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55aa053e6a50 msgr2=0x55aa053e4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:05.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.318+0000 7fa8dbfff640 1 --2- 172.21.15.40:0/4266734700 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55aa053e6a50 0x55aa053e4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.318+0000 7fa8dbfff640 1 -- 172.21.15.40:0/4266734700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55aa053a8fe0 msgr2=0x55aa053a66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:05.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.318+0000 7fa8dbfff640 1 --2- 172.21.15.40:0/4266734700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55aa053a8fe0 0x55aa053a66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.318+0000 7fa8dbfff640 1 -- 172.21.15.40:0/4266734700 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa053e2f40 con 0x55aa053cc6d0 2024-04-22T07:23:05.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.318+0000 7fa8dbfff640 1 --2- 172.21.15.40:0/4266734700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aa053cc6d0 0x55aa053e4700 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4057080 tx=0x7fa8c401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ad5a7af9697071 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:05.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.319+0000 7fa8d1ffb640 1 -- 172.21.15.40:0/4266734700 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4059030 con 0x55aa053cc6d0 2024-04-22T07:23:05.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.319+0000 7fa8d1ffb640 1 -- 172.21.15.40:0/4266734700 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8cc03a040 con 0x55aa053cc6d0 2024-04-22T07:23:05.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.319+0000 7fa8d1ffb640 1 -- 172.21.15.40:0/4266734700 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4071180 con 0x55aa053cc6d0 2024-04-22T07:23:05.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.321+0000 7fa8e5a82740 1 -- 172.21.15.40:0/4266734700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aa053cc6d0 msgr2=0x55aa053e4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:05.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.321+0000 7fa8e5a82740 1 --2- 172.21.15.40:0/4266734700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aa053cc6d0 0x55aa053e4700 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4057080 tx=0x7fa8c401f000 comp rx=0 tx=0).stop 2024-04-22T07:23:05.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.322+0000 7fa8e5a82740 1 -- 172.21.15.40:0/4266734700 shutdown_connections 2024-04-22T07:23:05.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.322+0000 7fa8e5a82740 1 --2- 172.21.15.40:0/4266734700 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55aa053e6a50 0x55aa053e4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.322+0000 7fa8e5a82740 1 --2- 172.21.15.40:0/4266734700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aa053cc6d0 0x55aa053e4700 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.322+0000 7fa8e5a82740 1 --2- 172.21.15.40:0/4266734700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55aa053a8fe0 0x55aa053a66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.322+0000 7fa8e5a82740 1 -- 172.21.15.40:0/4266734700 >> 172.21.15.40:0/4266734700 conn(0x55aa053a8c00 msgr2=0x55aa053e13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:23:05.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.322+0000 7fa8e5a82740 1 -- 172.21.15.40:0/4266734700 shutdown_connections 2024-04-22T07:23:05.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.322+0000 7fa8e5a82740 1 -- 172.21.15.40:0/4266734700 wait complete. 2024-04-22T07:23:05.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.324+0000 7fa8e5a82740 1 -- start start 2024-04-22T07:23:05.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.325+0000 7fa8e5a82740 1 Processor -- start 2024-04-22T07:23:05.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.329+0000 7fa8e5a82740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55aa053a8fe0 0x55aa05464810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:05.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.330+0000 7fa8e5a82740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aa053cc6d0 0x55aa053cad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:05.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.331+0000 7fa8e0c28640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55aa053a8fe0 0x55aa05464810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:05.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.331+0000 7fa8e5a82740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55aa053e6a50 0x55aa0545af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:05.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.331+0000 7fa8e5a82740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc06cfb0 con 0x55aa053cc6d0 2024-04-22T07:23:05.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.331+0000 7fa8dbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aa053cc6d0 0x55aa053cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:05.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.331+0000 7fa8e5a82740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc1413c0 con 0x55aa053e6a50 2024-04-22T07:23:05.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.331+0000 7fa8e5a82740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa8dc06d620 con 0x55aa053a8fe0 2024-04-22T07:23:05.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.331+0000 7fa8e0c28640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55aa053a8fe0 0x55aa05464810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.40:55084/0 (socket says 172.21.15.40:55084) 2024-04-22T07:23:05.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.331+0000 7fa8e0c28640 1 -- 172.21.15.40:0/3584978851 learned_addr learned my addr 172.21.15.40:0/3584978851 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:23:05.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.331+0000 7fa8e5a82740 10 client.0 _ll_register_callbacks cb 0x7fa8c4058dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:23:05.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.332+0000 7fa8e1429640 1 --2- 172.21.15.40:0/3584978851 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55aa053e6a50 0x55aa0545af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:05.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.332+0000 7fa8dbfff640 1 -- 172.21.15.40:0/3584978851 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55aa053a8fe0 msgr2=0x55aa05464810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:05.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.332+0000 7fa8dbfff640 1 --2- 172.21.15.40:0/3584978851 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55aa053a8fe0 0x55aa05464810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.332+0000 7fa8dbfff640 1 -- 172.21.15.40:0/3584978851 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55aa053e6a50 msgr2=0x55aa0545af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:05.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.332+0000 7fa8dbfff640 1 --2- 172.21.15.40:0/3584978851 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55aa053e6a50 0x55aa0545af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.332+0000 7fa8dbfff640 1 -- 172.21.15.40:0/3584978851 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa05464d50 con 0x55aa053cc6d0 2024-04-22T07:23:05.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.334+0000 7fa8dbfff640 1 --2- 172.21.15.40:0/3584978851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aa053cc6d0 0x55aa053cad30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4058ad0 tx=0x7fa8c401f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741ff070e9471306 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:05.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.334+0000 7fa8bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-04-22T07:23:05.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.334+0000 7fa8bb7fe640 1 -- 172.21.15.40:0/3584978851 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c407d060 con 0x55aa053cc6d0 2024-04-22T07:23:05.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.334+0000 7fa8bb7fe640 1 -- 172.21.15.40:0/3584978851 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fa8c4071180 con 0x55aa053cc6d0 2024-04-22T07:23:05.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.334+0000 7fa8e5a82740 1 -- 172.21.15.40:0/3584978851 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8cc03a040 con 0x55aa053cc6d0 2024-04-22T07:23:05.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.334+0000 7fa8bb7fe640 1 -- 172.21.15.40:0/3584978851 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fa8c4058ba0 con 0x55aa053cc6d0 2024-04-22T07:23:05.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.335+0000 7fa8e5a82740 10 client.5016 fetch_fsmap learned FSMap version 8 2024-04-22T07:23:05.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.335+0000 7fa8e5a82740 1 -- 172.21.15.40:0/3584978851 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55aa05464d50 con 0x55aa053cc6d0 2024-04-22T07:23:05.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.335+0000 7fa8bb7fe640 1 -- 172.21.15.40:0/3584978851 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8cc03a040 con 0x55aa053cc6d0 2024-04-22T07:23:05.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.335+0000 7fa8bb7fe640 1 -- 172.21.15.40:0/3584978851 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fa8c4005cc0 con 0x55aa053cc6d0 2024-04-22T07:23:05.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.335+0000 7fa8e5a82740 10 client.5016 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:23:05.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.335+0000 7fa8e5a82740 10 client.5016 resolve_mds: validated gid 4305 aka daemon mds.b 2024-04-22T07:23:05.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.335+0000 7fa8e5a82740 20 client.5016 populate_metadata read hostname 'smithi040' 2024-04-22T07:23:05.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.336+0000 7fa8e5a82740 1 --2- 172.21.15.40:0/3584978851 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55aa0545b460 0x55aa053e6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:05.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.336+0000 7fa8e5a82740 4 client.5016 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.8, "await": true}] 2024-04-22T07:23:05.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.336+0000 7fa8e5a82740 1 -- 172.21.15.40:0/3584978851 --> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.8, "await": true}) -- 0x55aa05313980 con 0x55aa0545b460 2024-04-22T07:23:05.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.336+0000 7fa8e0c28640 1 --2- 172.21.15.40:0/3584978851 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55aa0545b460 0x55aa053e6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:05.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.339+0000 7fa8e0c28640 1 --2- 172.21.15.40:0/3584978851 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55aa0545b460 0x55aa053e6f40 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ec322c93f358bf4 server_cookie=16423512504eb7e in_seq=0 out_seq=0 2024-04-22T07:23:05.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.339+0000 7fa8bb7fe640 10 client.5016 ms_handle_connect on v2:172.21.15.62:6833/2884673656 2024-04-22T07:23:05.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.792+0000 7fa8bb7fe640 1 -- 172.21.15.40:0/3584978851 <== mds.0 v2:172.21.15.62:6833/2884673656 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55aa05313980 con 0x55aa0545b460 2024-04-22T07:23:05.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.792+0000 7fa8bb7fe640 10 client.5016 handle_command_reply: tid=0 2024-04-22T07:23:05.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.792+0000 7fa8e5a82740 1 client.5016 shutdown 2024-04-22T07:23:05.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.793+0000 7fa8e5a82740 1 -- 172.21.15.40:0/3584978851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aa053cc6d0 msgr2=0x55aa053cad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:05.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.793+0000 7fa8e5a82740 1 --2- 172.21.15.40:0/3584978851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aa053cc6d0 0x55aa053cad30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4058ad0 tx=0x7fa8c401f070 comp rx=0 tx=0).stop 2024-04-22T07:23:05.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.798+0000 7fa8e5a82740 1 -- 172.21.15.40:0/3584978851 shutdown_connections 2024-04-22T07:23:05.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.798+0000 7fa8e5a82740 1 --2- 172.21.15.40:0/3584978851 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x55aa0545b460 0x55aa053e6f40 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.798+0000 7fa8e5a82740 1 --2- 172.21.15.40:0/3584978851 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55aa053e6a50 0x55aa0545af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.798+0000 7fa8bb7fe640 0 client.5016 ms_handle_reset on v2:172.21.15.62:6833/2884673656 2024-04-22T07:23:05.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.798+0000 7fa8e5a82740 1 --2- 172.21.15.40:0/3584978851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55aa053cc6d0 0x55aa053cad30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.798+0000 7fa8e5a82740 1 --2- 172.21.15.40:0/3584978851 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55aa053a8fe0 0x55aa05464810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.798+0000 7fa8e5a82740 1 -- 172.21.15.40:0/3584978851 >> 172.21.15.40:0/3584978851 conn(0x55aa053a8c00 msgr2=0x55aa053e55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:23:05.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.798+0000 7fa8e5a82740 1 -- 172.21.15.40:0/3584978851 shutdown_connections 2024-04-22T07:23:05.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.798+0000 7fa8e5a82740 1 -- 172.21.15.40:0/3584978851 wait complete. 2024-04-22T07:23:05.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.799+0000 7fa8e5a82740 20 client.5016 trim_cache size 0 max 16384 2024-04-22T07:23:05.797 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-22T07:23:05.797 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 8, 2024-04-22T07:23:05.797 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 4305, 2024-04-22T07:23:05.797 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 10, 2024-04-22T07:23:05.797 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-04-22T07:23:05.797 INFO:teuthology.orchestra.run.smithi040.stdout: "cffa742c": { 2024-04-22T07:23:05.797 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 10, 2024-04-22T07:23:05.797 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-04-22T07:23:05.798 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-04-22T07:23:05.798 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-04-22T07:23:05.798 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-04-22T07:23:05.798 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-22T07:23:05.798 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 60.0, 2024-04-22T07:23:05.798 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 78.8, 2024-04-22T07:23:05.798 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-04-22T07:23:05.798 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-04-22T07:23:05.798 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-04-22T07:23:05.798 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-04-22T07:23:05.798 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "QUIESCED", 2024-04-22T07:23:05.798 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-04-22T07:23:05.798 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:23:05.798 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:23:05.799 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:23:05.799 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:23:05.799 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:23:05.799 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-22T07:23:05.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.800+0000 7fa8d2ffd640 1 -- 172.21.15.40:0/4024424894 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fa8bc06c940 msgr2=0x7fa8bc06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:05.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.800+0000 7fa8d2ffd640 1 --2- 172.21.15.40:0/4024424894 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fa8bc06c940 0x7fa8bc06ee00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa8d400b4c0 tx=0x7fa8d40079d0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.800+0000 7fa8d2ffd640 1 -- 172.21.15.40:0/4024424894 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8dc0cd690 msgr2=0x7fa8dc157210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:05.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.800+0000 7fa8d2ffd640 1 --2- 172.21.15.40:0/4024424894 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8dc0cd690 0x7fa8dc157210 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400c620 tx=0x7fa8c400cae0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.801+0000 7fa8d2ffd640 1 -- 172.21.15.40:0/4024424894 shutdown_connections 2024-04-22T07:23:05.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.801+0000 7fa8d2ffd640 1 --2- 172.21.15.40:0/4024424894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8dc152b90 0x7fa8dc0c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.801+0000 7fa8d2ffd640 1 --2- 172.21.15.40:0/4024424894 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8dc0cd690 0x7fa8dc157210 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.801+0000 7fa8d2ffd640 1 --2- 172.21.15.40:0/4024424894 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fa8bc06c940 0x7fa8bc06ee00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.801+0000 7fa8d2ffd640 1 --2- 172.21.15.40:0/4024424894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8dc0707a0 0x7fa8dc148d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:05.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.801+0000 7fa8d2ffd640 1 -- 172.21.15.40:0/4024424894 >> 172.21.15.40:0/4024424894 conn(0x7fa8dc0714f0 msgr2=0x7fa8dc14f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:23:05.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.804+0000 7fa8d2ffd640 1 -- 172.21.15.40:0/4024424894 shutdown_connections 2024-04-22T07:23:05.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:05.807+0000 7fa8d2ffd640 1 -- 172.21.15.40:0/4024424894 wait complete. 2024-04-22T07:23:05.827 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced, set_id: cffa742c, quiesce took 1.3 seconds. Will release after: 18.8 2024-04-22T07:23:06.011 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:23:06.011 INFO:tasks.workunit.client.0.smithi040.stdout: Children see throughput for 1 initial writers = 741741.88 kB/sec 2024-04-22T07:23:06.011 INFO:tasks.workunit.client.0.smithi040.stdout: Parent sees throughput for 1 initial writers = 741644.85 kB/sec 2024-04-22T07:23:06.011 INFO:tasks.workunit.client.0.smithi040.stdout: Min throughput per process = 741741.88 kB/sec 2024-04-22T07:23:06.011 INFO:tasks.workunit.client.0.smithi040.stdout: Max throughput per process = 741741.88 kB/sec 2024-04-22T07:23:06.012 INFO:tasks.workunit.client.0.smithi040.stdout: Avg throughput per process = 741741.88 kB/sec 2024-04-22T07:23:06.012 INFO:tasks.workunit.client.0.smithi040.stdout: Min xfer = 1048576.00 kB 2024-04-22T07:23:23.790 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:23:23.793 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:23:24.628 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:23:24.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.743+0000 7f90ccf46640 1 Processor -- start 2024-04-22T07:23:24.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.743+0000 7f90ccf46640 1 -- start start 2024-04-22T07:23:24.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.744+0000 7f90ccf46640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f90c806f590 0x7f90c80722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:24.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.744+0000 7f90ccf46640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f90c806ff40 0x7f90c81619b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:24.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.744+0000 7f90ccf46640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90c80727e0 con 0x7f90c806f970 2024-04-22T07:23:24.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.744+0000 7f90ccf46640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f90c80c6c20 con 0x7f90c806f590 2024-04-22T07:23:24.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.744+0000 7f90ccf46640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f90c80c77a0 con 0x7f90c806ff40 2024-04-22T07:23:24.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.744+0000 7f90c659c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f90c806f590 0x7f90c80722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:24.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.744+0000 7f90c5d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f90c806f970 0x7f90c8150dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51500/0 (socket says 172.21.15.40:51500) 2024-04-22T07:23:24.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.744+0000 7f90c5d9b640 1 -- 172.21.15.40:0/2933645120 learned_addr learned my addr 172.21.15.40:0/2933645120 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:23:24.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.745+0000 7f90c6d9d640 1 --2- 172.21.15.40:0/2933645120 >> v2:172.21.15.62:3300/0 conn(0x7f90c806ff40 0x7f90c81619b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:24.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.745+0000 7f90c659c640 1 -- 172.21.15.40:0/2933645120 >> v2:172.21.15.62:3300/0 conn(0x7f90c806ff40 msgr2=0x7f90c81619b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:24.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.745+0000 7f90c659c640 1 --2- 172.21.15.40:0/2933645120 >> v2:172.21.15.62:3300/0 conn(0x7f90c806ff40 0x7f90c81619b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:24.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.745+0000 7f90c659c640 1 -- 172.21.15.40:0/2933645120 >> v1:172.21.15.40:6789/0 conn(0x7f90c806f970 legacy=0x7f90c8150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:24.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.745+0000 7f90c659c640 1 -- 172.21.15.40:0/2933645120 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90c815b400 con 0x7f90c806f590 2024-04-22T07:23:24.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.745+0000 7f90c659c640 1 --2- 172.21.15.40:0/2933645120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c806f590 0x7f90c80722a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f90c80688a0 tx=0x7f90b802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3de923e43485a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:24.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.746+0000 7f90c559a640 1 -- 172.21.15.40:0/2933645120 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b8035020 con 0x7f90c806f590 2024-04-22T07:23:24.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.746+0000 7f90c559a640 1 -- 172.21.15.40:0/2933645120 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90b8031830 con 0x7f90c806f590 2024-04-22T07:23:24.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.746+0000 7f90c559a640 1 -- 172.21.15.40:0/2933645120 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b8031c00 con 0x7f90c806f590 2024-04-22T07:23:24.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.746+0000 7f90ccf46640 1 -- 172.21.15.40:0/2933645120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c806f590 msgr2=0x7f90c80722a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:24.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.746+0000 7f90ccf46640 1 --2- 172.21.15.40:0/2933645120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c806f590 0x7f90c80722a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f90c80688a0 tx=0x7f90b802b8d0 comp rx=0 tx=0).stop 2024-04-22T07:23:24.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.746+0000 7f90ccf46640 1 -- 172.21.15.40:0/2933645120 shutdown_connections 2024-04-22T07:23:24.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.746+0000 7f90ccf46640 1 --2- 172.21.15.40:0/2933645120 >> v2:172.21.15.62:3300/0 conn(0x7f90c806ff40 0x7f90c81619b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:24.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.746+0000 7f90ccf46640 1 --2- 172.21.15.40:0/2933645120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c806f590 0x7f90c80722a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:24.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.746+0000 7f90ccf46640 1 -- 172.21.15.40:0/2933645120 >> 172.21.15.40:0/2933645120 conn(0x7f90c80cc220 msgr2=0x7f90c80cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:23:24.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.746+0000 7f90ccf46640 1 -- 172.21.15.40:0/2933645120 shutdown_connections 2024-04-22T07:23:24.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.746+0000 7f90ccf46640 1 -- 172.21.15.40:0/2933645120 wait complete. 2024-04-22T07:23:24.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.748+0000 7f90ccf46640 1 Processor -- start 2024-04-22T07:23:24.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.748+0000 7f90ccf46640 1 -- start start 2024-04-22T07:23:24.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.748+0000 7f90ccf46640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90c806f590 0x7f90c8149da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:24.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.748+0000 7f90ccf46640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90c806f970 0x7f90c81581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:24.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.748+0000 7f90ccf46640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c806ff40 0x7f90c80cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:24.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.748+0000 7f90ccf46640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f90c80c7430 con 0x7f90c806ff40 2024-04-22T07:23:24.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.748+0000 7f90ccf46640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f90c80c7150 con 0x7f90c806f590 2024-04-22T07:23:24.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.748+0000 7f90ccf46640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f90c8071940 con 0x7f90c806f970 2024-04-22T07:23:24.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.749+0000 7f90c6d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c806ff40 0x7f90c80cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:24.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.749+0000 7f90c6d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c806ff40 0x7f90c80cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39054/0 (socket says 172.21.15.40:39054) 2024-04-22T07:23:24.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.749+0000 7f90c6d9d640 1 -- 172.21.15.40:0/1223754265 learned_addr learned my addr 172.21.15.40:0/1223754265 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:23:24.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.749+0000 7f90c659c640 1 --2- 172.21.15.40:0/1223754265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90c806f590 0x7f90c8149da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:24.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.749+0000 7f90c5d9b640 1 --2- 172.21.15.40:0/1223754265 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90c806f970 0x7f90c81581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:24.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.749+0000 7f90c6d9d640 1 -- 172.21.15.40:0/1223754265 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90c806f970 msgr2=0x7f90c81581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:24.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.749+0000 7f90c6d9d640 1 --2- 172.21.15.40:0/1223754265 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90c806f970 0x7f90c81581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:24.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.749+0000 7f90c6d9d640 1 -- 172.21.15.40:0/1223754265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90c806f590 msgr2=0x7f90c8149da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:24.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.749+0000 7f90c6d9d640 1 --2- 172.21.15.40:0/1223754265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90c806f590 0x7f90c8149da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:24.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.749+0000 7f90c6d9d640 1 -- 172.21.15.40:0/1223754265 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90c8158bc0 con 0x7f90c806ff40 2024-04-22T07:23:24.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.749+0000 7f90c6d9d640 1 --2- 172.21.15.40:0/1223754265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c806ff40 0x7f90c80cc600 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f90c0008bb0 tx=0x7f90c000e4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:24.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.749+0000 7f90b6ffd640 1 -- 172.21.15.40:0/1223754265 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c001b070 con 0x7f90c806ff40 2024-04-22T07:23:24.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.749+0000 7f90b6ffd640 1 -- 172.21.15.40:0/1223754265 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c0016400 con 0x7f90c806ff40 2024-04-22T07:23:24.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.749+0000 7f90ccf46640 1 -- 172.21.15.40:0/1223754265 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90c8157450 con 0x7f90c806ff40 2024-04-22T07:23:24.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.749+0000 7f90b6ffd640 1 -- 172.21.15.40:0/1223754265 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c00167f0 con 0x7f90c806ff40 2024-04-22T07:23:24.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.749+0000 7f90ccf46640 1 -- 172.21.15.40:0/1223754265 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90c8157a10 con 0x7f90c806ff40 2024-04-22T07:23:24.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.750+0000 7f90ccf46640 1 -- 172.21.15.40:0/1223754265 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90c8069d40 con 0x7f90c806ff40 2024-04-22T07:23:24.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.751+0000 7f90b6ffd640 1 -- 172.21.15.40:0/1223754265 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f90c001e070 con 0x7f90c806ff40 2024-04-22T07:23:24.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.751+0000 7f90b6ffd640 1 --2- 172.21.15.40:0/1223754265 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f90a806c8f0 0x7f90a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:24.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.751+0000 7f90b6ffd640 1 -- 172.21.15.40:0/1223754265 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f90c008caa0 con 0x7f90c806ff40 2024-04-22T07:23:24.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.752+0000 7f90c659c640 1 --2- 172.21.15.40:0/1223754265 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f90a806c8f0 0x7f90a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:24.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.752+0000 7f90c659c640 1 --2- 172.21.15.40:0/1223754265 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f90a806c8f0 0x7f90a806edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f90b8036000 tx=0x7f90b8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:24.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.756+0000 7f90b6ffd640 1 -- 172.21.15.40:0/1223754265 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f90c0011070 con 0x7f90c806ff40 2024-04-22T07:23:24.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.980+0000 7f90ccf46640 1 -- 172.21.15.40:0/1223754265 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f90c80c8620 con 0x7f90c806ff40 2024-04-22T07:23:24.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.980+0000 7f90b6ffd640 1 -- 172.21.15.40:0/1223754265 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6821 (secure 0 0 0) 0x7f90c005a860 con 0x7f90c806ff40 2024-04-22T07:23:24.978 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:23:24.979 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1193926607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1193926607},{"type":"v1","addr":"172.21.15.62:6835","nonce":1193926607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/602167189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":602167189},{"type":"v1","addr":"172.21.15.62:6837","nonce":602167189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2062933254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2062933254},{"type":"v1","addr":"172.21.15.40:6835","nonce":2062933254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3873524978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3873524978},{"type":"v1","addr":"172.21.15.40:6837","nonce":3873524978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/1922761385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":1922761385},{"type":"v1","addr":"172.21.15.40:6839","nonce":1922761385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:20:53.216204+0000","modified":"2024-04-22T07:20:58.875393+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.62:6836/2884673656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2884673656},{"type":"v1","addr":"172.21.15.62:6836","nonce":2884673656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4305]},"id":1}]} 2024-04-22T07:23:24.979 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-04-22T07:23:24.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.982+0000 7f90ccf46640 1 -- 172.21.15.40:0/1223754265 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f90a806c8f0 msgr2=0x7f90a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:24.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.982+0000 7f90ccf46640 1 --2- 172.21.15.40:0/1223754265 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f90a806c8f0 0x7f90a806edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f90b8036000 tx=0x7f90b8008030 comp rx=0 tx=0).stop 2024-04-22T07:23:24.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.982+0000 7f90ccf46640 1 -- 172.21.15.40:0/1223754265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c806ff40 msgr2=0x7f90c80cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:24.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.982+0000 7f90ccf46640 1 --2- 172.21.15.40:0/1223754265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c806ff40 0x7f90c80cc600 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f90c0008bb0 tx=0x7f90c000e4a0 comp rx=0 tx=0).stop 2024-04-22T07:23:24.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.983+0000 7f90ccf46640 1 -- 172.21.15.40:0/1223754265 shutdown_connections 2024-04-22T07:23:24.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.983+0000 7f90ccf46640 1 --2- 172.21.15.40:0/1223754265 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f90a806c8f0 0x7f90a806edb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:24.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.983+0000 7f90ccf46640 1 --2- 172.21.15.40:0/1223754265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c806ff40 0x7f90c80cc600 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:24.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.983+0000 7f90ccf46640 1 --2- 172.21.15.40:0/1223754265 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f90c806f970 0x7f90c81581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:24.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.983+0000 7f90ccf46640 1 --2- 172.21.15.40:0/1223754265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f90c806f590 0x7f90c8149da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:24.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.983+0000 7f90ccf46640 1 -- 172.21.15.40:0/1223754265 >> 172.21.15.40:0/1223754265 conn(0x7f90c80cc220 msgr2=0x7f90c814ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:23:24.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.983+0000 7f90ccf46640 1 -- 172.21.15.40:0/1223754265 shutdown_connections 2024-04-22T07:23:24.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:24.983+0000 7f90ccf46640 1 -- 172.21.15.40:0/1223754265 wait complete. 2024-04-22T07:23:24.992 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4305 quiesce db --set-id cffa742c --release --await' 2024-04-22T07:23:24.992 DEBUG:teuthology.orchestra.run.smithi040:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4305 quiesce db --set-id cffa742c --release --await 2024-04-22T07:23:25.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.102+0000 7f0eeb9b2640 1 Processor -- start 2024-04-22T07:23:25.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.102+0000 7f0eeb9b2640 1 -- start start 2024-04-22T07:23:25.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.103+0000 7f0eeb9b2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ee40d08c0 0x7f0ee40caef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:25.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.103+0000 7f0eeb9b2640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ee415ac50 con 0x7f0ee40d0ca0 2024-04-22T07:23:25.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.103+0000 7f0eeb9b2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ee415af10 con 0x7f0ee40cd380 2024-04-22T07:23:25.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.103+0000 7f0eeb9b2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0ee40ccef0 con 0x7f0ee40d08c0 2024-04-22T07:23:25.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.103+0000 7f0ee8f4d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0ee40d0ca0 0x7f0ee40cbd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51508/0 (socket says 172.21.15.40:51508) 2024-04-22T07:23:25.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.103+0000 7f0ee8f4d640 1 -- 172.21.15.40:0/50596314 learned_addr learned my addr 172.21.15.40:0/50596314 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:23:25.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.103+0000 7f0edbfff640 1 -- 172.21.15.40:0/50596314 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 101577255 0 0) 0x7f0ee415ac50 con 0x7f0ee40d0ca0 2024-04-22T07:23:25.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.103+0000 7f0ee974e640 1 --2- 172.21.15.40:0/50596314 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ee40d08c0 0x7f0ee40caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:25.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.103+0000 7f0edbfff640 1 -- 172.21.15.40:0/50596314 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ed0003520 con 0x7f0ee40d0ca0 2024-04-22T07:23:25.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.103+0000 7f0edbfff640 1 -- 172.21.15.40:0/50596314 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3609387341 0 0) 0x7f0ed0003520 con 0x7f0ee40d0ca0 2024-04-22T07:23:25.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.103+0000 7f0edbfff640 1 -- 172.21.15.40:0/50596314 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ee40d08c0 msgr2=0x7f0ee40caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:25.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.103+0000 7f0edbfff640 1 --2- 172.21.15.40:0/50596314 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ee40d08c0 0x7f0ee40caef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.103+0000 7f0edbfff640 1 -- 172.21.15.40:0/50596314 >> v1:172.21.15.62:6789/0 conn(0x7f0ee40cd380 legacy=0x7f0ee40cd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:25.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.103+0000 7f0edbfff640 1 -- 172.21.15.40:0/50596314 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee415b1f0 con 0x7f0ee40d0ca0 2024-04-22T07:23:25.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.103+0000 7f0edbfff640 1 -- 172.21.15.40:0/50596314 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7f0ed4001670 con 0x7f0ee40d0ca0 2024-04-22T07:23:25.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.103+0000 7f0edbfff640 1 -- 172.21.15.40:0/50596314 >> v1:172.21.15.40:6789/0 conn(0x7f0ee40d0ca0 legacy=0x7f0ee40cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:25.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.103+0000 7f0edbfff640 1 --2- 172.21.15.40:0/50596314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ed00039e0 0x7f0ed0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:25.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.103+0000 7f0edbfff640 1 --2- 172.21.15.40:0/50596314 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ed0004800 0x7f0ed0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:25.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.103+0000 7f0edbfff640 1 --2- 172.21.15.40:0/50596314 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ee40d08c0 0x7f0ed00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:25.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.103+0000 7f0edbfff640 1 -- 172.21.15.40:0/50596314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee40ccef0 con 0x7f0ed00039e0 2024-04-22T07:23:25.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.103+0000 7f0edbfff640 1 -- 172.21.15.40:0/50596314 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed000bb00 con 0x7f0ed0004800 2024-04-22T07:23:25.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.103+0000 7f0edbfff640 1 -- 172.21.15.40:0/50596314 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0ed000bd00 con 0x7f0ee40d08c0 2024-04-22T07:23:25.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.104+0000 7f0ee974e640 1 --2- 172.21.15.40:0/50596314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ed00039e0 0x7f0ed0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:25.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.104+0000 7f0ee9f4f640 1 --2- 172.21.15.40:0/50596314 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ee40d08c0 0x7f0ed00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:25.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.104+0000 7f0ee8f4d640 1 --2- 172.21.15.40:0/50596314 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ed0004800 0x7f0ed0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:25.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.104+0000 7f0ee974e640 1 -- 172.21.15.40:0/50596314 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ee40d08c0 msgr2=0x7f0ed00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:25.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.104+0000 7f0ee974e640 1 --2- 172.21.15.40:0/50596314 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ee40d08c0 0x7f0ed00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.104+0000 7f0ee974e640 1 -- 172.21.15.40:0/50596314 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ed0004800 msgr2=0x7f0ed0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:25.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.104+0000 7f0ee974e640 1 --2- 172.21.15.40:0/50596314 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ed0004800 0x7f0ed0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.104+0000 7f0ee974e640 1 -- 172.21.15.40:0/50596314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed0003520 con 0x7f0ed00039e0 2024-04-22T07:23:25.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.104+0000 7f0ee8f4d640 1 --2- 172.21.15.40:0/50596314 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ed0004800 0x7f0ed0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:23:25.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.105+0000 7f0ee974e640 1 --2- 172.21.15.40:0/50596314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ed00039e0 0x7f0ed0003e00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0009a90 tx=0x7f0ed0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44cd2bdce0f9f97 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:25.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.105+0000 7f0edbfff640 1 -- 172.21.15.40:0/50596314 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0039070 con 0x7f0ed00039e0 2024-04-22T07:23:25.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.105+0000 7f0edbfff640 1 -- 172.21.15.40:0/50596314 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee002c680 con 0x7f0ed00039e0 2024-04-22T07:23:25.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.105+0000 7f0edbfff640 1 -- 172.21.15.40:0/50596314 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0009690 con 0x7f0ed00039e0 2024-04-22T07:23:25.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.105+0000 7f0eeb9b2640 1 -- 172.21.15.40:0/50596314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ed00039e0 msgr2=0x7f0ed0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:25.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.105+0000 7f0eeb9b2640 1 --2- 172.21.15.40:0/50596314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ed00039e0 0x7f0ed0003e00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0009a90 tx=0x7f0ed0005830 comp rx=0 tx=0).stop 2024-04-22T07:23:25.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.105+0000 7f0ee9f4f640 1 -- 172.21.15.40:0/50596314 reap_dead start 2024-04-22T07:23:25.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.105+0000 7f0eeb9b2640 1 -- 172.21.15.40:0/50596314 shutdown_connections 2024-04-22T07:23:25.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.105+0000 7f0eeb9b2640 1 -- 172.21.15.40:0/50596314 >> 172.21.15.40:0/50596314 conn(0x7f0ee406ce70 msgr2=0x7f0ee406d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:23:25.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.105+0000 7f0eeb9b2640 1 -- 172.21.15.40:0/50596314 shutdown_connections 2024-04-22T07:23:25.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.105+0000 7f0eeb9b2640 1 -- 172.21.15.40:0/50596314 wait complete. 2024-04-22T07:23:25.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.106+0000 7f0eeb9b2640 1 Processor -- start 2024-04-22T07:23:25.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.107+0000 7f0eeb9b2640 1 -- start start 2024-04-22T07:23:25.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.107+0000 7f0eeb9b2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ed00039e0 0x7f0ee41e76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:25.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.107+0000 7f0eeb9b2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ee41f0ba0 0x7f0ee415de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:25.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.107+0000 7f0eeb9b2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ee415a770 0x7f0ee415e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:25.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.107+0000 7f0eeb9b2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee415ba90 con 0x7f0ed00039e0 2024-04-22T07:23:25.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.107+0000 7f0eeb9b2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee415b7b0 con 0x7f0ee415a770 2024-04-22T07:23:25.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.107+0000 7f0eeb9b2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0ee4072eb0 con 0x7f0ee41f0ba0 2024-04-22T07:23:25.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.107+0000 7f0ee974e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ed00039e0 0x7f0ee41e76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:25.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.107+0000 7f0ee974e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ed00039e0 0x7f0ee41e76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39074/0 (socket says 172.21.15.40:39074) 2024-04-22T07:23:25.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.107+0000 7f0ee974e640 1 -- 172.21.15.40:0/3357325599 learned_addr learned my addr 172.21.15.40:0/3357325599 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:23:25.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.108+0000 7f0ee974e640 1 -- 172.21.15.40:0/3357325599 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ee41f0ba0 msgr2=0x7f0ee415de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:25.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.108+0000 7f0ee974e640 1 --2- 172.21.15.40:0/3357325599 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ee41f0ba0 0x7f0ee415de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.108+0000 7f0ee974e640 1 -- 172.21.15.40:0/3357325599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ee415a770 msgr2=0x7f0ee415e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:25.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.108+0000 7f0ee974e640 1 --2- 172.21.15.40:0/3357325599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ee415a770 0x7f0ee415e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.108+0000 7f0ee974e640 1 -- 172.21.15.40:0/3357325599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee41f1030 con 0x7f0ed00039e0 2024-04-22T07:23:25.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.108+0000 7f0ee974e640 1 --2- 172.21.15.40:0/3357325599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ed00039e0 0x7f0ee41e76a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0037040 tx=0x7f0ee0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:25.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.108+0000 7f0ed9ffb640 1 -- 172.21.15.40:0/3357325599 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0039050 con 0x7f0ed00039e0 2024-04-22T07:23:25.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.108+0000 7f0ed9ffb640 1 -- 172.21.15.40:0/3357325599 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee0045070 con 0x7f0ed00039e0 2024-04-22T07:23:25.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.108+0000 7f0eeb9b2640 1 -- 172.21.15.40:0/3357325599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ee41f1310 con 0x7f0ed00039e0 2024-04-22T07:23:25.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.108+0000 7f0ed9ffb640 1 -- 172.21.15.40:0/3357325599 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0003850 con 0x7f0ed00039e0 2024-04-22T07:23:25.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.108+0000 7f0eeb9b2640 1 -- 172.21.15.40:0/3357325599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ee41f18d0 con 0x7f0ed00039e0 2024-04-22T07:23:25.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.110+0000 7f0ed9ffb640 1 -- 172.21.15.40:0/3357325599 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0ee00039f0 con 0x7f0ed00039e0 2024-04-22T07:23:25.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.110+0000 7f0ed9ffb640 1 --2- 172.21.15.40:0/3357325599 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f0ec806c8f0 0x7f0ec806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:25.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.110+0000 7f0ed9ffb640 1 -- 172.21.15.40:0/3357325599 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f0ee00ada70 con 0x7f0ed00039e0 2024-04-22T07:23:25.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.110+0000 7f0ee8f4d640 1 --2- 172.21.15.40:0/3357325599 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f0ec806c8f0 0x7f0ec806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:25.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.110+0000 7f0ee8f4d640 1 --2- 172.21.15.40:0/3357325599 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f0ec806c8f0 0x7f0ec806edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4000fb0 tx=0x7f0ed4001e70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:25.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.111+0000 7f0eee5a5740 1 Processor -- start 2024-04-22T07:23:25.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.111+0000 7f0eee5a5740 1 -- start start 2024-04-22T07:23:25.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.111+0000 7f0eee5a5740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566441457d0 0x556644145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:25.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.112+0000 7f0eee5a5740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55664412f2d0 0x556644146900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:25.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.112+0000 7f0eee5a5740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556644104810 0x556644146e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:25.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.112+0000 7f0eee5a5740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55664406b500 con 0x5566441457d0 2024-04-22T07:23:25.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.112+0000 7f0eee5a5740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5566440116a0 con 0x55664412f2d0 2024-04-22T07:23:25.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.112+0000 7f0eee5a5740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x5566440674c0 con 0x556644104810 2024-04-22T07:23:25.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.112+0000 7f0ee974e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566441457d0 0x556644145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:25.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.112+0000 7f0ee974e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566441457d0 0x556644145bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39088/0 (socket says 172.21.15.40:39088) 2024-04-22T07:23:25.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.112+0000 7f0ee974e640 1 -- 172.21.15.40:0/4085716952 learned_addr learned my addr 172.21.15.40:0/4085716952 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:23:25.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.112+0000 7f0ee8f4d640 1 --2- 172.21.15.40:0/4085716952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55664412f2d0 0x556644146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:25.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.112+0000 7f0ee9f4f640 1 --2- 172.21.15.40:0/4085716952 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556644104810 0x556644146e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:25.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.112+0000 7f0ee974e640 1 -- 172.21.15.40:0/4085716952 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556644104810 msgr2=0x556644146e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:25.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.112+0000 7f0ee974e640 1 --2- 172.21.15.40:0/4085716952 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556644104810 0x556644146e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.112+0000 7f0ee974e640 1 -- 172.21.15.40:0/4085716952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55664412f2d0 msgr2=0x556644146900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:25.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.112+0000 7f0ee974e640 1 --2- 172.21.15.40:0/4085716952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55664412f2d0 0x556644146900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.112+0000 7f0ee974e640 1 -- 172.21.15.40:0/4085716952 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566440305e0 con 0x5566441457d0 2024-04-22T07:23:25.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.112+0000 7f0ee9f4f640 1 --2- 172.21.15.40:0/4085716952 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556644104810 0x556644146e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:23:25.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.112+0000 7f0ee8f4d640 1 --2- 172.21.15.40:0/4085716952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55664412f2d0 0x556644146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:23:25.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.112+0000 7f0ee974e640 1 --2- 172.21.15.40:0/4085716952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566441457d0 0x556644145bb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0ee007b4b0 tx=0x7f0ee0009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d61980fcf088131 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:25.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.112+0000 7f0eceffd640 1 -- 172.21.15.40:0/4085716952 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee007b7b0 con 0x5566441457d0 2024-04-22T07:23:25.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.112+0000 7f0eceffd640 1 -- 172.21.15.40:0/4085716952 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee003a040 con 0x5566441457d0 2024-04-22T07:23:25.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.112+0000 7f0eceffd640 1 -- 172.21.15.40:0/4085716952 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee007fb60 con 0x5566441457d0 2024-04-22T07:23:25.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.113+0000 7f0eee5a5740 1 -- 172.21.15.40:0/4085716952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566441457d0 msgr2=0x556644145bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:25.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.113+0000 7f0eee5a5740 1 --2- 172.21.15.40:0/4085716952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566441457d0 0x556644145bb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0ee007b4b0 tx=0x7f0ee0009190 comp rx=0 tx=0).stop 2024-04-22T07:23:25.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.113+0000 7f0eee5a5740 1 -- 172.21.15.40:0/4085716952 shutdown_connections 2024-04-22T07:23:25.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.113+0000 7f0eee5a5740 1 --2- 172.21.15.40:0/4085716952 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556644104810 0x556644146e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.113+0000 7f0eee5a5740 1 --2- 172.21.15.40:0/4085716952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55664412f2d0 0x556644146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.113+0000 7f0eee5a5740 1 --2- 172.21.15.40:0/4085716952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566441457d0 0x556644145bb0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.113+0000 7f0eee5a5740 1 -- 172.21.15.40:0/4085716952 >> 172.21.15.40:0/4085716952 conn(0x556644102550 msgr2=0x556644104e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:23:25.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.113+0000 7f0eee5a5740 1 -- 172.21.15.40:0/4085716952 shutdown_connections 2024-04-22T07:23:25.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.113+0000 7f0eee5a5740 1 -- 172.21.15.40:0/4085716952 wait complete. 2024-04-22T07:23:25.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.113+0000 7f0eee5a5740 1 -- start start 2024-04-22T07:23:25.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.114+0000 7f0eee5a5740 1 Processor -- start 2024-04-22T07:23:25.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.114+0000 7f0eee5a5740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55664412f2d0 0x55664412df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:25.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.114+0000 7f0eee5a5740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566441457d0 0x556644124290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:25.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.114+0000 7f0eee5a5740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55664412d3c0 0x5566441218d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:25.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.114+0000 7f0eee5a5740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5566440674c0 con 0x5566441457d0 2024-04-22T07:23:25.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.114+0000 7f0eee5a5740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556644024a60 con 0x55664412f2d0 2024-04-22T07:23:25.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.114+0000 7f0eee5a5740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55664406b500 con 0x55664412d3c0 2024-04-22T07:23:25.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.114+0000 7f0eee5a5740 10 client.0 _ll_register_callbacks cb 0x556643d7d110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:23:25.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.115+0000 7f0ee8f4d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566441457d0 0x556644124290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:25.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.115+0000 7f0ee8f4d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566441457d0 0x556644124290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39096/0 (socket says 172.21.15.40:39096) 2024-04-22T07:23:25.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.115+0000 7f0ee8f4d640 1 -- 172.21.15.40:0/4234626341 learned_addr learned my addr 172.21.15.40:0/4234626341 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:23:25.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.115+0000 7f0ee974e640 1 --2- 172.21.15.40:0/4234626341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55664412f2d0 0x55664412df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:25.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.115+0000 7f0ee9f4f640 1 --2- 172.21.15.40:0/4234626341 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55664412d3c0 0x5566441218d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:25.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.115+0000 7f0ee8f4d640 1 -- 172.21.15.40:0/4234626341 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55664412d3c0 msgr2=0x5566441218d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:25.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.115+0000 7f0ee8f4d640 1 --2- 172.21.15.40:0/4234626341 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55664412d3c0 0x5566441218d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.115+0000 7f0ee8f4d640 1 -- 172.21.15.40:0/4234626341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55664412f2d0 msgr2=0x55664412df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:25.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.115+0000 7f0ee8f4d640 1 --2- 172.21.15.40:0/4234626341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55664412f2d0 0x55664412df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.115+0000 7f0ee8f4d640 1 -- 172.21.15.40:0/4234626341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556643d7d920 con 0x5566441457d0 2024-04-22T07:23:25.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.115+0000 7f0ee8f4d640 1 --2- 172.21.15.40:0/4234626341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566441457d0 0x556644124290 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0ee41e8560 tx=0x7f0ed4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fadc4eff4020f1c server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:25.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.115+0000 7f0ec3fff640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-04-22T07:23:25.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.115+0000 7f0ec3fff640 1 -- 172.21.15.40:0/4234626341 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4027060 con 0x5566441457d0 2024-04-22T07:23:25.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.115+0000 7f0ec3fff640 1 -- 172.21.15.40:0/4234626341 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f0ed4010040 con 0x5566441457d0 2024-04-22T07:23:25.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.115+0000 7f0eee5a5740 1 -- 172.21.15.40:0/4234626341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ee003a040 con 0x5566441457d0 2024-04-22T07:23:25.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.115+0000 7f0ec3fff640 1 -- 172.21.15.40:0/4234626341 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f0ed4015110 con 0x5566441457d0 2024-04-22T07:23:25.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.115+0000 7f0eee5a5740 10 client.5037 fetch_fsmap learned FSMap version 8 2024-04-22T07:23:25.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.115+0000 7f0eee5a5740 1 -- 172.21.15.40:0/4234626341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x556643e49d30 con 0x5566441457d0 2024-04-22T07:23:25.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.116+0000 7f0ec3fff640 1 -- 172.21.15.40:0/4234626341 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee003a040 con 0x5566441457d0 2024-04-22T07:23:25.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.116+0000 7f0ec3fff640 1 -- 172.21.15.40:0/4234626341 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f0ed40226a0 con 0x5566441457d0 2024-04-22T07:23:25.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.116+0000 7f0eee5a5740 10 client.5037 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:23:25.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.116+0000 7f0eee5a5740 10 client.5037 resolve_mds: validated gid 4305 aka daemon mds.b 2024-04-22T07:23:25.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.116+0000 7f0eee5a5740 20 client.5037 populate_metadata read hostname 'smithi040' 2024-04-22T07:23:25.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.116+0000 7f0eee5a5740 1 --2- 172.21.15.40:0/4234626341 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x556644120a70 0x556644159c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:25.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.116+0000 7f0eee5a5740 4 client.5037 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T07:23:25.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.116+0000 7f0eee5a5740 1 -- 172.21.15.40:0/4234626341 --> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55664403ea10 con 0x556644120a70 2024-04-22T07:23:25.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.116+0000 7f0ee974e640 1 --2- 172.21.15.40:0/4234626341 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x556644120a70 0x556644159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:25.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.116+0000 7f0ec3fff640 10 client.5037 ms_handle_connect on v2:172.21.15.62:6833/2884673656 2024-04-22T07:23:25.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.116+0000 7f0ee974e640 1 --2- 172.21.15.40:0/4234626341 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x556644120a70 0x556644159c30 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a12955b5bcd15977 server_cookie=85ec4b99a0ffbbc9 in_seq=0 out_seq=0 2024-04-22T07:23:25.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.117+0000 7f0ec3fff640 1 -- 172.21.15.40:0/4234626341 <== mds.0 v2:172.21.15.62:6833/2884673656 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55664403ea10 con 0x556644120a70 2024-04-22T07:23:25.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.117+0000 7f0ec3fff640 10 client.5037 handle_command_reply: tid=0 2024-04-22T07:23:25.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.117+0000 7f0eee5a5740 1 client.5037 shutdown 2024-04-22T07:23:25.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.117+0000 7f0eee5a5740 1 -- 172.21.15.40:0/4234626341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566441457d0 msgr2=0x556644124290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:25.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.117+0000 7f0eee5a5740 1 --2- 172.21.15.40:0/4234626341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566441457d0 0x556644124290 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0ee41e8560 tx=0x7f0ed4011000 comp rx=0 tx=0).stop 2024-04-22T07:23:25.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.117+0000 7f0eee5a5740 1 -- 172.21.15.40:0/4234626341 shutdown_connections 2024-04-22T07:23:25.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.117+0000 7f0eee5a5740 1 --2- 172.21.15.40:0/4234626341 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x556644120a70 0x556644159c30 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.117+0000 7f0eee5a5740 1 --2- 172.21.15.40:0/4234626341 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55664412d3c0 0x5566441218d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.117+0000 7f0ec3fff640 0 client.5037 ms_handle_reset on v2:172.21.15.62:6833/2884673656 2024-04-22T07:23:25.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.117+0000 7f0eee5a5740 1 --2- 172.21.15.40:0/4234626341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566441457d0 0x556644124290 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.117+0000 7f0eee5a5740 1 --2- 172.21.15.40:0/4234626341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55664412f2d0 0x55664412df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.117+0000 7f0eee5a5740 1 -- 172.21.15.40:0/4234626341 >> 172.21.15.40:0/4234626341 conn(0x556644104810 msgr2=0x556644104e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:23:25.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.117+0000 7f0eee5a5740 1 -- 172.21.15.40:0/4234626341 shutdown_connections 2024-04-22T07:23:25.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.117+0000 7f0eee5a5740 1 -- 172.21.15.40:0/4234626341 wait complete. 2024-04-22T07:23:25.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.117+0000 7f0eee5a5740 20 client.5037 trim_cache size 0 max 16384 2024-04-22T07:23:25.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.134+0000 7f0eee5a5740 1 Processor -- start 2024-04-22T07:23:25.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.135+0000 7f0eee5a5740 1 -- start start 2024-04-22T07:23:25.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.135+0000 7f0eee5a5740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556644120a70 0x556644101280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:25.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.135+0000 7f0eee5a5740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55664412d3c0 0x5566441017c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:25.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.135+0000 7f0eee5a5740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55664412f2d0 0x55664412e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:25.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.135+0000 7f0eee5a5740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee41fe810 con 0x55664412d3c0 2024-04-22T07:23:25.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.135+0000 7f0eee5a5740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee41fd6f0 con 0x55664412f2d0 2024-04-22T07:23:25.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.135+0000 7f0eee5a5740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0ee414b720 con 0x556644120a70 2024-04-22T07:23:25.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.135+0000 7f0ee8f4d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55664412d3c0 0x5566441017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:25.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.135+0000 7f0ee8f4d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55664412d3c0 0x5566441017c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39098/0 (socket says 172.21.15.40:39098) 2024-04-22T07:23:25.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.135+0000 7f0ee8f4d640 1 -- 172.21.15.40:0/3601747752 learned_addr learned my addr 172.21.15.40:0/3601747752 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:23:25.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.136+0000 7f0ee9f4f640 1 --2- 172.21.15.40:0/3601747752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55664412f2d0 0x55664412e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:25.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.136+0000 7f0ee8f4d640 1 -- 172.21.15.40:0/3601747752 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556644120a70 msgr2=0x556644101280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:25.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.136+0000 7f0ee8f4d640 1 --2- 172.21.15.40:0/3601747752 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556644120a70 0x556644101280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.136+0000 7f0ee8f4d640 1 -- 172.21.15.40:0/3601747752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55664412f2d0 msgr2=0x55664412e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:25.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.136+0000 7f0ee8f4d640 1 --2- 172.21.15.40:0/3601747752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55664412f2d0 0x55664412e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.136+0000 7f0ee8f4d640 1 -- 172.21.15.40:0/3601747752 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556644121c40 con 0x55664412d3c0 2024-04-22T07:23:25.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.136+0000 7f0ee9f4f640 1 --2- 172.21.15.40:0/3601747752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55664412f2d0 0x55664412e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:23:25.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.136+0000 7f0ee8f4d640 1 --2- 172.21.15.40:0/3601747752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55664412d3c0 0x5566441017c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4001700 tx=0x7f0ed4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=288882e91273bf3a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:25.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.136+0000 7f0ece7fc640 1 -- 172.21.15.40:0/3601747752 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed400e940 con 0x55664412d3c0 2024-04-22T07:23:25.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.136+0000 7f0ece7fc640 1 -- 172.21.15.40:0/3601747752 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed4022460 con 0x55664412d3c0 2024-04-22T07:23:25.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.136+0000 7f0ece7fc640 1 -- 172.21.15.40:0/3601747752 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4022650 con 0x55664412d3c0 2024-04-22T07:23:25.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.136+0000 7f0eee5a5740 1 -- 172.21.15.40:0/3601747752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55664412d3c0 msgr2=0x5566441017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:25.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.136+0000 7f0eee5a5740 1 --2- 172.21.15.40:0/3601747752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55664412d3c0 0x5566441017c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4001700 tx=0x7f0ed4013000 comp rx=0 tx=0).stop 2024-04-22T07:23:25.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.136+0000 7f0eee5a5740 1 -- 172.21.15.40:0/3601747752 shutdown_connections 2024-04-22T07:23:25.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.136+0000 7f0eee5a5740 1 --2- 172.21.15.40:0/3601747752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55664412f2d0 0x55664412e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.136+0000 7f0eee5a5740 1 --2- 172.21.15.40:0/3601747752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55664412d3c0 0x5566441017c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.136+0000 7f0eee5a5740 1 --2- 172.21.15.40:0/3601747752 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x556644120a70 0x556644101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.136+0000 7f0eee5a5740 1 -- 172.21.15.40:0/3601747752 >> 172.21.15.40:0/3601747752 conn(0x556644104810 msgr2=0x556644143b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:23:25.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.137+0000 7f0eee5a5740 1 -- 172.21.15.40:0/3601747752 shutdown_connections 2024-04-22T07:23:25.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.137+0000 7f0eee5a5740 1 -- 172.21.15.40:0/3601747752 wait complete. 2024-04-22T07:23:25.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.137+0000 7f0eee5a5740 1 -- start start 2024-04-22T07:23:25.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.137+0000 7f0eee5a5740 1 Processor -- start 2024-04-22T07:23:25.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.138+0000 7f0eee5a5740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556644120a70 0x5566441529f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:25.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.138+0000 7f0eee5a5740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55664412d3c0 0x556644105290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:25.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.138+0000 7f0eee5a5740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55664412f2d0 0x556644169290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:25.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.138+0000 7f0eee5a5740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee41f4c20 con 0x556644120a70 2024-04-22T07:23:25.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.138+0000 7f0eee5a5740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee41fd020 con 0x55664412d3c0 2024-04-22T07:23:25.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.138+0000 7f0eee5a5740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0ee41fc9b0 con 0x55664412f2d0 2024-04-22T07:23:25.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.138+0000 7f0eee5a5740 10 client.0 _ll_register_callbacks cb 0x7f0ed4001110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:23:25.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.138+0000 7f0ee974e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556644120a70 0x5566441529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:25.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.138+0000 7f0ee974e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556644120a70 0x5566441529f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39104/0 (socket says 172.21.15.40:39104) 2024-04-22T07:23:25.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.138+0000 7f0ee974e640 1 -- 172.21.15.40:0/3276010963 learned_addr learned my addr 172.21.15.40:0/3276010963 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:23:25.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.138+0000 7f0ee9f4f640 1 --2- 172.21.15.40:0/3276010963 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55664412f2d0 0x556644169290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:25.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.138+0000 7f0ee8f4d640 1 --2- 172.21.15.40:0/3276010963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55664412d3c0 0x556644105290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:25.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.138+0000 7f0ee974e640 1 -- 172.21.15.40:0/3276010963 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55664412f2d0 msgr2=0x556644169290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:25.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.138+0000 7f0ee974e640 1 --2- 172.21.15.40:0/3276010963 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55664412f2d0 0x556644169290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.138+0000 7f0ee974e640 1 -- 172.21.15.40:0/3276010963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55664412d3c0 msgr2=0x556644105290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:23:25.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.138+0000 7f0ee974e640 1 --2- 172.21.15.40:0/3276010963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55664412d3c0 0x556644105290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.138+0000 7f0ee974e640 1 -- 172.21.15.40:0/3276010963 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556644122ea0 con 0x556644120a70 2024-04-22T07:23:25.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.139+0000 7f0ee974e640 1 --2- 172.21.15.40:0/3276010963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556644120a70 0x5566441529f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00abfd0 tx=0x7f0ee0006f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caed9c0cbf8ce1c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:23:25.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.139+0000 7f0ec3fff640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-04-22T07:23:25.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.139+0000 7f0ec3fff640 1 -- 172.21.15.40:0/3276010963 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee007fb60 con 0x556644120a70 2024-04-22T07:23:25.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.139+0000 7f0ec3fff640 1 -- 172.21.15.40:0/3276010963 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f0ee0003ce0 con 0x556644120a70 2024-04-22T07:23:25.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.139+0000 7f0eee5a5740 1 -- 172.21.15.40:0/3276010963 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ed4022460 con 0x556644120a70 2024-04-22T07:23:25.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.139+0000 7f0ec3fff640 1 -- 172.21.15.40:0/3276010963 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f0ee00a1050 con 0x556644120a70 2024-04-22T07:23:25.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.139+0000 7f0eee5a5740 10 client.5043 fetch_fsmap learned FSMap version 8 2024-04-22T07:23:25.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.139+0000 7f0eee5a5740 1 -- 172.21.15.40:0/3276010963 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x556644105a50 con 0x556644120a70 2024-04-22T07:23:25.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.139+0000 7f0ec3fff640 1 -- 172.21.15.40:0/3276010963 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed4022460 con 0x556644120a70 2024-04-22T07:23:25.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.139+0000 7f0ec3fff640 1 -- 172.21.15.40:0/3276010963 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f0ee0077e20 con 0x556644120a70 2024-04-22T07:23:25.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.139+0000 7f0eee5a5740 10 client.5043 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:23:25.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.139+0000 7f0eee5a5740 10 client.5043 resolve_mds: validated gid 4305 aka daemon mds.b 2024-04-22T07:23:25.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.139+0000 7f0eee5a5740 20 client.5043 populate_metadata read hostname 'smithi040' 2024-04-22T07:23:25.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.139+0000 7f0eee5a5740 1 --2- 172.21.15.40:0/3276010963 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x5566441457d0 0x5566441baab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:23:25.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.139+0000 7f0eee5a5740 4 client.5043 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "cffa742c", "release": true, "await": true}] 2024-04-22T07:23:25.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.139+0000 7f0eee5a5740 1 -- 172.21.15.40:0/3276010963 --> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] -- command(tid 0: {"prefix": "quiesce db", "set_id": "cffa742c", "release": true, "await": true}) -- 0x556644078f20 con 0x5566441457d0 2024-04-22T07:23:25.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.139+0000 7f0ee8f4d640 1 --2- 172.21.15.40:0/3276010963 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x5566441457d0 0x5566441baab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:23:25.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.140+0000 7f0ec3fff640 10 client.5043 ms_handle_connect on v2:172.21.15.62:6833/2884673656 2024-04-22T07:23:25.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.140+0000 7f0ee8f4d640 1 --2- 172.21.15.40:0/3276010963 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x5566441457d0 0x5566441baab0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dce5e2557d48a04a server_cookie=60722d57ce368cf7 in_seq=0 out_seq=0 2024-04-22T07:23:25.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.140+0000 7f0ec3fff640 1 -- 172.21.15.40:0/3276010963 <== mds.0 v2:172.21.15.62:6833/2884673656 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x556644078f20 con 0x5566441457d0 2024-04-22T07:23:25.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.140+0000 7f0ec3fff640 10 client.5043 handle_command_reply: tid=0 2024-04-22T07:23:25.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.140+0000 7f0eee5a5740 1 client.5043 shutdown 2024-04-22T07:23:25.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.140+0000 7f0eee5a5740 1 -- 172.21.15.40:0/3276010963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556644120a70 msgr2=0x5566441529f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:25.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.140+0000 7f0eee5a5740 1 --2- 172.21.15.40:0/3276010963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556644120a70 0x5566441529f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00abfd0 tx=0x7f0ee0006f40 comp rx=0 tx=0).stop 2024-04-22T07:23:25.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.140+0000 7f0eee5a5740 1 -- 172.21.15.40:0/3276010963 shutdown_connections 2024-04-22T07:23:25.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.140+0000 7f0eee5a5740 1 --2- 172.21.15.40:0/3276010963 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x5566441457d0 0x5566441baab0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.140+0000 7f0eee5a5740 1 --2- 172.21.15.40:0/3276010963 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55664412f2d0 0x556644169290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.140+0000 7f0eee5a5740 1 --2- 172.21.15.40:0/3276010963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55664412d3c0 0x556644105290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.140+0000 7f0eee5a5740 1 --2- 172.21.15.40:0/3276010963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556644120a70 0x5566441529f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.140+0000 7f0ec3fff640 0 client.5043 ms_handle_reset on v2:172.21.15.62:6833/2884673656 2024-04-22T07:23:25.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.140+0000 7f0eee5a5740 1 -- 172.21.15.40:0/3276010963 >> 172.21.15.40:0/3276010963 conn(0x556644104810 msgr2=0x556644101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:23:25.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.140+0000 7f0eee5a5740 1 -- 172.21.15.40:0/3276010963 shutdown_connections 2024-04-22T07:23:25.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.140+0000 7f0eee5a5740 1 -- 172.21.15.40:0/3276010963 wait complete. 2024-04-22T07:23:25.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.141+0000 7f0eee5a5740 20 client.5043 trim_cache size 0 max 16384 2024-04-22T07:23:25.145 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-22T07:23:25.145 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 8, 2024-04-22T07:23:25.145 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 4305, 2024-04-22T07:23:25.145 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 12, 2024-04-22T07:23:25.145 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": { 2024-04-22T07:23:25.145 INFO:teuthology.orchestra.run.smithi040.stdout: "cffa742c": { 2024-04-22T07:23:25.145 INFO:teuthology.orchestra.run.smithi040.stdout: "version": 12, 2024-04-22T07:23:25.146 INFO:teuthology.orchestra.run.smithi040.stdout: "age_ref": 0.0, 2024-04-22T07:23:25.146 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-04-22T07:23:25.146 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-04-22T07:23:25.146 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-04-22T07:23:25.146 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-22T07:23:25.146 INFO:teuthology.orchestra.run.smithi040.stdout: "timeout": 60.0, 2024-04-22T07:23:25.146 INFO:teuthology.orchestra.run.smithi040.stdout: "expiration": 78.8, 2024-04-22T07:23:25.146 INFO:teuthology.orchestra.run.smithi040.stdout: "members": { 2024-04-22T07:23:25.146 INFO:teuthology.orchestra.run.smithi040.stdout: "file:/": { 2024-04-22T07:23:25.146 INFO:teuthology.orchestra.run.smithi040.stdout: "excluded": false, 2024-04-22T07:23:25.146 INFO:teuthology.orchestra.run.smithi040.stdout: "state": { 2024-04-22T07:23:25.146 INFO:teuthology.orchestra.run.smithi040.stdout: "name": "RELEASED", 2024-04-22T07:23:25.146 INFO:teuthology.orchestra.run.smithi040.stdout: "age": 0.0 2024-04-22T07:23:25.147 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:23:25.147 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:23:25.147 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:23:25.147 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:23:25.147 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-22T07:23:25.147 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-22T07:23:25.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.141+0000 7f0eeb9b2640 1 -- 172.21.15.40:0/3357325599 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f0ec806c8f0 msgr2=0x7f0ec806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:25.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.141+0000 7f0eeb9b2640 1 --2- 172.21.15.40:0/3357325599 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f0ec806c8f0 0x7f0ec806edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4000fb0 tx=0x7f0ed4001e70 comp rx=0 tx=0).stop 2024-04-22T07:23:25.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.141+0000 7f0eeb9b2640 1 -- 172.21.15.40:0/3357325599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ed00039e0 msgr2=0x7f0ee41e76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:23:25.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.141+0000 7f0eeb9b2640 1 --2- 172.21.15.40:0/3357325599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ed00039e0 0x7f0ee41e76a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0037040 tx=0x7f0ee0004730 comp rx=0 tx=0).stop 2024-04-22T07:23:25.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.141+0000 7f0eeb9b2640 1 -- 172.21.15.40:0/3357325599 shutdown_connections 2024-04-22T07:23:25.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.141+0000 7f0eeb9b2640 1 --2- 172.21.15.40:0/3357325599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ee415a770 0x7f0ee415e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.141+0000 7f0eeb9b2640 1 --2- 172.21.15.40:0/3357325599 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ee41f0ba0 0x7f0ee415de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.141+0000 7f0eeb9b2640 1 --2- 172.21.15.40:0/3357325599 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f0ec806c8f0 0x7f0ec806edb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.141+0000 7f0eeb9b2640 1 --2- 172.21.15.40:0/3357325599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ed00039e0 0x7f0ee41e76a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:23:25.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.141+0000 7f0eeb9b2640 1 -- 172.21.15.40:0/3357325599 >> 172.21.15.40:0/3357325599 conn(0x7f0ee406ce70 msgr2=0x7f0ee40cc430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:23:25.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.141+0000 7f0eeb9b2640 1 -- 172.21.15.40:0/3357325599 shutdown_connections 2024-04-22T07:23:25.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:23:25.141+0000 7f0eeb9b2640 1 -- 172.21.15.40:0/3357325599 wait complete. 2024-04-22T07:23:25.156 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set_id: cffa742c, seconds elapsed: 20.6 2024-04-22T07:23:26.528 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:23:26.528 INFO:tasks.workunit.client.0.smithi040.stdout: Children see throughput for 1 rewriters = 62964.40 kB/sec 2024-04-22T07:23:26.528 INFO:tasks.workunit.client.0.smithi040.stdout: Parent sees throughput for 1 rewriters = 62963.67 kB/sec 2024-04-22T07:23:26.528 INFO:tasks.workunit.client.0.smithi040.stdout: Min throughput per process = 62964.40 kB/sec 2024-04-22T07:23:26.528 INFO:tasks.workunit.client.0.smithi040.stdout: Max throughput per process = 62964.40 kB/sec 2024-04-22T07:23:26.529 INFO:tasks.workunit.client.0.smithi040.stdout: Avg throughput per process = 62964.40 kB/sec 2024-04-22T07:23:26.529 INFO:tasks.workunit.client.0.smithi040.stdout: Min xfer = 1048576.00 kB 2024-04-22T07:23:28.854 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:23:28.854 INFO:tasks.workunit.client.0.smithi040.stdout: Children see throughput for 1 readers = 6706641.50 kB/sec 2024-04-22T07:23:28.854 INFO:tasks.workunit.client.0.smithi040.stdout: Parent sees throughput for 1 readers = 6698449.40 kB/sec 2024-04-22T07:23:28.854 INFO:tasks.workunit.client.0.smithi040.stdout: Min throughput per process = 6706641.50 kB/sec 2024-04-22T07:23:28.854 INFO:tasks.workunit.client.0.smithi040.stdout: Max throughput per process = 6706641.50 kB/sec 2024-04-22T07:23:28.854 INFO:tasks.workunit.client.0.smithi040.stdout: Avg throughput per process = 6706641.50 kB/sec 2024-04-22T07:23:28.854 INFO:tasks.workunit.client.0.smithi040.stdout: Min xfer = 1048576.00 kB 2024-04-22T07:23:31.078 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:23:31.078 INFO:tasks.workunit.client.0.smithi040.stdout: Children see throughput for 1 re-readers = 6693800.50 kB/sec 2024-04-22T07:23:31.078 INFO:tasks.workunit.client.0.smithi040.stdout: Parent sees throughput for 1 re-readers = 6684450.86 kB/sec 2024-04-22T07:23:31.078 INFO:tasks.workunit.client.0.smithi040.stdout: Min throughput per process = 6693800.50 kB/sec 2024-04-22T07:23:31.078 INFO:tasks.workunit.client.0.smithi040.stdout: Max throughput per process = 6693800.50 kB/sec 2024-04-22T07:23:31.078 INFO:tasks.workunit.client.0.smithi040.stdout: Avg throughput per process = 6693800.50 kB/sec 2024-04-22T07:23:31.078 INFO:tasks.workunit.client.0.smithi040.stdout: Min xfer = 1048576.00 kB 2024-04-22T07:23:37.378 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:23:37.378 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:23:37.379 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:23:37.379 INFO:tasks.workunit.client.0.smithi040.stdout:iozone test complete. 2024-04-22T07:23:37.379 INFO:tasks.workunit.client.0.smithi040.stderr:+ iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-04-22T07:23:37.446 INFO:tasks.workunit.client.0.smithi040.stdout: Iozone: Performance Test of File I/O 2024-04-22T07:23:37.446 INFO:tasks.workunit.client.0.smithi040.stdout: Version $Revision: 3.494 $ 2024-04-22T07:23:37.446 INFO:tasks.workunit.client.0.smithi040.stdout: Compiled for 64 bit mode. 2024-04-22T07:23:37.446 INFO:tasks.workunit.client.0.smithi040.stdout: Build: linux-AMD64 2024-04-22T07:23:37.446 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:23:37.446 INFO:tasks.workunit.client.0.smithi040.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-04-22T07:23:37.446 INFO:tasks.workunit.client.0.smithi040.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-04-22T07:23:37.446 INFO:tasks.workunit.client.0.smithi040.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-04-22T07:23:37.447 INFO:tasks.workunit.client.0.smithi040.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-04-22T07:23:37.447 INFO:tasks.workunit.client.0.smithi040.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-04-22T07:23:37.447 INFO:tasks.workunit.client.0.smithi040.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-04-22T07:23:37.447 INFO:tasks.workunit.client.0.smithi040.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-04-22T07:23:37.447 INFO:tasks.workunit.client.0.smithi040.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-04-22T07:23:37.447 INFO:tasks.workunit.client.0.smithi040.stdout: Alexey Skidanov, Sudhir Kumar. 2024-04-22T07:23:37.447 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:23:37.447 INFO:tasks.workunit.client.0.smithi040.stdout: Run began: Mon Apr 22 07:23:37 2024 2024-04-22T07:23:37.447 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:23:37.447 INFO:tasks.workunit.client.0.smithi040.stdout: Include close in write timing 2024-04-22T07:23:37.447 INFO:tasks.workunit.client.0.smithi040.stdout: Include fsync in write timing 2024-04-22T07:23:37.447 INFO:tasks.workunit.client.0.smithi040.stdout: File size set to 1048576 kB 2024-04-22T07:23:37.447 INFO:tasks.workunit.client.0.smithi040.stdout: Record Size 1024 kB 2024-04-22T07:23:37.447 INFO:tasks.workunit.client.0.smithi040.stdout: Command line used: iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-04-22T07:23:37.448 INFO:tasks.workunit.client.0.smithi040.stdout: Output is in kBytes/sec 2024-04-22T07:23:37.448 INFO:tasks.workunit.client.0.smithi040.stdout: Time Resolution = 0.000001 seconds. 2024-04-22T07:23:37.448 INFO:tasks.workunit.client.0.smithi040.stdout: Processor cache size set to 1024 kBytes. 2024-04-22T07:23:37.448 INFO:tasks.workunit.client.0.smithi040.stdout: Processor cache line size set to 32 bytes. 2024-04-22T07:23:37.448 INFO:tasks.workunit.client.0.smithi040.stdout: File stride size set to 17 * record size. 2024-04-22T07:23:37.448 INFO:tasks.workunit.client.0.smithi040.stdout: Throughput test with 1 process 2024-04-22T07:23:37.448 INFO:tasks.workunit.client.0.smithi040.stdout: Each process writes a 1048576 kByte file in 1024 kByte records 2024-04-22T07:23:38.827 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:23:38.827 INFO:tasks.workunit.client.0.smithi040.stdout: Children see throughput for 1 initial writers = 779018.38 kB/sec 2024-04-22T07:23:38.827 INFO:tasks.workunit.client.0.smithi040.stdout: Parent sees throughput for 1 initial writers = 778905.57 kB/sec 2024-04-22T07:23:38.827 INFO:tasks.workunit.client.0.smithi040.stdout: Min throughput per process = 779018.38 kB/sec 2024-04-22T07:23:38.827 INFO:tasks.workunit.client.0.smithi040.stdout: Max throughput per process = 779018.38 kB/sec 2024-04-22T07:23:38.828 INFO:tasks.workunit.client.0.smithi040.stdout: Avg throughput per process = 779018.38 kB/sec 2024-04-22T07:23:38.828 INFO:tasks.workunit.client.0.smithi040.stdout: Min xfer = 1048576.00 kB 2024-04-22T07:23:42.171 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:23:42.172 INFO:tasks.workunit.client.0.smithi040.stdout: Children see throughput for 1 rewriters = 843648.62 kB/sec 2024-04-22T07:23:42.172 INFO:tasks.workunit.client.0.smithi040.stdout: Parent sees throughput for 1 rewriters = 843534.08 kB/sec 2024-04-22T07:23:42.172 INFO:tasks.workunit.client.0.smithi040.stdout: Min throughput per process = 843648.62 kB/sec 2024-04-22T07:23:42.172 INFO:tasks.workunit.client.0.smithi040.stdout: Max throughput per process = 843648.62 kB/sec 2024-04-22T07:23:42.172 INFO:tasks.workunit.client.0.smithi040.stdout: Avg throughput per process = 843648.62 kB/sec 2024-04-22T07:23:42.172 INFO:tasks.workunit.client.0.smithi040.stdout: Min xfer = 1048576.00 kB 2024-04-22T07:23:44.474 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:23:44.474 INFO:tasks.workunit.client.0.smithi040.stdout: Children see throughput for 1 readers = 7662852.00 kB/sec 2024-04-22T07:23:44.474 INFO:tasks.workunit.client.0.smithi040.stdout: Parent sees throughput for 1 readers = 7650149.50 kB/sec 2024-04-22T07:23:44.474 INFO:tasks.workunit.client.0.smithi040.stdout: Min throughput per process = 7662852.00 kB/sec 2024-04-22T07:23:44.474 INFO:tasks.workunit.client.0.smithi040.stdout: Max throughput per process = 7662852.00 kB/sec 2024-04-22T07:23:44.475 INFO:tasks.workunit.client.0.smithi040.stdout: Avg throughput per process = 7662852.00 kB/sec 2024-04-22T07:23:44.475 INFO:tasks.workunit.client.0.smithi040.stdout: Min xfer = 1048576.00 kB 2024-04-22T07:23:46.676 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:23:46.676 INFO:tasks.workunit.client.0.smithi040.stdout: Children see throughput for 1 re-readers = 8042954.00 kB/sec 2024-04-22T07:23:46.676 INFO:tasks.workunit.client.0.smithi040.stdout: Parent sees throughput for 1 re-readers = 8029649.99 kB/sec 2024-04-22T07:23:46.676 INFO:tasks.workunit.client.0.smithi040.stdout: Min throughput per process = 8042954.00 kB/sec 2024-04-22T07:23:46.676 INFO:tasks.workunit.client.0.smithi040.stdout: Max throughput per process = 8042954.00 kB/sec 2024-04-22T07:23:46.676 INFO:tasks.workunit.client.0.smithi040.stdout: Avg throughput per process = 8042954.00 kB/sec 2024-04-22T07:23:46.677 INFO:tasks.workunit.client.0.smithi040.stdout: Min xfer = 1048576.00 kB 2024-04-22T07:23:52.994 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:23:52.995 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:23:52.995 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:23:52.995 INFO:tasks.workunit.client.0.smithi040.stdout:iozone test complete. 2024-04-22T07:23:52.995 INFO:tasks.workunit.client.0.smithi040.stderr:+ iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-04-22T07:23:53.062 INFO:tasks.workunit.client.0.smithi040.stdout: Iozone: Performance Test of File I/O 2024-04-22T07:23:53.063 INFO:tasks.workunit.client.0.smithi040.stdout: Version $Revision: 3.494 $ 2024-04-22T07:23:53.063 INFO:tasks.workunit.client.0.smithi040.stdout: Compiled for 64 bit mode. 2024-04-22T07:23:53.063 INFO:tasks.workunit.client.0.smithi040.stdout: Build: linux-AMD64 2024-04-22T07:23:53.063 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:23:53.063 INFO:tasks.workunit.client.0.smithi040.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-04-22T07:23:53.063 INFO:tasks.workunit.client.0.smithi040.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-04-22T07:23:53.063 INFO:tasks.workunit.client.0.smithi040.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-04-22T07:23:53.063 INFO:tasks.workunit.client.0.smithi040.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-04-22T07:23:53.063 INFO:tasks.workunit.client.0.smithi040.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-04-22T07:23:53.063 INFO:tasks.workunit.client.0.smithi040.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-04-22T07:23:53.063 INFO:tasks.workunit.client.0.smithi040.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-04-22T07:23:53.063 INFO:tasks.workunit.client.0.smithi040.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-04-22T07:23:53.063 INFO:tasks.workunit.client.0.smithi040.stdout: Alexey Skidanov, Sudhir Kumar. 2024-04-22T07:23:53.064 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:23:53.064 INFO:tasks.workunit.client.0.smithi040.stdout: Run began: Mon Apr 22 07:23:52 2024 2024-04-22T07:23:53.064 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:23:53.064 INFO:tasks.workunit.client.0.smithi040.stdout: Include close in write timing 2024-04-22T07:23:53.064 INFO:tasks.workunit.client.0.smithi040.stdout: Include fsync in write timing 2024-04-22T07:23:53.064 INFO:tasks.workunit.client.0.smithi040.stdout: File size set to 10485760 kB 2024-04-22T07:23:53.064 INFO:tasks.workunit.client.0.smithi040.stdout: Record Size 1024 kB 2024-04-22T07:23:53.064 INFO:tasks.workunit.client.0.smithi040.stdout: Command line used: iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-04-22T07:23:53.064 INFO:tasks.workunit.client.0.smithi040.stdout: Output is in kBytes/sec 2024-04-22T07:23:53.064 INFO:tasks.workunit.client.0.smithi040.stdout: Time Resolution = 0.000001 seconds. 2024-04-22T07:23:53.064 INFO:tasks.workunit.client.0.smithi040.stdout: Processor cache size set to 1024 kBytes. 2024-04-22T07:23:53.064 INFO:tasks.workunit.client.0.smithi040.stdout: Processor cache line size set to 32 bytes. 2024-04-22T07:23:53.064 INFO:tasks.workunit.client.0.smithi040.stdout: File stride size set to 17 * record size. 2024-04-22T07:23:53.064 INFO:tasks.workunit.client.0.smithi040.stdout: Throughput test with 1 process 2024-04-22T07:23:53.064 INFO:tasks.workunit.client.0.smithi040.stdout: Each process writes a 10485760 kByte file in 1024 kByte records 2024-04-22T07:23:53.847 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:23:53.850 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:24:05.425 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:24:05.425 INFO:tasks.workunit.client.0.smithi040.stdout: Children see throughput for 1 initial writers = 850588.88 kB/sec 2024-04-22T07:24:05.426 INFO:tasks.workunit.client.0.smithi040.stdout: Parent sees throughput for 1 initial writers = 850576.31 kB/sec 2024-04-22T07:24:05.426 INFO:tasks.workunit.client.0.smithi040.stdout: Min throughput per process = 850588.88 kB/sec 2024-04-22T07:24:05.426 INFO:tasks.workunit.client.0.smithi040.stdout: Max throughput per process = 850588.88 kB/sec 2024-04-22T07:24:05.426 INFO:tasks.workunit.client.0.smithi040.stdout: Avg throughput per process = 850588.88 kB/sec 2024-04-22T07:24:05.426 INFO:tasks.workunit.client.0.smithi040.stdout: Min xfer = 10485760.00 kB 2024-04-22T07:24:19.619 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:24:19.620 INFO:tasks.workunit.client.0.smithi040.stdout: Children see throughput for 1 rewriters = 878727.00 kB/sec 2024-04-22T07:24:19.620 INFO:tasks.workunit.client.0.smithi040.stdout: Parent sees throughput for 1 rewriters = 878713.55 kB/sec 2024-04-22T07:24:19.620 INFO:tasks.workunit.client.0.smithi040.stdout: Min throughput per process = 878727.00 kB/sec 2024-04-22T07:24:19.620 INFO:tasks.workunit.client.0.smithi040.stdout: Max throughput per process = 878727.00 kB/sec 2024-04-22T07:24:19.620 INFO:tasks.workunit.client.0.smithi040.stdout: Avg throughput per process = 878727.00 kB/sec 2024-04-22T07:24:19.620 INFO:tasks.workunit.client.0.smithi040.stdout: Min xfer = 10485760.00 kB 2024-04-22T07:24:23.022 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:24:23.022 INFO:tasks.workunit.client.0.smithi040.stdout: Children see throughput for 1 readers = 8976305.00 kB/sec 2024-04-22T07:24:23.022 INFO:tasks.workunit.client.0.smithi040.stdout: Parent sees throughput for 1 readers = 8974299.63 kB/sec 2024-04-22T07:24:23.022 INFO:tasks.workunit.client.0.smithi040.stdout: Min throughput per process = 8976305.00 kB/sec 2024-04-22T07:24:23.022 INFO:tasks.workunit.client.0.smithi040.stdout: Max throughput per process = 8976305.00 kB/sec 2024-04-22T07:24:23.022 INFO:tasks.workunit.client.0.smithi040.stdout: Avg throughput per process = 8976305.00 kB/sec 2024-04-22T07:24:23.022 INFO:tasks.workunit.client.0.smithi040.stdout: Min xfer = 10485760.00 kB 2024-04-22T07:24:23.937 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:24:23.940 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:24:26.280 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:24:26.280 INFO:tasks.workunit.client.0.smithi040.stdout: Children see throughput for 1 re-readers = 8975589.00 kB/sec 2024-04-22T07:24:26.280 INFO:tasks.workunit.client.0.smithi040.stdout: Parent sees throughput for 1 re-readers = 8973898.61 kB/sec 2024-04-22T07:24:26.280 INFO:tasks.workunit.client.0.smithi040.stdout: Min throughput per process = 8975589.00 kB/sec 2024-04-22T07:24:26.280 INFO:tasks.workunit.client.0.smithi040.stdout: Max throughput per process = 8975589.00 kB/sec 2024-04-22T07:24:26.280 INFO:tasks.workunit.client.0.smithi040.stdout: Avg throughput per process = 8975589.00 kB/sec 2024-04-22T07:24:26.280 INFO:tasks.workunit.client.0.smithi040.stdout: Min xfer = 10485760.00 kB 2024-04-22T07:24:33.060 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:24:33.060 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:24:33.061 INFO:tasks.workunit.client.0.smithi040.stdout: 2024-04-22T07:24:33.061 INFO:tasks.workunit.client.0.smithi040.stdout:iozone test complete. 2024-04-22T07:24:33.062 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-22T07:24:33.063 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-22T07:24:33.096 INFO:tasks.workunit:Stopping ['suites/iozone.sh'] on client.0... 2024-04-22T07:24:33.096 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-22T07:24:33.436 DEBUG:teuthology.parallel:result is None 2024-04-22T07:24:33.437 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-22T07:24:33.468 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-22T07:24:33.468 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-04-22T07:24:33.479 INFO:tasks.quiescer:joining Quiescers 2024-04-22T07:24:33.480 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:24:33.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.612+0000 7f9ff9d67640 1 Processor -- start 2024-04-22T07:24:33.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.612+0000 7f9ff9d67640 1 -- start start 2024-04-22T07:24:33.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.613+0000 7f9ff9d67640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ff40ceb10 0x7f9ff40c5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:33.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.613+0000 7f9ff9d67640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9ff40c97a0 0x7f9ff40ceef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:33.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.613+0000 7f9ff9d67640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ff40c93d0 con 0x7f9ff415bff0 2024-04-22T07:24:33.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.613+0000 7f9ff9d67640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f9ff40cdab0 con 0x7f9ff40c97a0 2024-04-22T07:24:33.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.613+0000 7f9ff9d67640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9ff40ca750 con 0x7f9ff40ceb10 2024-04-22T07:24:33.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.613+0000 7f9ff2ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9ff40c97a0 0x7f9ff40ceef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:33.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.613+0000 7f9ff3fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9ff415bff0 0x7f9ff40cb070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41228/0 (socket says 172.21.15.40:41228) 2024-04-22T07:24:33.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.613+0000 7f9ff3fff640 1 -- 172.21.15.40:0/1806140793 learned_addr learned my addr 172.21.15.40:0/1806140793 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:24:33.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.613+0000 7f9ff37fe640 1 --2- 172.21.15.40:0/1806140793 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ff40ceb10 0x7f9ff40c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:33.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.613+0000 7f9ff27fc640 1 -- 172.21.15.40:0/1806140793 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3491504088 0 0) 0x7f9ff40c93d0 con 0x7f9ff415bff0 2024-04-22T07:24:33.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.613+0000 7f9ff27fc640 1 -- 172.21.15.40:0/1806140793 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fdc003520 con 0x7f9ff415bff0 2024-04-22T07:24:33.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.613+0000 7f9ff2ffd640 1 -- 172.21.15.40:0/1806140793 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ff40ceb10 msgr2=0x7f9ff40c5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:33.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.613+0000 7f9ff2ffd640 1 --2- 172.21.15.40:0/1806140793 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ff40ceb10 0x7f9ff40c5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:33.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.613+0000 7f9ff2ffd640 1 -- 172.21.15.40:0/1806140793 >> v1:172.21.15.40:6789/0 conn(0x7f9ff415bff0 legacy=0x7f9ff40cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:33.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.613+0000 7f9ff2ffd640 1 -- 172.21.15.40:0/1806140793 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff40caa30 con 0x7f9ff40c97a0 2024-04-22T07:24:33.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.613+0000 7f9ff37fe640 1 --2- 172.21.15.40:0/1806140793 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ff40ceb10 0x7f9ff40c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:24:33.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.614+0000 7f9ff2ffd640 1 --2- 172.21.15.40:0/1806140793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ff40c97a0 0x7f9ff40ceef0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40097a0 tx=0x7f9fe402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2499e79b595862 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:33.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.614+0000 7f9ff27fc640 1 -- 172.21.15.40:0/1806140793 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4034070 con 0x7f9ff40c97a0 2024-04-22T07:24:33.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.614+0000 7f9ff27fc640 1 -- 172.21.15.40:0/1806140793 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe4030610 con 0x7f9ff40c97a0 2024-04-22T07:24:33.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.614+0000 7f9ff27fc640 1 -- 172.21.15.40:0/1806140793 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe40309e0 con 0x7f9ff40c97a0 2024-04-22T07:24:33.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.615+0000 7f9ff9d67640 1 -- 172.21.15.40:0/1806140793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ff40c97a0 msgr2=0x7f9ff40ceef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:33.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.615+0000 7f9ff9d67640 1 --2- 172.21.15.40:0/1806140793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ff40c97a0 0x7f9ff40ceef0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40097a0 tx=0x7f9fe402b960 comp rx=0 tx=0).stop 2024-04-22T07:24:33.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.615+0000 7f9ff9d67640 1 -- 172.21.15.40:0/1806140793 shutdown_connections 2024-04-22T07:24:33.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.615+0000 7f9ff9d67640 1 --2- 172.21.15.40:0/1806140793 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ff40c97a0 0x7f9ff40ceef0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:33.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.615+0000 7f9ff9d67640 1 --2- 172.21.15.40:0/1806140793 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ff40ceb10 0x7f9ff40c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:33.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.615+0000 7f9ff9d67640 1 -- 172.21.15.40:0/1806140793 >> 172.21.15.40:0/1806140793 conn(0x7f9ff406df50 msgr2=0x7f9ff406e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:33.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.615+0000 7f9ff9d67640 1 -- 172.21.15.40:0/1806140793 shutdown_connections 2024-04-22T07:24:33.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.615+0000 7f9ff9d67640 1 -- 172.21.15.40:0/1806140793 wait complete. 2024-04-22T07:24:33.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.616+0000 7f9ff9d67640 1 Processor -- start 2024-04-22T07:24:33.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.616+0000 7f9ff9d67640 1 -- start start 2024-04-22T07:24:33.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.617+0000 7f9ff9d67640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ff40c97a0 0x7f9ff414e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:33.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.617+0000 7f9ff9d67640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ff40ceb10 0x7f9ff41f15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:33.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.617+0000 7f9ff9d67640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ff415bff0 0x7f9ff41f4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:33.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.617+0000 7f9ff9d67640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff40cd740 con 0x7f9ff40c97a0 2024-04-22T07:24:33.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.617+0000 7f9ff9d67640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff40cd460 con 0x7f9ff415bff0 2024-04-22T07:24:33.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.617+0000 7f9ff9d67640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9ff41530b0 con 0x7f9ff40ceb10 2024-04-22T07:24:33.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.617+0000 7f9ff37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ff40c97a0 0x7f9ff414e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:33.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.617+0000 7f9ff37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ff40c97a0 0x7f9ff414e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53354/0 (socket says 172.21.15.40:53354) 2024-04-22T07:24:33.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.617+0000 7f9ff37fe640 1 -- 172.21.15.40:0/672478431 learned_addr learned my addr 172.21.15.40:0/672478431 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:33.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.617+0000 7f9ff2ffd640 1 --2- 172.21.15.40:0/672478431 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ff40ceb10 0x7f9ff41f15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:33.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.617+0000 7f9ff3fff640 1 --2- 172.21.15.40:0/672478431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ff415bff0 0x7f9ff41f4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:33.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.617+0000 7f9ff37fe640 1 -- 172.21.15.40:0/672478431 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ff40ceb10 msgr2=0x7f9ff41f15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:33.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.617+0000 7f9ff37fe640 1 --2- 172.21.15.40:0/672478431 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ff40ceb10 0x7f9ff41f15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:33.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.617+0000 7f9ff37fe640 1 -- 172.21.15.40:0/672478431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ff415bff0 msgr2=0x7f9ff41f4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:33.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.617+0000 7f9ff37fe640 1 --2- 172.21.15.40:0/672478431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ff415bff0 0x7f9ff41f4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:33.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.617+0000 7f9ff37fe640 1 -- 172.21.15.40:0/672478431 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff41f0b10 con 0x7f9ff40c97a0 2024-04-22T07:24:33.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.617+0000 7f9ff2ffd640 1 --2- 172.21.15.40:0/672478431 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ff40ceb10 0x7f9ff41f15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:24:33.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.617+0000 7f9ff3fff640 1 --2- 172.21.15.40:0/672478431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ff415bff0 0x7f9ff41f4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:24:33.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.617+0000 7f9ff37fe640 1 --2- 172.21.15.40:0/672478431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ff40c97a0 0x7f9ff414e180 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9fe800e810 tx=0x7f9fe800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:33.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.617+0000 7f9fdbfff640 1 -- 172.21.15.40:0/672478431 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe800f040 con 0x7f9ff40c97a0 2024-04-22T07:24:33.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.618+0000 7f9fdbfff640 1 -- 172.21.15.40:0/672478431 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fe8004030 con 0x7f9ff40c97a0 2024-04-22T07:24:33.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.618+0000 7f9fdbfff640 1 -- 172.21.15.40:0/672478431 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8004400 con 0x7f9ff40c97a0 2024-04-22T07:24:33.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.618+0000 7f9ff9d67640 1 -- 172.21.15.40:0/672478431 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ff414d700 con 0x7f9ff40c97a0 2024-04-22T07:24:33.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.618+0000 7f9ff9d67640 1 -- 172.21.15.40:0/672478431 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ff414dcc0 con 0x7f9ff40c97a0 2024-04-22T07:24:33.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.619+0000 7f9ff9d67640 1 -- 172.21.15.40:0/672478431 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ff4076080 con 0x7f9ff40c97a0 2024-04-22T07:24:33.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.619+0000 7f9fdbfff640 1 -- 172.21.15.40:0/672478431 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9fe800c6d0 con 0x7f9ff40c97a0 2024-04-22T07:24:33.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.619+0000 7f9fdbfff640 1 --2- 172.21.15.40:0/672478431 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9fe006c920 0x7f9fe006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:33.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.620+0000 7f9ff2ffd640 1 --2- 172.21.15.40:0/672478431 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9fe006c920 0x7f9fe006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:33.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.620+0000 7f9fdbfff640 1 -- 172.21.15.40:0/672478431 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f9fe808b970 con 0x7f9ff40c97a0 2024-04-22T07:24:33.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.620+0000 7f9ff2ffd640 1 --2- 172.21.15.40:0/672478431 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9fe006c920 0x7f9fe006ede0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4036000 tx=0x7f9fe4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:33.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.624+0000 7f9fdbfff640 1 -- 172.21.15.40:0/672478431 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9ff4076080 con 0x7f9ff40c97a0 2024-04-22T07:24:33.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.851+0000 7f9ff9d67640 1 -- 172.21.15.40:0/672478431 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ff4069d40 con 0x7f9ff40c97a0 2024-04-22T07:24:33.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.852+0000 7f9fdbfff640 1 -- 172.21.15.40:0/672478431 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6821 (secure 0 0 0) 0x7f9fe8017020 con 0x7f9ff40c97a0 2024-04-22T07:24:33.850 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:24:33.850 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1193926607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1193926607},{"type":"v1","addr":"172.21.15.62:6835","nonce":1193926607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/602167189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":602167189},{"type":"v1","addr":"172.21.15.62:6837","nonce":602167189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2062933254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2062933254},{"type":"v1","addr":"172.21.15.40:6835","nonce":2062933254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3873524978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3873524978},{"type":"v1","addr":"172.21.15.40:6837","nonce":3873524978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/1922761385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":1922761385},{"type":"v1","addr":"172.21.15.40:6839","nonce":1922761385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:20:53.216204+0000","modified":"2024-04-22T07:20:58.875393+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.62:6836/2884673656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2884673656},{"type":"v1","addr":"172.21.15.62:6836","nonce":2884673656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4305]},"id":1}]} 2024-04-22T07:24:33.851 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-04-22T07:24:33.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.854+0000 7f9ff9d67640 1 -- 172.21.15.40:0/672478431 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9fe006c920 msgr2=0x7f9fe006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:33.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.854+0000 7f9ff9d67640 1 --2- 172.21.15.40:0/672478431 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9fe006c920 0x7f9fe006ede0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4036000 tx=0x7f9fe4008030 comp rx=0 tx=0).stop 2024-04-22T07:24:33.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.854+0000 7f9ff9d67640 1 -- 172.21.15.40:0/672478431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ff40c97a0 msgr2=0x7f9ff414e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:33.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.854+0000 7f9ff9d67640 1 --2- 172.21.15.40:0/672478431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ff40c97a0 0x7f9ff414e180 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9fe800e810 tx=0x7f9fe800ecd0 comp rx=0 tx=0).stop 2024-04-22T07:24:33.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.854+0000 7f9ff9d67640 1 -- 172.21.15.40:0/672478431 shutdown_connections 2024-04-22T07:24:33.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.854+0000 7f9ff9d67640 1 --2- 172.21.15.40:0/672478431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ff415bff0 0x7f9ff41f4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:33.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.854+0000 7f9ff9d67640 1 --2- 172.21.15.40:0/672478431 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9ff40ceb10 0x7f9ff41f15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:33.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.854+0000 7f9ff9d67640 1 --2- 172.21.15.40:0/672478431 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f9fe006c920 0x7f9fe006ede0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:33.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.854+0000 7f9ff9d67640 1 --2- 172.21.15.40:0/672478431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ff40c97a0 0x7f9ff414e180 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:33.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.854+0000 7f9ff9d67640 1 -- 172.21.15.40:0/672478431 >> 172.21.15.40:0/672478431 conn(0x7f9ff406df50 msgr2=0x7f9ff40713f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:33.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.854+0000 7f9ff9d67640 1 -- 172.21.15.40:0/672478431 shutdown_connections 2024-04-22T07:24:33.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.854+0000 7f9ff9d67640 1 -- 172.21.15.40:0/672478431 wait complete. 2024-04-22T07:24:33.867 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4305 quiesce db --cancel --all' 2024-04-22T07:24:33.867 DEBUG:teuthology.orchestra.run.smithi040:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4305 quiesce db --cancel --all 2024-04-22T07:24:33.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.975+0000 7fdb4f4c1640 1 Processor -- start 2024-04-22T07:24:33.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.976+0000 7fdb4f4c1640 1 -- start start 2024-04-22T07:24:33.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.976+0000 7fdb4f4c1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdb48067920 0x7fdb48073380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:33.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.976+0000 7fdb4f4c1640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb480c8930 con 0x7fdb48067d00 2024-04-22T07:24:33.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.976+0000 7fdb4f4c1640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb4806d020 con 0x7fdb480cab50 2024-04-22T07:24:33.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.976+0000 7fdb4f4c1640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fdb480c9520 con 0x7fdb48067920 2024-04-22T07:24:33.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.977+0000 7fdb4ca5c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fdb48067d00 0x7fdb48154c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41236/0 (socket says 172.21.15.40:41236) 2024-04-22T07:24:33.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.977+0000 7fdb4ca5c640 1 -- 172.21.15.40:0/2051970167 learned_addr learned my addr 172.21.15.40:0/2051970167 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:24:33.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.977+0000 7fdb4d25d640 1 --2- 172.21.15.40:0/2051970167 >> v2:172.21.15.62:3300/0 conn(0x7fdb48067920 0x7fdb48073380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:33.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.977+0000 7fdb3ffff640 1 -- 172.21.15.40:0/2051970167 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1112833114 0 0) 0x7fdb480c8930 con 0x7fdb48067d00 2024-04-22T07:24:33.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.977+0000 7fdb3ffff640 1 -- 172.21.15.40:0/2051970167 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb34003520 con 0x7fdb48067d00 2024-04-22T07:24:33.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.977+0000 7fdb4d25d640 1 -- 172.21.15.40:0/2051970167 >> v1:172.21.15.62:6789/0 conn(0x7fdb480cab50 legacy=0x7fdb4815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:33.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.977+0000 7fdb3ffff640 1 -- 172.21.15.40:0/2051970167 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2310751782 0 0) 0x7fdb34003520 con 0x7fdb48067d00 2024-04-22T07:24:33.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.977+0000 7fdb4d25d640 1 -- 172.21.15.40:0/2051970167 >> v1:172.21.15.40:6789/0 conn(0x7fdb48067d00 legacy=0x7fdb48154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:33.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.977+0000 7fdb4d25d640 1 -- 172.21.15.40:0/2051970167 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb480c8bf0 con 0x7fdb48067920 2024-04-22T07:24:33.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.978+0000 7fdb4d25d640 1 --2- 172.21.15.40:0/2051970167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb48067920 0x7fdb48073380 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdb440097a0 tx=0x7fdb4402b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8d865a0aa9294ee server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:33.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.978+0000 7fdb3ffff640 1 -- 172.21.15.40:0/2051970167 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb44037070 con 0x7fdb48067920 2024-04-22T07:24:33.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.978+0000 7fdb3ffff640 1 -- 172.21.15.40:0/2051970167 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb44030510 con 0x7fdb48067920 2024-04-22T07:24:33.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.978+0000 7fdb3ffff640 1 -- 172.21.15.40:0/2051970167 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb38001670 con 0x7fdb48067920 2024-04-22T07:24:33.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.979+0000 7fdb4f4c1640 1 -- 172.21.15.40:0/2051970167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb48067920 msgr2=0x7fdb48073380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:33.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.979+0000 7fdb4f4c1640 1 --2- 172.21.15.40:0/2051970167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb48067920 0x7fdb48073380 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdb440097a0 tx=0x7fdb4402b710 comp rx=0 tx=0).stop 2024-04-22T07:24:33.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.979+0000 7fdb4f4c1640 1 -- 172.21.15.40:0/2051970167 shutdown_connections 2024-04-22T07:24:33.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.979+0000 7fdb4f4c1640 1 --2- 172.21.15.40:0/2051970167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb48067920 0x7fdb48073380 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:33.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.979+0000 7fdb4f4c1640 1 -- 172.21.15.40:0/2051970167 >> 172.21.15.40:0/2051970167 conn(0x7fdb480cdb50 msgr2=0x7fdb480ca020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:33.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.979+0000 7fdb4f4c1640 1 -- 172.21.15.40:0/2051970167 shutdown_connections 2024-04-22T07:24:33.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.979+0000 7fdb4f4c1640 1 -- 172.21.15.40:0/2051970167 wait complete. 2024-04-22T07:24:33.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.980+0000 7fdb4f4c1640 1 Processor -- start 2024-04-22T07:24:33.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.980+0000 7fdb4f4c1640 1 -- start start 2024-04-22T07:24:33.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.981+0000 7fdb4f4c1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb48067920 0x7fdb481576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:33.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.981+0000 7fdb4f4c1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb48067d00 0x7fdb48153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:33.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.981+0000 7fdb4f4c1640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdb480cab50 0x7fdb48158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:33.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.981+0000 7fdb4f4c1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdb48155350 con 0x7fdb48067920 2024-04-22T07:24:33.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.981+0000 7fdb4f4c1640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdb480c91b0 con 0x7fdb48067d00 2024-04-22T07:24:33.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.981+0000 7fdb4f4c1640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fdb481554d0 con 0x7fdb480cab50 2024-04-22T07:24:33.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.981+0000 7fdb4d25d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb48067920 0x7fdb481576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:33.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.981+0000 7fdb4d25d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb48067920 0x7fdb481576d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53370/0 (socket says 172.21.15.40:53370) 2024-04-22T07:24:33.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.981+0000 7fdb4d25d640 1 -- 172.21.15.40:0/3943963897 learned_addr learned my addr 172.21.15.40:0/3943963897 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:33.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.981+0000 7fdb4ca5c640 1 --2- 172.21.15.40:0/3943963897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb48067d00 0x7fdb48153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:33.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.981+0000 7fdb4da5e640 1 --2- 172.21.15.40:0/3943963897 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdb480cab50 0x7fdb48158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:33.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.981+0000 7fdb4d25d640 1 -- 172.21.15.40:0/3943963897 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdb480cab50 msgr2=0x7fdb48158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:33.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.981+0000 7fdb4d25d640 1 --2- 172.21.15.40:0/3943963897 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdb480cab50 0x7fdb48158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:33.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.981+0000 7fdb4d25d640 1 -- 172.21.15.40:0/3943963897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb48067d00 msgr2=0x7fdb48153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:33.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.981+0000 7fdb4d25d640 1 --2- 172.21.15.40:0/3943963897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb48067d00 0x7fdb48153370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:33.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.981+0000 7fdb4d25d640 1 -- 172.21.15.40:0/3943963897 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb48157d60 con 0x7fdb48067920 2024-04-22T07:24:33.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.981+0000 7fdb4ca5c640 1 --2- 172.21.15.40:0/3943963897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb48067d00 0x7fdb48153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:24:33.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.981+0000 7fdb4d25d640 1 --2- 172.21.15.40:0/3943963897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb48067920 0x7fdb481576d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdb4402b750 tx=0x7fdb440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:33.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.981+0000 7fdb3dffb640 1 -- 172.21.15.40:0/3943963897 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb44042020 con 0x7fdb48067920 2024-04-22T07:24:33.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.981+0000 7fdb3dffb640 1 -- 172.21.15.40:0/3943963897 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb440044c0 con 0x7fdb48067920 2024-04-22T07:24:33.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.981+0000 7fdb4f4c1640 1 -- 172.21.15.40:0/3943963897 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb48158040 con 0x7fdb48067920 2024-04-22T07:24:33.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.981+0000 7fdb3dffb640 1 -- 172.21.15.40:0/3943963897 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb44037040 con 0x7fdb48067920 2024-04-22T07:24:33.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.982+0000 7fdb4f4c1640 1 -- 172.21.15.40:0/3943963897 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb481f3f80 con 0x7fdb48067920 2024-04-22T07:24:33.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.983+0000 7fdb3dffb640 1 -- 172.21.15.40:0/3943963897 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdb44045020 con 0x7fdb48067920 2024-04-22T07:24:33.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.983+0000 7fdb3dffb640 1 --2- 172.21.15.40:0/3943963897 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fdb2c06c920 0x7fdb2c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:33.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.983+0000 7fdb3dffb640 1 -- 172.21.15.40:0/3943963897 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fdb440ada10 con 0x7fdb48067920 2024-04-22T07:24:33.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.984+0000 7fdb4ca5c640 1 --2- 172.21.15.40:0/3943963897 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fdb2c06c920 0x7fdb2c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:33.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.984+0000 7fdb4ca5c640 1 --2- 172.21.15.40:0/3943963897 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fdb2c06c920 0x7fdb2c06ede0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdb48073580 tx=0x7fdb38009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:33.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.984+0000 7fdb52192740 1 Processor -- start 2024-04-22T07:24:33.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.984+0000 7fdb52192740 1 -- start start 2024-04-22T07:24:33.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.985+0000 7fdb52192740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f1964f310 0x564f1960fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:33.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.985+0000 7fdb52192740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f1964f6f0 0x564f1964fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:33.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.985+0000 7fdb52192740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f1960c240 0x564f19658420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:33.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.985+0000 7fdb52192740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x564f19574000 con 0x564f1960c240 2024-04-22T07:24:33.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.985+0000 7fdb52192740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564f19510b20 con 0x564f1964f6f0 2024-04-22T07:24:33.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.985+0000 7fdb52192740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x564f1956ffc0 con 0x564f1964f310 2024-04-22T07:24:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.985+0000 7fdb4da5e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f1960c240 0x564f19658420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.985+0000 7fdb4da5e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f1960c240 0x564f19658420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53378/0 (socket says 172.21.15.40:53378) 2024-04-22T07:24:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.985+0000 7fdb4da5e640 1 -- 172.21.15.40:0/4061963145 learned_addr learned my addr 172.21.15.40:0/4061963145 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.985+0000 7fdb4d25d640 1 --2- 172.21.15.40:0/4061963145 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f1964f310 0x564f1960fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.985+0000 7fdb4ca5c640 1 --2- 172.21.15.40:0/4061963145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f1964f6f0 0x564f1964fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.985+0000 7fdb4da5e640 1 -- 172.21.15.40:0/4061963145 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f1964f310 msgr2=0x564f1960fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.985+0000 7fdb4da5e640 1 --2- 172.21.15.40:0/4061963145 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f1964f310 0x564f1960fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.985+0000 7fdb4da5e640 1 -- 172.21.15.40:0/4061963145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f1964f6f0 msgr2=0x564f1964fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.985+0000 7fdb4da5e640 1 --2- 172.21.15.40:0/4061963145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f1964f6f0 0x564f1964fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.985+0000 7fdb4da5e640 1 -- 172.21.15.40:0/4061963145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f1952aea0 con 0x564f1960c240 2024-04-22T07:24:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.986+0000 7fdb4d25d640 1 --2- 172.21.15.40:0/4061963145 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f1964f310 0x564f1960fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:24:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.986+0000 7fdb4ca5c640 1 --2- 172.21.15.40:0/4061963145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f1964f6f0 0x564f1964fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:24:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.986+0000 7fdb4da5e640 1 --2- 172.21.15.40:0/4061963145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f1960c240 0x564f19658420 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdb40001e30 tx=0x7fdb4000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e1e5cc57e675d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.986+0000 7fdb32ffd640 1 -- 172.21.15.40:0/4061963145 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb40019070 con 0x564f1960c240 2024-04-22T07:24:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.986+0000 7fdb32ffd640 1 -- 172.21.15.40:0/4061963145 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb4000ebe0 con 0x564f1960c240 2024-04-22T07:24:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.986+0000 7fdb32ffd640 1 -- 172.21.15.40:0/4061963145 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb40003970 con 0x564f1960c240 2024-04-22T07:24:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.986+0000 7fdb52192740 1 -- 172.21.15.40:0/4061963145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f1960c240 msgr2=0x564f19658420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.986+0000 7fdb52192740 1 --2- 172.21.15.40:0/4061963145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f1960c240 0x564f19658420 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdb40001e30 tx=0x7fdb4000e530 comp rx=0 tx=0).stop 2024-04-22T07:24:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.986+0000 7fdb52192740 1 -- 172.21.15.40:0/4061963145 shutdown_connections 2024-04-22T07:24:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.986+0000 7fdb52192740 1 --2- 172.21.15.40:0/4061963145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f1960c240 0x564f19658420 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.986+0000 7fdb52192740 1 --2- 172.21.15.40:0/4061963145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f1964f6f0 0x564f1964fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.986+0000 7fdb52192740 1 --2- 172.21.15.40:0/4061963145 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f1964f310 0x564f1960fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.986+0000 7fdb52192740 1 -- 172.21.15.40:0/4061963145 >> 172.21.15.40:0/4061963145 conn(0x564f1960aef0 msgr2=0x564f1960d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.986+0000 7fdb52192740 1 -- 172.21.15.40:0/4061963145 shutdown_connections 2024-04-22T07:24:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.987+0000 7fdb52192740 1 -- 172.21.15.40:0/4061963145 wait complete. 2024-04-22T07:24:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.987+0000 7fdb52192740 1 -- start start 2024-04-22T07:24:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.987+0000 7fdb52192740 1 Processor -- start 2024-04-22T07:24:33.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.988+0000 7fdb52192740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f1964f310 0x564f19630d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:33.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.988+0000 7fdb52192740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f1964f6f0 0x564f19633460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:33.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.988+0000 7fdb52192740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f19662de0 0x564f196638c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:33.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.988+0000 7fdb52192740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x564f19657f90 con 0x564f1964f310 2024-04-22T07:24:33.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.988+0000 7fdb52192740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564f1950e510 con 0x564f1964f6f0 2024-04-22T07:24:33.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.988+0000 7fdb52192740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x564f1960e7b0 con 0x564f19662de0 2024-04-22T07:24:33.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.988+0000 7fdb52192740 10 client.0 _ll_register_callbacks cb 0x564f1950df00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:24:33.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.988+0000 7fdb4d25d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f1964f310 0x564f19630d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:33.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.988+0000 7fdb4d25d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f1964f310 0x564f19630d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53388/0 (socket says 172.21.15.40:53388) 2024-04-22T07:24:33.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.988+0000 7fdb4d25d640 1 -- 172.21.15.40:0/1360205060 learned_addr learned my addr 172.21.15.40:0/1360205060 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:33.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.988+0000 7fdb4ca5c640 1 --2- 172.21.15.40:0/1360205060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f1964f6f0 0x564f19633460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:33.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.988+0000 7fdb4da5e640 1 --2- 172.21.15.40:0/1360205060 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f19662de0 0x564f196638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:33.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.988+0000 7fdb4d25d640 1 -- 172.21.15.40:0/1360205060 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f19662de0 msgr2=0x564f196638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:33.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.988+0000 7fdb4d25d640 1 --2- 172.21.15.40:0/1360205060 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f19662de0 0x564f196638c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:33.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.988+0000 7fdb4d25d640 1 -- 172.21.15.40:0/1360205060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f1964f6f0 msgr2=0x564f19633460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:33.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.988+0000 7fdb4d25d640 1 --2- 172.21.15.40:0/1360205060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f1964f6f0 0x564f19633460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:33.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.988+0000 7fdb4d25d640 1 -- 172.21.15.40:0/1360205060 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f19352a20 con 0x564f1964f310 2024-04-22T07:24:33.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.989+0000 7fdb4d25d640 1 --2- 172.21.15.40:0/1360205060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f1964f310 0x564f19630d80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdb44003fd0 tx=0x7fdb4407b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3061d7120d571621 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:33.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.989+0000 7fdb27fff640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-04-22T07:24:33.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.989+0000 7fdb27fff640 1 -- 172.21.15.40:0/1360205060 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4407b680 con 0x564f1964f310 2024-04-22T07:24:33.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.989+0000 7fdb27fff640 1 -- 172.21.15.40:0/1360205060 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fdb44077cf0 con 0x564f1964f310 2024-04-22T07:24:33.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.989+0000 7fdb52192740 1 -- 172.21.15.40:0/1360205060 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb4000ebe0 con 0x564f1964f310 2024-04-22T07:24:33.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.989+0000 7fdb27fff640 1 -- 172.21.15.40:0/1360205060 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fdb4407fa30 con 0x564f1964f310 2024-04-22T07:24:33.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.989+0000 7fdb52192740 10 client.5064 fetch_fsmap learned FSMap version 8 2024-04-22T07:24:33.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.989+0000 7fdb52192740 1 -- 172.21.15.40:0/1360205060 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x564f193b31b0 con 0x564f1964f310 2024-04-22T07:24:33.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.989+0000 7fdb27fff640 1 -- 172.21.15.40:0/1360205060 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb4000ebe0 con 0x564f1964f310 2024-04-22T07:24:33.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.989+0000 7fdb27fff640 1 -- 172.21.15.40:0/1360205060 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fdb44083dd0 con 0x564f1964f310 2024-04-22T07:24:33.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.989+0000 7fdb52192740 10 client.5064 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:24:33.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.989+0000 7fdb52192740 10 client.5064 resolve_mds: validated gid 4305 aka daemon mds.b 2024-04-22T07:24:33.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.989+0000 7fdb52192740 20 client.5064 populate_metadata read hostname 'smithi040' 2024-04-22T07:24:33.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.989+0000 7fdb52192740 1 --2- 172.21.15.40:0/1360205060 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x564f19648540 0x564f19648980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:33.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.989+0000 7fdb52192740 4 client.5064 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-22T07:24:33.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.989+0000 7fdb52192740 1 -- 172.21.15.40:0/1360205060 --> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f19581a20 con 0x564f19648540 2024-04-22T07:24:33.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.989+0000 7fdb4ca5c640 1 --2- 172.21.15.40:0/1360205060 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x564f19648540 0x564f19648980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:33.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.990+0000 7fdb27fff640 10 client.5064 ms_handle_connect on v2:172.21.15.62:6833/2884673656 2024-04-22T07:24:33.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.990+0000 7fdb4ca5c640 1 --2- 172.21.15.40:0/1360205060 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x564f19648540 0x564f19648980 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58615492da6b0cbf server_cookie=d737ae2034366425 in_seq=0 out_seq=0 2024-04-22T07:24:33.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.990+0000 7fdb27fff640 1 -- 172.21.15.40:0/1360205060 <== mds.0 v2:172.21.15.62:6833/2884673656 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564f19581a20 con 0x564f19648540 2024-04-22T07:24:33.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.990+0000 7fdb27fff640 10 client.5064 handle_command_reply: tid=0 2024-04-22T07:24:33.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.990+0000 7fdb52192740 1 client.5064 shutdown 2024-04-22T07:24:33.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.991+0000 7fdb52192740 1 -- 172.21.15.40:0/1360205060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f1964f310 msgr2=0x564f19630d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:33.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.991+0000 7fdb52192740 1 --2- 172.21.15.40:0/1360205060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f1964f310 0x564f19630d80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdb44003fd0 tx=0x7fdb4407b280 comp rx=0 tx=0).stop 2024-04-22T07:24:33.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.991+0000 7fdb52192740 1 -- 172.21.15.40:0/1360205060 shutdown_connections 2024-04-22T07:24:33.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.991+0000 7fdb52192740 1 --2- 172.21.15.40:0/1360205060 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x564f19648540 0x564f19648980 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:33.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.991+0000 7fdb52192740 1 --2- 172.21.15.40:0/1360205060 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f19662de0 0x564f196638c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:33.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.991+0000 7fdb52192740 1 --2- 172.21.15.40:0/1360205060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f1964f6f0 0x564f19633460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:33.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.991+0000 7fdb27fff640 0 client.5064 ms_handle_reset on v2:172.21.15.62:6833/2884673656 2024-04-22T07:24:33.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.991+0000 7fdb52192740 1 --2- 172.21.15.40:0/1360205060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f1964f310 0x564f19630d80 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:33.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.991+0000 7fdb52192740 1 -- 172.21.15.40:0/1360205060 >> 172.21.15.40:0/1360205060 conn(0x564f1960c240 msgr2=0x564f1960ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:33.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.991+0000 7fdb52192740 1 -- 172.21.15.40:0/1360205060 shutdown_connections 2024-04-22T07:24:33.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.991+0000 7fdb52192740 1 -- 172.21.15.40:0/1360205060 wait complete. 2024-04-22T07:24:33.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:33.991+0000 7fdb52192740 20 client.5064 trim_cache size 0 max 16384 2024-04-22T07:24:34.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.009+0000 7fdb52192740 1 Processor -- start 2024-04-22T07:24:34.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.009+0000 7fdb52192740 1 -- start start 2024-04-22T07:24:34.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.009+0000 7fdb52192740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f1964f310 0x564f1964fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:34.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.009+0000 7fdb52192740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f1964f6f0 0x564f196344c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:34.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.009+0000 7fdb52192740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f19662de0 0x564f19634a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:34.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.009+0000 7fdb52192740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdb481fdf10 con 0x564f19662de0 2024-04-22T07:24:34.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.009+0000 7fdb52192740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdb481fcdf0 con 0x564f1964f6f0 2024-04-22T07:24:34.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.009+0000 7fdb52192740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fdb4814cce0 con 0x564f1964f310 2024-04-22T07:24:34.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.010+0000 7fdb4da5e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f19662de0 0x564f19634a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:34.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.010+0000 7fdb4da5e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f19662de0 0x564f19634a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53404/0 (socket says 172.21.15.40:53404) 2024-04-22T07:24:34.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.010+0000 7fdb4da5e640 1 -- 172.21.15.40:0/694447364 learned_addr learned my addr 172.21.15.40:0/694447364 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:34.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.010+0000 7fdb4d25d640 1 --2- 172.21.15.40:0/694447364 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f1964f310 0x564f1964fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:34.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.010+0000 7fdb4ca5c640 1 --2- 172.21.15.40:0/694447364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f1964f6f0 0x564f196344c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:34.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.010+0000 7fdb4da5e640 1 -- 172.21.15.40:0/694447364 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f1964f310 msgr2=0x564f1964fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:34.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.010+0000 7fdb4da5e640 1 --2- 172.21.15.40:0/694447364 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f1964f310 0x564f1964fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.010+0000 7fdb4da5e640 1 -- 172.21.15.40:0/694447364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f1964f6f0 msgr2=0x564f196344c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:34.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.010+0000 7fdb4da5e640 1 --2- 172.21.15.40:0/694447364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f1964f6f0 0x564f196344c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.010+0000 7fdb4da5e640 1 -- 172.21.15.40:0/694447364 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f19246310 con 0x564f19662de0 2024-04-22T07:24:34.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.010+0000 7fdb4da5e640 1 --2- 172.21.15.40:0/694447364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f19662de0 0x564f19634a00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdb4000ea30 tx=0x7fdb4000c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a970001b4a7093cb server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:34.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.010+0000 7fdb327fc640 1 -- 172.21.15.40:0/694447364 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb40019040 con 0x564f19662de0 2024-04-22T07:24:34.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.010+0000 7fdb327fc640 1 -- 172.21.15.40:0/694447364 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb40006d30 con 0x564f19662de0 2024-04-22T07:24:34.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.010+0000 7fdb327fc640 1 -- 172.21.15.40:0/694447364 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb40003b90 con 0x564f19662de0 2024-04-22T07:24:34.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.011+0000 7fdb52192740 1 -- 172.21.15.40:0/694447364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f19662de0 msgr2=0x564f19634a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:34.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.011+0000 7fdb52192740 1 --2- 172.21.15.40:0/694447364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f19662de0 0x564f19634a00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdb4000ea30 tx=0x7fdb4000c000 comp rx=0 tx=0).stop 2024-04-22T07:24:34.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.011+0000 7fdb52192740 1 -- 172.21.15.40:0/694447364 shutdown_connections 2024-04-22T07:24:34.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.011+0000 7fdb52192740 1 --2- 172.21.15.40:0/694447364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f19662de0 0x564f19634a00 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.011+0000 7fdb52192740 1 --2- 172.21.15.40:0/694447364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f1964f6f0 0x564f196344c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.011+0000 7fdb52192740 1 --2- 172.21.15.40:0/694447364 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f1964f310 0x564f1964fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.011+0000 7fdb52192740 1 -- 172.21.15.40:0/694447364 >> 172.21.15.40:0/694447364 conn(0x564f1960c240 msgr2=0x564f19604510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:34.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.011+0000 7fdb52192740 1 -- 172.21.15.40:0/694447364 shutdown_connections 2024-04-22T07:24:34.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.011+0000 7fdb52192740 1 -- 172.21.15.40:0/694447364 wait complete. 2024-04-22T07:24:34.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.011+0000 7fdb52192740 1 -- start start 2024-04-22T07:24:34.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.012+0000 7fdb52192740 1 Processor -- start 2024-04-22T07:24:34.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.012+0000 7fdb52192740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f1964f310 0x564f19673c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:34.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.012+0000 7fdb52192740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f1964f6f0 0x564f196c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:34.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.012+0000 7fdb52192740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f19662de0 0x564f196c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:34.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.012+0000 7fdb52192740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4814fa10 con 0x564f19662de0 2024-04-22T07:24:34.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.012+0000 7fdb52192740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdb481fc720 con 0x564f1964f6f0 2024-04-22T07:24:34.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.012+0000 7fdb52192740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fdb481fc070 con 0x564f1964f310 2024-04-22T07:24:34.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.012+0000 7fdb52192740 10 client.0 _ll_register_callbacks cb 0x7fdb4407b450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-22T07:24:34.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.012+0000 7fdb4da5e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f19662de0 0x564f196c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:34.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.013+0000 7fdb4da5e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f19662de0 0x564f196c42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53420/0 (socket says 172.21.15.40:53420) 2024-04-22T07:24:34.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.013+0000 7fdb4da5e640 1 -- 172.21.15.40:0/1383488444 learned_addr learned my addr 172.21.15.40:0/1383488444 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:34.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.013+0000 7fdb4ca5c640 1 --2- 172.21.15.40:0/1383488444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f1964f6f0 0x564f196c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:34.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.013+0000 7fdb4d25d640 1 --2- 172.21.15.40:0/1383488444 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f1964f310 0x564f19673c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:34.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.013+0000 7fdb4da5e640 1 -- 172.21.15.40:0/1383488444 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f1964f310 msgr2=0x564f19673c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:34.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.013+0000 7fdb4da5e640 1 --2- 172.21.15.40:0/1383488444 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f1964f310 0x564f19673c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.013+0000 7fdb4da5e640 1 -- 172.21.15.40:0/1383488444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f1964f6f0 msgr2=0x564f196c3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:34.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.013+0000 7fdb4da5e640 1 --2- 172.21.15.40:0/1383488444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f1964f6f0 0x564f196c3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.013+0000 7fdb4da5e640 1 -- 172.21.15.40:0/1383488444 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f19634f80 con 0x564f19662de0 2024-04-22T07:24:34.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.013+0000 7fdb4da5e640 1 --2- 172.21.15.40:0/1383488444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f19662de0 0x564f196c42b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdb40010000 tx=0x7fdb40001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e2a56fae2d2f03 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:34.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.013+0000 7fdb27fff640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-04-22T07:24:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.013+0000 7fdb27fff640 1 -- 172.21.15.40:0/1383488444 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4002e060 con 0x564f19662de0 2024-04-22T07:24:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.013+0000 7fdb27fff640 1 -- 172.21.15.40:0/1383488444 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fdb40006b30 con 0x564f19662de0 2024-04-22T07:24:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.013+0000 7fdb52192740 1 -- 172.21.15.40:0/1383488444 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb40006d30 con 0x564f19662de0 2024-04-22T07:24:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.013+0000 7fdb27fff640 1 -- 172.21.15.40:0/1383488444 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fdb40019070 con 0x564f19662de0 2024-04-22T07:24:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.013+0000 7fdb52192740 10 client.5070 fetch_fsmap learned FSMap version 8 2024-04-22T07:24:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.013+0000 7fdb52192740 1 -- 172.21.15.40:0/1383488444 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x564f19644a80 con 0x564f19662de0 2024-04-22T07:24:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.013+0000 7fdb27fff640 1 -- 172.21.15.40:0/1383488444 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb40006d30 con 0x564f19662de0 2024-04-22T07:24:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.014+0000 7fdb27fff640 1 -- 172.21.15.40:0/1383488444 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fdb40003970 con 0x564f19662de0 2024-04-22T07:24:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.014+0000 7fdb52192740 10 client.5070 fetch_fsmap finished waiting for FSMap version 8 2024-04-22T07:24:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.014+0000 7fdb52192740 10 client.5070 resolve_mds: validated gid 4305 aka daemon mds.b 2024-04-22T07:24:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.014+0000 7fdb52192740 20 client.5070 populate_metadata read hostname 'smithi040' 2024-04-22T07:24:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.014+0000 7fdb52192740 1 --2- 172.21.15.40:0/1383488444 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x564f19634ad0 0x564f1960c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.014+0000 7fdb52192740 4 client.5070 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-04-22T07:24:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.014+0000 7fdb52192740 1 -- 172.21.15.40:0/1383488444 --> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x564f1957b890 con 0x564f19634ad0 2024-04-22T07:24:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.014+0000 7fdb4d25d640 1 --2- 172.21.15.40:0/1383488444 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x564f19634ad0 0x564f1960c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.014+0000 7fdb4d25d640 1 --2- 172.21.15.40:0/1383488444 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x564f19634ad0 0x564f1960c7c0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=febc28916b2a05fd server_cookie=6a0e6a1408755fd in_seq=0 out_seq=0 2024-04-22T07:24:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.014+0000 7fdb27fff640 10 client.5070 ms_handle_connect on v2:172.21.15.62:6833/2884673656 2024-04-22T07:24:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.015+0000 7fdb27fff640 1 -- 172.21.15.40:0/1383488444 <== mds.0 v2:172.21.15.62:6833/2884673656 1 ==== command_reply(tid 0: 0 ) ==== 8+0+78 (crc 0 0 0) 0x564f1957b890 con 0x564f19634ad0 2024-04-22T07:24:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.015+0000 7fdb27fff640 10 client.5070 handle_command_reply: tid=0 2024-04-22T07:24:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.015+0000 7fdb52192740 1 client.5070 shutdown 2024-04-22T07:24:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.015+0000 7fdb52192740 1 -- 172.21.15.40:0/1383488444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f19662de0 msgr2=0x564f196c42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.015+0000 7fdb52192740 1 --2- 172.21.15.40:0/1383488444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f19662de0 0x564f196c42b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdb40010000 tx=0x7fdb40001250 comp rx=0 tx=0).stop 2024-04-22T07:24:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.015+0000 7fdb52192740 1 -- 172.21.15.40:0/1383488444 shutdown_connections 2024-04-22T07:24:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.015+0000 7fdb52192740 1 --2- 172.21.15.40:0/1383488444 >> [v2:172.21.15.62:6833/2884673656,v1:172.21.15.62:6836/2884673656] conn(0x564f19634ad0 0x564f1960c7c0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.015+0000 7fdb52192740 1 --2- 172.21.15.40:0/1383488444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564f19662de0 0x564f196c42b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.015+0000 7fdb52192740 1 --2- 172.21.15.40:0/1383488444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564f1964f6f0 0x564f196c3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.015+0000 7fdb27fff640 0 client.5070 ms_handle_reset on v2:172.21.15.62:6833/2884673656 2024-04-22T07:24:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.015+0000 7fdb52192740 1 --2- 172.21.15.40:0/1383488444 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x564f1964f310 0x564f19673c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.015+0000 7fdb52192740 1 -- 172.21.15.40:0/1383488444 >> 172.21.15.40:0/1383488444 conn(0x564f1960c240 msgr2=0x564f1964e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:34.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.015+0000 7fdb52192740 1 -- 172.21.15.40:0/1383488444 shutdown_connections 2024-04-22T07:24:34.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.015+0000 7fdb52192740 1 -- 172.21.15.40:0/1383488444 wait complete. 2024-04-22T07:24:34.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.015+0000 7fdb52192740 20 client.5070 trim_cache size 0 max 16384 2024-04-22T07:24:34.018 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-22T07:24:34.018 INFO:teuthology.orchestra.run.smithi040.stdout: "epoch": 8, 2024-04-22T07:24:34.018 INFO:teuthology.orchestra.run.smithi040.stdout: "leader": 4305, 2024-04-22T07:24:34.018 INFO:teuthology.orchestra.run.smithi040.stdout: "set_version": 12, 2024-04-22T07:24:34.018 INFO:teuthology.orchestra.run.smithi040.stdout: "sets": {} 2024-04-22T07:24:34.018 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-22T07:24:34.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.015+0000 7fdb4f4c1640 1 -- 172.21.15.40:0/3943963897 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fdb2c06c920 msgr2=0x7fdb2c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:34.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.015+0000 7fdb4f4c1640 1 --2- 172.21.15.40:0/3943963897 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fdb2c06c920 0x7fdb2c06ede0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdb48073580 tx=0x7fdb38009040 comp rx=0 tx=0).stop 2024-04-22T07:24:34.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.015+0000 7fdb4f4c1640 1 -- 172.21.15.40:0/3943963897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb48067920 msgr2=0x7fdb481576d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:34.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.015+0000 7fdb4f4c1640 1 --2- 172.21.15.40:0/3943963897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb48067920 0x7fdb481576d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdb4402b750 tx=0x7fdb440046c0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.016+0000 7fdb4f4c1640 1 -- 172.21.15.40:0/3943963897 shutdown_connections 2024-04-22T07:24:34.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.016+0000 7fdb4f4c1640 1 --2- 172.21.15.40:0/3943963897 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdb480cab50 0x7fdb48158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.016+0000 7fdb4f4c1640 1 --2- 172.21.15.40:0/3943963897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb48067d00 0x7fdb48153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.016+0000 7fdb4f4c1640 1 --2- 172.21.15.40:0/3943963897 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fdb2c06c920 0x7fdb2c06ede0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.016+0000 7fdb4f4c1640 1 --2- 172.21.15.40:0/3943963897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb48067920 0x7fdb481576d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.016+0000 7fdb4f4c1640 1 -- 172.21.15.40:0/3943963897 >> 172.21.15.40:0/3943963897 conn(0x7fdb480cdb50 msgr2=0x7fdb4806c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:34.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.016+0000 7fdb4f4c1640 1 -- 172.21.15.40:0/3943963897 shutdown_connections 2024-04-22T07:24:34.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.016+0000 7fdb4f4c1640 1 -- 172.21.15.40:0/3943963897 wait complete. 2024-04-22T07:24:34.024 INFO:tasks.quiescer:done joining Quiescers 2024-04-22T07:24:34.025 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-22T07:24:34.034 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-22T07:24:34.034 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:24:34.034 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-22T07:24:34.050 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-22T07:24:34.050 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-22T07:24:34.105 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:24:34.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.247+0000 7f1c56fc7640 1 Processor -- start 2024-04-22T07:24:34.245 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.247+0000 7f1c56fc7640 1 -- start start 2024-04-22T07:24:34.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.248+0000 7f1c56fc7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1c5006ea90 0x7f1c50158470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:34.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.248+0000 7f1c56fc7640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c500c5650 con 0x7f1c500c7d30 2024-04-22T07:24:34.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.248+0000 7f1c56fc7640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c500c3970 con 0x7f1c50151c00 2024-04-22T07:24:34.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.248+0000 7f1c56fc7640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f1c500c3720 con 0x7f1c5006ea90 2024-04-22T07:24:34.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.248+0000 7f1c55564640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1c500c7d30 0x7f1c500c81e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41238/0 (socket says 172.21.15.40:41238) 2024-04-22T07:24:34.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.248+0000 7f1c55564640 1 -- 172.21.15.40:0/3973219373 learned_addr learned my addr 172.21.15.40:0/3973219373 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:24:34.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.248+0000 7f1c4ffff640 1 --2- 172.21.15.40:0/3973219373 >> v2:172.21.15.62:3300/0 conn(0x7f1c5006ea90 0x7f1c50158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:34.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.248+0000 7f1c4f7fe640 1 -- 172.21.15.40:0/3973219373 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3888175508 0 0) 0x7f1c500c5650 con 0x7f1c500c7d30 2024-04-22T07:24:34.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.248+0000 7f1c4f7fe640 1 -- 172.21.15.40:0/3973219373 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c3c003520 con 0x7f1c500c7d30 2024-04-22T07:24:34.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.249+0000 7f1c4f7fe640 1 -- 172.21.15.40:0/3973219373 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3230925271 0 0) 0x7f1c3c003520 con 0x7f1c500c7d30 2024-04-22T07:24:34.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.249+0000 7f1c4f7fe640 1 -- 172.21.15.40:0/3973219373 >> v2:172.21.15.62:3300/0 conn(0x7f1c5006ea90 msgr2=0x7f1c50158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:34.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.249+0000 7f1c4f7fe640 1 --2- 172.21.15.40:0/3973219373 >> v2:172.21.15.62:3300/0 conn(0x7f1c5006ea90 0x7f1c50158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.249+0000 7f1c4f7fe640 1 -- 172.21.15.40:0/3973219373 >> v1:172.21.15.62:6789/0 conn(0x7f1c50151c00 legacy=0x7f1c500c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:34.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.249+0000 7f1c4f7fe640 1 -- 172.21.15.40:0/3973219373 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c500c3c50 con 0x7f1c500c7d30 2024-04-22T07:24:34.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.249+0000 7f1c4f7fe640 1 -- 172.21.15.40:0/3973219373 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7f1c40001670 con 0x7f1c500c7d30 2024-04-22T07:24:34.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.249+0000 7f1c4f7fe640 1 -- 172.21.15.40:0/3973219373 >> v1:172.21.15.40:6789/0 conn(0x7f1c500c7d30 legacy=0x7f1c500c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:34.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.249+0000 7f1c4f7fe640 1 --2- 172.21.15.40:0/3973219373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c3c0039b0 0x7f1c3c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:34.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.249+0000 7f1c4f7fe640 1 --2- 172.21.15.40:0/3973219373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c3c004800 0x7f1c3c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:34.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.249+0000 7f1c4f7fe640 1 --2- 172.21.15.40:0/3973219373 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c3c0051c0 0x7f1c3c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:34.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.249+0000 7f1c4f7fe640 1 -- 172.21.15.40:0/3973219373 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1c500c3720 con 0x7f1c3c0039b0 2024-04-22T07:24:34.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.249+0000 7f1c4f7fe640 1 -- 172.21.15.40:0/3973219373 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3c00c090 con 0x7f1c3c004800 2024-04-22T07:24:34.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.249+0000 7f1c4f7fe640 1 -- 172.21.15.40:0/3973219373 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1c3c00c290 con 0x7f1c3c0051c0 2024-04-22T07:24:34.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.249+0000 7f1c54d63640 1 --2- 172.21.15.40:0/3973219373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c3c0039b0 0x7f1c3c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:34.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.249+0000 7f1c55564640 1 --2- 172.21.15.40:0/3973219373 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c3c0051c0 0x7f1c3c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:34.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.249+0000 7f1c4ffff640 1 --2- 172.21.15.40:0/3973219373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c3c004800 0x7f1c3c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:34.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.249+0000 7f1c54d63640 1 -- 172.21.15.40:0/3973219373 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c3c0051c0 msgr2=0x7f1c3c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:34.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.249+0000 7f1c54d63640 1 --2- 172.21.15.40:0/3973219373 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c3c0051c0 0x7f1c3c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.249+0000 7f1c54d63640 1 -- 172.21.15.40:0/3973219373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c3c004800 msgr2=0x7f1c3c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:34.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.249+0000 7f1c54d63640 1 --2- 172.21.15.40:0/3973219373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c3c004800 0x7f1c3c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.249+0000 7f1c55564640 1 -- 172.21.15.40:0/3973219373 reap_dead start 2024-04-22T07:24:34.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.249+0000 7f1c54d63640 1 -- 172.21.15.40:0/3973219373 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c3c003520 con 0x7f1c3c0039b0 2024-04-22T07:24:34.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.250+0000 7f1c54d63640 1 --2- 172.21.15.40:0/3973219373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c3c0039b0 0x7f1c3c003df0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1c48001e50 tx=0x7f1c3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5780d3393754db7a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:34.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.250+0000 7f1c4f7fe640 1 -- 172.21.15.40:0/3973219373 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c48001a70 con 0x7f1c3c0039b0 2024-04-22T07:24:34.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.250+0000 7f1c4f7fe640 1 -- 172.21.15.40:0/3973219373 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c48003b70 con 0x7f1c3c0039b0 2024-04-22T07:24:34.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.250+0000 7f1c4f7fe640 1 -- 172.21.15.40:0/3973219373 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c480050d0 con 0x7f1c3c0039b0 2024-04-22T07:24:34.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.251+0000 7f1c56fc7640 1 -- 172.21.15.40:0/3973219373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c3c0039b0 msgr2=0x7f1c3c003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:34.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.251+0000 7f1c56fc7640 1 --2- 172.21.15.40:0/3973219373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c3c0039b0 0x7f1c3c003df0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1c48001e50 tx=0x7f1c3c005830 comp rx=0 tx=0).stop 2024-04-22T07:24:34.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.251+0000 7f1c56fc7640 1 -- 172.21.15.40:0/3973219373 shutdown_connections 2024-04-22T07:24:34.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.251+0000 7f1c56fc7640 1 --2- 172.21.15.40:0/3973219373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c3c0039b0 0x7f1c3c003df0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.251+0000 7f1c56fc7640 1 -- 172.21.15.40:0/3973219373 >> 172.21.15.40:0/3973219373 conn(0x7f1c500cc220 msgr2=0x7f1c500cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:34.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.251+0000 7f1c56fc7640 1 -- 172.21.15.40:0/3973219373 shutdown_connections 2024-04-22T07:24:34.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.251+0000 7f1c56fc7640 1 -- 172.21.15.40:0/3973219373 wait complete. 2024-04-22T07:24:34.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.252+0000 7f1c56fc7640 1 Processor -- start 2024-04-22T07:24:34.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.252+0000 7f1c56fc7640 1 -- start start 2024-04-22T07:24:34.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.253+0000 7f1c56fc7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c3c0039b0 0x7f1c500cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:34.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.253+0000 7f1c56fc7640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c5014eab0 0x7f1c5014eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:34.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.253+0000 7f1c56fc7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c50143940 0x7f1c50143dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:34.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.253+0000 7f1c56fc7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1c500ccfb0 con 0x7f1c3c0039b0 2024-04-22T07:24:34.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.253+0000 7f1c56fc7640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1c500c5bd0 con 0x7f1c50143940 2024-04-22T07:24:34.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.253+0000 7f1c56fc7640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1c500c3f30 con 0x7f1c5014eab0 2024-04-22T07:24:34.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.253+0000 7f1c54d63640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c3c0039b0 0x7f1c500cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:34.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.253+0000 7f1c54d63640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c3c0039b0 0x7f1c500cbbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53432/0 (socket says 172.21.15.40:53432) 2024-04-22T07:24:34.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.253+0000 7f1c54d63640 1 -- 172.21.15.40:0/4147133849 learned_addr learned my addr 172.21.15.40:0/4147133849 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:34.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.253+0000 7f1c4ffff640 1 --2- 172.21.15.40:0/4147133849 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c5014eab0 0x7f1c5014eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:34.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.253+0000 7f1c55564640 1 --2- 172.21.15.40:0/4147133849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c50143940 0x7f1c50143dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:34.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.253+0000 7f1c54d63640 1 -- 172.21.15.40:0/4147133849 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c5014eab0 msgr2=0x7f1c5014eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:34.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.253+0000 7f1c54d63640 1 --2- 172.21.15.40:0/4147133849 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c5014eab0 0x7f1c5014eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.253+0000 7f1c54d63640 1 -- 172.21.15.40:0/4147133849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c50143940 msgr2=0x7f1c50143dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:34.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.253+0000 7f1c54d63640 1 --2- 172.21.15.40:0/4147133849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c50143940 0x7f1c50143dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.253+0000 7f1c54d63640 1 -- 172.21.15.40:0/4147133849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c5014ba40 con 0x7f1c3c0039b0 2024-04-22T07:24:34.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.253+0000 7f1c4ffff640 1 --2- 172.21.15.40:0/4147133849 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c5014eab0 0x7f1c5014eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:24:34.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.253+0000 7f1c55564640 1 --2- 172.21.15.40:0/4147133849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c50143940 0x7f1c50143dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:24:34.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.253+0000 7f1c54d63640 1 --2- 172.21.15.40:0/4147133849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c3c0039b0 0x7f1c500cbbc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1c4802c060 tx=0x7f1c480014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:34.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.253+0000 7f1c4d7fa640 1 -- 172.21.15.40:0/4147133849 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c48003970 con 0x7f1c3c0039b0 2024-04-22T07:24:34.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.253+0000 7f1c4d7fa640 1 -- 172.21.15.40:0/4147133849 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c48006b50 con 0x7f1c3c0039b0 2024-04-22T07:24:34.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.253+0000 7f1c56fc7640 1 -- 172.21.15.40:0/4147133849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c501504c0 con 0x7f1c3c0039b0 2024-04-22T07:24:34.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.253+0000 7f1c4d7fa640 1 -- 172.21.15.40:0/4147133849 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c48007030 con 0x7f1c3c0039b0 2024-04-22T07:24:34.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.253+0000 7f1c56fc7640 1 -- 172.21.15.40:0/4147133849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c500c77d0 con 0x7f1c3c0039b0 2024-04-22T07:24:34.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.254+0000 7f1c56fc7640 1 -- 172.21.15.40:0/4147133849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c50069d40 con 0x7f1c3c0039b0 2024-04-22T07:24:34.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.255+0000 7f1c4d7fa640 1 -- 172.21.15.40:0/4147133849 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1c480071d0 con 0x7f1c3c0039b0 2024-04-22T07:24:34.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.255+0000 7f1c4d7fa640 1 --2- 172.21.15.40:0/4147133849 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f1c3006c920 0x7f1c3006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:34.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.255+0000 7f1c4ffff640 1 --2- 172.21.15.40:0/4147133849 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f1c3006c920 0x7f1c3006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:34.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.255+0000 7f1c4d7fa640 1 -- 172.21.15.40:0/4147133849 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f1c480adb50 con 0x7f1c3c0039b0 2024-04-22T07:24:34.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.256+0000 7f1c4ffff640 1 --2- 172.21.15.40:0/4147133849 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f1c3006c920 0x7f1c3006ede0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1c500c9450 tx=0x7f1c38008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:34.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.260+0000 7f1c4d7fa640 1 -- 172.21.15.40:0/4147133849 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1c48049060 con 0x7f1c3c0039b0 2024-04-22T07:24:34.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.444+0000 7f1c56fc7640 1 -- 172.21.15.40:0/4147133849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1c5014bc80 con 0x7f1c3c0039b0 2024-04-22T07:24:34.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.445+0000 7f1c4d7fa640 1 -- 172.21.15.40:0/4147133849 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16586 (secure 0 0 0) 0x7f1c48033020 con 0x7f1c3c0039b0 2024-04-22T07:24:34.443 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:24:34.443 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"dd5b16e4-89fe-4602-b37f-062846793158","created":"2024-04-22T07:20:29.488892+0000","modified":"2024-04-22T07:21:34.978774+0000","last_up_change":"2024-04-22T07:20:40.397383+0000","last_in_change":"2024-04-22T07:20:31.702551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:20:41.793179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:20:51.815779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:20:52.164265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32238b7e-228b-4a67-bfca-16e8f0020a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6801","nonce":1526385055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6803","nonce":1526385055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6807","nonce":1526385055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6805","nonce":1526385055}]},"public_addr":"172.21.15.40:6801/1526385055","cluster_addr":"172.21.15.40:6803/1526385055","heartbeat_back_addr":"172.21.15.40:6807/1526385055","heartbeat_front_addr":"172.21.15.40:6805/1526385055","state":["exists","up"]},{"osd":1,"uuid":"5ad8da43-39b1-4295-b4d1-0f1e1d06fc0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6809","nonce":623026645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6811","nonce":623026645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6815","nonce":623026645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6813","nonce":623026645}]},"public_addr":"172.21.15.40:6809/623026645","cluster_addr":"172.21.15.40:6811/623026645","heartbeat_back_addr":"172.21.15.40:6815/623026645","heartbeat_front_addr":"172.21.15.40:6813/623026645","state":["exists","up"]},{"osd":2,"uuid":"7d2c6d50-719d-4232-ad47-f04dcf1a8bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6820","nonce":1885686505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6824","nonce":1885686505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6831","nonce":1885686505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6828","nonce":1885686505}]},"public_addr":"172.21.15.40:6820/1885686505","cluster_addr":"172.21.15.40:6824/1885686505","heartbeat_back_addr":"172.21.15.40:6831/1885686505","heartbeat_front_addr":"172.21.15.40:6828/1885686505","state":["exists","up"]},{"osd":3,"uuid":"af42e7d6-a6bf-403e-92e7-162d7c4fbf0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6817","nonce":130276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6819","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6821","nonce":130276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6829","nonce":130276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6823","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6825","nonce":130276746}]},"public_addr":"172.21.15.40:6817/130276746","cluster_addr":"172.21.15.40:6821/130276746","heartbeat_back_addr":"172.21.15.40:6829/130276746","heartbeat_front_addr":"172.21.15.40:6825/130276746","state":["exists","up"]},{"osd":4,"uuid":"f8e89e0d-be96-4f19-88c0-69c408df7d98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6801","nonce":2251435758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6803","nonce":2251435758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6807","nonce":2251435758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6805","nonce":2251435758}]},"public_addr":"172.21.15.62:6801/2251435758","cluster_addr":"172.21.15.62:6803/2251435758","heartbeat_back_addr":"172.21.15.62:6807/2251435758","heartbeat_front_addr":"172.21.15.62:6805/2251435758","state":["exists","up"]},{"osd":5,"uuid":"ba6dc1bc-272b-4f80-b55f-40bc4a0c3ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6809","nonce":3509322231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6811","nonce":3509322231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6815","nonce":3509322231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6813","nonce":3509322231}]},"public_addr":"172.21.15.62:6809/3509322231","cluster_addr":"172.21.15.62:6811/3509322231","heartbeat_back_addr":"172.21.15.62:6815/3509322231","heartbeat_front_addr":"172.21.15.62:6813/3509322231","state":["exists","up"]},{"osd":6,"uuid":"834fcd74-14bf-45ec-a10a-0374f4ce9bf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6825","nonce":3094315954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6827","nonce":3094315954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6831","nonce":3094315954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6829","nonce":3094315954}]},"public_addr":"172.21.15.62:6825/3094315954","cluster_addr":"172.21.15.62:6827/3094315954","heartbeat_back_addr":"172.21.15.62:6831/3094315954","heartbeat_front_addr":"172.21.15.62:6829/3094315954","state":["exists","up"]},{"osd":7,"uuid":"831c9a73-960e-4d2e-b86a-33a6916be059","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6817","nonce":147453972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6819","nonce":147453972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6823","nonce":147453972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6821","nonce":147453972}]},"public_addr":"172.21.15.62:6817/147453972","cluster_addr":"172.21.15.62:6819/147453972","heartbeat_back_addr":"172.21.15.62:6823/147453972","heartbeat_front_addr":"172.21.15.62:6821/147453972","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.828738+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.873471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.908090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.894782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:37.686796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.801123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.852323+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.812139+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.34","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:24:34.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.447+0000 7f1c56fc7640 1 -- 172.21.15.40:0/4147133849 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f1c3006c920 msgr2=0x7f1c3006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:34.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.447+0000 7f1c56fc7640 1 --2- 172.21.15.40:0/4147133849 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f1c3006c920 0x7f1c3006ede0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1c500c9450 tx=0x7f1c38008040 comp rx=0 tx=0).stop 2024-04-22T07:24:34.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.447+0000 7f1c56fc7640 1 -- 172.21.15.40:0/4147133849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c3c0039b0 msgr2=0x7f1c500cbbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:34.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.447+0000 7f1c56fc7640 1 --2- 172.21.15.40:0/4147133849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c3c0039b0 0x7f1c500cbbc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1c4802c060 tx=0x7f1c480014a0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.447+0000 7f1c56fc7640 1 -- 172.21.15.40:0/4147133849 shutdown_connections 2024-04-22T07:24:34.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.447+0000 7f1c56fc7640 1 --2- 172.21.15.40:0/4147133849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1c50143940 0x7f1c50143dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.447+0000 7f1c56fc7640 1 --2- 172.21.15.40:0/4147133849 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1c5014eab0 0x7f1c5014eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.447+0000 7f1c56fc7640 1 --2- 172.21.15.40:0/4147133849 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f1c3006c920 0x7f1c3006ede0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.447+0000 7f1c56fc7640 1 --2- 172.21.15.40:0/4147133849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c3c0039b0 0x7f1c500cbbc0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.447+0000 7f1c56fc7640 1 -- 172.21.15.40:0/4147133849 >> 172.21.15.40:0/4147133849 conn(0x7f1c500cc220 msgr2=0x7f1c500c8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:34.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.447+0000 7f1c56fc7640 1 -- 172.21.15.40:0/4147133849 shutdown_connections 2024-04-22T07:24:34.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.447+0000 7f1c56fc7640 1 -- 172.21.15.40:0/4147133849 wait complete. 2024-04-22T07:24:34.456 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-22T07:20:41.793179+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-22T07:20:51.815779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-22T07:20:52.164265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-22T07:24:34.457 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-22T07:24:34.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.563+0000 7f8434bb1640 1 Processor -- start 2024-04-22T07:24:34.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.563+0000 7f8434bb1640 1 -- start start 2024-04-22T07:24:34.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.564+0000 7f8434bb1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f843006b920 0x7f843015b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:34.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.564+0000 7f8434bb1640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f843006c500 con 0x7f84300c3e40 2024-04-22T07:24:34.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.564+0000 7f8434bb1640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f843006c7e0 con 0x7f843006fd10 2024-04-22T07:24:34.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.564+0000 7f8434bb1640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f843015b370 con 0x7f843006b920 2024-04-22T07:24:34.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.564+0000 7f842dd9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f843006b920 0x7f843015b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:34.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.564+0000 7f842ed9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f84300c3e40 0x7f8430165720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41248/0 (socket says 172.21.15.40:41248) 2024-04-22T07:24:34.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.564+0000 7f842ed9d640 1 -- 172.21.15.40:0/2293633767 learned_addr learned my addr 172.21.15.40:0/2293633767 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:24:34.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.564+0000 7f842dd9b640 1 -- 172.21.15.40:0/2293633767 >> v1:172.21.15.62:6789/0 conn(0x7f843006fd10 legacy=0x7f84300c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:34.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.564+0000 7f842dd9b640 1 -- 172.21.15.40:0/2293633767 >> v1:172.21.15.40:6789/0 conn(0x7f84300c3e40 legacy=0x7f8430165720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:34.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.564+0000 7f842d59a640 1 -- 172.21.15.40:0/2293633767 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3396158395 0 0) 0x7f843006c500 con 0x7f84300c3e40 2024-04-22T07:24:34.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.564+0000 7f842dd9b640 1 -- 172.21.15.40:0/2293633767 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f843006cac0 con 0x7f843006b920 2024-04-22T07:24:34.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.565+0000 7f842dd9b640 1 --2- 172.21.15.40:0/2293633767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f843006b920 0x7f843015b800 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8418009790 tx=0x7f841802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f550ad6135869c server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:34.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.565+0000 7f842d59a640 1 -- 172.21.15.40:0/2293633767 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8418035020 con 0x7f843006b920 2024-04-22T07:24:34.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.565+0000 7f842d59a640 1 -- 172.21.15.40:0/2293633767 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8418031830 con 0x7f843006b920 2024-04-22T07:24:34.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.565+0000 7f842d59a640 1 -- 172.21.15.40:0/2293633767 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8418031c00 con 0x7f843006b920 2024-04-22T07:24:34.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.566+0000 7f8434bb1640 1 -- 172.21.15.40:0/2293633767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f843006b920 msgr2=0x7f843015b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:34.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.566+0000 7f8434bb1640 1 --2- 172.21.15.40:0/2293633767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f843006b920 0x7f843015b800 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8418009790 tx=0x7f841802b8d0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.566+0000 7f8434bb1640 1 -- 172.21.15.40:0/2293633767 shutdown_connections 2024-04-22T07:24:34.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.566+0000 7f8434bb1640 1 --2- 172.21.15.40:0/2293633767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f843006b920 0x7f843015b800 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.566+0000 7f8434bb1640 1 -- 172.21.15.40:0/2293633767 >> 172.21.15.40:0/2293633767 conn(0x7f8430071530 msgr2=0x7f8430071910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:34.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.566+0000 7f8434bb1640 1 -- 172.21.15.40:0/2293633767 shutdown_connections 2024-04-22T07:24:34.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.566+0000 7f8434bb1640 1 -- 172.21.15.40:0/2293633767 wait complete. 2024-04-22T07:24:34.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.567+0000 7f8434bb1640 1 Processor -- start 2024-04-22T07:24:34.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.567+0000 7f8434bb1640 1 -- start start 2024-04-22T07:24:34.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.568+0000 7f8434bb1640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f843006b920 0x7f84300afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:34.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.568+0000 7f8434bb1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f843006fd10 0x7f84301f0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:34.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.568+0000 7f8434bb1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84300c3e40 0x7f84301f1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:34.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.568+0000 7f8434bb1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f843006cda0 con 0x7f843006fd10 2024-04-22T07:24:34.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.568+0000 7f8434bb1640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f84300700f0 con 0x7f84300c3e40 2024-04-22T07:24:34.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.568+0000 7f8434bb1640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f843015bd40 con 0x7f843006b920 2024-04-22T07:24:34.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.568+0000 7f842dd9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f843006fd10 0x7f84301f0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:34.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.568+0000 7f842dd9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f843006fd10 0x7f84301f0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53442/0 (socket says 172.21.15.40:53442) 2024-04-22T07:24:34.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.568+0000 7f842dd9b640 1 -- 172.21.15.40:0/2576517011 learned_addr learned my addr 172.21.15.40:0/2576517011 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.568+0000 7f842e59c640 1 --2- 172.21.15.40:0/2576517011 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f843006b920 0x7f84300afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.568+0000 7f842ed9d640 1 --2- 172.21.15.40:0/2576517011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84300c3e40 0x7f84301f1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.568+0000 7f842dd9b640 1 -- 172.21.15.40:0/2576517011 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f843006b920 msgr2=0x7f84300afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.568+0000 7f842dd9b640 1 --2- 172.21.15.40:0/2576517011 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f843006b920 0x7f84300afba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.568+0000 7f842dd9b640 1 -- 172.21.15.40:0/2576517011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84300c3e40 msgr2=0x7f84301f1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.568+0000 7f842dd9b640 1 --2- 172.21.15.40:0/2576517011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84300c3e40 0x7f84301f1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.568+0000 7f842dd9b640 1 -- 172.21.15.40:0/2576517011 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84301f4ce0 con 0x7f843006fd10 2024-04-22T07:24:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.569+0000 7f842dd9b640 1 --2- 172.21.15.40:0/2576517011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f843006fd10 0x7f84301f0ee0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f84180098b0 tx=0x7f84180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.569+0000 7f8426ffd640 1 -- 172.21.15.40:0/2576517011 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841803a9f0 con 0x7f843006fd10 2024-04-22T07:24:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.569+0000 7f8426ffd640 1 -- 172.21.15.40:0/2576517011 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f841803ab90 con 0x7f843006fd10 2024-04-22T07:24:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.569+0000 7f8434bb1640 1 -- 172.21.15.40:0/2576517011 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84301f4160 con 0x7f843006fd10 2024-04-22T07:24:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.569+0000 7f8426ffd640 1 -- 172.21.15.40:0/2576517011 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84180443f0 con 0x7f843006fd10 2024-04-22T07:24:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.569+0000 7f8434bb1640 1 -- 172.21.15.40:0/2576517011 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84301f4720 con 0x7f843006fd10 2024-04-22T07:24:34.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.570+0000 7f8434bb1640 1 -- 172.21.15.40:0/2576517011 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8430069550 con 0x7f843006fd10 2024-04-22T07:24:34.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.570+0000 7f8426ffd640 1 -- 172.21.15.40:0/2576517011 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f841804b060 con 0x7f843006fd10 2024-04-22T07:24:34.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.571+0000 7f8426ffd640 1 --2- 172.21.15.40:0/2576517011 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f841006c8f0 0x7f841006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:34.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.571+0000 7f8426ffd640 1 -- 172.21.15.40:0/2576517011 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f84180ad780 con 0x7f843006fd10 2024-04-22T07:24:34.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.571+0000 7f842e59c640 1 --2- 172.21.15.40:0/2576517011 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f841006c8f0 0x7f841006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:34.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.571+0000 7f842e59c640 1 --2- 172.21.15.40:0/2576517011 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f841006c8f0 0x7f841006edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8428004f60 tx=0x7f8428007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:34.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.575+0000 7f8426ffd640 1 -- 172.21.15.40:0/2576517011 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f841803f070 con 0x7f843006fd10 2024-04-22T07:24:34.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.759+0000 7f8434bb1640 1 -- 172.21.15.40:0/2576517011 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f843004fdc0 con 0x7f843006fd10 2024-04-22T07:24:34.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.759+0000 7f8426ffd640 1 -- 172.21.15.40:0/2576517011 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f841807b4b0 con 0x7f843006fd10 2024-04-22T07:24:34.757 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-04-22T07:24:34.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.761+0000 7f8434bb1640 1 -- 172.21.15.40:0/2576517011 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f841006c8f0 msgr2=0x7f841006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:34.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.761+0000 7f8434bb1640 1 --2- 172.21.15.40:0/2576517011 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f841006c8f0 0x7f841006edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8428004f60 tx=0x7f8428007e30 comp rx=0 tx=0).stop 2024-04-22T07:24:34.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.761+0000 7f8434bb1640 1 -- 172.21.15.40:0/2576517011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f843006fd10 msgr2=0x7f84301f0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:34.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.761+0000 7f8434bb1640 1 --2- 172.21.15.40:0/2576517011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f843006fd10 0x7f84301f0ee0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f84180098b0 tx=0x7f84180046c0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.761+0000 7f8434bb1640 1 -- 172.21.15.40:0/2576517011 shutdown_connections 2024-04-22T07:24:34.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.761+0000 7f8434bb1640 1 --2- 172.21.15.40:0/2576517011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f84300c3e40 0x7f84301f1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.761+0000 7f8434bb1640 1 --2- 172.21.15.40:0/2576517011 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f841006c8f0 0x7f841006edb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.761+0000 7f8434bb1640 1 --2- 172.21.15.40:0/2576517011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f843006fd10 0x7f84301f0ee0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.761+0000 7f8434bb1640 1 --2- 172.21.15.40:0/2576517011 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f843006b920 0x7f84300afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.761+0000 7f8434bb1640 1 -- 172.21.15.40:0/2576517011 >> 172.21.15.40:0/2576517011 conn(0x7f8430071530 msgr2=0x7f84300c4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:34.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.761+0000 7f8434bb1640 1 -- 172.21.15.40:0/2576517011 shutdown_connections 2024-04-22T07:24:34.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.761+0000 7f8434bb1640 1 -- 172.21.15.40:0/2576517011 wait complete. 2024-04-22T07:24:34.770 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-22T07:24:34.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.877+0000 7f18bca8e640 1 Processor -- start 2024-04-22T07:24:34.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.877+0000 7f18bca8e640 1 -- start start 2024-04-22T07:24:34.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.878+0000 7f18bca8e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f18b8154fb0 0x7f18b8072d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:34.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.878+0000 7f18bca8e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18b80d09f0 0x7f18b80d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:34.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.878+0000 7f18bca8e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18b80ccd80 con 0x7f18b80caee0 2024-04-22T07:24:34.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.878+0000 7f18bca8e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f18b80c5c50 con 0x7f18b8154fb0 2024-04-22T07:24:34.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.878+0000 7f18bca8e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f18b80cc7e0 con 0x7f18b80d09f0 2024-04-22T07:24:34.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.878+0000 7f18b659c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f18b8154fb0 0x7f18b8072d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:34.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.878+0000 7f18b659c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f18b8154fb0 0x7f18b8072d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53444/0 (socket says 172.21.15.40:53444) 2024-04-22T07:24:34.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.878+0000 7f18b659c640 1 -- 172.21.15.40:0/3071228217 learned_addr learned my addr 172.21.15.40:0/3071228217 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:34.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.878+0000 7f18b6d9d640 1 --2- 172.21.15.40:0/3071228217 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18b80d09f0 0x7f18b80d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:34.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.879+0000 7f18b659c640 1 -- 172.21.15.40:0/3071228217 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18b80d09f0 msgr2=0x7f18b80d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:34.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.879+0000 7f18b659c640 1 --2- 172.21.15.40:0/3071228217 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18b80d09f0 0x7f18b80d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.879+0000 7f18b659c640 1 -- 172.21.15.40:0/3071228217 >> v1:172.21.15.62:6789/0 conn(0x7f18b80caee0 legacy=0x7f18b815e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:34.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.879+0000 7f18b659c640 1 -- 172.21.15.40:0/3071228217 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b80ccaa0 con 0x7f18b8154fb0 2024-04-22T07:24:34.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.879+0000 7f18b659c640 1 --2- 172.21.15.40:0/3071228217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18b8154fb0 0x7f18b8072d40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f18b0009870 tx=0x7f18b002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c180b01ec955db4a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:34.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.879+0000 7f18b559a640 1 -- 172.21.15.40:0/3071228217 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b0034070 con 0x7f18b8154fb0 2024-04-22T07:24:34.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.880+0000 7f18b559a640 1 -- 172.21.15.40:0/3071228217 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b0030840 con 0x7f18b8154fb0 2024-04-22T07:24:34.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.880+0000 7f18b559a640 1 -- 172.21.15.40:0/3071228217 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b0030c10 con 0x7f18b8154fb0 2024-04-22T07:24:34.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.880+0000 7f18bca8e640 1 -- 172.21.15.40:0/3071228217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18b8154fb0 msgr2=0x7f18b8072d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:34.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.880+0000 7f18bca8e640 1 --2- 172.21.15.40:0/3071228217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18b8154fb0 0x7f18b8072d40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f18b0009870 tx=0x7f18b002b980 comp rx=0 tx=0).stop 2024-04-22T07:24:34.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.880+0000 7f18bca8e640 1 -- 172.21.15.40:0/3071228217 shutdown_connections 2024-04-22T07:24:34.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.880+0000 7f18bca8e640 1 --2- 172.21.15.40:0/3071228217 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18b80d09f0 0x7f18b80d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.880+0000 7f18bca8e640 1 --2- 172.21.15.40:0/3071228217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18b8154fb0 0x7f18b8072d40 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.880+0000 7f18bca8e640 1 -- 172.21.15.40:0/3071228217 >> 172.21.15.40:0/3071228217 conn(0x7f18b80676b0 msgr2=0x7f18b8067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:34.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.880+0000 7f18bca8e640 1 -- 172.21.15.40:0/3071228217 shutdown_connections 2024-04-22T07:24:34.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.880+0000 7f18bca8e640 1 -- 172.21.15.40:0/3071228217 wait complete. 2024-04-22T07:24:34.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.881+0000 7f18bca8e640 1 Processor -- start 2024-04-22T07:24:34.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.881+0000 7f18bca8e640 1 -- start start 2024-04-22T07:24:34.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.882+0000 7f18bca8e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18b80caee0 0x7f18b81f1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:34.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.882+0000 7f18bca8e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18b80d09f0 0x7f18b80c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:34.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.882+0000 7f18bca8e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18b8154fb0 0x7f18b814dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:34.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.882+0000 7f18bca8e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f18b80cbe90 con 0x7f18b8154fb0 2024-04-22T07:24:34.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.882+0000 7f18bca8e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f18b80cbbb0 con 0x7f18b80caee0 2024-04-22T07:24:34.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.882+0000 7f18bca8e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f18b80cc170 con 0x7f18b80d09f0 2024-04-22T07:24:34.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.882+0000 7f18b6d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18b8154fb0 0x7f18b814dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:34.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.882+0000 7f18b6d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18b8154fb0 0x7f18b814dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53458/0 (socket says 172.21.15.40:53458) 2024-04-22T07:24:34.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.882+0000 7f18b6d9d640 1 -- 172.21.15.40:0/229099126 learned_addr learned my addr 172.21.15.40:0/229099126 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:34.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.882+0000 7f18b659c640 1 --2- 172.21.15.40:0/229099126 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18b80caee0 0x7f18b81f1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:34.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.882+0000 7f18b5d9b640 1 --2- 172.21.15.40:0/229099126 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18b80d09f0 0x7f18b80c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:34.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.883+0000 7f18b6d9d640 1 -- 172.21.15.40:0/229099126 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18b80d09f0 msgr2=0x7f18b80c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:34.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.883+0000 7f18b6d9d640 1 --2- 172.21.15.40:0/229099126 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18b80d09f0 0x7f18b80c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.883+0000 7f18b6d9d640 1 -- 172.21.15.40:0/229099126 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18b80caee0 msgr2=0x7f18b81f1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:34.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.883+0000 7f18b6d9d640 1 --2- 172.21.15.40:0/229099126 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18b80caee0 0x7f18b81f1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:34.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.883+0000 7f18b6d9d640 1 -- 172.21.15.40:0/229099126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b8151610 con 0x7f18b8154fb0 2024-04-22T07:24:34.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.883+0000 7f18b5d9b640 1 --2- 172.21.15.40:0/229099126 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18b80d09f0 0x7f18b80c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:24:34.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.883+0000 7f18b6d9d640 1 --2- 172.21.15.40:0/229099126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18b8154fb0 0x7f18b814dd40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f18a8007e70 tx=0x7f18a800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:34.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.883+0000 7f18aeffd640 1 -- 172.21.15.40:0/229099126 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a8014620 con 0x7f18b8154fb0 2024-04-22T07:24:34.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.883+0000 7f18aeffd640 1 -- 172.21.15.40:0/229099126 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18a8019070 con 0x7f18b8154fb0 2024-04-22T07:24:34.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.883+0000 7f18bca8e640 1 -- 172.21.15.40:0/229099126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18b81518f0 con 0x7f18b8154fb0 2024-04-22T07:24:34.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.883+0000 7f18aeffd640 1 -- 172.21.15.40:0/229099126 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a8014a20 con 0x7f18b8154fb0 2024-04-22T07:24:34.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.883+0000 7f18bca8e640 1 -- 172.21.15.40:0/229099126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18b8152c00 con 0x7f18b8154fb0 2024-04-22T07:24:34.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.884+0000 7f18bca8e640 1 -- 172.21.15.40:0/229099126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18b804fdc0 con 0x7f18b8154fb0 2024-04-22T07:24:34.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.884+0000 7f18aeffd640 1 -- 172.21.15.40:0/229099126 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f18a8014bc0 con 0x7f18b8154fb0 2024-04-22T07:24:34.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.885+0000 7f18aeffd640 1 --2- 172.21.15.40:0/229099126 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f189806c920 0x7f189806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:34.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.885+0000 7f18aeffd640 1 -- 172.21.15.40:0/229099126 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f18a808c3a0 con 0x7f18b8154fb0 2024-04-22T07:24:34.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.885+0000 7f18b659c640 1 --2- 172.21.15.40:0/229099126 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f189806c920 0x7f189806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:34.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.885+0000 7f18b659c640 1 --2- 172.21.15.40:0/229099126 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f189806c920 0x7f189806ede0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f18b0036000 tx=0x7f18b003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:34.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:34.889+0000 7f18aeffd640 1 -- 172.21.15.40:0/229099126 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f18a805a7b0 con 0x7f18b8154fb0 2024-04-22T07:24:35.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.154+0000 7f18bca8e640 1 -- 172.21.15.40:0/229099126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f18b80cb5a0 con 0x7f18b8154fb0 2024-04-22T07:24:35.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.154+0000 7f18aeffd640 1 -- 172.21.15.40:0/229099126 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f18a805a0b0 con 0x7f18b8154fb0 2024-04-22T07:24:35.152 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-22T07:24:35.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.159+0000 7f18bca8e640 1 -- 172.21.15.40:0/229099126 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f189806c920 msgr2=0x7f189806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:35.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.159+0000 7f18bca8e640 1 --2- 172.21.15.40:0/229099126 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f189806c920 0x7f189806ede0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f18b0036000 tx=0x7f18b003b040 comp rx=0 tx=0).stop 2024-04-22T07:24:35.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.159+0000 7f18bca8e640 1 -- 172.21.15.40:0/229099126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18b8154fb0 msgr2=0x7f18b814dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:35.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.159+0000 7f18bca8e640 1 --2- 172.21.15.40:0/229099126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18b8154fb0 0x7f18b814dd40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f18a8007e70 tx=0x7f18a800e4b0 comp rx=0 tx=0).stop 2024-04-22T07:24:35.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.159+0000 7f18bca8e640 1 -- 172.21.15.40:0/229099126 shutdown_connections 2024-04-22T07:24:35.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.159+0000 7f18bca8e640 1 --2- 172.21.15.40:0/229099126 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f189806c920 0x7f189806ede0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:35.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.159+0000 7f18bca8e640 1 --2- 172.21.15.40:0/229099126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18b8154fb0 0x7f18b814dd40 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:35.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.159+0000 7f18bca8e640 1 --2- 172.21.15.40:0/229099126 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f18b80d09f0 0x7f18b80c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:35.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.159+0000 7f18bca8e640 1 --2- 172.21.15.40:0/229099126 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f18b80caee0 0x7f18b81f1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:35.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.159+0000 7f18bca8e640 1 -- 172.21.15.40:0/229099126 >> 172.21.15.40:0/229099126 conn(0x7f18b80676b0 msgr2=0x7f18b8150190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:35.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.160+0000 7f18bca8e640 1 -- 172.21.15.40:0/229099126 shutdown_connections 2024-04-22T07:24:35.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.160+0000 7f18bca8e640 1 -- 172.21.15.40:0/229099126 wait complete. 2024-04-22T07:24:35.175 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-22T07:24:35.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.344+0000 7f0588c93640 1 Processor -- start 2024-04-22T07:24:35.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.344+0000 7f0588c93640 1 -- start start 2024-04-22T07:24:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.345+0000 7f0588c93640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05841550f0 0x7f058415ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.345+0000 7f0588c93640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f058415afd0 con 0x7f05840cba00 2024-04-22T07:24:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.345+0000 7f0588c93640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f058415b290 con 0x7f05840cb5b0 2024-04-22T07:24:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.345+0000 7f0588c93640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f058415b570 con 0x7f05841550f0 2024-04-22T07:24:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.345+0000 7f0582d9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f05840cba00 0x7f05840c5630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41258/0 (socket says 172.21.15.40:41258) 2024-04-22T07:24:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.345+0000 7f0582d9d640 1 -- 172.21.15.40:0/2829804798 learned_addr learned my addr 172.21.15.40:0/2829804798 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:24:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.345+0000 7f058259c640 1 --2- 172.21.15.40:0/2829804798 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05841550f0 0x7f058415ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.346+0000 7f058259c640 1 -- 172.21.15.40:0/2829804798 >> v1:172.21.15.62:6789/0 conn(0x7f05840cb5b0 legacy=0x7f05840cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.346+0000 7f058259c640 1 -- 172.21.15.40:0/2829804798 >> v1:172.21.15.40:6789/0 conn(0x7f05840cba00 legacy=0x7f05840c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.346+0000 7f058259c640 1 -- 172.21.15.40:0/2829804798 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f058415b850 con 0x7f05841550f0 2024-04-22T07:24:35.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.347+0000 7f058259c640 1 --2- 172.21.15.40:0/2829804798 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05841550f0 0x7f058415ed60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f05740097d0 tx=0x7f057402b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca91ec283a0a1bd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:35.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.347+0000 7f0581d9b640 1 -- 172.21.15.40:0/2829804798 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0574031780 con 0x7f05841550f0 2024-04-22T07:24:35.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.347+0000 7f0581d9b640 1 -- 172.21.15.40:0/2829804798 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0574037070 con 0x7f05841550f0 2024-04-22T07:24:35.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.348+0000 7f0588c93640 1 -- 172.21.15.40:0/2829804798 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05841550f0 msgr2=0x7f058415ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:35.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.348+0000 7f0588c93640 1 --2- 172.21.15.40:0/2829804798 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05841550f0 0x7f058415ed60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f05740097d0 tx=0x7f057402b820 comp rx=0 tx=0).stop 2024-04-22T07:24:35.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.349+0000 7f0588c93640 1 -- 172.21.15.40:0/2829804798 shutdown_connections 2024-04-22T07:24:35.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.349+0000 7f0588c93640 1 --2- 172.21.15.40:0/2829804798 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05841550f0 0x7f058415ed60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:35.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.349+0000 7f0588c93640 1 -- 172.21.15.40:0/2829804798 >> 172.21.15.40:0/2829804798 conn(0x7f058406b920 msgr2=0x7f058406bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:35.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.351+0000 7f0588c93640 1 -- 172.21.15.40:0/2829804798 shutdown_connections 2024-04-22T07:24:35.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.351+0000 7f0588c93640 1 -- 172.21.15.40:0/2829804798 wait complete. 2024-04-22T07:24:35.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.353+0000 7f0588c93640 1 Processor -- start 2024-04-22T07:24:35.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.353+0000 7f0588c93640 1 -- start start 2024-04-22T07:24:35.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.354+0000 7f0588c93640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05840cb5b0 0x7f05840c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:35.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.354+0000 7f0588c93640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05840cba00 0x7f05840c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:35.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.354+0000 7f0588c93640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05841550f0 0x7f05840c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:35.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.354+0000 7f0588c93640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f05840cd750 con 0x7f05841550f0 2024-04-22T07:24:35.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.354+0000 7f0588c93640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f05841554d0 con 0x7f05840cba00 2024-04-22T07:24:35.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.354+0000 7f0588c93640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f05840cd8d0 con 0x7f05840cb5b0 2024-04-22T07:24:35.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.354+0000 7f0582d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05841550f0 0x7f05840c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:35.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.354+0000 7f057bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05840cba00 0x7f05840c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:35.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.354+0000 7f0582d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05841550f0 0x7f05840c85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53462/0 (socket says 172.21.15.40:53462) 2024-04-22T07:24:35.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.354+0000 7f0582d9d640 1 -- 172.21.15.40:0/3978436078 learned_addr learned my addr 172.21.15.40:0/3978436078 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:35.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.354+0000 7f058259c640 1 --2- 172.21.15.40:0/3978436078 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05840cb5b0 0x7f05840c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:35.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.355+0000 7f0582d9d640 1 -- 172.21.15.40:0/3978436078 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05840cb5b0 msgr2=0x7f05840c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:35.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.355+0000 7f0582d9d640 1 --2- 172.21.15.40:0/3978436078 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05840cb5b0 0x7f05840c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:35.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.355+0000 7f0582d9d640 1 -- 172.21.15.40:0/3978436078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05840cba00 msgr2=0x7f05840c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:35.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.355+0000 7f0582d9d640 1 --2- 172.21.15.40:0/3978436078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05840cba00 0x7f05840c8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:35.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.355+0000 7f0582d9d640 1 -- 172.21.15.40:0/3978436078 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05840d1080 con 0x7f05841550f0 2024-04-22T07:24:35.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.355+0000 7f057bfff640 1 --2- 172.21.15.40:0/3978436078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05840cba00 0x7f05840c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:24:35.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.355+0000 7f0582d9d640 1 --2- 172.21.15.40:0/3978436078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05841550f0 0x7f05840c85c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f057c00cbf0 tx=0x7f057c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:35.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.355+0000 7f057affd640 1 -- 172.21.15.40:0/3978436078 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c017070 con 0x7f05841550f0 2024-04-22T07:24:35.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.356+0000 7f0588c93640 1 -- 172.21.15.40:0/3978436078 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05840d1340 con 0x7f05841550f0 2024-04-22T07:24:35.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.356+0000 7f057affd640 1 -- 172.21.15.40:0/3978436078 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f057c00ace0 con 0x7f05841550f0 2024-04-22T07:24:35.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.356+0000 7f057affd640 1 -- 172.21.15.40:0/3978436078 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c012600 con 0x7f05841550f0 2024-04-22T07:24:35.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.356+0000 7f0588c93640 1 -- 172.21.15.40:0/3978436078 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05840c9310 con 0x7f05841550f0 2024-04-22T07:24:35.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.358+0000 7f0588c93640 1 -- 172.21.15.40:0/3978436078 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0568005290 con 0x7f05841550f0 2024-04-22T07:24:35.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.358+0000 7f057affd640 1 -- 172.21.15.40:0/3978436078 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f057c01a070 con 0x7f05841550f0 2024-04-22T07:24:35.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.359+0000 7f057affd640 1 --2- 172.21.15.40:0/3978436078 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f056406c940 0x7f056406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:35.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.359+0000 7f057affd640 1 -- 172.21.15.40:0/3978436078 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f057c08b610 con 0x7f05841550f0 2024-04-22T07:24:35.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.360+0000 7f058259c640 1 --2- 172.21.15.40:0/3978436078 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f056406c940 0x7f056406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:35.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.360+0000 7f058259c640 1 --2- 172.21.15.40:0/3978436078 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f056406c940 0x7f056406ee00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0574036000 tx=0x7f057403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:35.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.367+0000 7f057affd640 1 -- 172.21.15.40:0/3978436078 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f057c059540 con 0x7f05841550f0 2024-04-22T07:24:35.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.712+0000 7f0588c93640 1 -- 172.21.15.40:0/3978436078 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0568005850 con 0x7f05841550f0 2024-04-22T07:24:35.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.713+0000 7f057affd640 1 -- 172.21.15.40:0/3978436078 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f057c05d840 con 0x7f05841550f0 2024-04-22T07:24:35.711 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-04-22T07:24:35.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.716+0000 7f0588c93640 1 -- 172.21.15.40:0/3978436078 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f056406c940 msgr2=0x7f056406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:35.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.716+0000 7f0588c93640 1 --2- 172.21.15.40:0/3978436078 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f056406c940 0x7f056406ee00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0574036000 tx=0x7f057403d040 comp rx=0 tx=0).stop 2024-04-22T07:24:35.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.716+0000 7f0588c93640 1 -- 172.21.15.40:0/3978436078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05841550f0 msgr2=0x7f05840c85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:35.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.716+0000 7f0588c93640 1 --2- 172.21.15.40:0/3978436078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05841550f0 0x7f05840c85c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f057c00cbf0 tx=0x7f057c00a430 comp rx=0 tx=0).stop 2024-04-22T07:24:35.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.717+0000 7f0588c93640 1 -- 172.21.15.40:0/3978436078 shutdown_connections 2024-04-22T07:24:35.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.717+0000 7f0588c93640 1 --2- 172.21.15.40:0/3978436078 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f056406c940 0x7f056406ee00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:35.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.717+0000 7f0588c93640 1 --2- 172.21.15.40:0/3978436078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05841550f0 0x7f05840c85c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:35.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.717+0000 7f0588c93640 1 --2- 172.21.15.40:0/3978436078 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05840cba00 0x7f05840c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:35.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.717+0000 7f0588c93640 1 --2- 172.21.15.40:0/3978436078 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f05840cb5b0 0x7f05840c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:35.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.717+0000 7f0588c93640 1 -- 172.21.15.40:0/3978436078 >> 172.21.15.40:0/3978436078 conn(0x7f058406b920 msgr2=0x7f058415a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:35.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.717+0000 7f0588c93640 1 -- 172.21.15.40:0/3978436078 shutdown_connections 2024-04-22T07:24:35.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.717+0000 7f0588c93640 1 -- 172.21.15.40:0/3978436078 wait complete. 2024-04-22T07:24:35.732 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-22T07:24:35.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.896+0000 7fe785c81640 1 Processor -- start 2024-04-22T07:24:35.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.896+0000 7fe785c81640 1 -- start start 2024-04-22T07:24:35.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.898+0000 7fe785c81640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe780151d40 0x7fe78006ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:35.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.898+0000 7fe785c81640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7800c4a70 con 0x7fe7800727f0 2024-04-22T07:24:35.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.898+0000 7fe77ffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe7800727f0 0x7fe7801623f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41260/0 (socket says 172.21.15.40:41260) 2024-04-22T07:24:35.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.898+0000 7fe77ffff640 1 -- 172.21.15.40:0/158122173 learned_addr learned my addr 172.21.15.40:0/158122173 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:24:35.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.898+0000 7fe785c81640 1 -- 172.21.15.40:0/158122173 --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7800c4d50 con 0x7fe7800c7040 2024-04-22T07:24:35.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.898+0000 7fe777fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe7800c7040 0x7fe780158470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.40:54138/0 (socket says 172.21.15.40:54138) 2024-04-22T07:24:35.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.898+0000 7fe77f7fe640 1 --2- 172.21.15.40:0/158122173 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe780151d40 0x7fe78006ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:35.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.898+0000 7fe785c81640 1 -- 172.21.15.40:0/158122173 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe7800c4840 con 0x7fe780151d40 2024-04-22T07:24:35.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.899+0000 7fe77effd640 1 -- 172.21.15.40:0/158122173 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 570729673 0 0) 0x7fe7800c4a70 con 0x7fe7800727f0 2024-04-22T07:24:35.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.899+0000 7fe77effd640 1 -- 172.21.15.40:0/158122173 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe76c003520 con 0x7fe7800727f0 2024-04-22T07:24:35.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.899+0000 7fe77effd640 1 -- 172.21.15.40:0/158122173 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3149933768 0 0) 0x7fe7800c4d50 con 0x7fe7800c7040 2024-04-22T07:24:35.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.899+0000 7fe77effd640 1 -- 172.21.15.40:0/158122173 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7800c4a70 con 0x7fe7800c7040 2024-04-22T07:24:35.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.900+0000 7fe77effd640 1 -- 172.21.15.40:0/158122173 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 913105725 0 0) 0x7fe76c003520 con 0x7fe7800727f0 2024-04-22T07:24:35.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.900+0000 7fe77f7fe640 1 -- 172.21.15.40:0/158122173 >> v1:172.21.15.62:6789/0 conn(0x7fe7800c7040 legacy=0x7fe780158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:35.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.900+0000 7fe77f7fe640 1 -- 172.21.15.40:0/158122173 >> v1:172.21.15.40:6789/0 conn(0x7fe7800727f0 legacy=0x7fe7801623f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:35.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.900+0000 7fe77f7fe640 1 -- 172.21.15.40:0/158122173 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe780157c70 con 0x7fe780151d40 2024-04-22T07:24:35.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.901+0000 7fe77f7fe640 1 --2- 172.21.15.40:0/158122173 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe780151d40 0x7fe78006ce50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe7680097d0 tx=0x7fe76802b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=392f446f37af94b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:35.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.902+0000 7fe77effd640 1 -- 172.21.15.40:0/158122173 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768037070 con 0x7fe780151d40 2024-04-22T07:24:35.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.902+0000 7fe77effd640 1 -- 172.21.15.40:0/158122173 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe768030510 con 0x7fe780151d40 2024-04-22T07:24:35.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.902+0000 7fe77effd640 1 -- 172.21.15.40:0/158122173 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7780019f0 con 0x7fe780151d40 2024-04-22T07:24:35.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.903+0000 7fe785c81640 1 -- 172.21.15.40:0/158122173 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe780151d40 msgr2=0x7fe78006ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:35.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.903+0000 7fe785c81640 1 --2- 172.21.15.40:0/158122173 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe780151d40 0x7fe78006ce50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe7680097d0 tx=0x7fe76802b790 comp rx=0 tx=0).stop 2024-04-22T07:24:35.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.903+0000 7fe785c81640 1 -- 172.21.15.40:0/158122173 shutdown_connections 2024-04-22T07:24:35.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.903+0000 7fe785c81640 1 --2- 172.21.15.40:0/158122173 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe780151d40 0x7fe78006ce50 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe7680097d0 tx=0x7fe76802b790 comp rx=0 tx=0).stop 2024-04-22T07:24:35.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.903+0000 7fe785c81640 1 -- 172.21.15.40:0/158122173 >> 172.21.15.40:0/158122173 conn(0x7fe7800ca470 msgr2=0x7fe7800cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:35.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.903+0000 7fe785c81640 1 -- 172.21.15.40:0/158122173 shutdown_connections 2024-04-22T07:24:35.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.903+0000 7fe785c81640 1 -- 172.21.15.40:0/158122173 wait complete. 2024-04-22T07:24:35.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.905+0000 7fe785c81640 1 Processor -- start 2024-04-22T07:24:35.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.905+0000 7fe785c81640 1 -- start start 2024-04-22T07:24:35.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.907+0000 7fe785c81640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7800727f0 0x7fe7800cc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:35.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.907+0000 7fe785c81640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7800c7040 0x7fe780145dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:35.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.907+0000 7fe785c81640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe780146300 0x7fe78014ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:35.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.907+0000 7fe777fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7800c7040 0x7fe780145dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:35.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.907+0000 7fe77f7fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7800727f0 0x7fe7800cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:35.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.907+0000 7fe777fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7800c7040 0x7fe780145dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.40:45582/0 (socket says 172.21.15.40:45582) 2024-04-22T07:24:35.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.907+0000 7fe77f7fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7800727f0 0x7fe7800cc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.40:60648/0 (socket says 172.21.15.40:60648) 2024-04-22T07:24:35.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.907+0000 7fe777fff640 1 -- 172.21.15.40:0/4122718841 learned_addr learned my addr 172.21.15.40:0/4122718841 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:35.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.907+0000 7fe785c81640 1 -- 172.21.15.40:0/4122718841 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe780157fe0 con 0x7fe780146300 2024-04-22T07:24:35.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.907+0000 7fe785c81640 1 -- 172.21.15.40:0/4122718841 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe780152120 con 0x7fe7800c7040 2024-04-22T07:24:35.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.907+0000 7fe785c81640 1 -- 172.21.15.40:0/4122718841 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe7801522a0 con 0x7fe7800727f0 2024-04-22T07:24:35.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.908+0000 7fe77ffff640 1 --2- 172.21.15.40:0/4122718841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe780146300 0x7fe78014ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:35.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.908+0000 7fe77f7fe640 1 -- 172.21.15.40:0/4122718841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7800c7040 msgr2=0x7fe780145dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:35.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.908+0000 7fe77f7fe640 1 --2- 172.21.15.40:0/4122718841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7800c7040 0x7fe780145dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:35.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.908+0000 7fe77f7fe640 1 -- 172.21.15.40:0/4122718841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe780146300 msgr2=0x7fe78014ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:35.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.908+0000 7fe77f7fe640 1 --2- 172.21.15.40:0/4122718841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe780146300 0x7fe78014ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:35.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.908+0000 7fe77f7fe640 1 -- 172.21.15.40:0/4122718841 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7801449a0 con 0x7fe7800727f0 2024-04-22T07:24:35.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.908+0000 7fe77ffff640 1 --2- 172.21.15.40:0/4122718841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe780146300 0x7fe78014ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:24:35.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.908+0000 7fe77f7fe640 1 --2- 172.21.15.40:0/4122718841 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7800727f0 0x7fe7800cc530 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe768032000 tx=0x7fe7680046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:35.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.908+0000 7fe77cff9640 1 -- 172.21.15.40:0/4122718841 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768042020 con 0x7fe7800727f0 2024-04-22T07:24:35.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.909+0000 7fe77cff9640 1 -- 172.21.15.40:0/4122718841 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe768032700 con 0x7fe7800727f0 2024-04-22T07:24:35.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.909+0000 7fe785c81640 1 -- 172.21.15.40:0/4122718841 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe780144c60 con 0x7fe7800727f0 2024-04-22T07:24:35.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.909+0000 7fe77cff9640 1 -- 172.21.15.40:0/4122718841 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768037040 con 0x7fe7800727f0 2024-04-22T07:24:35.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.909+0000 7fe785c81640 1 -- 172.21.15.40:0/4122718841 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe780145220 con 0x7fe7800727f0 2024-04-22T07:24:35.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.911+0000 7fe77cff9640 1 -- 172.21.15.40:0/4122718841 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe768045020 con 0x7fe7800727f0 2024-04-22T07:24:35.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.911+0000 7fe785c81640 1 -- 172.21.15.40:0/4122718841 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe764005290 con 0x7fe7800727f0 2024-04-22T07:24:35.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.912+0000 7fe77cff9640 1 --2- 172.21.15.40:0/4122718841 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe76006c8f0 0x7fe76006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:35.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.912+0000 7fe77cff9640 1 -- 172.21.15.40:0/4122718841 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fe7680ad480 con 0x7fe7800727f0 2024-04-22T07:24:35.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.912+0000 7fe777fff640 1 --2- 172.21.15.40:0/4122718841 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe76006c8f0 0x7fe76006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:35.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.913+0000 7fe777fff640 1 --2- 172.21.15.40:0/4122718841 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe76006c8f0 0x7fe76006edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe7801500b0 tx=0x7fe770007d80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:35.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:35.920+0000 7fe77cff9640 1 -- 172.21.15.40:0/4122718841 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe76804c030 con 0x7fe7800727f0 2024-04-22T07:24:36.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.285+0000 7fe785c81640 1 -- 172.21.15.40:0/4122718841 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe764005850 con 0x7fe7800727f0 2024-04-22T07:24:36.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.285+0000 7fe77cff9640 1 -- 172.21.15.40:0/4122718841 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fe76807b920 con 0x7fe7800727f0 2024-04-22T07:24:36.283 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2024-04-22T07:24:36.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.288+0000 7fe785c81640 1 -- 172.21.15.40:0/4122718841 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe76006c8f0 msgr2=0x7fe76006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:36.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.288+0000 7fe785c81640 1 --2- 172.21.15.40:0/4122718841 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe76006c8f0 0x7fe76006edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe7801500b0 tx=0x7fe770007d80 comp rx=0 tx=0).stop 2024-04-22T07:24:36.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.288+0000 7fe785c81640 1 -- 172.21.15.40:0/4122718841 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7800727f0 msgr2=0x7fe7800cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:36.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.288+0000 7fe785c81640 1 --2- 172.21.15.40:0/4122718841 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7800727f0 0x7fe7800cc530 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe768032000 tx=0x7fe7680046c0 comp rx=0 tx=0).stop 2024-04-22T07:24:36.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.288+0000 7fe785c81640 1 -- 172.21.15.40:0/4122718841 shutdown_connections 2024-04-22T07:24:36.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.288+0000 7fe785c81640 1 --2- 172.21.15.40:0/4122718841 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe76006c8f0 0x7fe76006edb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:36.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.288+0000 7fe785c81640 1 --2- 172.21.15.40:0/4122718841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe780146300 0x7fe78014ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:36.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.288+0000 7fe785c81640 1 --2- 172.21.15.40:0/4122718841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe7800c7040 0x7fe780145dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:36.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.288+0000 7fe785c81640 1 --2- 172.21.15.40:0/4122718841 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe7800727f0 0x7fe7800cc530 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:36.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.288+0000 7fe785c81640 1 -- 172.21.15.40:0/4122718841 >> 172.21.15.40:0/4122718841 conn(0x7fe7800ca470 msgr2=0x7fe7800c8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:36.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.288+0000 7fe785c81640 1 -- 172.21.15.40:0/4122718841 shutdown_connections 2024-04-22T07:24:36.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.288+0000 7fe785c81640 1 -- 172.21.15.40:0/4122718841 wait complete. 2024-04-22T07:24:36.300 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-22T07:24:36.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T07:24:36.301 DEBUG:teuthology.orchestra.run.smithi040:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-22T07:24:36.343 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2024-04-22T07:24:36.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T07:24:36.344 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-22T07:24:36.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T07:24:36.412 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-04-22T07:24:36.469 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-22T07:24:36.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T07:24:36.470 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-22T07:24:36.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-22T07:24:36.539 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2024-04-22T07:24:36.634 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-22T07:24:36.644 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-22T07:24:36.644 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T07:24:36.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.754+0000 7fd2f9d52640 1 Processor -- start 2024-04-22T07:24:36.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.754+0000 7fd2f9d52640 1 -- start start 2024-04-22T07:24:36.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.755+0000 7fd2f9d52640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd2f406f510 0x7fd2f4158b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:36.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.755+0000 7fd2f9d52640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd2f40c2e70 0x7fd2f41590d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:36.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.755+0000 7fd2f9d52640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2f40c5f30 con 0x7fd2f4152ff0 2024-04-22T07:24:36.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.755+0000 7fd2f9d52640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fd2f40c8a30 con 0x7fd2f40c2e70 2024-04-22T07:24:36.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.755+0000 7fd2f9d52640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fd2f40c8750 con 0x7fd2f406f510 2024-04-22T07:24:36.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.755+0000 7fd2f3fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd2f40c2e70 0x7fd2f41590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:36.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.755+0000 7fd2f37fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd2f4152ff0 0x7fd2f406ee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41274/0 (socket says 172.21.15.40:41274) 2024-04-22T07:24:36.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.755+0000 7fd2f37fe640 1 -- 172.21.15.40:0/145772340 learned_addr learned my addr 172.21.15.40:0/145772340 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:24:36.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.755+0000 7fd2f2ffd640 1 --2- 172.21.15.40:0/145772340 >> v2:172.21.15.62:3300/0 conn(0x7fd2f406f510 0x7fd2f4158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:36.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.756+0000 7fd2f3fff640 1 -- 172.21.15.40:0/145772340 >> v2:172.21.15.62:3300/0 conn(0x7fd2f406f510 msgr2=0x7fd2f4158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:36.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.756+0000 7fd2f3fff640 1 --2- 172.21.15.40:0/145772340 >> v2:172.21.15.62:3300/0 conn(0x7fd2f406f510 0x7fd2f4158b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:36.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.756+0000 7fd2f3fff640 1 -- 172.21.15.40:0/145772340 >> v1:172.21.15.40:6789/0 conn(0x7fd2f4152ff0 legacy=0x7fd2f406ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:36.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.756+0000 7fd2f27fc640 1 -- 172.21.15.40:0/145772340 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2109741088 0 0) 0x7fd2f40c5f30 con 0x7fd2f4152ff0 2024-04-22T07:24:36.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.756+0000 7fd2f3fff640 1 -- 172.21.15.40:0/145772340 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f40c4ac0 con 0x7fd2f40c2e70 2024-04-22T07:24:36.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.756+0000 7fd2f3fff640 1 --2- 172.21.15.40:0/145772340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2f40c2e70 0x7fd2f41590d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd2f406cb70 tx=0x7fd2ec02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235e7c5492efd581 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:36.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.757+0000 7fd2f27fc640 1 -- 172.21.15.40:0/145772340 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec039070 con 0x7fd2f40c2e70 2024-04-22T07:24:36.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.757+0000 7fd2f27fc640 1 -- 172.21.15.40:0/145772340 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2ec02cc80 con 0x7fd2f40c2e70 2024-04-22T07:24:36.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.757+0000 7fd2f27fc640 1 -- 172.21.15.40:0/145772340 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec034660 con 0x7fd2f40c2e70 2024-04-22T07:24:36.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.757+0000 7fd2f9d52640 1 -- 172.21.15.40:0/145772340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2f40c2e70 msgr2=0x7fd2f41590d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:36.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.757+0000 7fd2f9d52640 1 --2- 172.21.15.40:0/145772340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2f40c2e70 0x7fd2f41590d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd2f406cb70 tx=0x7fd2ec02bed0 comp rx=0 tx=0).stop 2024-04-22T07:24:36.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.757+0000 7fd2f9d52640 1 -- 172.21.15.40:0/145772340 shutdown_connections 2024-04-22T07:24:36.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.757+0000 7fd2f9d52640 1 --2- 172.21.15.40:0/145772340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2f40c2e70 0x7fd2f41590d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:36.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.757+0000 7fd2f9d52640 1 --2- 172.21.15.40:0/145772340 >> v2:172.21.15.62:3300/0 conn(0x7fd2f406f510 0x7fd2f4158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:36.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.757+0000 7fd2f9d52640 1 -- 172.21.15.40:0/145772340 >> 172.21.15.40:0/145772340 conn(0x7fd2f40cc220 msgr2=0x7fd2f40cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:36.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.757+0000 7fd2f9d52640 1 -- 172.21.15.40:0/145772340 shutdown_connections 2024-04-22T07:24:36.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.757+0000 7fd2f9d52640 1 -- 172.21.15.40:0/145772340 wait complete. 2024-04-22T07:24:36.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.758+0000 7fd2f9d52640 1 Processor -- start 2024-04-22T07:24:36.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.759+0000 7fd2f9d52640 1 -- start start 2024-04-22T07:24:36.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.759+0000 7fd2f9d52640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2f406f510 0x7fd2f41e5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:36.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.759+0000 7fd2f9d52640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2f40c2e70 0x7fd2f41f0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:36.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.759+0000 7fd2f9d52640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd2f4152ff0 0x7fd2f413f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:36.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.759+0000 7fd2f9d52640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f40c33c0 con 0x7fd2f40c2e70 2024-04-22T07:24:36.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.759+0000 7fd2f9d52640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f40c5080 con 0x7fd2f406f510 2024-04-22T07:24:36.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.759+0000 7fd2f9d52640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fd2f40c65c0 con 0x7fd2f4152ff0 2024-04-22T07:24:36.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.759+0000 7fd2f2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2f40c2e70 0x7fd2f41f0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:36.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.759+0000 7fd2f2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2f40c2e70 0x7fd2f41f0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53478/0 (socket says 172.21.15.40:53478) 2024-04-22T07:24:36.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.759+0000 7fd2f2ffd640 1 -- 172.21.15.40:0/760959597 learned_addr learned my addr 172.21.15.40:0/760959597 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:36.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.759+0000 7fd2f37fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2f406f510 0x7fd2f41e5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.760+0000 7fd2f3fff640 1 --2- 172.21.15.40:0/760959597 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd2f4152ff0 0x7fd2f413f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.760+0000 7fd2f2ffd640 1 -- 172.21.15.40:0/760959597 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd2f4152ff0 msgr2=0x7fd2f413f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.760+0000 7fd2f2ffd640 1 --2- 172.21.15.40:0/760959597 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd2f4152ff0 0x7fd2f413f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.760+0000 7fd2f2ffd640 1 -- 172.21.15.40:0/760959597 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2f406f510 msgr2=0x7fd2f41e5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.760+0000 7fd2f2ffd640 1 --2- 172.21.15.40:0/760959597 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2f406f510 0x7fd2f41e5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.760+0000 7fd2f2ffd640 1 -- 172.21.15.40:0/760959597 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f41e3ef0 con 0x7fd2f40c2e70 2024-04-22T07:24:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.760+0000 7fd2f37fe640 1 --2- 172.21.15.40:0/760959597 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2f406f510 0x7fd2f41e5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:24:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.760+0000 7fd2f2ffd640 1 --2- 172.21.15.40:0/760959597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2f40c2e70 0x7fd2f41f0740 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd2e800d600 tx=0x7fd2e800dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.760+0000 7fd2dbfff640 1 -- 172.21.15.40:0/760959597 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8004240 con 0x7fd2f40c2e70 2024-04-22T07:24:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.760+0000 7fd2dbfff640 1 -- 172.21.15.40:0/760959597 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2e80043e0 con 0x7fd2f40c2e70 2024-04-22T07:24:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.760+0000 7fd2f9d52640 1 -- 172.21.15.40:0/760959597 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2f41f48b0 con 0x7fd2f40c2e70 2024-04-22T07:24:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.760+0000 7fd2dbfff640 1 -- 172.21.15.40:0/760959597 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8003830 con 0x7fd2f40c2e70 2024-04-22T07:24:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.760+0000 7fd2f9d52640 1 -- 172.21.15.40:0/760959597 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2f41e3410 con 0x7fd2f40c2e70 2024-04-22T07:24:36.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.761+0000 7fd2f9d52640 1 -- 172.21.15.40:0/760959597 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2f4152120 con 0x7fd2f40c2e70 2024-04-22T07:24:36.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.762+0000 7fd2dbfff640 1 -- 172.21.15.40:0/760959597 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd2e80039d0 con 0x7fd2f40c2e70 2024-04-22T07:24:36.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.762+0000 7fd2dbfff640 1 --2- 172.21.15.40:0/760959597 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fd2e006c920 0x7fd2e006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:36.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.762+0000 7fd2f37fe640 1 --2- 172.21.15.40:0/760959597 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fd2e006c920 0x7fd2e006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:36.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.762+0000 7fd2dbfff640 1 -- 172.21.15.40:0/760959597 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fd2e808bca0 con 0x7fd2f40c2e70 2024-04-22T07:24:36.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.763+0000 7fd2f37fe640 1 --2- 172.21.15.40:0/760959597 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fd2e006c920 0x7fd2e006ede0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4000f60 tx=0x7fd2e4007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:36.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.767+0000 7fd2dbfff640 1 -- 172.21.15.40:0/760959597 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd2f4152120 con 0x7fd2f40c2e70 2024-04-22T07:24:36.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.949+0000 7fd2f9d52640 1 -- 172.21.15.40:0/760959597 --> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd2f41f4b90 con 0x7fd2e006c920 2024-04-22T07:24:36.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.955+0000 7fd2dbfff640 1 -- 172.21.15.40:0/760959597 <== mgr.4107 v2:172.21.15.40:6832/91163869 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253888 (secure 0 0 0) 0x7fd2f41f4b90 con 0x7fd2e006c920 2024-04-22T07:24:36.956 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:24:36.957 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-22T07:24:36.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.959+0000 7fd2f9d52640 1 -- 172.21.15.40:0/760959597 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fd2e006c920 msgr2=0x7fd2e006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:36.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.959+0000 7fd2f9d52640 1 --2- 172.21.15.40:0/760959597 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fd2e006c920 0x7fd2e006ede0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4000f60 tx=0x7fd2e4007d50 comp rx=0 tx=0).stop 2024-04-22T07:24:36.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.959+0000 7fd2f9d52640 1 -- 172.21.15.40:0/760959597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2f40c2e70 msgr2=0x7fd2f41f0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:36.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.959+0000 7fd2f9d52640 1 --2- 172.21.15.40:0/760959597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2f40c2e70 0x7fd2f41f0740 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd2e800d600 tx=0x7fd2e800dac0 comp rx=0 tx=0).stop 2024-04-22T07:24:36.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.959+0000 7fd2f9d52640 1 -- 172.21.15.40:0/760959597 shutdown_connections 2024-04-22T07:24:36.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.959+0000 7fd2f9d52640 1 --2- 172.21.15.40:0/760959597 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd2f4152ff0 0x7fd2f413f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:36.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.959+0000 7fd2f9d52640 1 --2- 172.21.15.40:0/760959597 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fd2e006c920 0x7fd2e006ede0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:36.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.959+0000 7fd2f9d52640 1 --2- 172.21.15.40:0/760959597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2f40c2e70 0x7fd2f41f0740 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:36.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.959+0000 7fd2f9d52640 1 --2- 172.21.15.40:0/760959597 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd2f406f510 0x7fd2f41e5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:36.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.959+0000 7fd2f9d52640 1 -- 172.21.15.40:0/760959597 >> 172.21.15.40:0/760959597 conn(0x7fd2f40cc220 msgr2=0x7fd2f40cb600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:36.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.959+0000 7fd2f9d52640 1 -- 172.21.15.40:0/760959597 shutdown_connections 2024-04-22T07:24:36.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:36.959+0000 7fd2f9d52640 1 -- 172.21.15.40:0/760959597 wait complete. 2024-04-22T07:24:36.968 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-04-22T07:24:35.829104+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":10742960982,"num_objects":2586,"num_object_clones":0,"num_object_copies":5172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2586,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":9264,"num_write_kb":25175378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9723,"ondisk_log_size":9723,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":21274088,"kb_used_data":20984424,"kb_used_omap":12,"kb_used_meta":289587,"kb_avail":733700632,"statfs":{"total":773094113280,"available":751309447168,"internally_reserved":0,"allocated":21488050176,"data_stored":21486656326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":296537652},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5411,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":356361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002810"},"pg_stats":[{"pgid":"3.3f","version":"25'104","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.800931+0000","last_change":"2024-04-22T07:20:53.873662+0000","last_active":"2024-04-22T07:24:18.800931+0000","last_peered":"2024-04-22T07:24:18.800931+0000","last_clean":"2024-04-22T07:24:18.800931+0000","last_became_active":"2024-04-22T07:20:53.873384+0000","last_became_peered":"2024-04-22T07:20:53.873384+0000","last_unstale":"2024-04-22T07:24:18.800931+0000","last_undegraded":"2024-04-22T07:24:18.800931+0000","last_fullsized":"2024-04-22T07:24:18.800931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'94","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.326910+0000","last_change":"2024-04-22T07:20:53.870454+0000","last_active":"2024-04-22T07:24:18.326910+0000","last_peered":"2024-04-22T07:24:18.326910+0000","last_clean":"2024-04-22T07:24:18.326910+0000","last_became_active":"2024-04-22T07:20:53.869964+0000","last_became_peered":"2024-04-22T07:20:53.869964+0000","last_unstale":"2024-04-22T07:24:18.326910+0000","last_undegraded":"2024-04-22T07:24:18.326910+0000","last_fullsized":"2024-04-22T07:24:18.326910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'109","reported_seq":126,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.110352+0000","last_change":"2024-04-22T07:20:53.871145+0000","last_active":"2024-04-22T07:24:18.110352+0000","last_peered":"2024-04-22T07:24:18.110352+0000","last_clean":"2024-04-22T07:24:18.110352+0000","last_became_active":"2024-04-22T07:20:53.870819+0000","last_became_peered":"2024-04-22T07:20:53.870819+0000","last_unstale":"2024-04-22T07:24:18.110352+0000","last_undegraded":"2024-04-22T07:24:18.110352+0000","last_fullsized":"2024-04-22T07:24:18.110352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:02:16.373202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'125","reported_seq":142,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.262371+0000","last_change":"2024-04-22T07:20:53.870458+0000","last_active":"2024-04-22T07:24:18.262371+0000","last_peered":"2024-04-22T07:24:18.262371+0000","last_clean":"2024-04-22T07:24:18.262371+0000","last_became_active":"2024-04-22T07:20:53.870125+0000","last_became_peered":"2024-04-22T07:20:53.870125+0000","last_unstale":"2024-04-22T07:24:18.262371+0000","last_undegraded":"2024-04-22T07:24:18.262371+0000","last_fullsized":"2024-04-22T07:24:18.262371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209715200,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'112","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.619359+0000","last_change":"2024-04-22T07:20:53.877301+0000","last_active":"2024-04-22T07:24:19.619359+0000","last_peered":"2024-04-22T07:24:19.619359+0000","last_clean":"2024-04-22T07:24:19.619359+0000","last_became_active":"2024-04-22T07:20:53.874941+0000","last_became_peered":"2024-04-22T07:20:53.874941+0000","last_unstale":"2024-04-22T07:24:19.619359+0000","last_undegraded":"2024-04-22T07:24:19.619359+0000","last_fullsized":"2024-04-22T07:24:19.619359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:52.686229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"25'102","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.010027+0000","last_change":"2024-04-22T07:20:53.869735+0000","last_active":"2024-04-22T07:24:18.010027+0000","last_peered":"2024-04-22T07:24:18.010027+0000","last_clean":"2024-04-22T07:24:18.010027+0000","last_became_active":"2024-04-22T07:20:53.869369+0000","last_became_peered":"2024-04-22T07:20:53.869369+0000","last_unstale":"2024-04-22T07:24:18.010027+0000","last_undegraded":"2024-04-22T07:24:18.010027+0000","last_fullsized":"2024-04-22T07:24:18.010027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:27.624819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'125","reported_seq":142,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.772161+0000","last_change":"2024-04-22T07:20:53.873492+0000","last_active":"2024-04-22T07:24:17.772161+0000","last_peered":"2024-04-22T07:24:17.772161+0000","last_clean":"2024-04-22T07:24:17.772161+0000","last_became_active":"2024-04-22T07:20:53.873220+0000","last_became_peered":"2024-04-22T07:20:53.873220+0000","last_unstale":"2024-04-22T07:24:17.772161+0000","last_undegraded":"2024-04-22T07:24:17.772161+0000","last_fullsized":"2024-04-22T07:24:17.772161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:35:26.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'131","reported_seq":148,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.580589+0000","last_change":"2024-04-22T07:20:53.875847+0000","last_active":"2024-04-22T07:24:19.580589+0000","last_peered":"2024-04-22T07:24:19.580589+0000","last_clean":"2024-04-22T07:24:19.580589+0000","last_became_active":"2024-04-22T07:20:53.875017+0000","last_became_peered":"2024-04-22T07:20:53.875017+0000","last_unstale":"2024-04-22T07:24:19.580589+0000","last_undegraded":"2024-04-22T07:24:19.580589+0000","last_fullsized":"2024-04-22T07:24:19.580589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:07.080135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213909504,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'114","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.682363+0000","last_change":"2024-04-22T07:20:53.869174+0000","last_active":"2024-04-22T07:24:18.682363+0000","last_peered":"2024-04-22T07:24:18.682363+0000","last_clean":"2024-04-22T07:24:18.682363+0000","last_became_active":"2024-04-22T07:20:53.868906+0000","last_became_peered":"2024-04-22T07:20:53.868906+0000","last_unstale":"2024-04-22T07:24:18.682363+0000","last_undegraded":"2024-04-22T07:24:18.682363+0000","last_fullsized":"2024-04-22T07:24:18.682363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'117","reported_seq":134,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.460504+0000","last_change":"2024-04-22T07:20:53.874933+0000","last_active":"2024-04-22T07:24:18.460504+0000","last_peered":"2024-04-22T07:24:18.460504+0000","last_clean":"2024-04-22T07:24:18.460504+0000","last_became_active":"2024-04-22T07:20:53.874673+0000","last_became_peered":"2024-04-22T07:20:53.874673+0000","last_unstale":"2024-04-22T07:24:18.460504+0000","last_undegraded":"2024-04-22T07:24:18.460504+0000","last_fullsized":"2024-04-22T07:24:18.460504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'135","reported_seq":152,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.470880+0000","last_change":"2024-04-22T07:20:53.874909+0000","last_active":"2024-04-22T07:24:19.470880+0000","last_peered":"2024-04-22T07:24:19.470880+0000","last_clean":"2024-04-22T07:24:19.470880+0000","last_became_active":"2024-04-22T07:20:53.873945+0000","last_became_peered":"2024-04-22T07:20:53.873945+0000","last_unstale":"2024-04-22T07:24:19.470880+0000","last_undegraded":"2024-04-22T07:24:19.470880+0000","last_fullsized":"2024-04-22T07:24:19.470880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:53.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226492416,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'107","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.266832+0000","last_change":"2024-04-22T07:21:34.992848+0000","last_active":"2024-04-22T07:24:17.266832+0000","last_peered":"2024-04-22T07:24:17.266832+0000","last_clean":"2024-04-22T07:24:17.266832+0000","last_became_active":"2024-04-22T07:21:34.992633+0000","last_became_peered":"2024-04-22T07:21:34.992633+0000","last_unstale":"2024-04-22T07:24:17.266832+0000","last_undegraded":"2024-04-22T07:24:17.266832+0000","last_fullsized":"2024-04-22T07:24:17.266832+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:07.080135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"25'112","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.514886+0000","last_change":"2024-04-22T07:20:53.879419+0000","last_active":"2024-04-22T07:24:18.514886+0000","last_peered":"2024-04-22T07:24:18.514886+0000","last_clean":"2024-04-22T07:24:18.514886+0000","last_became_active":"2024-04-22T07:20:53.879070+0000","last_became_peered":"2024-04-22T07:20:53.879070+0000","last_unstale":"2024-04-22T07:24:18.514886+0000","last_undegraded":"2024-04-22T07:24:18.514886+0000","last_fullsized":"2024-04-22T07:24:18.514886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'107","reported_seq":124,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.923162+0000","last_change":"2024-04-22T07:20:53.877395+0000","last_active":"2024-04-22T07:24:17.923162+0000","last_peered":"2024-04-22T07:24:17.923162+0000","last_clean":"2024-04-22T07:24:17.923162+0000","last_became_active":"2024-04-22T07:20:53.877116+0000","last_became_peered":"2024-04-22T07:20:53.877116+0000","last_unstale":"2024-04-22T07:24:17.923162+0000","last_undegraded":"2024-04-22T07:24:17.923162+0000","last_fullsized":"2024-04-22T07:24:17.923162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:21:25.001413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'110","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.786094+0000","last_change":"2024-04-22T07:20:53.875156+0000","last_active":"2024-04-22T07:24:18.786094+0000","last_peered":"2024-04-22T07:24:18.786094+0000","last_clean":"2024-04-22T07:24:18.786094+0000","last_became_active":"2024-04-22T07:20:53.874468+0000","last_became_peered":"2024-04-22T07:20:53.874468+0000","last_unstale":"2024-04-22T07:24:18.786094+0000","last_undegraded":"2024-04-22T07:24:18.786094+0000","last_fullsized":"2024-04-22T07:24:18.786094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:42:03.637655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'107","reported_seq":124,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.009935+0000","last_change":"2024-04-22T07:20:53.867178+0000","last_active":"2024-04-22T07:24:18.009935+0000","last_peered":"2024-04-22T07:24:18.009935+0000","last_clean":"2024-04-22T07:24:18.009935+0000","last_became_active":"2024-04-22T07:20:53.865491+0000","last_became_peered":"2024-04-22T07:20:53.865491+0000","last_unstale":"2024-04-22T07:24:18.009935+0000","last_undegraded":"2024-04-22T07:24:18.009935+0000","last_fullsized":"2024-04-22T07:24:18.009935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'104","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.603187+0000","last_change":"2024-04-22T07:20:53.876797+0000","last_active":"2024-04-22T07:24:19.603187+0000","last_peered":"2024-04-22T07:24:19.603187+0000","last_clean":"2024-04-22T07:24:19.603187+0000","last_became_active":"2024-04-22T07:20:53.876321+0000","last_became_peered":"2024-04-22T07:20:53.876321+0000","last_unstale":"2024-04-22T07:24:19.603187+0000","last_undegraded":"2024-04-22T07:24:19.603187+0000","last_fullsized":"2024-04-22T07:24:19.603187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:22:45.699676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176160768,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'109","reported_seq":126,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.292536+0000","last_change":"2024-04-22T07:20:53.868760+0000","last_active":"2024-04-22T07:24:18.292536+0000","last_peered":"2024-04-22T07:24:18.292536+0000","last_clean":"2024-04-22T07:24:18.292536+0000","last_became_active":"2024-04-22T07:20:53.868441+0000","last_became_peered":"2024-04-22T07:20:53.868441+0000","last_unstale":"2024-04-22T07:24:18.292536+0000","last_undegraded":"2024-04-22T07:24:18.292536+0000","last_fullsized":"2024-04-22T07:24:18.292536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'124","reported_seq":141,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.956473+0000","last_change":"2024-04-22T07:20:53.864806+0000","last_active":"2024-04-22T07:24:18.956473+0000","last_peered":"2024-04-22T07:24:18.956473+0000","last_clean":"2024-04-22T07:24:18.956473+0000","last_became_active":"2024-04-22T07:20:53.864535+0000","last_became_peered":"2024-04-22T07:20:53.864535+0000","last_unstale":"2024-04-22T07:24:18.956473+0000","last_undegraded":"2024-04-22T07:24:18.956473+0000","last_fullsized":"2024-04-22T07:24:18.956473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:22:07.227993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205520896,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'114","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.611712+0000","last_change":"2024-04-22T07:20:53.878013+0000","last_active":"2024-04-22T07:24:19.611712+0000","last_peered":"2024-04-22T07:24:19.611712+0000","last_clean":"2024-04-22T07:24:19.611712+0000","last_became_active":"2024-04-22T07:20:53.876641+0000","last_became_peered":"2024-04-22T07:20:53.876641+0000","last_unstale":"2024-04-22T07:24:19.611712+0000","last_undegraded":"2024-04-22T07:24:19.611712+0000","last_fullsized":"2024-04-22T07:24:19.611712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:45:15.519469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'95","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.008489+0000","last_change":"2024-04-22T07:20:53.868319+0000","last_active":"2024-04-22T07:24:18.008489+0000","last_peered":"2024-04-22T07:24:18.008489+0000","last_clean":"2024-04-22T07:24:18.008489+0000","last_became_active":"2024-04-22T07:20:53.868014+0000","last_became_peered":"2024-04-22T07:20:53.868014+0000","last_unstale":"2024-04-22T07:24:18.008489+0000","last_undegraded":"2024-04-22T07:24:18.008489+0000","last_fullsized":"2024-04-22T07:24:18.008489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:09:27.178992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'127","reported_seq":144,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.581492+0000","last_change":"2024-04-22T07:20:53.867684+0000","last_active":"2024-04-22T07:24:17.581492+0000","last_peered":"2024-04-22T07:24:17.581492+0000","last_clean":"2024-04-22T07:24:17.581492+0000","last_became_active":"2024-04-22T07:20:53.867403+0000","last_became_peered":"2024-04-22T07:20:53.867403+0000","last_unstale":"2024-04-22T07:24:17.581492+0000","last_undegraded":"2024-04-22T07:24:17.581492+0000","last_fullsized":"2024-04-22T07:24:17.581492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180355072,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'93","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.418999+0000","last_change":"2024-04-22T07:20:53.869595+0000","last_active":"2024-04-22T07:24:18.418999+0000","last_peered":"2024-04-22T07:24:18.418999+0000","last_clean":"2024-04-22T07:24:18.418999+0000","last_became_active":"2024-04-22T07:20:53.868519+0000","last_became_peered":"2024-04-22T07:20:53.868519+0000","last_unstale":"2024-04-22T07:24:18.418999+0000","last_undegraded":"2024-04-22T07:24:18.418999+0000","last_fullsized":"2024-04-22T07:24:18.418999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:35:26.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'132","reported_seq":149,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.238781+0000","last_change":"2024-04-22T07:20:53.865275+0000","last_active":"2024-04-22T07:24:18.238781+0000","last_peered":"2024-04-22T07:24:18.238781+0000","last_clean":"2024-04-22T07:24:18.238781+0000","last_became_active":"2024-04-22T07:20:53.865026+0000","last_became_peered":"2024-04-22T07:20:53.865026+0000","last_unstale":"2024-04-22T07:24:18.238781+0000","last_undegraded":"2024-04-22T07:24:18.238781+0000","last_fullsized":"2024-04-22T07:24:18.238781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:48:40.630407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205520896,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'104","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.032178+0000","last_change":"2024-04-22T07:20:53.873457+0000","last_active":"2024-04-22T07:24:19.032178+0000","last_peered":"2024-04-22T07:24:19.032178+0000","last_clean":"2024-04-22T07:24:19.032178+0000","last_became_active":"2024-04-22T07:20:53.873147+0000","last_became_peered":"2024-04-22T07:20:53.873147+0000","last_unstale":"2024-04-22T07:24:19.032178+0000","last_undegraded":"2024-04-22T07:24:19.032178+0000","last_fullsized":"2024-04-22T07:24:19.032178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:53.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'142","reported_seq":159,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.451823+0000","last_change":"2024-04-22T07:20:53.865327+0000","last_active":"2024-04-22T07:24:19.451823+0000","last_peered":"2024-04-22T07:24:19.451823+0000","last_clean":"2024-04-22T07:24:19.451823+0000","last_became_active":"2024-04-22T07:20:53.865030+0000","last_became_peered":"2024-04-22T07:20:53.865030+0000","last_unstale":"2024-04-22T07:24:19.451823+0000","last_undegraded":"2024-04-22T07:24:19.451823+0000","last_fullsized":"2024-04-22T07:24:19.451823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201326592,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'105","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.922661+0000","last_change":"2024-04-22T07:20:53.876792+0000","last_active":"2024-04-22T07:24:17.922661+0000","last_peered":"2024-04-22T07:24:17.922661+0000","last_clean":"2024-04-22T07:24:17.922661+0000","last_became_active":"2024-04-22T07:20:53.876446+0000","last_became_peered":"2024-04-22T07:20:53.876446+0000","last_unstale":"2024-04-22T07:24:17.922661+0000","last_undegraded":"2024-04-22T07:24:17.922661+0000","last_fullsized":"2024-04-22T07:24:17.922661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:34.943561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'100","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.522155+0000","last_change":"2024-04-22T07:20:53.878147+0000","last_active":"2024-04-22T07:24:18.522155+0000","last_peered":"2024-04-22T07:24:18.522155+0000","last_clean":"2024-04-22T07:24:18.522155+0000","last_became_active":"2024-04-22T07:20:53.877867+0000","last_became_peered":"2024-04-22T07:20:53.877867+0000","last_unstale":"2024-04-22T07:24:18.522155+0000","last_undegraded":"2024-04-22T07:24:18.522155+0000","last_fullsized":"2024-04-22T07:24:18.522155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'88","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.152344+0000","last_change":"2024-04-22T07:20:53.872447+0000","last_active":"2024-04-22T07:24:18.152344+0000","last_peered":"2024-04-22T07:24:18.152344+0000","last_clean":"2024-04-22T07:24:18.152344+0000","last_became_active":"2024-04-22T07:20:53.871862+0000","last_became_peered":"2024-04-22T07:20:53.871862+0000","last_unstale":"2024-04-22T07:24:18.152344+0000","last_undegraded":"2024-04-22T07:24:18.152344+0000","last_fullsized":"2024-04-22T07:24:18.152344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:08:33.063318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'98","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.563563+0000","last_change":"2024-04-22T07:20:53.862483+0000","last_active":"2024-04-22T07:24:18.563563+0000","last_peered":"2024-04-22T07:24:18.563563+0000","last_clean":"2024-04-22T07:24:18.563563+0000","last_became_active":"2024-04-22T07:20:53.862199+0000","last_became_peered":"2024-04-22T07:20:53.862199+0000","last_unstale":"2024-04-22T07:24:18.563563+0000","last_undegraded":"2024-04-22T07:24:18.563563+0000","last_fullsized":"2024-04-22T07:24:18.563563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:10:12.276510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'102","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.074312+0000","last_change":"2024-04-22T07:20:53.872507+0000","last_active":"2024-04-22T07:24:17.074312+0000","last_peered":"2024-04-22T07:24:17.074312+0000","last_clean":"2024-04-22T07:24:17.074312+0000","last_became_active":"2024-04-22T07:20:53.872199+0000","last_became_peered":"2024-04-22T07:20:53.872199+0000","last_unstale":"2024-04-22T07:24:17.074312+0000","last_undegraded":"2024-04-22T07:24:17.074312+0000","last_fullsized":"2024-04-22T07:24:17.074312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:09.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'112","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.328824+0000","last_change":"2024-04-22T07:20:53.863946+0000","last_active":"2024-04-22T07:24:17.328824+0000","last_peered":"2024-04-22T07:24:17.328824+0000","last_clean":"2024-04-22T07:24:17.328824+0000","last_became_active":"2024-04-22T07:20:53.863688+0000","last_became_peered":"2024-04-22T07:20:53.863688+0000","last_unstale":"2024-04-22T07:24:17.328824+0000","last_undegraded":"2024-04-22T07:24:17.328824+0000","last_fullsized":"2024-04-22T07:24:17.328824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'98","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.752899+0000","last_change":"2024-04-22T07:20:53.874785+0000","last_active":"2024-04-22T07:24:17.752899+0000","last_peered":"2024-04-22T07:24:17.752899+0000","last_clean":"2024-04-22T07:24:17.752899+0000","last_became_active":"2024-04-22T07:20:53.874524+0000","last_became_peered":"2024-04-22T07:20:53.874524+0000","last_unstale":"2024-04-22T07:24:17.752899+0000","last_undegraded":"2024-04-22T07:24:17.752899+0000","last_fullsized":"2024-04-22T07:24:17.752899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'362","reported_seq":381,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.625239+0000","last_change":"2024-04-22T07:20:52.860712+0000","last_active":"2024-04-22T07:24:19.625239+0000","last_peered":"2024-04-22T07:24:19.625239+0000","last_clean":"2024-04-22T07:24:19.625239+0000","last_became_active":"2024-04-22T07:20:52.860015+0000","last_became_peered":"2024-04-22T07:20:52.860015+0000","last_unstale":"2024-04-22T07:24:19.625239+0000","last_undegraded":"2024-04-22T07:24:19.625239+0000","last_fullsized":"2024-04-22T07:24:19.625239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:59:32.487127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":756398,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":1085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'105","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.798779+0000","last_change":"2024-04-22T07:20:53.879570+0000","last_active":"2024-04-22T07:24:18.798779+0000","last_peered":"2024-04-22T07:24:18.798779+0000","last_clean":"2024-04-22T07:24:18.798779+0000","last_became_active":"2024-04-22T07:20:53.879191+0000","last_became_peered":"2024-04-22T07:20:53.879191+0000","last_unstale":"2024-04-22T07:24:18.798779+0000","last_undegraded":"2024-04-22T07:24:18.798779+0000","last_fullsized":"2024-04-22T07:24:18.798779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:34:52.306691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.990925+0000","last_change":"2024-04-22T07:20:52.862510+0000","last_active":"2024-04-22T07:21:34.990925+0000","last_peered":"2024-04-22T07:21:34.990925+0000","last_clean":"2024-04-22T07:21:34.990925+0000","last_became_active":"2024-04-22T07:20:52.862228+0000","last_became_peered":"2024-04-22T07:20:52.862228+0000","last_unstale":"2024-04-22T07:21:34.990925+0000","last_undegraded":"2024-04-22T07:21:34.990925+0000","last_fullsized":"2024-04-22T07:21:34.990925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:51.683021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.210531+0000","last_change":"2024-04-22T07:20:52.856651+0000","last_active":"2024-04-22T07:21:35.210531+0000","last_peered":"2024-04-22T07:21:35.210531+0000","last_clean":"2024-04-22T07:21:35.210531+0000","last_became_active":"2024-04-22T07:20:52.856096+0000","last_became_peered":"2024-04-22T07:20:52.856096+0000","last_unstale":"2024-04-22T07:21:35.210531+0000","last_undegraded":"2024-04-22T07:21:35.210531+0000","last_fullsized":"2024-04-22T07:21:35.210531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:04.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'122","reported_seq":139,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.614207+0000","last_change":"2024-04-22T07:20:53.873708+0000","last_active":"2024-04-22T07:24:18.614207+0000","last_peered":"2024-04-22T07:24:18.614207+0000","last_clean":"2024-04-22T07:24:18.614207+0000","last_became_active":"2024-04-22T07:20:53.872793+0000","last_became_peered":"2024-04-22T07:20:53.872793+0000","last_unstale":"2024-04-22T07:24:18.614207+0000","last_undegraded":"2024-04-22T07:24:18.614207+0000","last_fullsized":"2024-04-22T07:24:18.614207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:52.686229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197132288,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.990502+0000","last_change":"2024-04-22T07:20:52.861133+0000","last_active":"2024-04-22T07:21:34.990502+0000","last_peered":"2024-04-22T07:21:34.990502+0000","last_clean":"2024-04-22T07:21:34.990502+0000","last_became_active":"2024-04-22T07:20:52.860736+0000","last_became_peered":"2024-04-22T07:20:52.860736+0000","last_unstale":"2024-04-22T07:21:34.990502+0000","last_undegraded":"2024-04-22T07:21:34.990502+0000","last_fullsized":"2024-04-22T07:21:34.990502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:06.123308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'114","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.987671+0000","last_change":"2024-04-22T07:20:53.867477+0000","last_active":"2024-04-22T07:24:17.987671+0000","last_peered":"2024-04-22T07:24:17.987671+0000","last_clean":"2024-04-22T07:24:17.987671+0000","last_became_active":"2024-04-22T07:20:53.867086+0000","last_became_peered":"2024-04-22T07:20:53.867086+0000","last_unstale":"2024-04-22T07:24:17.987671+0000","last_undegraded":"2024-04-22T07:24:17.987671+0000","last_fullsized":"2024-04-22T07:24:17.987671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:56:55.644168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180355072,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:23:20.804973+0000","last_change":"2024-04-22T07:20:52.863567+0000","last_active":"2024-04-22T07:23:20.804973+0000","last_peered":"2024-04-22T07:23:20.804973+0000","last_clean":"2024-04-22T07:23:20.804973+0000","last_became_active":"2024-04-22T07:20:52.863285+0000","last_became_peered":"2024-04-22T07:20:52.863285+0000","last_unstale":"2024-04-22T07:23:20.804973+0000","last_undegraded":"2024-04-22T07:23:20.804973+0000","last_fullsized":"2024-04-22T07:23:20.804973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'167","reported_seq":184,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.454086+0000","last_change":"2024-04-22T07:20:53.864955+0000","last_active":"2024-04-22T07:24:19.454086+0000","last_peered":"2024-04-22T07:24:19.454086+0000","last_clean":"2024-04-22T07:24:19.454086+0000","last_became_active":"2024-04-22T07:20:53.864694+0000","last_became_peered":"2024-04-22T07:20:53.864694+0000","last_unstale":"2024-04-22T07:24:19.454086+0000","last_undegraded":"2024-04-22T07:24:19.454086+0000","last_fullsized":"2024-04-22T07:24:19.454086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.067980+0000","last_change":"2024-04-22T07:20:52.858761+0000","last_active":"2024-04-22T07:21:35.067980+0000","last_peered":"2024-04-22T07:21:35.067980+0000","last_clean":"2024-04-22T07:21:35.067980+0000","last_became_active":"2024-04-22T07:20:52.856815+0000","last_became_peered":"2024-04-22T07:20:52.856815+0000","last_unstale":"2024-04-22T07:21:35.067980+0000","last_undegraded":"2024-04-22T07:21:35.067980+0000","last_fullsized":"2024-04-22T07:21:35.067980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:06.123308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'101","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.314030+0000","last_change":"2024-04-22T07:20:53.867290+0000","last_active":"2024-04-22T07:24:19.314030+0000","last_peered":"2024-04-22T07:24:19.314030+0000","last_clean":"2024-04-22T07:24:19.314030+0000","last_became_active":"2024-04-22T07:20:53.866955+0000","last_became_peered":"2024-04-22T07:20:53.866955+0000","last_unstale":"2024-04-22T07:24:19.314030+0000","last_undegraded":"2024-04-22T07:24:19.314030+0000","last_fullsized":"2024-04-22T07:24:19.314030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:43.442316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'6","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:23:39.194608+0000","last_change":"2024-04-22T07:20:52.863670+0000","last_active":"2024-04-22T07:23:39.194608+0000","last_peered":"2024-04-22T07:23:39.194608+0000","last_clean":"2024-04-22T07:23:39.194608+0000","last_became_active":"2024-04-22T07:20:52.863320+0000","last_became_peered":"2024-04-22T07:20:52.863320+0000","last_unstale":"2024-04-22T07:23:39.194608+0000","last_undegraded":"2024-04-22T07:23:39.194608+0000","last_fullsized":"2024-04-22T07:23:39.194608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:04.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'107","reported_seq":124,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.895654+0000","last_change":"2024-04-22T07:20:53.868286+0000","last_active":"2024-04-22T07:24:17.895654+0000","last_peered":"2024-04-22T07:24:17.895654+0000","last_clean":"2024-04-22T07:24:17.895654+0000","last_became_active":"2024-04-22T07:20:53.862811+0000","last_became_peered":"2024-04-22T07:20:53.862811+0000","last_unstale":"2024-04-22T07:24:17.895654+0000","last_undegraded":"2024-04-22T07:24:17.895654+0000","last_fullsized":"2024-04-22T07:24:17.895654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'2013","reported_seq":2032,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:12.634943+0000","last_change":"2024-04-22T07:20:52.863638+0000","last_active":"2024-04-22T07:24:12.634943+0000","last_peered":"2024-04-22T07:24:12.634943+0000","last_clean":"2024-04-22T07:24:12.634943+0000","last_became_active":"2024-04-22T07:20:52.863244+0000","last_became_peered":"2024-04-22T07:20:52.863244+0000","last_unstale":"2024-04-22T07:24:12.634943+0000","last_undegraded":"2024-04-22T07:24:12.634943+0000","last_fullsized":"2024-04-22T07:24:12.634943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2013,"log_dups_size":0,"ondisk_log_size":2013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:36:49.017537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2012,"num_write_kb":6025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'111","reported_seq":128,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.388276+0000","last_change":"2024-04-22T07:20:53.875162+0000","last_active":"2024-04-22T07:24:19.388276+0000","last_peered":"2024-04-22T07:24:19.388276+0000","last_clean":"2024-04-22T07:24:19.388276+0000","last_became_active":"2024-04-22T07:20:53.874612+0000","last_became_peered":"2024-04-22T07:20:53.874612+0000","last_unstale":"2024-04-22T07:24:19.388276+0000","last_undegraded":"2024-04-22T07:24:19.388276+0000","last_fullsized":"2024-04-22T07:24:19.388276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:13:12.303505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.991827+0000","last_change":"2024-04-22T07:20:52.855194+0000","last_active":"2024-04-22T07:21:34.991827+0000","last_peered":"2024-04-22T07:21:34.991827+0000","last_clean":"2024-04-22T07:21:34.991827+0000","last_became_active":"2024-04-22T07:20:52.854915+0000","last_became_peered":"2024-04-22T07:20:52.854915+0000","last_unstale":"2024-04-22T07:21:34.991827+0000","last_undegraded":"2024-04-22T07:21:34.991827+0000","last_fullsized":"2024-04-22T07:21:34.991827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'117","reported_seq":134,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.241266+0000","last_change":"2024-04-22T07:20:53.868695+0000","last_active":"2024-04-22T07:24:18.241266+0000","last_peered":"2024-04-22T07:24:18.241266+0000","last_clean":"2024-04-22T07:24:18.241266+0000","last_became_active":"2024-04-22T07:20:53.868400+0000","last_became_peered":"2024-04-22T07:20:53.868400+0000","last_unstale":"2024-04-22T07:24:18.241266+0000","last_undegraded":"2024-04-22T07:24:18.241266+0000","last_fullsized":"2024-04-22T07:24:18.241266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:30:23.352871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.990952+0000","last_change":"2024-04-22T07:20:52.861884+0000","last_active":"2024-04-22T07:21:34.990952+0000","last_peered":"2024-04-22T07:21:34.990952+0000","last_clean":"2024-04-22T07:21:34.990952+0000","last_became_active":"2024-04-22T07:20:52.861546+0000","last_became_peered":"2024-04-22T07:20:52.861546+0000","last_unstale":"2024-04-22T07:21:34.990952+0000","last_undegraded":"2024-04-22T07:21:34.990952+0000","last_fullsized":"2024-04-22T07:21:34.990952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:37.283262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'121","reported_seq":138,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.300317+0000","last_change":"2024-04-22T07:20:53.863071+0000","last_active":"2024-04-22T07:24:18.300317+0000","last_peered":"2024-04-22T07:24:18.300317+0000","last_clean":"2024-04-22T07:24:18.300317+0000","last_became_active":"2024-04-22T07:20:53.862763+0000","last_became_peered":"2024-04-22T07:20:53.862763+0000","last_unstale":"2024-04-22T07:24:18.300317+0000","last_undegraded":"2024-04-22T07:24:18.300317+0000","last_fullsized":"2024-04-22T07:24:18.300317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:19:57.432323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197132288,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.067474+0000","last_change":"2024-04-22T07:20:52.865285+0000","last_active":"2024-04-22T07:21:35.067474+0000","last_peered":"2024-04-22T07:21:35.067474+0000","last_clean":"2024-04-22T07:21:35.067474+0000","last_became_active":"2024-04-22T07:20:52.864725+0000","last_became_peered":"2024-04-22T07:20:52.864725+0000","last_unstale":"2024-04-22T07:21:35.067474+0000","last_undegraded":"2024-04-22T07:21:35.067474+0000","last_fullsized":"2024-04-22T07:21:35.067474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:23:28.850031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'133","reported_seq":150,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.053849+0000","last_change":"2024-04-22T07:20:53.875479+0000","last_active":"2024-04-22T07:24:18.053849+0000","last_peered":"2024-04-22T07:24:18.053849+0000","last_clean":"2024-04-22T07:24:18.053849+0000","last_became_active":"2024-04-22T07:20:53.874567+0000","last_became_peered":"2024-04-22T07:20:53.874567+0000","last_unstale":"2024-04-22T07:24:18.053849+0000","last_undegraded":"2024-04-22T07:24:18.053849+0000","last_fullsized":"2024-04-22T07:24:18.053849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.210944+0000","last_change":"2024-04-22T07:20:52.860646+0000","last_active":"2024-04-22T07:21:35.210944+0000","last_peered":"2024-04-22T07:21:35.210944+0000","last_clean":"2024-04-22T07:21:35.210944+0000","last_became_active":"2024-04-22T07:20:52.860347+0000","last_became_peered":"2024-04-22T07:20:52.860347+0000","last_unstale":"2024-04-22T07:21:35.210944+0000","last_undegraded":"2024-04-22T07:21:35.210944+0000","last_fullsized":"2024-04-22T07:21:35.210944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:53:20.912264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'145","reported_seq":162,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.262173+0000","last_change":"2024-04-22T07:20:53.859641+0000","last_active":"2024-04-22T07:24:18.262173+0000","last_peered":"2024-04-22T07:24:18.262173+0000","last_clean":"2024-04-22T07:24:18.262173+0000","last_became_active":"2024-04-22T07:20:53.859365+0000","last_became_peered":"2024-04-22T07:20:53.859365+0000","last_unstale":"2024-04-22T07:24:18.262173+0000","last_undegraded":"2024-04-22T07:24:18.262173+0000","last_fullsized":"2024-04-22T07:24:18.262173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:46:50.322722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192937984,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.068079+0000","last_change":"2024-04-22T07:20:52.866960+0000","last_active":"2024-04-22T07:21:35.068079+0000","last_peered":"2024-04-22T07:21:35.068079+0000","last_clean":"2024-04-22T07:21:35.068079+0000","last_became_active":"2024-04-22T07:20:52.866654+0000","last_became_peered":"2024-04-22T07:20:52.866654+0000","last_unstale":"2024-04-22T07:21:35.068079+0000","last_undegraded":"2024-04-22T07:21:35.068079+0000","last_fullsized":"2024-04-22T07:21:35.068079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:51.683021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'106","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.470642+0000","last_change":"2024-04-22T07:20:53.874775+0000","last_active":"2024-04-22T07:24:19.470642+0000","last_peered":"2024-04-22T07:24:19.470642+0000","last_clean":"2024-04-22T07:24:19.470642+0000","last_became_active":"2024-04-22T07:20:53.874499+0000","last_became_peered":"2024-04-22T07:20:53.874499+0000","last_unstale":"2024-04-22T07:24:19.470642+0000","last_undegraded":"2024-04-22T07:24:19.470642+0000","last_fullsized":"2024-04-22T07:24:19.470642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:23.268067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.211381+0000","last_change":"2024-04-22T07:20:52.867201+0000","last_active":"2024-04-22T07:21:35.211381+0000","last_peered":"2024-04-22T07:21:35.211381+0000","last_clean":"2024-04-22T07:21:35.211381+0000","last_became_active":"2024-04-22T07:20:52.866627+0000","last_became_peered":"2024-04-22T07:20:52.866627+0000","last_unstale":"2024-04-22T07:21:35.211381+0000","last_undegraded":"2024-04-22T07:21:35.211381+0000","last_fullsized":"2024-04-22T07:21:35.211381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:09:08.908298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'103","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.022418+0000","last_change":"2024-04-22T07:20:53.871645+0000","last_active":"2024-04-22T07:24:18.022418+0000","last_peered":"2024-04-22T07:24:18.022418+0000","last_clean":"2024-04-22T07:24:18.022418+0000","last_became_active":"2024-04-22T07:20:53.871353+0000","last_became_peered":"2024-04-22T07:20:53.871353+0000","last_unstale":"2024-04-22T07:24:18.022418+0000","last_undegraded":"2024-04-22T07:24:18.022418+0000","last_fullsized":"2024-04-22T07:24:18.022418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:48:40.630407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.211197+0000","last_change":"2024-04-22T07:20:52.866996+0000","last_active":"2024-04-22T07:21:35.211197+0000","last_peered":"2024-04-22T07:21:35.211197+0000","last_clean":"2024-04-22T07:21:35.211197+0000","last_became_active":"2024-04-22T07:20:52.866677+0000","last_became_peered":"2024-04-22T07:20:52.866677+0000","last_unstale":"2024-04-22T07:21:35.211197+0000","last_undegraded":"2024-04-22T07:21:35.211197+0000","last_fullsized":"2024-04-22T07:21:35.211197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'102","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.600972+0000","last_change":"2024-04-22T07:20:53.871064+0000","last_active":"2024-04-22T07:24:19.600972+0000","last_peered":"2024-04-22T07:24:19.600972+0000","last_clean":"2024-04-22T07:24:19.600972+0000","last_became_active":"2024-04-22T07:20:53.866968+0000","last_became_peered":"2024-04-22T07:20:53.866968+0000","last_unstale":"2024-04-22T07:24:19.600972+0000","last_undegraded":"2024-04-22T07:24:19.600972+0000","last_fullsized":"2024-04-22T07:24:19.600972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:43.442316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.211392+0000","last_change":"2024-04-22T07:20:52.856958+0000","last_active":"2024-04-22T07:21:35.211392+0000","last_peered":"2024-04-22T07:21:35.211392+0000","last_clean":"2024-04-22T07:21:35.211392+0000","last_became_active":"2024-04-22T07:20:52.856289+0000","last_became_peered":"2024-04-22T07:20:52.856289+0000","last_unstale":"2024-04-22T07:21:35.211392+0000","last_undegraded":"2024-04-22T07:21:35.211392+0000","last_fullsized":"2024-04-22T07:21:35.211392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'112","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.925311+0000","last_change":"2024-04-22T07:20:53.872915+0000","last_active":"2024-04-22T07:24:18.925311+0000","last_peered":"2024-04-22T07:24:18.925311+0000","last_clean":"2024-04-22T07:24:18.925311+0000","last_became_active":"2024-04-22T07:20:53.872005+0000","last_became_peered":"2024-04-22T07:20:53.872005+0000","last_unstale":"2024-04-22T07:24:18.925311+0000","last_undegraded":"2024-04-22T07:24:18.925311+0000","last_fullsized":"2024-04-22T07:24:18.925311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:53:29.242632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.990127+0000","last_change":"2024-04-22T07:20:43.747396+0000","last_active":"2024-04-22T07:21:34.990127+0000","last_peered":"2024-04-22T07:21:34.990127+0000","last_clean":"2024-04-22T07:21:34.990127+0000","last_became_active":"2024-04-22T07:20:43.746332+0000","last_became_peered":"2024-04-22T07:20:43.746332+0000","last_unstale":"2024-04-22T07:21:34.990127+0000","last_undegraded":"2024-04-22T07:21:34.990127+0000","last_fullsized":"2024-04-22T07:21:34.990127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:42.732916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:42.732916+0000","last_clean_scrub_stamp":"2024-04-22T07:20:42.732916+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:02:55.086445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.991064+0000","last_change":"2024-04-22T07:20:52.862492+0000","last_active":"2024-04-22T07:21:34.991064+0000","last_peered":"2024-04-22T07:21:34.991064+0000","last_clean":"2024-04-22T07:21:34.991064+0000","last_became_active":"2024-04-22T07:20:52.862201+0000","last_became_peered":"2024-04-22T07:20:52.862201+0000","last_unstale":"2024-04-22T07:21:34.991064+0000","last_undegraded":"2024-04-22T07:21:34.991064+0000","last_fullsized":"2024-04-22T07:21:34.991064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:52.015227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'112","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.991597+0000","last_change":"2024-04-22T07:20:53.868797+0000","last_active":"2024-04-22T07:24:17.991597+0000","last_peered":"2024-04-22T07:24:17.991597+0000","last_clean":"2024-04-22T07:24:17.991597+0000","last_became_active":"2024-04-22T07:20:53.868335+0000","last_became_peered":"2024-04-22T07:20:53.868335+0000","last_unstale":"2024-04-22T07:24:17.991597+0000","last_undegraded":"2024-04-22T07:24:17.991597+0000","last_fullsized":"2024-04-22T07:24:17.991597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:43:02.116289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.990606+0000","last_change":"2024-04-22T07:20:52.867622+0000","last_active":"2024-04-22T07:21:34.990606+0000","last_peered":"2024-04-22T07:21:34.990606+0000","last_clean":"2024-04-22T07:21:34.990606+0000","last_became_active":"2024-04-22T07:20:52.866996+0000","last_became_peered":"2024-04-22T07:20:52.866996+0000","last_unstale":"2024-04-22T07:21:34.990606+0000","last_undegraded":"2024-04-22T07:21:34.990606+0000","last_fullsized":"2024-04-22T07:21:34.990606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:08.286530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'107","reported_seq":124,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.010322+0000","last_change":"2024-04-22T07:20:53.871576+0000","last_active":"2024-04-22T07:24:18.010322+0000","last_peered":"2024-04-22T07:24:18.010322+0000","last_clean":"2024-04-22T07:24:18.010322+0000","last_became_active":"2024-04-22T07:20:53.871239+0000","last_became_peered":"2024-04-22T07:20:53.871239+0000","last_unstale":"2024-04-22T07:24:18.010322+0000","last_undegraded":"2024-04-22T07:24:18.010322+0000","last_fullsized":"2024-04-22T07:24:18.010322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:23:55.981669+0000","last_change":"2024-04-22T07:20:52.866974+0000","last_active":"2024-04-22T07:23:55.981669+0000","last_peered":"2024-04-22T07:23:55.981669+0000","last_clean":"2024-04-22T07:23:55.981669+0000","last_became_active":"2024-04-22T07:20:52.866581+0000","last_became_peered":"2024-04-22T07:20:52.866581+0000","last_unstale":"2024-04-22T07:23:55.981669+0000","last_undegraded":"2024-04-22T07:23:55.981669+0000","last_fullsized":"2024-04-22T07:23:55.981669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'96","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.614662+0000","last_change":"2024-04-22T07:20:53.865035+0000","last_active":"2024-04-22T07:24:18.614662+0000","last_peered":"2024-04-22T07:24:18.614662+0000","last_clean":"2024-04-22T07:24:18.614662+0000","last_became_active":"2024-04-22T07:20:53.864523+0000","last_became_peered":"2024-04-22T07:20:53.864523+0000","last_unstale":"2024-04-22T07:24:18.614662+0000","last_undegraded":"2024-04-22T07:24:18.614662+0000","last_fullsized":"2024-04-22T07:24:18.614662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:13:12.303505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.991090+0000","last_change":"2024-04-22T07:20:52.858498+0000","last_active":"2024-04-22T07:21:34.991090+0000","last_peered":"2024-04-22T07:21:34.991090+0000","last_clean":"2024-04-22T07:21:34.991090+0000","last_became_active":"2024-04-22T07:20:52.858139+0000","last_became_peered":"2024-04-22T07:20:52.858139+0000","last_unstale":"2024-04-22T07:21:34.991090+0000","last_undegraded":"2024-04-22T07:21:34.991090+0000","last_fullsized":"2024-04-22T07:21:34.991090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:45.382709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'111","reported_seq":128,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.617500+0000","last_change":"2024-04-22T07:20:53.877595+0000","last_active":"2024-04-22T07:24:19.617500+0000","last_peered":"2024-04-22T07:24:19.617500+0000","last_clean":"2024-04-22T07:24:19.617500+0000","last_became_active":"2024-04-22T07:20:53.877208+0000","last_became_peered":"2024-04-22T07:20:53.877208+0000","last_unstale":"2024-04-22T07:24:19.617500+0000","last_undegraded":"2024-04-22T07:24:19.617500+0000","last_fullsized":"2024-04-22T07:24:19.617500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:46:50.322722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.211230+0000","last_change":"2024-04-22T07:20:52.866224+0000","last_active":"2024-04-22T07:21:35.211230+0000","last_peered":"2024-04-22T07:21:35.211230+0000","last_clean":"2024-04-22T07:21:35.211230+0000","last_became_active":"2024-04-22T07:20:52.865903+0000","last_became_peered":"2024-04-22T07:20:52.865903+0000","last_unstale":"2024-04-22T07:21:35.211230+0000","last_undegraded":"2024-04-22T07:21:35.211230+0000","last_fullsized":"2024-04-22T07:21:35.211230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'110","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.572978+0000","last_change":"2024-04-22T07:20:53.873266+0000","last_active":"2024-04-22T07:24:17.572978+0000","last_peered":"2024-04-22T07:24:17.572978+0000","last_clean":"2024-04-22T07:24:17.572978+0000","last_became_active":"2024-04-22T07:20:53.872915+0000","last_became_peered":"2024-04-22T07:20:53.872915+0000","last_unstale":"2024-04-22T07:24:17.572978+0000","last_undegraded":"2024-04-22T07:24:17.572978+0000","last_fullsized":"2024-04-22T07:24:17.572978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:09.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.991276+0000","last_change":"2024-04-22T07:20:52.863593+0000","last_active":"2024-04-22T07:21:34.991276+0000","last_peered":"2024-04-22T07:21:34.991276+0000","last_clean":"2024-04-22T07:21:34.991276+0000","last_became_active":"2024-04-22T07:20:52.863296+0000","last_became_peered":"2024-04-22T07:20:52.863296+0000","last_unstale":"2024-04-22T07:21:34.991276+0000","last_undegraded":"2024-04-22T07:21:34.991276+0000","last_fullsized":"2024-04-22T07:21:34.991276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:22.261683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'103","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.166523+0000","last_change":"2024-04-22T07:20:53.874491+0000","last_active":"2024-04-22T07:24:18.166523+0000","last_peered":"2024-04-22T07:24:18.166523+0000","last_clean":"2024-04-22T07:24:18.166523+0000","last_became_active":"2024-04-22T07:20:53.874202+0000","last_became_peered":"2024-04-22T07:20:53.874202+0000","last_unstale":"2024-04-22T07:24:18.166523+0000","last_undegraded":"2024-04-22T07:24:18.166523+0000","last_fullsized":"2024-04-22T07:24:18.166523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:23.268067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'19","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:30.910041+0000","last_change":"2024-04-22T07:20:52.865905+0000","last_active":"2024-04-22T07:24:30.910041+0000","last_peered":"2024-04-22T07:24:30.910041+0000","last_clean":"2024-04-22T07:24:30.910041+0000","last_became_active":"2024-04-22T07:20:52.865566+0000","last_became_peered":"2024-04-22T07:20:52.865566+0000","last_unstale":"2024-04-22T07:24:30.910041+0000","last_undegraded":"2024-04-22T07:24:30.910041+0000","last_fullsized":"2024-04-22T07:24:30.910041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:38:31.271879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'114","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.964928+0000","last_change":"2024-04-22T07:20:53.869951+0000","last_active":"2024-04-22T07:24:17.964928+0000","last_peered":"2024-04-22T07:24:17.964928+0000","last_clean":"2024-04-22T07:24:17.964928+0000","last_became_active":"2024-04-22T07:20:53.869613+0000","last_became_peered":"2024-04-22T07:20:53.869613+0000","last_unstale":"2024-04-22T07:24:17.964928+0000","last_undegraded":"2024-04-22T07:24:17.964928+0000","last_fullsized":"2024-04-22T07:24:17.964928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:14:09.372107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.991409+0000","last_change":"2024-04-22T07:20:52.864740+0000","last_active":"2024-04-22T07:21:34.991409+0000","last_peered":"2024-04-22T07:21:34.991409+0000","last_clean":"2024-04-22T07:21:34.991409+0000","last_became_active":"2024-04-22T07:20:52.864434+0000","last_became_peered":"2024-04-22T07:20:52.864434+0000","last_unstale":"2024-04-22T07:21:34.991409+0000","last_undegraded":"2024-04-22T07:21:34.991409+0000","last_fullsized":"2024-04-22T07:21:34.991409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:33.937176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'116","reported_seq":133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.747016+0000","last_change":"2024-04-22T07:20:53.871156+0000","last_active":"2024-04-22T07:24:17.747016+0000","last_peered":"2024-04-22T07:24:17.747016+0000","last_clean":"2024-04-22T07:24:17.747016+0000","last_became_active":"2024-04-22T07:20:53.870664+0000","last_became_peered":"2024-04-22T07:20:53.870664+0000","last_unstale":"2024-04-22T07:24:17.747016+0000","last_undegraded":"2024-04-22T07:24:17.747016+0000","last_fullsized":"2024-04-22T07:24:17.747016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:01:02.139458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.067306+0000","last_change":"2024-04-22T07:20:52.854668+0000","last_active":"2024-04-22T07:21:35.067306+0000","last_peered":"2024-04-22T07:21:35.067306+0000","last_clean":"2024-04-22T07:21:35.067306+0000","last_became_active":"2024-04-22T07:20:52.854395+0000","last_became_peered":"2024-04-22T07:20:52.854395+0000","last_unstale":"2024-04-22T07:21:35.067306+0000","last_undegraded":"2024-04-22T07:21:35.067306+0000","last_fullsized":"2024-04-22T07:21:35.067306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:59:32.487127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'114","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.011769+0000","last_change":"2024-04-22T07:20:53.870972+0000","last_active":"2024-04-22T07:24:18.011769+0000","last_peered":"2024-04-22T07:24:18.011769+0000","last_clean":"2024-04-22T07:24:18.011769+0000","last_became_active":"2024-04-22T07:20:53.870674+0000","last_became_peered":"2024-04-22T07:20:53.870674+0000","last_unstale":"2024-04-22T07:24:18.011769+0000","last_undegraded":"2024-04-22T07:24:18.011769+0000","last_fullsized":"2024-04-22T07:24:18.011769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:10.431906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.211569+0000","last_change":"2024-04-22T07:20:52.866003+0000","last_active":"2024-04-22T07:21:35.211569+0000","last_peered":"2024-04-22T07:21:35.211569+0000","last_clean":"2024-04-22T07:21:35.211569+0000","last_became_active":"2024-04-22T07:20:52.865606+0000","last_became_peered":"2024-04-22T07:20:52.865606+0000","last_unstale":"2024-04-22T07:21:35.211569+0000","last_undegraded":"2024-04-22T07:21:35.211569+0000","last_fullsized":"2024-04-22T07:21:35.211569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:58:06.713204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'116","reported_seq":133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.898981+0000","last_change":"2024-04-22T07:20:53.870737+0000","last_active":"2024-04-22T07:24:17.898981+0000","last_peered":"2024-04-22T07:24:17.898981+0000","last_clean":"2024-04-22T07:24:17.898981+0000","last_became_active":"2024-04-22T07:20:53.870402+0000","last_became_peered":"2024-04-22T07:20:53.870402+0000","last_unstale":"2024-04-22T07:24:17.898981+0000","last_undegraded":"2024-04-22T07:24:17.898981+0000","last_fullsized":"2024-04-22T07:24:17.898981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:30:17.845591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.210719+0000","last_change":"2024-04-22T07:20:52.861048+0000","last_active":"2024-04-22T07:21:35.210719+0000","last_peered":"2024-04-22T07:21:35.210719+0000","last_clean":"2024-04-22T07:21:35.210719+0000","last_became_active":"2024-04-22T07:20:52.860702+0000","last_became_peered":"2024-04-22T07:20:52.860702+0000","last_unstale":"2024-04-22T07:21:35.210719+0000","last_undegraded":"2024-04-22T07:21:35.210719+0000","last_fullsized":"2024-04-22T07:21:35.210719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'105","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:16.898071+0000","last_change":"2024-04-22T07:20:53.868782+0000","last_active":"2024-04-22T07:24:16.898071+0000","last_peered":"2024-04-22T07:24:16.898071+0000","last_clean":"2024-04-22T07:24:16.898071+0000","last_became_active":"2024-04-22T07:20:53.868509+0000","last_became_peered":"2024-04-22T07:20:53.868509+0000","last_unstale":"2024-04-22T07:24:16.898071+0000","last_undegraded":"2024-04-22T07:24:16.898071+0000","last_fullsized":"2024-04-22T07:24:16.898071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:07.129692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'3","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:23:10.820295+0000","last_change":"2024-04-22T07:20:52.858508+0000","last_active":"2024-04-22T07:23:10.820295+0000","last_peered":"2024-04-22T07:23:10.820295+0000","last_clean":"2024-04-22T07:23:10.820295+0000","last_became_active":"2024-04-22T07:20:52.858215+0000","last_became_peered":"2024-04-22T07:20:52.858215+0000","last_unstale":"2024-04-22T07:23:10.820295+0000","last_undegraded":"2024-04-22T07:23:10.820295+0000","last_fullsized":"2024-04-22T07:23:10.820295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:26.618434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'94","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.924667+0000","last_change":"2024-04-22T07:20:53.867977+0000","last_active":"2024-04-22T07:24:18.924667+0000","last_peered":"2024-04-22T07:24:18.924667+0000","last_clean":"2024-04-22T07:24:18.924667+0000","last_became_active":"2024-04-22T07:20:53.867447+0000","last_became_peered":"2024-04-22T07:20:53.867447+0000","last_unstale":"2024-04-22T07:24:18.924667+0000","last_undegraded":"2024-04-22T07:24:18.924667+0000","last_fullsized":"2024-04-22T07:24:18.924667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:48:52.934171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'131","reported_seq":148,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.110899+0000","last_change":"2024-04-22T07:20:53.875681+0000","last_active":"2024-04-22T07:24:19.110899+0000","last_peered":"2024-04-22T07:24:19.110899+0000","last_clean":"2024-04-22T07:24:19.110899+0000","last_became_active":"2024-04-22T07:20:53.875305+0000","last_became_peered":"2024-04-22T07:20:53.875305+0000","last_unstale":"2024-04-22T07:24:19.110899+0000","last_undegraded":"2024-04-22T07:24:19.110899+0000","last_fullsized":"2024-04-22T07:24:19.110899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:22:34.452869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.068077+0000","last_change":"2024-04-22T07:20:52.857445+0000","last_active":"2024-04-22T07:21:35.068077+0000","last_peered":"2024-04-22T07:21:35.068077+0000","last_clean":"2024-04-22T07:21:35.068077+0000","last_became_active":"2024-04-22T07:20:52.856293+0000","last_became_peered":"2024-04-22T07:20:52.856293+0000","last_unstale":"2024-04-22T07:21:35.068077+0000","last_undegraded":"2024-04-22T07:21:35.068077+0000","last_fullsized":"2024-04-22T07:21:35.068077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:10.640191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'106","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.277781+0000","last_change":"2024-04-22T07:20:53.870827+0000","last_active":"2024-04-22T07:24:18.277781+0000","last_peered":"2024-04-22T07:24:18.277781+0000","last_clean":"2024-04-22T07:24:18.277781+0000","last_became_active":"2024-04-22T07:20:53.870548+0000","last_became_peered":"2024-04-22T07:20:53.870548+0000","last_unstale":"2024-04-22T07:24:18.277781+0000","last_undegraded":"2024-04-22T07:24:18.277781+0000","last_fullsized":"2024-04-22T07:24:18.277781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:27.624819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'4","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:23:38.961771+0000","last_change":"2024-04-22T07:20:52.856933+0000","last_active":"2024-04-22T07:23:38.961771+0000","last_peered":"2024-04-22T07:23:38.961771+0000","last_clean":"2024-04-22T07:23:38.961771+0000","last_became_active":"2024-04-22T07:20:52.856617+0000","last_became_peered":"2024-04-22T07:20:52.856617+0000","last_unstale":"2024-04-22T07:23:38.961771+0000","last_undegraded":"2024-04-22T07:23:38.961771+0000","last_fullsized":"2024-04-22T07:23:38.961771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:08.286530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'97","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.032653+0000","last_change":"2024-04-22T07:20:53.866552+0000","last_active":"2024-04-22T07:24:19.032653+0000","last_peered":"2024-04-22T07:24:19.032653+0000","last_clean":"2024-04-22T07:24:19.032653+0000","last_became_active":"2024-04-22T07:20:53.866286+0000","last_became_peered":"2024-04-22T07:20:53.866286+0000","last_unstale":"2024-04-22T07:24:19.032653+0000","last_undegraded":"2024-04-22T07:24:19.032653+0000","last_fullsized":"2024-04-22T07:24:19.032653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:45:15.519469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.211591+0000","last_change":"2024-04-22T07:20:52.863291+0000","last_active":"2024-04-22T07:21:35.211591+0000","last_peered":"2024-04-22T07:21:35.211591+0000","last_clean":"2024-04-22T07:21:35.211591+0000","last_became_active":"2024-04-22T07:20:52.862967+0000","last_became_peered":"2024-04-22T07:20:52.862967+0000","last_unstale":"2024-04-22T07:21:35.211591+0000","last_undegraded":"2024-04-22T07:21:35.211591+0000","last_fullsized":"2024-04-22T07:21:35.211591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:10.640191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'115","reported_seq":132,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.727128+0000","last_change":"2024-04-22T07:20:53.871045+0000","last_active":"2024-04-22T07:24:18.727128+0000","last_peered":"2024-04-22T07:24:18.727128+0000","last_clean":"2024-04-22T07:24:18.727128+0000","last_became_active":"2024-04-22T07:20:53.870715+0000","last_became_peered":"2024-04-22T07:20:53.870715+0000","last_unstale":"2024-04-22T07:24:18.727128+0000","last_undegraded":"2024-04-22T07:24:18.727128+0000","last_fullsized":"2024-04-22T07:24:18.727128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176160768,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'4","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.211838+0000","last_change":"2024-04-22T07:20:52.869553+0000","last_active":"2024-04-22T07:21:35.211838+0000","last_peered":"2024-04-22T07:21:35.211838+0000","last_clean":"2024-04-22T07:21:35.211838+0000","last_became_active":"2024-04-22T07:20:52.869300+0000","last_became_peered":"2024-04-22T07:20:52.869300+0000","last_unstale":"2024-04-22T07:21:35.211838+0000","last_undegraded":"2024-04-22T07:21:35.211838+0000","last_fullsized":"2024-04-22T07:21:35.211838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:27.709073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":10737418240,"num_objects":2560,"num_object_clones":0,"num_object_copies":5120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6656,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21474836480,"data_stored":21474836480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7171,"ondisk_log_size":7171,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4952374,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2449,"num_write_kb":7138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9969664,"data_stored":9904748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2435,"ondisk_log_size":2435,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509489,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1706704,"kb_used_data":1675528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92665136,"statfs":{"total":96636764160,"available":94889099264,"internally_reserved":0,"allocated":1715740672,"data_stored":1715563810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509489,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2190756,"kb_used_data":2159580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92181084,"statfs":{"total":96636764160,"available":94393430016,"internally_reserved":0,"allocated":2211409920,"data_stored":2211242343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509488,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2916340,"kb_used_data":2885164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":91455500,"statfs":{"total":96636764160,"available":93650432000,"internally_reserved":0,"allocated":2954407936,"data_stored":2954224813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509489,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3357384,"kb_used_data":3326208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":91014456,"statfs":{"total":96636764160,"available":93198802944,"internally_reserved":0,"allocated":3406036992,"data_stored":3405868578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509490,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3084620,"kb_used_data":3035396,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":91287220,"statfs":{"total":96636764160,"available":93478113280,"internally_reserved":0,"allocated":3108245504,"data_stored":3108073084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509489,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2231564,"kb_used_data":2200388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92140276,"statfs":{"total":96636764160,"available":94351642624,"internally_reserved":0,"allocated":2253197312,"data_stored":2253024834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509491,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3586764,"kb_used_data":3555588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":90785076,"statfs":{"total":96636764160,"available":92963917824,"internally_reserved":0,"allocated":3640922112,"data_stored":3640749076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2199956,"kb_used_data":2146572,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":92171884,"statfs":{"total":96636764160,"available":94384009216,"internally_reserved":0,"allocated":2198089728,"data_stored":2197909788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4210688,"data_stored":4195648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":770048,"data_stored":756692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":757760,"data_stored":756398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3640655872,"data_stored":3640655872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2252341248,"data_stored":2252341248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3103784960,"data_stored":3103784960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3405774848,"data_stored":3405774848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2193620992,"data_stored":2193620992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2952790016,"data_stored":2952790016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2210398208,"data_stored":2210398208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1715470336,"data_stored":1715470336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T07:24:36.973 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T07:24:37.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.111+0000 7fe4755e6640 1 Processor -- start 2024-04-22T07:24:37.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.111+0000 7fe4755e6640 1 -- start start 2024-04-22T07:24:37.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.112+0000 7fe4755e6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe4701551a0 0x7fe4700cd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:37.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.112+0000 7fe4755e6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe47015bae0 0x7fe4700cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:37.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.112+0000 7fe4755e6640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4700cb6f0 0x7fe4700cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:37.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.112+0000 7fe4755e6640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fe4700cc060 con 0x7fe47015bae0 2024-04-22T07:24:37.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.112+0000 7fe4755e6640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fe47015e410 con 0x7fe4701551a0 2024-04-22T07:24:37.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.112+0000 7fe4755e6640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe470155580 con 0x7fe4700cb6f0 2024-04-22T07:24:37.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.112+0000 7fe467fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe47015bae0 0x7fe4700cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:37.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.112+0000 7fe467fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe47015bae0 0x7fe4700cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53484/0 (socket says 172.21.15.40:53484) 2024-04-22T07:24:37.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.112+0000 7fe467fff640 1 -- 172.21.15.40:0/2001474975 learned_addr learned my addr 172.21.15.40:0/2001474975 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:37.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.112+0000 7fe46f7fe640 1 --2- 172.21.15.40:0/2001474975 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4700cb6f0 0x7fe4700cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:37.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.112+0000 7fe46effd640 1 --2- 172.21.15.40:0/2001474975 >> v2:172.21.15.62:3300/0 conn(0x7fe4701551a0 0x7fe4700cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:37.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.112+0000 7fe467fff640 1 -- 172.21.15.40:0/2001474975 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4700cb6f0 msgr2=0x7fe4700cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:37.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.112+0000 7fe467fff640 1 --2- 172.21.15.40:0/2001474975 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4700cb6f0 0x7fe4700cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.112+0000 7fe467fff640 1 -- 172.21.15.40:0/2001474975 >> v2:172.21.15.62:3300/0 conn(0x7fe4701551a0 msgr2=0x7fe4700cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:37.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.112+0000 7fe467fff640 1 --2- 172.21.15.40:0/2001474975 >> v2:172.21.15.62:3300/0 conn(0x7fe4701551a0 0x7fe4700cd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.112+0000 7fe467fff640 1 -- 172.21.15.40:0/2001474975 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe47015e6b0 con 0x7fe47015bae0 2024-04-22T07:24:37.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.112+0000 7fe46f7fe640 1 --2- 172.21.15.40:0/2001474975 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4700cb6f0 0x7fe4700cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:24:37.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.113+0000 7fe467fff640 1 --2- 172.21.15.40:0/2001474975 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe47015bae0 0x7fe4700cd650 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe4700d1740 tx=0x7fe45802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e91c23cec87bda4 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:37.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.113+0000 7fe46e7fc640 1 -- 172.21.15.40:0/2001474975 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe458035020 con 0x7fe47015bae0 2024-04-22T07:24:37.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.113+0000 7fe46e7fc640 1 -- 172.21.15.40:0/2001474975 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe458031870 con 0x7fe47015bae0 2024-04-22T07:24:37.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.113+0000 7fe46e7fc640 1 -- 172.21.15.40:0/2001474975 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe458031c40 con 0x7fe47015bae0 2024-04-22T07:24:37.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.114+0000 7fe4755e6640 1 -- 172.21.15.40:0/2001474975 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe47015bae0 msgr2=0x7fe4700cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:37.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.114+0000 7fe4755e6640 1 --2- 172.21.15.40:0/2001474975 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe47015bae0 0x7fe4700cd650 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe4700d1740 tx=0x7fe45802b910 comp rx=0 tx=0).stop 2024-04-22T07:24:37.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.114+0000 7fe4755e6640 1 -- 172.21.15.40:0/2001474975 shutdown_connections 2024-04-22T07:24:37.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.114+0000 7fe4755e6640 1 --2- 172.21.15.40:0/2001474975 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe47015bae0 0x7fe4700cd650 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.114+0000 7fe4755e6640 1 --2- 172.21.15.40:0/2001474975 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4700cb6f0 0x7fe4700cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.114+0000 7fe4755e6640 1 --2- 172.21.15.40:0/2001474975 >> v2:172.21.15.62:3300/0 conn(0x7fe4701551a0 0x7fe4700cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.114+0000 7fe4755e6640 1 -- 172.21.15.40:0/2001474975 >> 172.21.15.40:0/2001474975 conn(0x7fe4700678c0 msgr2=0x7fe470072860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:37.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.114+0000 7fe4755e6640 1 -- 172.21.15.40:0/2001474975 shutdown_connections 2024-04-22T07:24:37.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.114+0000 7fe4755e6640 1 -- 172.21.15.40:0/2001474975 wait complete. 2024-04-22T07:24:37.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.115+0000 7fe4755e6640 1 Processor -- start 2024-04-22T07:24:37.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.115+0000 7fe4755e6640 1 -- start start 2024-04-22T07:24:37.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.115+0000 7fe4755e6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4700cb6f0 0x7fe4701f17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:37.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.115+0000 7fe4755e6640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4701551a0 0x7fe470159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:37.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.115+0000 7fe4755e6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe47015bae0 0x7fe4701e5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:37.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.115+0000 7fe4755e6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe47015ef50 con 0x7fe4700cb6f0 2024-04-22T07:24:37.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.115+0000 7fe4755e6640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe47015ec70 con 0x7fe47015bae0 2024-04-22T07:24:37.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.115+0000 7fe4755e6640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe47015f230 con 0x7fe4701551a0 2024-04-22T07:24:37.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.116+0000 7fe46effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4700cb6f0 0x7fe4701f17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:37.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.116+0000 7fe46effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4700cb6f0 0x7fe4701f17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53498/0 (socket says 172.21.15.40:53498) 2024-04-22T07:24:37.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.116+0000 7fe46effd640 1 -- 172.21.15.40:0/3949137464 learned_addr learned my addr 172.21.15.40:0/3949137464 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:37.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.116+0000 7fe46f7fe640 1 --2- 172.21.15.40:0/3949137464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe47015bae0 0x7fe4701e5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:37.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.116+0000 7fe467fff640 1 --2- 172.21.15.40:0/3949137464 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4701551a0 0x7fe470159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:37.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.116+0000 7fe46effd640 1 -- 172.21.15.40:0/3949137464 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4701551a0 msgr2=0x7fe470159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:37.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.116+0000 7fe46effd640 1 --2- 172.21.15.40:0/3949137464 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4701551a0 0x7fe470159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.116+0000 7fe46effd640 1 -- 172.21.15.40:0/3949137464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe47015bae0 msgr2=0x7fe4701e5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:37.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.116+0000 7fe46effd640 1 --2- 172.21.15.40:0/3949137464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe47015bae0 0x7fe4701e5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.116+0000 7fe46effd640 1 -- 172.21.15.40:0/3949137464 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe47015e090 con 0x7fe4700cb6f0 2024-04-22T07:24:37.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.116+0000 7fe46f7fe640 1 --2- 172.21.15.40:0/3949137464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe47015bae0 0x7fe4701e5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:24:37.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.116+0000 7fe467fff640 1 --2- 172.21.15.40:0/3949137464 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4701551a0 0x7fe470159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:24:37.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.116+0000 7fe46effd640 1 --2- 172.21.15.40:0/3949137464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4700cb6f0 0x7fe4701f17c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe46000c820 tx=0x7fe46000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:37.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.116+0000 7fe4677fe640 1 -- 172.21.15.40:0/3949137464 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe460015070 con 0x7fe4700cb6f0 2024-04-22T07:24:37.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.116+0000 7fe4677fe640 1 -- 172.21.15.40:0/3949137464 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe460004240 con 0x7fe4700cb6f0 2024-04-22T07:24:37.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.116+0000 7fe4677fe640 1 -- 172.21.15.40:0/3949137464 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46000ce10 con 0x7fe4700cb6f0 2024-04-22T07:24:37.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.116+0000 7fe4755e6640 1 -- 172.21.15.40:0/3949137464 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe47015bfe0 con 0x7fe4700cb6f0 2024-04-22T07:24:37.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.116+0000 7fe4755e6640 1 -- 172.21.15.40:0/3949137464 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe47015c5a0 con 0x7fe4700cb6f0 2024-04-22T07:24:37.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.117+0000 7fe4755e6640 1 -- 172.21.15.40:0/3949137464 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe470069d40 con 0x7fe4700cb6f0 2024-04-22T07:24:37.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.118+0000 7fe4677fe640 1 -- 172.21.15.40:0/3949137464 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe460007830 con 0x7fe4700cb6f0 2024-04-22T07:24:37.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.118+0000 7fe4677fe640 1 --2- 172.21.15.40:0/3949137464 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe45006c8f0 0x7fe45006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:37.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.118+0000 7fe4677fe640 1 -- 172.21.15.40:0/3949137464 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fe46008ba90 con 0x7fe4700cb6f0 2024-04-22T07:24:37.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.118+0000 7fe467fff640 1 --2- 172.21.15.40:0/3949137464 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe45006c8f0 0x7fe45006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:37.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.119+0000 7fe467fff640 1 --2- 172.21.15.40:0/3949137464 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe45006c8f0 0x7fe45006edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe458036000 tx=0x7fe45803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:37.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.123+0000 7fe4677fe640 1 -- 172.21.15.40:0/3949137464 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe460059ea0 con 0x7fe4700cb6f0 2024-04-22T07:24:37.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.303+0000 7fe4755e6640 1 -- 172.21.15.40:0/3949137464 --> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe470153b70 con 0x7fe45006c8f0 2024-04-22T07:24:37.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.309+0000 7fe4677fe640 1 -- 172.21.15.40:0/3949137464 <== mgr.4107 v2:172.21.15.40:6832/91163869 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253888 (secure 0 0 0) 0x7fe470153b70 con 0x7fe45006c8f0 2024-04-22T07:24:37.310 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:24:37.311 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-22T07:24:37.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.312+0000 7fe4755e6640 1 -- 172.21.15.40:0/3949137464 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe45006c8f0 msgr2=0x7fe45006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:37.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.313+0000 7fe4755e6640 1 --2- 172.21.15.40:0/3949137464 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe45006c8f0 0x7fe45006edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe458036000 tx=0x7fe45803c040 comp rx=0 tx=0).stop 2024-04-22T07:24:37.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.313+0000 7fe4755e6640 1 -- 172.21.15.40:0/3949137464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4700cb6f0 msgr2=0x7fe4701f17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:37.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.313+0000 7fe4755e6640 1 --2- 172.21.15.40:0/3949137464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4700cb6f0 0x7fe4701f17c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe46000c820 tx=0x7fe46000cce0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.313+0000 7fe4755e6640 1 -- 172.21.15.40:0/3949137464 shutdown_connections 2024-04-22T07:24:37.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.313+0000 7fe4755e6640 1 --2- 172.21.15.40:0/3949137464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe47015bae0 0x7fe4701e5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.313+0000 7fe4755e6640 1 --2- 172.21.15.40:0/3949137464 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe4701551a0 0x7fe470159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.313+0000 7fe4755e6640 1 --2- 172.21.15.40:0/3949137464 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe45006c8f0 0x7fe45006edb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.313+0000 7fe4755e6640 1 --2- 172.21.15.40:0/3949137464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4700cb6f0 0x7fe4701f17c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.313+0000 7fe4755e6640 1 -- 172.21.15.40:0/3949137464 >> 172.21.15.40:0/3949137464 conn(0x7fe4700678c0 msgr2=0x7fe4701526b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:37.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.313+0000 7fe4755e6640 1 -- 172.21.15.40:0/3949137464 shutdown_connections 2024-04-22T07:24:37.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.313+0000 7fe4755e6640 1 -- 172.21.15.40:0/3949137464 wait complete. 2024-04-22T07:24:37.321 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-04-22T07:24:35.829104+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":10742960982,"num_objects":2586,"num_object_clones":0,"num_object_copies":5172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2586,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":9264,"num_write_kb":25175378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9723,"ondisk_log_size":9723,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":21274088,"kb_used_data":20984424,"kb_used_omap":12,"kb_used_meta":289587,"kb_avail":733700632,"statfs":{"total":773094113280,"available":751309447168,"internally_reserved":0,"allocated":21488050176,"data_stored":21486656326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":296537652},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5411,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":356361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002810"},"pg_stats":[{"pgid":"3.3f","version":"25'104","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.800931+0000","last_change":"2024-04-22T07:20:53.873662+0000","last_active":"2024-04-22T07:24:18.800931+0000","last_peered":"2024-04-22T07:24:18.800931+0000","last_clean":"2024-04-22T07:24:18.800931+0000","last_became_active":"2024-04-22T07:20:53.873384+0000","last_became_peered":"2024-04-22T07:20:53.873384+0000","last_unstale":"2024-04-22T07:24:18.800931+0000","last_undegraded":"2024-04-22T07:24:18.800931+0000","last_fullsized":"2024-04-22T07:24:18.800931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'94","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.326910+0000","last_change":"2024-04-22T07:20:53.870454+0000","last_active":"2024-04-22T07:24:18.326910+0000","last_peered":"2024-04-22T07:24:18.326910+0000","last_clean":"2024-04-22T07:24:18.326910+0000","last_became_active":"2024-04-22T07:20:53.869964+0000","last_became_peered":"2024-04-22T07:20:53.869964+0000","last_unstale":"2024-04-22T07:24:18.326910+0000","last_undegraded":"2024-04-22T07:24:18.326910+0000","last_fullsized":"2024-04-22T07:24:18.326910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'109","reported_seq":126,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.110352+0000","last_change":"2024-04-22T07:20:53.871145+0000","last_active":"2024-04-22T07:24:18.110352+0000","last_peered":"2024-04-22T07:24:18.110352+0000","last_clean":"2024-04-22T07:24:18.110352+0000","last_became_active":"2024-04-22T07:20:53.870819+0000","last_became_peered":"2024-04-22T07:20:53.870819+0000","last_unstale":"2024-04-22T07:24:18.110352+0000","last_undegraded":"2024-04-22T07:24:18.110352+0000","last_fullsized":"2024-04-22T07:24:18.110352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:02:16.373202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'125","reported_seq":142,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.262371+0000","last_change":"2024-04-22T07:20:53.870458+0000","last_active":"2024-04-22T07:24:18.262371+0000","last_peered":"2024-04-22T07:24:18.262371+0000","last_clean":"2024-04-22T07:24:18.262371+0000","last_became_active":"2024-04-22T07:20:53.870125+0000","last_became_peered":"2024-04-22T07:20:53.870125+0000","last_unstale":"2024-04-22T07:24:18.262371+0000","last_undegraded":"2024-04-22T07:24:18.262371+0000","last_fullsized":"2024-04-22T07:24:18.262371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209715200,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'112","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.619359+0000","last_change":"2024-04-22T07:20:53.877301+0000","last_active":"2024-04-22T07:24:19.619359+0000","last_peered":"2024-04-22T07:24:19.619359+0000","last_clean":"2024-04-22T07:24:19.619359+0000","last_became_active":"2024-04-22T07:20:53.874941+0000","last_became_peered":"2024-04-22T07:20:53.874941+0000","last_unstale":"2024-04-22T07:24:19.619359+0000","last_undegraded":"2024-04-22T07:24:19.619359+0000","last_fullsized":"2024-04-22T07:24:19.619359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:52.686229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"25'102","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.010027+0000","last_change":"2024-04-22T07:20:53.869735+0000","last_active":"2024-04-22T07:24:18.010027+0000","last_peered":"2024-04-22T07:24:18.010027+0000","last_clean":"2024-04-22T07:24:18.010027+0000","last_became_active":"2024-04-22T07:20:53.869369+0000","last_became_peered":"2024-04-22T07:20:53.869369+0000","last_unstale":"2024-04-22T07:24:18.010027+0000","last_undegraded":"2024-04-22T07:24:18.010027+0000","last_fullsized":"2024-04-22T07:24:18.010027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:27.624819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'125","reported_seq":142,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.772161+0000","last_change":"2024-04-22T07:20:53.873492+0000","last_active":"2024-04-22T07:24:17.772161+0000","last_peered":"2024-04-22T07:24:17.772161+0000","last_clean":"2024-04-22T07:24:17.772161+0000","last_became_active":"2024-04-22T07:20:53.873220+0000","last_became_peered":"2024-04-22T07:20:53.873220+0000","last_unstale":"2024-04-22T07:24:17.772161+0000","last_undegraded":"2024-04-22T07:24:17.772161+0000","last_fullsized":"2024-04-22T07:24:17.772161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:35:26.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'131","reported_seq":148,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.580589+0000","last_change":"2024-04-22T07:20:53.875847+0000","last_active":"2024-04-22T07:24:19.580589+0000","last_peered":"2024-04-22T07:24:19.580589+0000","last_clean":"2024-04-22T07:24:19.580589+0000","last_became_active":"2024-04-22T07:20:53.875017+0000","last_became_peered":"2024-04-22T07:20:53.875017+0000","last_unstale":"2024-04-22T07:24:19.580589+0000","last_undegraded":"2024-04-22T07:24:19.580589+0000","last_fullsized":"2024-04-22T07:24:19.580589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:07.080135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213909504,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'114","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.682363+0000","last_change":"2024-04-22T07:20:53.869174+0000","last_active":"2024-04-22T07:24:18.682363+0000","last_peered":"2024-04-22T07:24:18.682363+0000","last_clean":"2024-04-22T07:24:18.682363+0000","last_became_active":"2024-04-22T07:20:53.868906+0000","last_became_peered":"2024-04-22T07:20:53.868906+0000","last_unstale":"2024-04-22T07:24:18.682363+0000","last_undegraded":"2024-04-22T07:24:18.682363+0000","last_fullsized":"2024-04-22T07:24:18.682363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'117","reported_seq":134,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.460504+0000","last_change":"2024-04-22T07:20:53.874933+0000","last_active":"2024-04-22T07:24:18.460504+0000","last_peered":"2024-04-22T07:24:18.460504+0000","last_clean":"2024-04-22T07:24:18.460504+0000","last_became_active":"2024-04-22T07:20:53.874673+0000","last_became_peered":"2024-04-22T07:20:53.874673+0000","last_unstale":"2024-04-22T07:24:18.460504+0000","last_undegraded":"2024-04-22T07:24:18.460504+0000","last_fullsized":"2024-04-22T07:24:18.460504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'135","reported_seq":152,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.470880+0000","last_change":"2024-04-22T07:20:53.874909+0000","last_active":"2024-04-22T07:24:19.470880+0000","last_peered":"2024-04-22T07:24:19.470880+0000","last_clean":"2024-04-22T07:24:19.470880+0000","last_became_active":"2024-04-22T07:20:53.873945+0000","last_became_peered":"2024-04-22T07:20:53.873945+0000","last_unstale":"2024-04-22T07:24:19.470880+0000","last_undegraded":"2024-04-22T07:24:19.470880+0000","last_fullsized":"2024-04-22T07:24:19.470880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:53.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226492416,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'107","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.266832+0000","last_change":"2024-04-22T07:21:34.992848+0000","last_active":"2024-04-22T07:24:17.266832+0000","last_peered":"2024-04-22T07:24:17.266832+0000","last_clean":"2024-04-22T07:24:17.266832+0000","last_became_active":"2024-04-22T07:21:34.992633+0000","last_became_peered":"2024-04-22T07:21:34.992633+0000","last_unstale":"2024-04-22T07:24:17.266832+0000","last_undegraded":"2024-04-22T07:24:17.266832+0000","last_fullsized":"2024-04-22T07:24:17.266832+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:07.080135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"25'112","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.514886+0000","last_change":"2024-04-22T07:20:53.879419+0000","last_active":"2024-04-22T07:24:18.514886+0000","last_peered":"2024-04-22T07:24:18.514886+0000","last_clean":"2024-04-22T07:24:18.514886+0000","last_became_active":"2024-04-22T07:20:53.879070+0000","last_became_peered":"2024-04-22T07:20:53.879070+0000","last_unstale":"2024-04-22T07:24:18.514886+0000","last_undegraded":"2024-04-22T07:24:18.514886+0000","last_fullsized":"2024-04-22T07:24:18.514886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'107","reported_seq":124,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.923162+0000","last_change":"2024-04-22T07:20:53.877395+0000","last_active":"2024-04-22T07:24:17.923162+0000","last_peered":"2024-04-22T07:24:17.923162+0000","last_clean":"2024-04-22T07:24:17.923162+0000","last_became_active":"2024-04-22T07:20:53.877116+0000","last_became_peered":"2024-04-22T07:20:53.877116+0000","last_unstale":"2024-04-22T07:24:17.923162+0000","last_undegraded":"2024-04-22T07:24:17.923162+0000","last_fullsized":"2024-04-22T07:24:17.923162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:21:25.001413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'110","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.786094+0000","last_change":"2024-04-22T07:20:53.875156+0000","last_active":"2024-04-22T07:24:18.786094+0000","last_peered":"2024-04-22T07:24:18.786094+0000","last_clean":"2024-04-22T07:24:18.786094+0000","last_became_active":"2024-04-22T07:20:53.874468+0000","last_became_peered":"2024-04-22T07:20:53.874468+0000","last_unstale":"2024-04-22T07:24:18.786094+0000","last_undegraded":"2024-04-22T07:24:18.786094+0000","last_fullsized":"2024-04-22T07:24:18.786094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:42:03.637655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'107","reported_seq":124,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.009935+0000","last_change":"2024-04-22T07:20:53.867178+0000","last_active":"2024-04-22T07:24:18.009935+0000","last_peered":"2024-04-22T07:24:18.009935+0000","last_clean":"2024-04-22T07:24:18.009935+0000","last_became_active":"2024-04-22T07:20:53.865491+0000","last_became_peered":"2024-04-22T07:20:53.865491+0000","last_unstale":"2024-04-22T07:24:18.009935+0000","last_undegraded":"2024-04-22T07:24:18.009935+0000","last_fullsized":"2024-04-22T07:24:18.009935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'104","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.603187+0000","last_change":"2024-04-22T07:20:53.876797+0000","last_active":"2024-04-22T07:24:19.603187+0000","last_peered":"2024-04-22T07:24:19.603187+0000","last_clean":"2024-04-22T07:24:19.603187+0000","last_became_active":"2024-04-22T07:20:53.876321+0000","last_became_peered":"2024-04-22T07:20:53.876321+0000","last_unstale":"2024-04-22T07:24:19.603187+0000","last_undegraded":"2024-04-22T07:24:19.603187+0000","last_fullsized":"2024-04-22T07:24:19.603187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:22:45.699676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176160768,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'109","reported_seq":126,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.292536+0000","last_change":"2024-04-22T07:20:53.868760+0000","last_active":"2024-04-22T07:24:18.292536+0000","last_peered":"2024-04-22T07:24:18.292536+0000","last_clean":"2024-04-22T07:24:18.292536+0000","last_became_active":"2024-04-22T07:20:53.868441+0000","last_became_peered":"2024-04-22T07:20:53.868441+0000","last_unstale":"2024-04-22T07:24:18.292536+0000","last_undegraded":"2024-04-22T07:24:18.292536+0000","last_fullsized":"2024-04-22T07:24:18.292536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'124","reported_seq":141,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.956473+0000","last_change":"2024-04-22T07:20:53.864806+0000","last_active":"2024-04-22T07:24:18.956473+0000","last_peered":"2024-04-22T07:24:18.956473+0000","last_clean":"2024-04-22T07:24:18.956473+0000","last_became_active":"2024-04-22T07:20:53.864535+0000","last_became_peered":"2024-04-22T07:20:53.864535+0000","last_unstale":"2024-04-22T07:24:18.956473+0000","last_undegraded":"2024-04-22T07:24:18.956473+0000","last_fullsized":"2024-04-22T07:24:18.956473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:22:07.227993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205520896,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'114","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.611712+0000","last_change":"2024-04-22T07:20:53.878013+0000","last_active":"2024-04-22T07:24:19.611712+0000","last_peered":"2024-04-22T07:24:19.611712+0000","last_clean":"2024-04-22T07:24:19.611712+0000","last_became_active":"2024-04-22T07:20:53.876641+0000","last_became_peered":"2024-04-22T07:20:53.876641+0000","last_unstale":"2024-04-22T07:24:19.611712+0000","last_undegraded":"2024-04-22T07:24:19.611712+0000","last_fullsized":"2024-04-22T07:24:19.611712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:45:15.519469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'95","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.008489+0000","last_change":"2024-04-22T07:20:53.868319+0000","last_active":"2024-04-22T07:24:18.008489+0000","last_peered":"2024-04-22T07:24:18.008489+0000","last_clean":"2024-04-22T07:24:18.008489+0000","last_became_active":"2024-04-22T07:20:53.868014+0000","last_became_peered":"2024-04-22T07:20:53.868014+0000","last_unstale":"2024-04-22T07:24:18.008489+0000","last_undegraded":"2024-04-22T07:24:18.008489+0000","last_fullsized":"2024-04-22T07:24:18.008489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:09:27.178992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'127","reported_seq":144,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.581492+0000","last_change":"2024-04-22T07:20:53.867684+0000","last_active":"2024-04-22T07:24:17.581492+0000","last_peered":"2024-04-22T07:24:17.581492+0000","last_clean":"2024-04-22T07:24:17.581492+0000","last_became_active":"2024-04-22T07:20:53.867403+0000","last_became_peered":"2024-04-22T07:20:53.867403+0000","last_unstale":"2024-04-22T07:24:17.581492+0000","last_undegraded":"2024-04-22T07:24:17.581492+0000","last_fullsized":"2024-04-22T07:24:17.581492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180355072,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'93","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.418999+0000","last_change":"2024-04-22T07:20:53.869595+0000","last_active":"2024-04-22T07:24:18.418999+0000","last_peered":"2024-04-22T07:24:18.418999+0000","last_clean":"2024-04-22T07:24:18.418999+0000","last_became_active":"2024-04-22T07:20:53.868519+0000","last_became_peered":"2024-04-22T07:20:53.868519+0000","last_unstale":"2024-04-22T07:24:18.418999+0000","last_undegraded":"2024-04-22T07:24:18.418999+0000","last_fullsized":"2024-04-22T07:24:18.418999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:35:26.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'132","reported_seq":149,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.238781+0000","last_change":"2024-04-22T07:20:53.865275+0000","last_active":"2024-04-22T07:24:18.238781+0000","last_peered":"2024-04-22T07:24:18.238781+0000","last_clean":"2024-04-22T07:24:18.238781+0000","last_became_active":"2024-04-22T07:20:53.865026+0000","last_became_peered":"2024-04-22T07:20:53.865026+0000","last_unstale":"2024-04-22T07:24:18.238781+0000","last_undegraded":"2024-04-22T07:24:18.238781+0000","last_fullsized":"2024-04-22T07:24:18.238781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:48:40.630407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205520896,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'104","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.032178+0000","last_change":"2024-04-22T07:20:53.873457+0000","last_active":"2024-04-22T07:24:19.032178+0000","last_peered":"2024-04-22T07:24:19.032178+0000","last_clean":"2024-04-22T07:24:19.032178+0000","last_became_active":"2024-04-22T07:20:53.873147+0000","last_became_peered":"2024-04-22T07:20:53.873147+0000","last_unstale":"2024-04-22T07:24:19.032178+0000","last_undegraded":"2024-04-22T07:24:19.032178+0000","last_fullsized":"2024-04-22T07:24:19.032178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:53.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'142","reported_seq":159,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.451823+0000","last_change":"2024-04-22T07:20:53.865327+0000","last_active":"2024-04-22T07:24:19.451823+0000","last_peered":"2024-04-22T07:24:19.451823+0000","last_clean":"2024-04-22T07:24:19.451823+0000","last_became_active":"2024-04-22T07:20:53.865030+0000","last_became_peered":"2024-04-22T07:20:53.865030+0000","last_unstale":"2024-04-22T07:24:19.451823+0000","last_undegraded":"2024-04-22T07:24:19.451823+0000","last_fullsized":"2024-04-22T07:24:19.451823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201326592,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'105","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.922661+0000","last_change":"2024-04-22T07:20:53.876792+0000","last_active":"2024-04-22T07:24:17.922661+0000","last_peered":"2024-04-22T07:24:17.922661+0000","last_clean":"2024-04-22T07:24:17.922661+0000","last_became_active":"2024-04-22T07:20:53.876446+0000","last_became_peered":"2024-04-22T07:20:53.876446+0000","last_unstale":"2024-04-22T07:24:17.922661+0000","last_undegraded":"2024-04-22T07:24:17.922661+0000","last_fullsized":"2024-04-22T07:24:17.922661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:34.943561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'100","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.522155+0000","last_change":"2024-04-22T07:20:53.878147+0000","last_active":"2024-04-22T07:24:18.522155+0000","last_peered":"2024-04-22T07:24:18.522155+0000","last_clean":"2024-04-22T07:24:18.522155+0000","last_became_active":"2024-04-22T07:20:53.877867+0000","last_became_peered":"2024-04-22T07:20:53.877867+0000","last_unstale":"2024-04-22T07:24:18.522155+0000","last_undegraded":"2024-04-22T07:24:18.522155+0000","last_fullsized":"2024-04-22T07:24:18.522155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'88","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.152344+0000","last_change":"2024-04-22T07:20:53.872447+0000","last_active":"2024-04-22T07:24:18.152344+0000","last_peered":"2024-04-22T07:24:18.152344+0000","last_clean":"2024-04-22T07:24:18.152344+0000","last_became_active":"2024-04-22T07:20:53.871862+0000","last_became_peered":"2024-04-22T07:20:53.871862+0000","last_unstale":"2024-04-22T07:24:18.152344+0000","last_undegraded":"2024-04-22T07:24:18.152344+0000","last_fullsized":"2024-04-22T07:24:18.152344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:08:33.063318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'98","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.563563+0000","last_change":"2024-04-22T07:20:53.862483+0000","last_active":"2024-04-22T07:24:18.563563+0000","last_peered":"2024-04-22T07:24:18.563563+0000","last_clean":"2024-04-22T07:24:18.563563+0000","last_became_active":"2024-04-22T07:20:53.862199+0000","last_became_peered":"2024-04-22T07:20:53.862199+0000","last_unstale":"2024-04-22T07:24:18.563563+0000","last_undegraded":"2024-04-22T07:24:18.563563+0000","last_fullsized":"2024-04-22T07:24:18.563563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:10:12.276510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'102","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.074312+0000","last_change":"2024-04-22T07:20:53.872507+0000","last_active":"2024-04-22T07:24:17.074312+0000","last_peered":"2024-04-22T07:24:17.074312+0000","last_clean":"2024-04-22T07:24:17.074312+0000","last_became_active":"2024-04-22T07:20:53.872199+0000","last_became_peered":"2024-04-22T07:20:53.872199+0000","last_unstale":"2024-04-22T07:24:17.074312+0000","last_undegraded":"2024-04-22T07:24:17.074312+0000","last_fullsized":"2024-04-22T07:24:17.074312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:09.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'112","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.328824+0000","last_change":"2024-04-22T07:20:53.863946+0000","last_active":"2024-04-22T07:24:17.328824+0000","last_peered":"2024-04-22T07:24:17.328824+0000","last_clean":"2024-04-22T07:24:17.328824+0000","last_became_active":"2024-04-22T07:20:53.863688+0000","last_became_peered":"2024-04-22T07:20:53.863688+0000","last_unstale":"2024-04-22T07:24:17.328824+0000","last_undegraded":"2024-04-22T07:24:17.328824+0000","last_fullsized":"2024-04-22T07:24:17.328824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'98","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.752899+0000","last_change":"2024-04-22T07:20:53.874785+0000","last_active":"2024-04-22T07:24:17.752899+0000","last_peered":"2024-04-22T07:24:17.752899+0000","last_clean":"2024-04-22T07:24:17.752899+0000","last_became_active":"2024-04-22T07:20:53.874524+0000","last_became_peered":"2024-04-22T07:20:53.874524+0000","last_unstale":"2024-04-22T07:24:17.752899+0000","last_undegraded":"2024-04-22T07:24:17.752899+0000","last_fullsized":"2024-04-22T07:24:17.752899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'362","reported_seq":381,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.625239+0000","last_change":"2024-04-22T07:20:52.860712+0000","last_active":"2024-04-22T07:24:19.625239+0000","last_peered":"2024-04-22T07:24:19.625239+0000","last_clean":"2024-04-22T07:24:19.625239+0000","last_became_active":"2024-04-22T07:20:52.860015+0000","last_became_peered":"2024-04-22T07:20:52.860015+0000","last_unstale":"2024-04-22T07:24:19.625239+0000","last_undegraded":"2024-04-22T07:24:19.625239+0000","last_fullsized":"2024-04-22T07:24:19.625239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:59:32.487127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":756398,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":1085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'105","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.798779+0000","last_change":"2024-04-22T07:20:53.879570+0000","last_active":"2024-04-22T07:24:18.798779+0000","last_peered":"2024-04-22T07:24:18.798779+0000","last_clean":"2024-04-22T07:24:18.798779+0000","last_became_active":"2024-04-22T07:20:53.879191+0000","last_became_peered":"2024-04-22T07:20:53.879191+0000","last_unstale":"2024-04-22T07:24:18.798779+0000","last_undegraded":"2024-04-22T07:24:18.798779+0000","last_fullsized":"2024-04-22T07:24:18.798779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:34:52.306691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.990925+0000","last_change":"2024-04-22T07:20:52.862510+0000","last_active":"2024-04-22T07:21:34.990925+0000","last_peered":"2024-04-22T07:21:34.990925+0000","last_clean":"2024-04-22T07:21:34.990925+0000","last_became_active":"2024-04-22T07:20:52.862228+0000","last_became_peered":"2024-04-22T07:20:52.862228+0000","last_unstale":"2024-04-22T07:21:34.990925+0000","last_undegraded":"2024-04-22T07:21:34.990925+0000","last_fullsized":"2024-04-22T07:21:34.990925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:51.683021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.210531+0000","last_change":"2024-04-22T07:20:52.856651+0000","last_active":"2024-04-22T07:21:35.210531+0000","last_peered":"2024-04-22T07:21:35.210531+0000","last_clean":"2024-04-22T07:21:35.210531+0000","last_became_active":"2024-04-22T07:20:52.856096+0000","last_became_peered":"2024-04-22T07:20:52.856096+0000","last_unstale":"2024-04-22T07:21:35.210531+0000","last_undegraded":"2024-04-22T07:21:35.210531+0000","last_fullsized":"2024-04-22T07:21:35.210531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:04.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'122","reported_seq":139,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.614207+0000","last_change":"2024-04-22T07:20:53.873708+0000","last_active":"2024-04-22T07:24:18.614207+0000","last_peered":"2024-04-22T07:24:18.614207+0000","last_clean":"2024-04-22T07:24:18.614207+0000","last_became_active":"2024-04-22T07:20:53.872793+0000","last_became_peered":"2024-04-22T07:20:53.872793+0000","last_unstale":"2024-04-22T07:24:18.614207+0000","last_undegraded":"2024-04-22T07:24:18.614207+0000","last_fullsized":"2024-04-22T07:24:18.614207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:52.686229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197132288,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.990502+0000","last_change":"2024-04-22T07:20:52.861133+0000","last_active":"2024-04-22T07:21:34.990502+0000","last_peered":"2024-04-22T07:21:34.990502+0000","last_clean":"2024-04-22T07:21:34.990502+0000","last_became_active":"2024-04-22T07:20:52.860736+0000","last_became_peered":"2024-04-22T07:20:52.860736+0000","last_unstale":"2024-04-22T07:21:34.990502+0000","last_undegraded":"2024-04-22T07:21:34.990502+0000","last_fullsized":"2024-04-22T07:21:34.990502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:06.123308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'114","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.987671+0000","last_change":"2024-04-22T07:20:53.867477+0000","last_active":"2024-04-22T07:24:17.987671+0000","last_peered":"2024-04-22T07:24:17.987671+0000","last_clean":"2024-04-22T07:24:17.987671+0000","last_became_active":"2024-04-22T07:20:53.867086+0000","last_became_peered":"2024-04-22T07:20:53.867086+0000","last_unstale":"2024-04-22T07:24:17.987671+0000","last_undegraded":"2024-04-22T07:24:17.987671+0000","last_fullsized":"2024-04-22T07:24:17.987671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:56:55.644168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180355072,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:23:20.804973+0000","last_change":"2024-04-22T07:20:52.863567+0000","last_active":"2024-04-22T07:23:20.804973+0000","last_peered":"2024-04-22T07:23:20.804973+0000","last_clean":"2024-04-22T07:23:20.804973+0000","last_became_active":"2024-04-22T07:20:52.863285+0000","last_became_peered":"2024-04-22T07:20:52.863285+0000","last_unstale":"2024-04-22T07:23:20.804973+0000","last_undegraded":"2024-04-22T07:23:20.804973+0000","last_fullsized":"2024-04-22T07:23:20.804973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'167","reported_seq":184,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.454086+0000","last_change":"2024-04-22T07:20:53.864955+0000","last_active":"2024-04-22T07:24:19.454086+0000","last_peered":"2024-04-22T07:24:19.454086+0000","last_clean":"2024-04-22T07:24:19.454086+0000","last_became_active":"2024-04-22T07:20:53.864694+0000","last_became_peered":"2024-04-22T07:20:53.864694+0000","last_unstale":"2024-04-22T07:24:19.454086+0000","last_undegraded":"2024-04-22T07:24:19.454086+0000","last_fullsized":"2024-04-22T07:24:19.454086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.067980+0000","last_change":"2024-04-22T07:20:52.858761+0000","last_active":"2024-04-22T07:21:35.067980+0000","last_peered":"2024-04-22T07:21:35.067980+0000","last_clean":"2024-04-22T07:21:35.067980+0000","last_became_active":"2024-04-22T07:20:52.856815+0000","last_became_peered":"2024-04-22T07:20:52.856815+0000","last_unstale":"2024-04-22T07:21:35.067980+0000","last_undegraded":"2024-04-22T07:21:35.067980+0000","last_fullsized":"2024-04-22T07:21:35.067980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:06.123308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'101","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.314030+0000","last_change":"2024-04-22T07:20:53.867290+0000","last_active":"2024-04-22T07:24:19.314030+0000","last_peered":"2024-04-22T07:24:19.314030+0000","last_clean":"2024-04-22T07:24:19.314030+0000","last_became_active":"2024-04-22T07:20:53.866955+0000","last_became_peered":"2024-04-22T07:20:53.866955+0000","last_unstale":"2024-04-22T07:24:19.314030+0000","last_undegraded":"2024-04-22T07:24:19.314030+0000","last_fullsized":"2024-04-22T07:24:19.314030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:43.442316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'6","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:23:39.194608+0000","last_change":"2024-04-22T07:20:52.863670+0000","last_active":"2024-04-22T07:23:39.194608+0000","last_peered":"2024-04-22T07:23:39.194608+0000","last_clean":"2024-04-22T07:23:39.194608+0000","last_became_active":"2024-04-22T07:20:52.863320+0000","last_became_peered":"2024-04-22T07:20:52.863320+0000","last_unstale":"2024-04-22T07:23:39.194608+0000","last_undegraded":"2024-04-22T07:23:39.194608+0000","last_fullsized":"2024-04-22T07:23:39.194608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:04.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'107","reported_seq":124,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.895654+0000","last_change":"2024-04-22T07:20:53.868286+0000","last_active":"2024-04-22T07:24:17.895654+0000","last_peered":"2024-04-22T07:24:17.895654+0000","last_clean":"2024-04-22T07:24:17.895654+0000","last_became_active":"2024-04-22T07:20:53.862811+0000","last_became_peered":"2024-04-22T07:20:53.862811+0000","last_unstale":"2024-04-22T07:24:17.895654+0000","last_undegraded":"2024-04-22T07:24:17.895654+0000","last_fullsized":"2024-04-22T07:24:17.895654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'2013","reported_seq":2032,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:12.634943+0000","last_change":"2024-04-22T07:20:52.863638+0000","last_active":"2024-04-22T07:24:12.634943+0000","last_peered":"2024-04-22T07:24:12.634943+0000","last_clean":"2024-04-22T07:24:12.634943+0000","last_became_active":"2024-04-22T07:20:52.863244+0000","last_became_peered":"2024-04-22T07:20:52.863244+0000","last_unstale":"2024-04-22T07:24:12.634943+0000","last_undegraded":"2024-04-22T07:24:12.634943+0000","last_fullsized":"2024-04-22T07:24:12.634943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2013,"log_dups_size":0,"ondisk_log_size":2013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:36:49.017537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2012,"num_write_kb":6025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'111","reported_seq":128,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.388276+0000","last_change":"2024-04-22T07:20:53.875162+0000","last_active":"2024-04-22T07:24:19.388276+0000","last_peered":"2024-04-22T07:24:19.388276+0000","last_clean":"2024-04-22T07:24:19.388276+0000","last_became_active":"2024-04-22T07:20:53.874612+0000","last_became_peered":"2024-04-22T07:20:53.874612+0000","last_unstale":"2024-04-22T07:24:19.388276+0000","last_undegraded":"2024-04-22T07:24:19.388276+0000","last_fullsized":"2024-04-22T07:24:19.388276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:13:12.303505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.991827+0000","last_change":"2024-04-22T07:20:52.855194+0000","last_active":"2024-04-22T07:21:34.991827+0000","last_peered":"2024-04-22T07:21:34.991827+0000","last_clean":"2024-04-22T07:21:34.991827+0000","last_became_active":"2024-04-22T07:20:52.854915+0000","last_became_peered":"2024-04-22T07:20:52.854915+0000","last_unstale":"2024-04-22T07:21:34.991827+0000","last_undegraded":"2024-04-22T07:21:34.991827+0000","last_fullsized":"2024-04-22T07:21:34.991827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'117","reported_seq":134,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.241266+0000","last_change":"2024-04-22T07:20:53.868695+0000","last_active":"2024-04-22T07:24:18.241266+0000","last_peered":"2024-04-22T07:24:18.241266+0000","last_clean":"2024-04-22T07:24:18.241266+0000","last_became_active":"2024-04-22T07:20:53.868400+0000","last_became_peered":"2024-04-22T07:20:53.868400+0000","last_unstale":"2024-04-22T07:24:18.241266+0000","last_undegraded":"2024-04-22T07:24:18.241266+0000","last_fullsized":"2024-04-22T07:24:18.241266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:30:23.352871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.990952+0000","last_change":"2024-04-22T07:20:52.861884+0000","last_active":"2024-04-22T07:21:34.990952+0000","last_peered":"2024-04-22T07:21:34.990952+0000","last_clean":"2024-04-22T07:21:34.990952+0000","last_became_active":"2024-04-22T07:20:52.861546+0000","last_became_peered":"2024-04-22T07:20:52.861546+0000","last_unstale":"2024-04-22T07:21:34.990952+0000","last_undegraded":"2024-04-22T07:21:34.990952+0000","last_fullsized":"2024-04-22T07:21:34.990952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:37.283262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'121","reported_seq":138,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.300317+0000","last_change":"2024-04-22T07:20:53.863071+0000","last_active":"2024-04-22T07:24:18.300317+0000","last_peered":"2024-04-22T07:24:18.300317+0000","last_clean":"2024-04-22T07:24:18.300317+0000","last_became_active":"2024-04-22T07:20:53.862763+0000","last_became_peered":"2024-04-22T07:20:53.862763+0000","last_unstale":"2024-04-22T07:24:18.300317+0000","last_undegraded":"2024-04-22T07:24:18.300317+0000","last_fullsized":"2024-04-22T07:24:18.300317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:19:57.432323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197132288,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.067474+0000","last_change":"2024-04-22T07:20:52.865285+0000","last_active":"2024-04-22T07:21:35.067474+0000","last_peered":"2024-04-22T07:21:35.067474+0000","last_clean":"2024-04-22T07:21:35.067474+0000","last_became_active":"2024-04-22T07:20:52.864725+0000","last_became_peered":"2024-04-22T07:20:52.864725+0000","last_unstale":"2024-04-22T07:21:35.067474+0000","last_undegraded":"2024-04-22T07:21:35.067474+0000","last_fullsized":"2024-04-22T07:21:35.067474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:23:28.850031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'133","reported_seq":150,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.053849+0000","last_change":"2024-04-22T07:20:53.875479+0000","last_active":"2024-04-22T07:24:18.053849+0000","last_peered":"2024-04-22T07:24:18.053849+0000","last_clean":"2024-04-22T07:24:18.053849+0000","last_became_active":"2024-04-22T07:20:53.874567+0000","last_became_peered":"2024-04-22T07:20:53.874567+0000","last_unstale":"2024-04-22T07:24:18.053849+0000","last_undegraded":"2024-04-22T07:24:18.053849+0000","last_fullsized":"2024-04-22T07:24:18.053849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.210944+0000","last_change":"2024-04-22T07:20:52.860646+0000","last_active":"2024-04-22T07:21:35.210944+0000","last_peered":"2024-04-22T07:21:35.210944+0000","last_clean":"2024-04-22T07:21:35.210944+0000","last_became_active":"2024-04-22T07:20:52.860347+0000","last_became_peered":"2024-04-22T07:20:52.860347+0000","last_unstale":"2024-04-22T07:21:35.210944+0000","last_undegraded":"2024-04-22T07:21:35.210944+0000","last_fullsized":"2024-04-22T07:21:35.210944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:53:20.912264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'145","reported_seq":162,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.262173+0000","last_change":"2024-04-22T07:20:53.859641+0000","last_active":"2024-04-22T07:24:18.262173+0000","last_peered":"2024-04-22T07:24:18.262173+0000","last_clean":"2024-04-22T07:24:18.262173+0000","last_became_active":"2024-04-22T07:20:53.859365+0000","last_became_peered":"2024-04-22T07:20:53.859365+0000","last_unstale":"2024-04-22T07:24:18.262173+0000","last_undegraded":"2024-04-22T07:24:18.262173+0000","last_fullsized":"2024-04-22T07:24:18.262173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:46:50.322722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192937984,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.068079+0000","last_change":"2024-04-22T07:20:52.866960+0000","last_active":"2024-04-22T07:21:35.068079+0000","last_peered":"2024-04-22T07:21:35.068079+0000","last_clean":"2024-04-22T07:21:35.068079+0000","last_became_active":"2024-04-22T07:20:52.866654+0000","last_became_peered":"2024-04-22T07:20:52.866654+0000","last_unstale":"2024-04-22T07:21:35.068079+0000","last_undegraded":"2024-04-22T07:21:35.068079+0000","last_fullsized":"2024-04-22T07:21:35.068079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:51.683021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'106","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.470642+0000","last_change":"2024-04-22T07:20:53.874775+0000","last_active":"2024-04-22T07:24:19.470642+0000","last_peered":"2024-04-22T07:24:19.470642+0000","last_clean":"2024-04-22T07:24:19.470642+0000","last_became_active":"2024-04-22T07:20:53.874499+0000","last_became_peered":"2024-04-22T07:20:53.874499+0000","last_unstale":"2024-04-22T07:24:19.470642+0000","last_undegraded":"2024-04-22T07:24:19.470642+0000","last_fullsized":"2024-04-22T07:24:19.470642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:23.268067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.211381+0000","last_change":"2024-04-22T07:20:52.867201+0000","last_active":"2024-04-22T07:21:35.211381+0000","last_peered":"2024-04-22T07:21:35.211381+0000","last_clean":"2024-04-22T07:21:35.211381+0000","last_became_active":"2024-04-22T07:20:52.866627+0000","last_became_peered":"2024-04-22T07:20:52.866627+0000","last_unstale":"2024-04-22T07:21:35.211381+0000","last_undegraded":"2024-04-22T07:21:35.211381+0000","last_fullsized":"2024-04-22T07:21:35.211381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:09:08.908298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'103","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.022418+0000","last_change":"2024-04-22T07:20:53.871645+0000","last_active":"2024-04-22T07:24:18.022418+0000","last_peered":"2024-04-22T07:24:18.022418+0000","last_clean":"2024-04-22T07:24:18.022418+0000","last_became_active":"2024-04-22T07:20:53.871353+0000","last_became_peered":"2024-04-22T07:20:53.871353+0000","last_unstale":"2024-04-22T07:24:18.022418+0000","last_undegraded":"2024-04-22T07:24:18.022418+0000","last_fullsized":"2024-04-22T07:24:18.022418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:48:40.630407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.211197+0000","last_change":"2024-04-22T07:20:52.866996+0000","last_active":"2024-04-22T07:21:35.211197+0000","last_peered":"2024-04-22T07:21:35.211197+0000","last_clean":"2024-04-22T07:21:35.211197+0000","last_became_active":"2024-04-22T07:20:52.866677+0000","last_became_peered":"2024-04-22T07:20:52.866677+0000","last_unstale":"2024-04-22T07:21:35.211197+0000","last_undegraded":"2024-04-22T07:21:35.211197+0000","last_fullsized":"2024-04-22T07:21:35.211197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'102","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.600972+0000","last_change":"2024-04-22T07:20:53.871064+0000","last_active":"2024-04-22T07:24:19.600972+0000","last_peered":"2024-04-22T07:24:19.600972+0000","last_clean":"2024-04-22T07:24:19.600972+0000","last_became_active":"2024-04-22T07:20:53.866968+0000","last_became_peered":"2024-04-22T07:20:53.866968+0000","last_unstale":"2024-04-22T07:24:19.600972+0000","last_undegraded":"2024-04-22T07:24:19.600972+0000","last_fullsized":"2024-04-22T07:24:19.600972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:43.442316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.211392+0000","last_change":"2024-04-22T07:20:52.856958+0000","last_active":"2024-04-22T07:21:35.211392+0000","last_peered":"2024-04-22T07:21:35.211392+0000","last_clean":"2024-04-22T07:21:35.211392+0000","last_became_active":"2024-04-22T07:20:52.856289+0000","last_became_peered":"2024-04-22T07:20:52.856289+0000","last_unstale":"2024-04-22T07:21:35.211392+0000","last_undegraded":"2024-04-22T07:21:35.211392+0000","last_fullsized":"2024-04-22T07:21:35.211392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'112","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.925311+0000","last_change":"2024-04-22T07:20:53.872915+0000","last_active":"2024-04-22T07:24:18.925311+0000","last_peered":"2024-04-22T07:24:18.925311+0000","last_clean":"2024-04-22T07:24:18.925311+0000","last_became_active":"2024-04-22T07:20:53.872005+0000","last_became_peered":"2024-04-22T07:20:53.872005+0000","last_unstale":"2024-04-22T07:24:18.925311+0000","last_undegraded":"2024-04-22T07:24:18.925311+0000","last_fullsized":"2024-04-22T07:24:18.925311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:53:29.242632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.990127+0000","last_change":"2024-04-22T07:20:43.747396+0000","last_active":"2024-04-22T07:21:34.990127+0000","last_peered":"2024-04-22T07:21:34.990127+0000","last_clean":"2024-04-22T07:21:34.990127+0000","last_became_active":"2024-04-22T07:20:43.746332+0000","last_became_peered":"2024-04-22T07:20:43.746332+0000","last_unstale":"2024-04-22T07:21:34.990127+0000","last_undegraded":"2024-04-22T07:21:34.990127+0000","last_fullsized":"2024-04-22T07:21:34.990127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:42.732916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:42.732916+0000","last_clean_scrub_stamp":"2024-04-22T07:20:42.732916+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:02:55.086445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.991064+0000","last_change":"2024-04-22T07:20:52.862492+0000","last_active":"2024-04-22T07:21:34.991064+0000","last_peered":"2024-04-22T07:21:34.991064+0000","last_clean":"2024-04-22T07:21:34.991064+0000","last_became_active":"2024-04-22T07:20:52.862201+0000","last_became_peered":"2024-04-22T07:20:52.862201+0000","last_unstale":"2024-04-22T07:21:34.991064+0000","last_undegraded":"2024-04-22T07:21:34.991064+0000","last_fullsized":"2024-04-22T07:21:34.991064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:52.015227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'112","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.991597+0000","last_change":"2024-04-22T07:20:53.868797+0000","last_active":"2024-04-22T07:24:17.991597+0000","last_peered":"2024-04-22T07:24:17.991597+0000","last_clean":"2024-04-22T07:24:17.991597+0000","last_became_active":"2024-04-22T07:20:53.868335+0000","last_became_peered":"2024-04-22T07:20:53.868335+0000","last_unstale":"2024-04-22T07:24:17.991597+0000","last_undegraded":"2024-04-22T07:24:17.991597+0000","last_fullsized":"2024-04-22T07:24:17.991597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:43:02.116289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.990606+0000","last_change":"2024-04-22T07:20:52.867622+0000","last_active":"2024-04-22T07:21:34.990606+0000","last_peered":"2024-04-22T07:21:34.990606+0000","last_clean":"2024-04-22T07:21:34.990606+0000","last_became_active":"2024-04-22T07:20:52.866996+0000","last_became_peered":"2024-04-22T07:20:52.866996+0000","last_unstale":"2024-04-22T07:21:34.990606+0000","last_undegraded":"2024-04-22T07:21:34.990606+0000","last_fullsized":"2024-04-22T07:21:34.990606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:08.286530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'107","reported_seq":124,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.010322+0000","last_change":"2024-04-22T07:20:53.871576+0000","last_active":"2024-04-22T07:24:18.010322+0000","last_peered":"2024-04-22T07:24:18.010322+0000","last_clean":"2024-04-22T07:24:18.010322+0000","last_became_active":"2024-04-22T07:20:53.871239+0000","last_became_peered":"2024-04-22T07:20:53.871239+0000","last_unstale":"2024-04-22T07:24:18.010322+0000","last_undegraded":"2024-04-22T07:24:18.010322+0000","last_fullsized":"2024-04-22T07:24:18.010322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:23:55.981669+0000","last_change":"2024-04-22T07:20:52.866974+0000","last_active":"2024-04-22T07:23:55.981669+0000","last_peered":"2024-04-22T07:23:55.981669+0000","last_clean":"2024-04-22T07:23:55.981669+0000","last_became_active":"2024-04-22T07:20:52.866581+0000","last_became_peered":"2024-04-22T07:20:52.866581+0000","last_unstale":"2024-04-22T07:23:55.981669+0000","last_undegraded":"2024-04-22T07:23:55.981669+0000","last_fullsized":"2024-04-22T07:23:55.981669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'96","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.614662+0000","last_change":"2024-04-22T07:20:53.865035+0000","last_active":"2024-04-22T07:24:18.614662+0000","last_peered":"2024-04-22T07:24:18.614662+0000","last_clean":"2024-04-22T07:24:18.614662+0000","last_became_active":"2024-04-22T07:20:53.864523+0000","last_became_peered":"2024-04-22T07:20:53.864523+0000","last_unstale":"2024-04-22T07:24:18.614662+0000","last_undegraded":"2024-04-22T07:24:18.614662+0000","last_fullsized":"2024-04-22T07:24:18.614662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:13:12.303505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.991090+0000","last_change":"2024-04-22T07:20:52.858498+0000","last_active":"2024-04-22T07:21:34.991090+0000","last_peered":"2024-04-22T07:21:34.991090+0000","last_clean":"2024-04-22T07:21:34.991090+0000","last_became_active":"2024-04-22T07:20:52.858139+0000","last_became_peered":"2024-04-22T07:20:52.858139+0000","last_unstale":"2024-04-22T07:21:34.991090+0000","last_undegraded":"2024-04-22T07:21:34.991090+0000","last_fullsized":"2024-04-22T07:21:34.991090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:45.382709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'111","reported_seq":128,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.617500+0000","last_change":"2024-04-22T07:20:53.877595+0000","last_active":"2024-04-22T07:24:19.617500+0000","last_peered":"2024-04-22T07:24:19.617500+0000","last_clean":"2024-04-22T07:24:19.617500+0000","last_became_active":"2024-04-22T07:20:53.877208+0000","last_became_peered":"2024-04-22T07:20:53.877208+0000","last_unstale":"2024-04-22T07:24:19.617500+0000","last_undegraded":"2024-04-22T07:24:19.617500+0000","last_fullsized":"2024-04-22T07:24:19.617500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:46:50.322722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.211230+0000","last_change":"2024-04-22T07:20:52.866224+0000","last_active":"2024-04-22T07:21:35.211230+0000","last_peered":"2024-04-22T07:21:35.211230+0000","last_clean":"2024-04-22T07:21:35.211230+0000","last_became_active":"2024-04-22T07:20:52.865903+0000","last_became_peered":"2024-04-22T07:20:52.865903+0000","last_unstale":"2024-04-22T07:21:35.211230+0000","last_undegraded":"2024-04-22T07:21:35.211230+0000","last_fullsized":"2024-04-22T07:21:35.211230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'110","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.572978+0000","last_change":"2024-04-22T07:20:53.873266+0000","last_active":"2024-04-22T07:24:17.572978+0000","last_peered":"2024-04-22T07:24:17.572978+0000","last_clean":"2024-04-22T07:24:17.572978+0000","last_became_active":"2024-04-22T07:20:53.872915+0000","last_became_peered":"2024-04-22T07:20:53.872915+0000","last_unstale":"2024-04-22T07:24:17.572978+0000","last_undegraded":"2024-04-22T07:24:17.572978+0000","last_fullsized":"2024-04-22T07:24:17.572978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:09.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.991276+0000","last_change":"2024-04-22T07:20:52.863593+0000","last_active":"2024-04-22T07:21:34.991276+0000","last_peered":"2024-04-22T07:21:34.991276+0000","last_clean":"2024-04-22T07:21:34.991276+0000","last_became_active":"2024-04-22T07:20:52.863296+0000","last_became_peered":"2024-04-22T07:20:52.863296+0000","last_unstale":"2024-04-22T07:21:34.991276+0000","last_undegraded":"2024-04-22T07:21:34.991276+0000","last_fullsized":"2024-04-22T07:21:34.991276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:22.261683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'103","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.166523+0000","last_change":"2024-04-22T07:20:53.874491+0000","last_active":"2024-04-22T07:24:18.166523+0000","last_peered":"2024-04-22T07:24:18.166523+0000","last_clean":"2024-04-22T07:24:18.166523+0000","last_became_active":"2024-04-22T07:20:53.874202+0000","last_became_peered":"2024-04-22T07:20:53.874202+0000","last_unstale":"2024-04-22T07:24:18.166523+0000","last_undegraded":"2024-04-22T07:24:18.166523+0000","last_fullsized":"2024-04-22T07:24:18.166523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:23.268067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'19","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:30.910041+0000","last_change":"2024-04-22T07:20:52.865905+0000","last_active":"2024-04-22T07:24:30.910041+0000","last_peered":"2024-04-22T07:24:30.910041+0000","last_clean":"2024-04-22T07:24:30.910041+0000","last_became_active":"2024-04-22T07:20:52.865566+0000","last_became_peered":"2024-04-22T07:20:52.865566+0000","last_unstale":"2024-04-22T07:24:30.910041+0000","last_undegraded":"2024-04-22T07:24:30.910041+0000","last_fullsized":"2024-04-22T07:24:30.910041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:38:31.271879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'114","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.964928+0000","last_change":"2024-04-22T07:20:53.869951+0000","last_active":"2024-04-22T07:24:17.964928+0000","last_peered":"2024-04-22T07:24:17.964928+0000","last_clean":"2024-04-22T07:24:17.964928+0000","last_became_active":"2024-04-22T07:20:53.869613+0000","last_became_peered":"2024-04-22T07:20:53.869613+0000","last_unstale":"2024-04-22T07:24:17.964928+0000","last_undegraded":"2024-04-22T07:24:17.964928+0000","last_fullsized":"2024-04-22T07:24:17.964928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:14:09.372107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.991409+0000","last_change":"2024-04-22T07:20:52.864740+0000","last_active":"2024-04-22T07:21:34.991409+0000","last_peered":"2024-04-22T07:21:34.991409+0000","last_clean":"2024-04-22T07:21:34.991409+0000","last_became_active":"2024-04-22T07:20:52.864434+0000","last_became_peered":"2024-04-22T07:20:52.864434+0000","last_unstale":"2024-04-22T07:21:34.991409+0000","last_undegraded":"2024-04-22T07:21:34.991409+0000","last_fullsized":"2024-04-22T07:21:34.991409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:33.937176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'116","reported_seq":133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.747016+0000","last_change":"2024-04-22T07:20:53.871156+0000","last_active":"2024-04-22T07:24:17.747016+0000","last_peered":"2024-04-22T07:24:17.747016+0000","last_clean":"2024-04-22T07:24:17.747016+0000","last_became_active":"2024-04-22T07:20:53.870664+0000","last_became_peered":"2024-04-22T07:20:53.870664+0000","last_unstale":"2024-04-22T07:24:17.747016+0000","last_undegraded":"2024-04-22T07:24:17.747016+0000","last_fullsized":"2024-04-22T07:24:17.747016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:01:02.139458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.067306+0000","last_change":"2024-04-22T07:20:52.854668+0000","last_active":"2024-04-22T07:21:35.067306+0000","last_peered":"2024-04-22T07:21:35.067306+0000","last_clean":"2024-04-22T07:21:35.067306+0000","last_became_active":"2024-04-22T07:20:52.854395+0000","last_became_peered":"2024-04-22T07:20:52.854395+0000","last_unstale":"2024-04-22T07:21:35.067306+0000","last_undegraded":"2024-04-22T07:21:35.067306+0000","last_fullsized":"2024-04-22T07:21:35.067306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:59:32.487127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'114","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.011769+0000","last_change":"2024-04-22T07:20:53.870972+0000","last_active":"2024-04-22T07:24:18.011769+0000","last_peered":"2024-04-22T07:24:18.011769+0000","last_clean":"2024-04-22T07:24:18.011769+0000","last_became_active":"2024-04-22T07:20:53.870674+0000","last_became_peered":"2024-04-22T07:20:53.870674+0000","last_unstale":"2024-04-22T07:24:18.011769+0000","last_undegraded":"2024-04-22T07:24:18.011769+0000","last_fullsized":"2024-04-22T07:24:18.011769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:10.431906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.211569+0000","last_change":"2024-04-22T07:20:52.866003+0000","last_active":"2024-04-22T07:21:35.211569+0000","last_peered":"2024-04-22T07:21:35.211569+0000","last_clean":"2024-04-22T07:21:35.211569+0000","last_became_active":"2024-04-22T07:20:52.865606+0000","last_became_peered":"2024-04-22T07:20:52.865606+0000","last_unstale":"2024-04-22T07:21:35.211569+0000","last_undegraded":"2024-04-22T07:21:35.211569+0000","last_fullsized":"2024-04-22T07:21:35.211569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:58:06.713204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'116","reported_seq":133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.898981+0000","last_change":"2024-04-22T07:20:53.870737+0000","last_active":"2024-04-22T07:24:17.898981+0000","last_peered":"2024-04-22T07:24:17.898981+0000","last_clean":"2024-04-22T07:24:17.898981+0000","last_became_active":"2024-04-22T07:20:53.870402+0000","last_became_peered":"2024-04-22T07:20:53.870402+0000","last_unstale":"2024-04-22T07:24:17.898981+0000","last_undegraded":"2024-04-22T07:24:17.898981+0000","last_fullsized":"2024-04-22T07:24:17.898981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:30:17.845591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.210719+0000","last_change":"2024-04-22T07:20:52.861048+0000","last_active":"2024-04-22T07:21:35.210719+0000","last_peered":"2024-04-22T07:21:35.210719+0000","last_clean":"2024-04-22T07:21:35.210719+0000","last_became_active":"2024-04-22T07:20:52.860702+0000","last_became_peered":"2024-04-22T07:20:52.860702+0000","last_unstale":"2024-04-22T07:21:35.210719+0000","last_undegraded":"2024-04-22T07:21:35.210719+0000","last_fullsized":"2024-04-22T07:21:35.210719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'105","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:16.898071+0000","last_change":"2024-04-22T07:20:53.868782+0000","last_active":"2024-04-22T07:24:16.898071+0000","last_peered":"2024-04-22T07:24:16.898071+0000","last_clean":"2024-04-22T07:24:16.898071+0000","last_became_active":"2024-04-22T07:20:53.868509+0000","last_became_peered":"2024-04-22T07:20:53.868509+0000","last_unstale":"2024-04-22T07:24:16.898071+0000","last_undegraded":"2024-04-22T07:24:16.898071+0000","last_fullsized":"2024-04-22T07:24:16.898071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:07.129692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'3","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:23:10.820295+0000","last_change":"2024-04-22T07:20:52.858508+0000","last_active":"2024-04-22T07:23:10.820295+0000","last_peered":"2024-04-22T07:23:10.820295+0000","last_clean":"2024-04-22T07:23:10.820295+0000","last_became_active":"2024-04-22T07:20:52.858215+0000","last_became_peered":"2024-04-22T07:20:52.858215+0000","last_unstale":"2024-04-22T07:23:10.820295+0000","last_undegraded":"2024-04-22T07:23:10.820295+0000","last_fullsized":"2024-04-22T07:23:10.820295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:26.618434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'94","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.924667+0000","last_change":"2024-04-22T07:20:53.867977+0000","last_active":"2024-04-22T07:24:18.924667+0000","last_peered":"2024-04-22T07:24:18.924667+0000","last_clean":"2024-04-22T07:24:18.924667+0000","last_became_active":"2024-04-22T07:20:53.867447+0000","last_became_peered":"2024-04-22T07:20:53.867447+0000","last_unstale":"2024-04-22T07:24:18.924667+0000","last_undegraded":"2024-04-22T07:24:18.924667+0000","last_fullsized":"2024-04-22T07:24:18.924667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:48:52.934171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'131","reported_seq":148,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.110899+0000","last_change":"2024-04-22T07:20:53.875681+0000","last_active":"2024-04-22T07:24:19.110899+0000","last_peered":"2024-04-22T07:24:19.110899+0000","last_clean":"2024-04-22T07:24:19.110899+0000","last_became_active":"2024-04-22T07:20:53.875305+0000","last_became_peered":"2024-04-22T07:20:53.875305+0000","last_unstale":"2024-04-22T07:24:19.110899+0000","last_undegraded":"2024-04-22T07:24:19.110899+0000","last_fullsized":"2024-04-22T07:24:19.110899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:22:34.452869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.068077+0000","last_change":"2024-04-22T07:20:52.857445+0000","last_active":"2024-04-22T07:21:35.068077+0000","last_peered":"2024-04-22T07:21:35.068077+0000","last_clean":"2024-04-22T07:21:35.068077+0000","last_became_active":"2024-04-22T07:20:52.856293+0000","last_became_peered":"2024-04-22T07:20:52.856293+0000","last_unstale":"2024-04-22T07:21:35.068077+0000","last_undegraded":"2024-04-22T07:21:35.068077+0000","last_fullsized":"2024-04-22T07:21:35.068077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:10.640191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'106","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.277781+0000","last_change":"2024-04-22T07:20:53.870827+0000","last_active":"2024-04-22T07:24:18.277781+0000","last_peered":"2024-04-22T07:24:18.277781+0000","last_clean":"2024-04-22T07:24:18.277781+0000","last_became_active":"2024-04-22T07:20:53.870548+0000","last_became_peered":"2024-04-22T07:20:53.870548+0000","last_unstale":"2024-04-22T07:24:18.277781+0000","last_undegraded":"2024-04-22T07:24:18.277781+0000","last_fullsized":"2024-04-22T07:24:18.277781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:27.624819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'4","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:23:38.961771+0000","last_change":"2024-04-22T07:20:52.856933+0000","last_active":"2024-04-22T07:23:38.961771+0000","last_peered":"2024-04-22T07:23:38.961771+0000","last_clean":"2024-04-22T07:23:38.961771+0000","last_became_active":"2024-04-22T07:20:52.856617+0000","last_became_peered":"2024-04-22T07:20:52.856617+0000","last_unstale":"2024-04-22T07:23:38.961771+0000","last_undegraded":"2024-04-22T07:23:38.961771+0000","last_fullsized":"2024-04-22T07:23:38.961771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:08.286530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'97","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.032653+0000","last_change":"2024-04-22T07:20:53.866552+0000","last_active":"2024-04-22T07:24:19.032653+0000","last_peered":"2024-04-22T07:24:19.032653+0000","last_clean":"2024-04-22T07:24:19.032653+0000","last_became_active":"2024-04-22T07:20:53.866286+0000","last_became_peered":"2024-04-22T07:20:53.866286+0000","last_unstale":"2024-04-22T07:24:19.032653+0000","last_undegraded":"2024-04-22T07:24:19.032653+0000","last_fullsized":"2024-04-22T07:24:19.032653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:45:15.519469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.211591+0000","last_change":"2024-04-22T07:20:52.863291+0000","last_active":"2024-04-22T07:21:35.211591+0000","last_peered":"2024-04-22T07:21:35.211591+0000","last_clean":"2024-04-22T07:21:35.211591+0000","last_became_active":"2024-04-22T07:20:52.862967+0000","last_became_peered":"2024-04-22T07:20:52.862967+0000","last_unstale":"2024-04-22T07:21:35.211591+0000","last_undegraded":"2024-04-22T07:21:35.211591+0000","last_fullsized":"2024-04-22T07:21:35.211591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:10.640191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'115","reported_seq":132,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.727128+0000","last_change":"2024-04-22T07:20:53.871045+0000","last_active":"2024-04-22T07:24:18.727128+0000","last_peered":"2024-04-22T07:24:18.727128+0000","last_clean":"2024-04-22T07:24:18.727128+0000","last_became_active":"2024-04-22T07:20:53.870715+0000","last_became_peered":"2024-04-22T07:20:53.870715+0000","last_unstale":"2024-04-22T07:24:18.727128+0000","last_undegraded":"2024-04-22T07:24:18.727128+0000","last_fullsized":"2024-04-22T07:24:18.727128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176160768,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'4","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.211838+0000","last_change":"2024-04-22T07:20:52.869553+0000","last_active":"2024-04-22T07:21:35.211838+0000","last_peered":"2024-04-22T07:21:35.211838+0000","last_clean":"2024-04-22T07:21:35.211838+0000","last_became_active":"2024-04-22T07:20:52.869300+0000","last_became_peered":"2024-04-22T07:20:52.869300+0000","last_unstale":"2024-04-22T07:21:35.211838+0000","last_undegraded":"2024-04-22T07:21:35.211838+0000","last_fullsized":"2024-04-22T07:21:35.211838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:27.709073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":10737418240,"num_objects":2560,"num_object_clones":0,"num_object_copies":5120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6656,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21474836480,"data_stored":21474836480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7171,"ondisk_log_size":7171,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4952374,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2449,"num_write_kb":7138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9969664,"data_stored":9904748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2435,"ondisk_log_size":2435,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509489,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1706704,"kb_used_data":1675528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92665136,"statfs":{"total":96636764160,"available":94889099264,"internally_reserved":0,"allocated":1715740672,"data_stored":1715563810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509489,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2190756,"kb_used_data":2159580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92181084,"statfs":{"total":96636764160,"available":94393430016,"internally_reserved":0,"allocated":2211409920,"data_stored":2211242343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509488,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2916340,"kb_used_data":2885164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":91455500,"statfs":{"total":96636764160,"available":93650432000,"internally_reserved":0,"allocated":2954407936,"data_stored":2954224813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509489,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3357384,"kb_used_data":3326208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":91014456,"statfs":{"total":96636764160,"available":93198802944,"internally_reserved":0,"allocated":3406036992,"data_stored":3405868578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509490,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3084620,"kb_used_data":3035396,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":91287220,"statfs":{"total":96636764160,"available":93478113280,"internally_reserved":0,"allocated":3108245504,"data_stored":3108073084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509489,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2231564,"kb_used_data":2200388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92140276,"statfs":{"total":96636764160,"available":94351642624,"internally_reserved":0,"allocated":2253197312,"data_stored":2253024834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509491,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3586764,"kb_used_data":3555588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":90785076,"statfs":{"total":96636764160,"available":92963917824,"internally_reserved":0,"allocated":3640922112,"data_stored":3640749076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2199956,"kb_used_data":2146572,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":92171884,"statfs":{"total":96636764160,"available":94384009216,"internally_reserved":0,"allocated":2198089728,"data_stored":2197909788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4210688,"data_stored":4195648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":770048,"data_stored":756692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":757760,"data_stored":756398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3640655872,"data_stored":3640655872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2252341248,"data_stored":2252341248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3103784960,"data_stored":3103784960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3405774848,"data_stored":3405774848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2193620992,"data_stored":2193620992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2952790016,"data_stored":2952790016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2210398208,"data_stored":2210398208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1715470336,"data_stored":1715470336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T07:24:37.326 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-22T07:24:37.326 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T07:24:37.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.465+0000 7f5f5989a640 1 Processor -- start 2024-04-22T07:24:37.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.465+0000 7f5f5989a640 1 -- start start 2024-04-22T07:24:37.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.466+0000 7f5f5989a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5f54155040 0x7f5f540c9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:37.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.466+0000 7f5f5989a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f54155420 0x7f5f540676b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:37.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.466+0000 7f5f5989a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f5406bac0 con 0x7f5f5406c050 2024-04-22T07:24:37.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.466+0000 7f5f5989a640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f5f5406c5b0 con 0x7f5f54155040 2024-04-22T07:24:37.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.466+0000 7f5f5989a640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5f5406d280 con 0x7f5f54155420 2024-04-22T07:24:37.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.466+0000 7f5f537fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5f5406c050 0x7f5f5415b280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41290/0 (socket says 172.21.15.40:41290) 2024-04-22T07:24:37.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.466+0000 7f5f537fe640 1 -- 172.21.15.40:0/938466666 learned_addr learned my addr 172.21.15.40:0/938466666 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:24:37.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.466+0000 7f5f52ffd640 1 --2- 172.21.15.40:0/938466666 >> v2:172.21.15.62:3300/0 conn(0x7f5f54155040 0x7f5f540c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:37.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.466+0000 7f5f4bfff640 1 --2- 172.21.15.40:0/938466666 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f54155420 0x7f5f540676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:37.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.466+0000 7f5f527fc640 1 -- 172.21.15.40:0/938466666 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4207442693 0 0) 0x7f5f5406bac0 con 0x7f5f5406c050 2024-04-22T07:24:37.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.466+0000 7f5f527fc640 1 -- 172.21.15.40:0/938466666 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f40003520 con 0x7f5f5406c050 2024-04-22T07:24:37.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.466+0000 7f5f527fc640 1 -- 172.21.15.40:0/938466666 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 63355446 0 0) 0x7f5f40003520 con 0x7f5f5406c050 2024-04-22T07:24:37.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.466+0000 7f5f527fc640 1 -- 172.21.15.40:0/938466666 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f54155420 msgr2=0x7f5f540676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:37.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.466+0000 7f5f527fc640 1 --2- 172.21.15.40:0/938466666 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f54155420 0x7f5f540676b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.466+0000 7f5f527fc640 1 -- 172.21.15.40:0/938466666 >> v2:172.21.15.62:3300/0 conn(0x7f5f54155040 msgr2=0x7f5f540c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:37.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.466+0000 7f5f527fc640 1 --2- 172.21.15.40:0/938466666 >> v2:172.21.15.62:3300/0 conn(0x7f5f54155040 0x7f5f540c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.466+0000 7f5f527fc640 1 -- 172.21.15.40:0/938466666 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f5406bd60 con 0x7f5f5406c050 2024-04-22T07:24:37.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.466+0000 7f5f527fc640 1 -- 172.21.15.40:0/938466666 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7f5f4c0019f0 con 0x7f5f5406c050 2024-04-22T07:24:37.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.466+0000 7f5f527fc640 1 -- 172.21.15.40:0/938466666 >> v1:172.21.15.40:6789/0 conn(0x7f5f5406c050 legacy=0x7f5f5415b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:37.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.466+0000 7f5f527fc640 1 --2- 172.21.15.40:0/938466666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f400039b0 0x7f5f40003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:37.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.466+0000 7f5f527fc640 1 --2- 172.21.15.40:0/938466666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f40004800 0x7f5f40004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:37.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.466+0000 7f5f527fc640 1 --2- 172.21.15.40:0/938466666 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f54155420 0x7f5f400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:37.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.466+0000 7f5f527fc640 1 -- 172.21.15.40:0/938466666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5406c5b0 con 0x7f5f400039b0 2024-04-22T07:24:37.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.466+0000 7f5f527fc640 1 -- 172.21.15.40:0/938466666 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5406d280 con 0x7f5f40004800 2024-04-22T07:24:37.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.467+0000 7f5f527fc640 1 -- 172.21.15.40:0/938466666 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5f4000b9c0 con 0x7f5f54155420 2024-04-22T07:24:37.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.467+0000 7f5f52ffd640 1 --2- 172.21.15.40:0/938466666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f400039b0 0x7f5f40003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:37.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.467+0000 7f5f4bfff640 1 --2- 172.21.15.40:0/938466666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f40004800 0x7f5f40004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:37.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.467+0000 7f5f537fe640 1 --2- 172.21.15.40:0/938466666 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f54155420 0x7f5f400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:37.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.467+0000 7f5f52ffd640 1 -- 172.21.15.40:0/938466666 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f54155420 msgr2=0x7f5f400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:37.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.467+0000 7f5f52ffd640 1 --2- 172.21.15.40:0/938466666 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f54155420 0x7f5f400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.467+0000 7f5f52ffd640 1 -- 172.21.15.40:0/938466666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f40004800 msgr2=0x7f5f40004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:37.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.467+0000 7f5f52ffd640 1 --2- 172.21.15.40:0/938466666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f40004800 0x7f5f40004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.467+0000 7f5f52ffd640 1 -- 172.21.15.40:0/938466666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f40003520 con 0x7f5f400039b0 2024-04-22T07:24:37.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.467+0000 7f5f4bfff640 1 --2- 172.21.15.40:0/938466666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f40004800 0x7f5f40004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:24:37.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.468+0000 7f5f52ffd640 1 --2- 172.21.15.40:0/938466666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f400039b0 0x7f5f40003dd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009ac0 tx=0x7f5f40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb362980d500f11 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:37.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.468+0000 7f5f527fc640 1 -- 172.21.15.40:0/938466666 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f44039070 con 0x7f5f400039b0 2024-04-22T07:24:37.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.468+0000 7f5f527fc640 1 -- 172.21.15.40:0/938466666 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f4402c710 con 0x7f5f400039b0 2024-04-22T07:24:37.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.468+0000 7f5f527fc640 1 -- 172.21.15.40:0/938466666 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f44009690 con 0x7f5f400039b0 2024-04-22T07:24:37.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.468+0000 7f5f5989a640 1 -- 172.21.15.40:0/938466666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f400039b0 msgr2=0x7f5f40003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:37.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.468+0000 7f5f5989a640 1 --2- 172.21.15.40:0/938466666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f400039b0 0x7f5f40003dd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009ac0 tx=0x7f5f40005830 comp rx=0 tx=0).stop 2024-04-22T07:24:37.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.468+0000 7f5f537fe640 1 -- 172.21.15.40:0/938466666 reap_dead start 2024-04-22T07:24:37.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.468+0000 7f5f5989a640 1 -- 172.21.15.40:0/938466666 shutdown_connections 2024-04-22T07:24:37.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.468+0000 7f5f5989a640 1 -- 172.21.15.40:0/938466666 >> 172.21.15.40:0/938466666 conn(0x7f5f540cdb70 msgr2=0x7f5f540c9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:37.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.468+0000 7f5f5989a640 1 -- 172.21.15.40:0/938466666 shutdown_connections 2024-04-22T07:24:37.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.468+0000 7f5f5989a640 1 -- 172.21.15.40:0/938466666 wait complete. 2024-04-22T07:24:37.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.469+0000 7f5f5989a640 1 Processor -- start 2024-04-22T07:24:37.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.470+0000 7f5f5989a640 1 -- start start 2024-04-22T07:24:37.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.470+0000 7f5f5989a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f400039b0 0x7f5f541f4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:37.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.470+0000 7f5f5989a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f54149a90 0x7f5f54149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:37.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.470+0000 7f5f5989a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f54153ba0 0x7f5f54154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:37.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.470+0000 7f5f5989a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5415b990 con 0x7f5f54149a90 2024-04-22T07:24:37.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.470+0000 7f5f5989a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5406cf10 con 0x7f5f54153ba0 2024-04-22T07:24:37.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.470+0000 7f5f5989a640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5f5415bb10 con 0x7f5f400039b0 2024-04-22T07:24:37.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.470+0000 7f5f4bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f54149a90 0x7f5f54149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:37.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.470+0000 7f5f4bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f54149a90 0x7f5f54149ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53522/0 (socket says 172.21.15.40:53522) 2024-04-22T07:24:37.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.470+0000 7f5f4bfff640 1 -- 172.21.15.40:0/3815269518 learned_addr learned my addr 172.21.15.40:0/3815269518 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:37.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.470+0000 7f5f537fe640 1 --2- 172.21.15.40:0/3815269518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f54153ba0 0x7f5f54154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:37.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.470+0000 7f5f52ffd640 1 --2- 172.21.15.40:0/3815269518 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f400039b0 0x7f5f541f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:37.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.471+0000 7f5f4bfff640 1 -- 172.21.15.40:0/3815269518 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f400039b0 msgr2=0x7f5f541f4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:37.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.471+0000 7f5f4bfff640 1 --2- 172.21.15.40:0/3815269518 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f400039b0 0x7f5f541f4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.471+0000 7f5f4bfff640 1 -- 172.21.15.40:0/3815269518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f54153ba0 msgr2=0x7f5f54154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:37.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.471+0000 7f5f4bfff640 1 --2- 172.21.15.40:0/3815269518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f54153ba0 0x7f5f54154020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.471+0000 7f5f4bfff640 1 -- 172.21.15.40:0/3815269518 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f54159c60 con 0x7f5f54149a90 2024-04-22T07:24:37.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.471+0000 7f5f4bfff640 1 --2- 172.21.15.40:0/3815269518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f54149a90 0x7f5f54149ed0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0116d0 tx=0x7f5f3c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:37.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.471+0000 7f5f50ff9640 1 -- 172.21.15.40:0/3815269518 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c015870 con 0x7f5f54149a90 2024-04-22T07:24:37.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.471+0000 7f5f50ff9640 1 -- 172.21.15.40:0/3815269518 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f3c015a10 con 0x7f5f54149a90 2024-04-22T07:24:37.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.471+0000 7f5f5989a640 1 -- 172.21.15.40:0/3815269518 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f54159f20 con 0x7f5f54149a90 2024-04-22T07:24:37.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.471+0000 7f5f50ff9640 1 -- 172.21.15.40:0/3815269518 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c015e00 con 0x7f5f54149a90 2024-04-22T07:24:37.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.471+0000 7f5f5989a640 1 -- 172.21.15.40:0/3815269518 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f5415a4e0 con 0x7f5f54149a90 2024-04-22T07:24:37.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.472+0000 7f5f5989a640 1 -- 172.21.15.40:0/3815269518 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f541531e0 con 0x7f5f54149a90 2024-04-22T07:24:37.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.472+0000 7f5f50ff9640 1 -- 172.21.15.40:0/3815269518 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5f3c00f460 con 0x7f5f54149a90 2024-04-22T07:24:37.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.473+0000 7f5f50ff9640 1 --2- 172.21.15.40:0/3815269518 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5f3406c8f0 0x7f5f3406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:37.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.473+0000 7f5f50ff9640 1 -- 172.21.15.40:0/3815269518 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f5f3c08c3a0 con 0x7f5f54149a90 2024-04-22T07:24:37.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.473+0000 7f5f52ffd640 1 --2- 172.21.15.40:0/3815269518 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5f3406c8f0 0x7f5f3406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:37.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.473+0000 7f5f52ffd640 1 --2- 172.21.15.40:0/3815269518 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5f3406c8f0 0x7f5f3406edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5f44036000 tx=0x7f5f44030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:37.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.477+0000 7f5f50ff9640 1 -- 172.21.15.40:0/3815269518 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5f541531e0 con 0x7f5f54149a90 2024-04-22T07:24:37.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.658+0000 7f5f5989a640 1 -- 172.21.15.40:0/3815269518 --> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5f54069d40 con 0x7f5f3406c8f0 2024-04-22T07:24:37.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.664+0000 7f5f50ff9640 1 -- 172.21.15.40:0/3815269518 <== mgr.4107 v2:172.21.15.40:6832/91163869 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253888 (secure 0 0 0) 0x7f5f54069d40 con 0x7f5f3406c8f0 2024-04-22T07:24:37.664 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:24:37.665 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-22T07:24:37.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.666+0000 7f5f5989a640 1 -- 172.21.15.40:0/3815269518 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5f3406c8f0 msgr2=0x7f5f3406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:37.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.666+0000 7f5f5989a640 1 --2- 172.21.15.40:0/3815269518 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5f3406c8f0 0x7f5f3406edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5f44036000 tx=0x7f5f44030000 comp rx=0 tx=0).stop 2024-04-22T07:24:37.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.666+0000 7f5f5989a640 1 -- 172.21.15.40:0/3815269518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f54149a90 msgr2=0x7f5f54149ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:37.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.666+0000 7f5f5989a640 1 --2- 172.21.15.40:0/3815269518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f54149a90 0x7f5f54149ed0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0116d0 tx=0x7f5f3c011ad0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.667+0000 7f5f5989a640 1 -- 172.21.15.40:0/3815269518 shutdown_connections 2024-04-22T07:24:37.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.667+0000 7f5f5989a640 1 --2- 172.21.15.40:0/3815269518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f54153ba0 0x7f5f54154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.667+0000 7f5f5989a640 1 --2- 172.21.15.40:0/3815269518 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f5f3406c8f0 0x7f5f3406edb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.667+0000 7f5f5989a640 1 --2- 172.21.15.40:0/3815269518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f54149a90 0x7f5f54149ed0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.667+0000 7f5f5989a640 1 --2- 172.21.15.40:0/3815269518 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5f400039b0 0x7f5f541f4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.667+0000 7f5f5989a640 1 -- 172.21.15.40:0/3815269518 >> 172.21.15.40:0/3815269518 conn(0x7f5f540cdb70 msgr2=0x7f5f540c7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:37.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.667+0000 7f5f5989a640 1 -- 172.21.15.40:0/3815269518 shutdown_connections 2024-04-22T07:24:37.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.667+0000 7f5f5989a640 1 -- 172.21.15.40:0/3815269518 wait complete. 2024-04-22T07:24:37.676 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-04-22T07:24:35.829104+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":10742960982,"num_objects":2586,"num_object_clones":0,"num_object_copies":5172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2586,"num_whiteouts":0,"num_read":118,"num_read_kb":102,"num_write":9264,"num_write_kb":25175378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9723,"ondisk_log_size":9723,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":21274088,"kb_used_data":20984424,"kb_used_omap":12,"kb_used_meta":289587,"kb_avail":733700632,"statfs":{"total":773094113280,"available":751309447168,"internally_reserved":0,"allocated":21488050176,"data_stored":21486656326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":296537652},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5411,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":356361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002810"},"pg_stats":[{"pgid":"3.3f","version":"25'104","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.800931+0000","last_change":"2024-04-22T07:20:53.873662+0000","last_active":"2024-04-22T07:24:18.800931+0000","last_peered":"2024-04-22T07:24:18.800931+0000","last_clean":"2024-04-22T07:24:18.800931+0000","last_became_active":"2024-04-22T07:20:53.873384+0000","last_became_peered":"2024-04-22T07:20:53.873384+0000","last_unstale":"2024-04-22T07:24:18.800931+0000","last_undegraded":"2024-04-22T07:24:18.800931+0000","last_fullsized":"2024-04-22T07:24:18.800931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'94","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.326910+0000","last_change":"2024-04-22T07:20:53.870454+0000","last_active":"2024-04-22T07:24:18.326910+0000","last_peered":"2024-04-22T07:24:18.326910+0000","last_clean":"2024-04-22T07:24:18.326910+0000","last_became_active":"2024-04-22T07:20:53.869964+0000","last_became_peered":"2024-04-22T07:20:53.869964+0000","last_unstale":"2024-04-22T07:24:18.326910+0000","last_undegraded":"2024-04-22T07:24:18.326910+0000","last_fullsized":"2024-04-22T07:24:18.326910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'109","reported_seq":126,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.110352+0000","last_change":"2024-04-22T07:20:53.871145+0000","last_active":"2024-04-22T07:24:18.110352+0000","last_peered":"2024-04-22T07:24:18.110352+0000","last_clean":"2024-04-22T07:24:18.110352+0000","last_became_active":"2024-04-22T07:20:53.870819+0000","last_became_peered":"2024-04-22T07:20:53.870819+0000","last_unstale":"2024-04-22T07:24:18.110352+0000","last_undegraded":"2024-04-22T07:24:18.110352+0000","last_fullsized":"2024-04-22T07:24:18.110352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:02:16.373202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'125","reported_seq":142,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.262371+0000","last_change":"2024-04-22T07:20:53.870458+0000","last_active":"2024-04-22T07:24:18.262371+0000","last_peered":"2024-04-22T07:24:18.262371+0000","last_clean":"2024-04-22T07:24:18.262371+0000","last_became_active":"2024-04-22T07:20:53.870125+0000","last_became_peered":"2024-04-22T07:20:53.870125+0000","last_unstale":"2024-04-22T07:24:18.262371+0000","last_undegraded":"2024-04-22T07:24:18.262371+0000","last_fullsized":"2024-04-22T07:24:18.262371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209715200,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'112","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.619359+0000","last_change":"2024-04-22T07:20:53.877301+0000","last_active":"2024-04-22T07:24:19.619359+0000","last_peered":"2024-04-22T07:24:19.619359+0000","last_clean":"2024-04-22T07:24:19.619359+0000","last_became_active":"2024-04-22T07:20:53.874941+0000","last_became_peered":"2024-04-22T07:20:53.874941+0000","last_unstale":"2024-04-22T07:24:19.619359+0000","last_undegraded":"2024-04-22T07:24:19.619359+0000","last_fullsized":"2024-04-22T07:24:19.619359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:52.686229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"25'102","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.010027+0000","last_change":"2024-04-22T07:20:53.869735+0000","last_active":"2024-04-22T07:24:18.010027+0000","last_peered":"2024-04-22T07:24:18.010027+0000","last_clean":"2024-04-22T07:24:18.010027+0000","last_became_active":"2024-04-22T07:20:53.869369+0000","last_became_peered":"2024-04-22T07:20:53.869369+0000","last_unstale":"2024-04-22T07:24:18.010027+0000","last_undegraded":"2024-04-22T07:24:18.010027+0000","last_fullsized":"2024-04-22T07:24:18.010027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:27.624819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'125","reported_seq":142,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.772161+0000","last_change":"2024-04-22T07:20:53.873492+0000","last_active":"2024-04-22T07:24:17.772161+0000","last_peered":"2024-04-22T07:24:17.772161+0000","last_clean":"2024-04-22T07:24:17.772161+0000","last_became_active":"2024-04-22T07:20:53.873220+0000","last_became_peered":"2024-04-22T07:20:53.873220+0000","last_unstale":"2024-04-22T07:24:17.772161+0000","last_undegraded":"2024-04-22T07:24:17.772161+0000","last_fullsized":"2024-04-22T07:24:17.772161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:35:26.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'131","reported_seq":148,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.580589+0000","last_change":"2024-04-22T07:20:53.875847+0000","last_active":"2024-04-22T07:24:19.580589+0000","last_peered":"2024-04-22T07:24:19.580589+0000","last_clean":"2024-04-22T07:24:19.580589+0000","last_became_active":"2024-04-22T07:20:53.875017+0000","last_became_peered":"2024-04-22T07:20:53.875017+0000","last_unstale":"2024-04-22T07:24:19.580589+0000","last_undegraded":"2024-04-22T07:24:19.580589+0000","last_fullsized":"2024-04-22T07:24:19.580589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:07.080135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213909504,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'114","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.682363+0000","last_change":"2024-04-22T07:20:53.869174+0000","last_active":"2024-04-22T07:24:18.682363+0000","last_peered":"2024-04-22T07:24:18.682363+0000","last_clean":"2024-04-22T07:24:18.682363+0000","last_became_active":"2024-04-22T07:20:53.868906+0000","last_became_peered":"2024-04-22T07:20:53.868906+0000","last_unstale":"2024-04-22T07:24:18.682363+0000","last_undegraded":"2024-04-22T07:24:18.682363+0000","last_fullsized":"2024-04-22T07:24:18.682363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'117","reported_seq":134,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.460504+0000","last_change":"2024-04-22T07:20:53.874933+0000","last_active":"2024-04-22T07:24:18.460504+0000","last_peered":"2024-04-22T07:24:18.460504+0000","last_clean":"2024-04-22T07:24:18.460504+0000","last_became_active":"2024-04-22T07:20:53.874673+0000","last_became_peered":"2024-04-22T07:20:53.874673+0000","last_unstale":"2024-04-22T07:24:18.460504+0000","last_undegraded":"2024-04-22T07:24:18.460504+0000","last_fullsized":"2024-04-22T07:24:18.460504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'135","reported_seq":152,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.470880+0000","last_change":"2024-04-22T07:20:53.874909+0000","last_active":"2024-04-22T07:24:19.470880+0000","last_peered":"2024-04-22T07:24:19.470880+0000","last_clean":"2024-04-22T07:24:19.470880+0000","last_became_active":"2024-04-22T07:20:53.873945+0000","last_became_peered":"2024-04-22T07:20:53.873945+0000","last_unstale":"2024-04-22T07:24:19.470880+0000","last_undegraded":"2024-04-22T07:24:19.470880+0000","last_fullsized":"2024-04-22T07:24:19.470880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:53.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226492416,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'107","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.266832+0000","last_change":"2024-04-22T07:21:34.992848+0000","last_active":"2024-04-22T07:24:17.266832+0000","last_peered":"2024-04-22T07:24:17.266832+0000","last_clean":"2024-04-22T07:24:17.266832+0000","last_became_active":"2024-04-22T07:21:34.992633+0000","last_became_peered":"2024-04-22T07:21:34.992633+0000","last_unstale":"2024-04-22T07:24:17.266832+0000","last_undegraded":"2024-04-22T07:24:17.266832+0000","last_fullsized":"2024-04-22T07:24:17.266832+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:07.080135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"25'112","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.514886+0000","last_change":"2024-04-22T07:20:53.879419+0000","last_active":"2024-04-22T07:24:18.514886+0000","last_peered":"2024-04-22T07:24:18.514886+0000","last_clean":"2024-04-22T07:24:18.514886+0000","last_became_active":"2024-04-22T07:20:53.879070+0000","last_became_peered":"2024-04-22T07:20:53.879070+0000","last_unstale":"2024-04-22T07:24:18.514886+0000","last_undegraded":"2024-04-22T07:24:18.514886+0000","last_fullsized":"2024-04-22T07:24:18.514886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'107","reported_seq":124,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.923162+0000","last_change":"2024-04-22T07:20:53.877395+0000","last_active":"2024-04-22T07:24:17.923162+0000","last_peered":"2024-04-22T07:24:17.923162+0000","last_clean":"2024-04-22T07:24:17.923162+0000","last_became_active":"2024-04-22T07:20:53.877116+0000","last_became_peered":"2024-04-22T07:20:53.877116+0000","last_unstale":"2024-04-22T07:24:17.923162+0000","last_undegraded":"2024-04-22T07:24:17.923162+0000","last_fullsized":"2024-04-22T07:24:17.923162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:21:25.001413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'110","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.786094+0000","last_change":"2024-04-22T07:20:53.875156+0000","last_active":"2024-04-22T07:24:18.786094+0000","last_peered":"2024-04-22T07:24:18.786094+0000","last_clean":"2024-04-22T07:24:18.786094+0000","last_became_active":"2024-04-22T07:20:53.874468+0000","last_became_peered":"2024-04-22T07:20:53.874468+0000","last_unstale":"2024-04-22T07:24:18.786094+0000","last_undegraded":"2024-04-22T07:24:18.786094+0000","last_fullsized":"2024-04-22T07:24:18.786094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:42:03.637655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'107","reported_seq":124,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.009935+0000","last_change":"2024-04-22T07:20:53.867178+0000","last_active":"2024-04-22T07:24:18.009935+0000","last_peered":"2024-04-22T07:24:18.009935+0000","last_clean":"2024-04-22T07:24:18.009935+0000","last_became_active":"2024-04-22T07:20:53.865491+0000","last_became_peered":"2024-04-22T07:20:53.865491+0000","last_unstale":"2024-04-22T07:24:18.009935+0000","last_undegraded":"2024-04-22T07:24:18.009935+0000","last_fullsized":"2024-04-22T07:24:18.009935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":102,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'104","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.603187+0000","last_change":"2024-04-22T07:20:53.876797+0000","last_active":"2024-04-22T07:24:19.603187+0000","last_peered":"2024-04-22T07:24:19.603187+0000","last_clean":"2024-04-22T07:24:19.603187+0000","last_became_active":"2024-04-22T07:20:53.876321+0000","last_became_peered":"2024-04-22T07:20:53.876321+0000","last_unstale":"2024-04-22T07:24:19.603187+0000","last_undegraded":"2024-04-22T07:24:19.603187+0000","last_fullsized":"2024-04-22T07:24:19.603187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:22:45.699676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176160768,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'109","reported_seq":126,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.292536+0000","last_change":"2024-04-22T07:20:53.868760+0000","last_active":"2024-04-22T07:24:18.292536+0000","last_peered":"2024-04-22T07:24:18.292536+0000","last_clean":"2024-04-22T07:24:18.292536+0000","last_became_active":"2024-04-22T07:20:53.868441+0000","last_became_peered":"2024-04-22T07:20:53.868441+0000","last_unstale":"2024-04-22T07:24:18.292536+0000","last_undegraded":"2024-04-22T07:24:18.292536+0000","last_fullsized":"2024-04-22T07:24:18.292536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'124","reported_seq":141,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.956473+0000","last_change":"2024-04-22T07:20:53.864806+0000","last_active":"2024-04-22T07:24:18.956473+0000","last_peered":"2024-04-22T07:24:18.956473+0000","last_clean":"2024-04-22T07:24:18.956473+0000","last_became_active":"2024-04-22T07:20:53.864535+0000","last_became_peered":"2024-04-22T07:20:53.864535+0000","last_unstale":"2024-04-22T07:24:18.956473+0000","last_undegraded":"2024-04-22T07:24:18.956473+0000","last_fullsized":"2024-04-22T07:24:18.956473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:22:07.227993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205520896,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'114","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.611712+0000","last_change":"2024-04-22T07:20:53.878013+0000","last_active":"2024-04-22T07:24:19.611712+0000","last_peered":"2024-04-22T07:24:19.611712+0000","last_clean":"2024-04-22T07:24:19.611712+0000","last_became_active":"2024-04-22T07:20:53.876641+0000","last_became_peered":"2024-04-22T07:20:53.876641+0000","last_unstale":"2024-04-22T07:24:19.611712+0000","last_undegraded":"2024-04-22T07:24:19.611712+0000","last_fullsized":"2024-04-22T07:24:19.611712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:45:15.519469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'95","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.008489+0000","last_change":"2024-04-22T07:20:53.868319+0000","last_active":"2024-04-22T07:24:18.008489+0000","last_peered":"2024-04-22T07:24:18.008489+0000","last_clean":"2024-04-22T07:24:18.008489+0000","last_became_active":"2024-04-22T07:20:53.868014+0000","last_became_peered":"2024-04-22T07:20:53.868014+0000","last_unstale":"2024-04-22T07:24:18.008489+0000","last_undegraded":"2024-04-22T07:24:18.008489+0000","last_fullsized":"2024-04-22T07:24:18.008489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:09:27.178992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'127","reported_seq":144,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.581492+0000","last_change":"2024-04-22T07:20:53.867684+0000","last_active":"2024-04-22T07:24:17.581492+0000","last_peered":"2024-04-22T07:24:17.581492+0000","last_clean":"2024-04-22T07:24:17.581492+0000","last_became_active":"2024-04-22T07:20:53.867403+0000","last_became_peered":"2024-04-22T07:20:53.867403+0000","last_unstale":"2024-04-22T07:24:17.581492+0000","last_undegraded":"2024-04-22T07:24:17.581492+0000","last_fullsized":"2024-04-22T07:24:17.581492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180355072,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'93","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.418999+0000","last_change":"2024-04-22T07:20:53.869595+0000","last_active":"2024-04-22T07:24:18.418999+0000","last_peered":"2024-04-22T07:24:18.418999+0000","last_clean":"2024-04-22T07:24:18.418999+0000","last_became_active":"2024-04-22T07:20:53.868519+0000","last_became_peered":"2024-04-22T07:20:53.868519+0000","last_unstale":"2024-04-22T07:24:18.418999+0000","last_undegraded":"2024-04-22T07:24:18.418999+0000","last_fullsized":"2024-04-22T07:24:18.418999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:35:26.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'132","reported_seq":149,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.238781+0000","last_change":"2024-04-22T07:20:53.865275+0000","last_active":"2024-04-22T07:24:18.238781+0000","last_peered":"2024-04-22T07:24:18.238781+0000","last_clean":"2024-04-22T07:24:18.238781+0000","last_became_active":"2024-04-22T07:20:53.865026+0000","last_became_peered":"2024-04-22T07:20:53.865026+0000","last_unstale":"2024-04-22T07:24:18.238781+0000","last_undegraded":"2024-04-22T07:24:18.238781+0000","last_fullsized":"2024-04-22T07:24:18.238781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:48:40.630407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205520896,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'104","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.032178+0000","last_change":"2024-04-22T07:20:53.873457+0000","last_active":"2024-04-22T07:24:19.032178+0000","last_peered":"2024-04-22T07:24:19.032178+0000","last_clean":"2024-04-22T07:24:19.032178+0000","last_became_active":"2024-04-22T07:20:53.873147+0000","last_became_peered":"2024-04-22T07:20:53.873147+0000","last_unstale":"2024-04-22T07:24:19.032178+0000","last_undegraded":"2024-04-22T07:24:19.032178+0000","last_fullsized":"2024-04-22T07:24:19.032178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:53.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'142","reported_seq":159,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.451823+0000","last_change":"2024-04-22T07:20:53.865327+0000","last_active":"2024-04-22T07:24:19.451823+0000","last_peered":"2024-04-22T07:24:19.451823+0000","last_clean":"2024-04-22T07:24:19.451823+0000","last_became_active":"2024-04-22T07:20:53.865030+0000","last_became_peered":"2024-04-22T07:20:53.865030+0000","last_unstale":"2024-04-22T07:24:19.451823+0000","last_undegraded":"2024-04-22T07:24:19.451823+0000","last_fullsized":"2024-04-22T07:24:19.451823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201326592,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'105","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.922661+0000","last_change":"2024-04-22T07:20:53.876792+0000","last_active":"2024-04-22T07:24:17.922661+0000","last_peered":"2024-04-22T07:24:17.922661+0000","last_clean":"2024-04-22T07:24:17.922661+0000","last_became_active":"2024-04-22T07:20:53.876446+0000","last_became_peered":"2024-04-22T07:20:53.876446+0000","last_unstale":"2024-04-22T07:24:17.922661+0000","last_undegraded":"2024-04-22T07:24:17.922661+0000","last_fullsized":"2024-04-22T07:24:17.922661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:34.943561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'100","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.522155+0000","last_change":"2024-04-22T07:20:53.878147+0000","last_active":"2024-04-22T07:24:18.522155+0000","last_peered":"2024-04-22T07:24:18.522155+0000","last_clean":"2024-04-22T07:24:18.522155+0000","last_became_active":"2024-04-22T07:20:53.877867+0000","last_became_peered":"2024-04-22T07:20:53.877867+0000","last_unstale":"2024-04-22T07:24:18.522155+0000","last_undegraded":"2024-04-22T07:24:18.522155+0000","last_fullsized":"2024-04-22T07:24:18.522155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'88","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.152344+0000","last_change":"2024-04-22T07:20:53.872447+0000","last_active":"2024-04-22T07:24:18.152344+0000","last_peered":"2024-04-22T07:24:18.152344+0000","last_clean":"2024-04-22T07:24:18.152344+0000","last_became_active":"2024-04-22T07:20:53.871862+0000","last_became_peered":"2024-04-22T07:20:53.871862+0000","last_unstale":"2024-04-22T07:24:18.152344+0000","last_undegraded":"2024-04-22T07:24:18.152344+0000","last_fullsized":"2024-04-22T07:24:18.152344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:08:33.063318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'98","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.563563+0000","last_change":"2024-04-22T07:20:53.862483+0000","last_active":"2024-04-22T07:24:18.563563+0000","last_peered":"2024-04-22T07:24:18.563563+0000","last_clean":"2024-04-22T07:24:18.563563+0000","last_became_active":"2024-04-22T07:20:53.862199+0000","last_became_peered":"2024-04-22T07:20:53.862199+0000","last_unstale":"2024-04-22T07:24:18.563563+0000","last_undegraded":"2024-04-22T07:24:18.563563+0000","last_fullsized":"2024-04-22T07:24:18.563563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:10:12.276510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'102","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.074312+0000","last_change":"2024-04-22T07:20:53.872507+0000","last_active":"2024-04-22T07:24:17.074312+0000","last_peered":"2024-04-22T07:24:17.074312+0000","last_clean":"2024-04-22T07:24:17.074312+0000","last_became_active":"2024-04-22T07:20:53.872199+0000","last_became_peered":"2024-04-22T07:20:53.872199+0000","last_unstale":"2024-04-22T07:24:17.074312+0000","last_undegraded":"2024-04-22T07:24:17.074312+0000","last_fullsized":"2024-04-22T07:24:17.074312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:09.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'112","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.328824+0000","last_change":"2024-04-22T07:20:53.863946+0000","last_active":"2024-04-22T07:24:17.328824+0000","last_peered":"2024-04-22T07:24:17.328824+0000","last_clean":"2024-04-22T07:24:17.328824+0000","last_became_active":"2024-04-22T07:20:53.863688+0000","last_became_peered":"2024-04-22T07:20:53.863688+0000","last_unstale":"2024-04-22T07:24:17.328824+0000","last_undegraded":"2024-04-22T07:24:17.328824+0000","last_fullsized":"2024-04-22T07:24:17.328824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'98","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.752899+0000","last_change":"2024-04-22T07:20:53.874785+0000","last_active":"2024-04-22T07:24:17.752899+0000","last_peered":"2024-04-22T07:24:17.752899+0000","last_clean":"2024-04-22T07:24:17.752899+0000","last_became_active":"2024-04-22T07:20:53.874524+0000","last_became_peered":"2024-04-22T07:20:53.874524+0000","last_unstale":"2024-04-22T07:24:17.752899+0000","last_undegraded":"2024-04-22T07:24:17.752899+0000","last_fullsized":"2024-04-22T07:24:17.752899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'362","reported_seq":381,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.625239+0000","last_change":"2024-04-22T07:20:52.860712+0000","last_active":"2024-04-22T07:24:19.625239+0000","last_peered":"2024-04-22T07:24:19.625239+0000","last_clean":"2024-04-22T07:24:19.625239+0000","last_became_active":"2024-04-22T07:20:52.860015+0000","last_became_peered":"2024-04-22T07:20:52.860015+0000","last_unstale":"2024-04-22T07:24:19.625239+0000","last_undegraded":"2024-04-22T07:24:19.625239+0000","last_fullsized":"2024-04-22T07:24:19.625239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:59:32.487127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":756398,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":361,"num_write_kb":1085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'105","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.798779+0000","last_change":"2024-04-22T07:20:53.879570+0000","last_active":"2024-04-22T07:24:18.798779+0000","last_peered":"2024-04-22T07:24:18.798779+0000","last_clean":"2024-04-22T07:24:18.798779+0000","last_became_active":"2024-04-22T07:20:53.879191+0000","last_became_peered":"2024-04-22T07:20:53.879191+0000","last_unstale":"2024-04-22T07:24:18.798779+0000","last_undegraded":"2024-04-22T07:24:18.798779+0000","last_fullsized":"2024-04-22T07:24:18.798779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:34:52.306691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":94,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.990925+0000","last_change":"2024-04-22T07:20:52.862510+0000","last_active":"2024-04-22T07:21:34.990925+0000","last_peered":"2024-04-22T07:21:34.990925+0000","last_clean":"2024-04-22T07:21:34.990925+0000","last_became_active":"2024-04-22T07:20:52.862228+0000","last_became_peered":"2024-04-22T07:20:52.862228+0000","last_unstale":"2024-04-22T07:21:34.990925+0000","last_undegraded":"2024-04-22T07:21:34.990925+0000","last_fullsized":"2024-04-22T07:21:34.990925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:51.683021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.210531+0000","last_change":"2024-04-22T07:20:52.856651+0000","last_active":"2024-04-22T07:21:35.210531+0000","last_peered":"2024-04-22T07:21:35.210531+0000","last_clean":"2024-04-22T07:21:35.210531+0000","last_became_active":"2024-04-22T07:20:52.856096+0000","last_became_peered":"2024-04-22T07:20:52.856096+0000","last_unstale":"2024-04-22T07:21:35.210531+0000","last_undegraded":"2024-04-22T07:21:35.210531+0000","last_fullsized":"2024-04-22T07:21:35.210531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:04.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'122","reported_seq":139,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.614207+0000","last_change":"2024-04-22T07:20:53.873708+0000","last_active":"2024-04-22T07:24:18.614207+0000","last_peered":"2024-04-22T07:24:18.614207+0000","last_clean":"2024-04-22T07:24:18.614207+0000","last_became_active":"2024-04-22T07:20:53.872793+0000","last_became_peered":"2024-04-22T07:20:53.872793+0000","last_unstale":"2024-04-22T07:24:18.614207+0000","last_undegraded":"2024-04-22T07:24:18.614207+0000","last_fullsized":"2024-04-22T07:24:18.614207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:52.686229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197132288,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":115,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.990502+0000","last_change":"2024-04-22T07:20:52.861133+0000","last_active":"2024-04-22T07:21:34.990502+0000","last_peered":"2024-04-22T07:21:34.990502+0000","last_clean":"2024-04-22T07:21:34.990502+0000","last_became_active":"2024-04-22T07:20:52.860736+0000","last_became_peered":"2024-04-22T07:20:52.860736+0000","last_unstale":"2024-04-22T07:21:34.990502+0000","last_undegraded":"2024-04-22T07:21:34.990502+0000","last_fullsized":"2024-04-22T07:21:34.990502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:06.123308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'114","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.987671+0000","last_change":"2024-04-22T07:20:53.867477+0000","last_active":"2024-04-22T07:24:17.987671+0000","last_peered":"2024-04-22T07:24:17.987671+0000","last_clean":"2024-04-22T07:24:17.987671+0000","last_became_active":"2024-04-22T07:20:53.867086+0000","last_became_peered":"2024-04-22T07:20:53.867086+0000","last_unstale":"2024-04-22T07:24:17.987671+0000","last_undegraded":"2024-04-22T07:24:17.987671+0000","last_fullsized":"2024-04-22T07:24:17.987671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:56:55.644168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180355072,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:23:20.804973+0000","last_change":"2024-04-22T07:20:52.863567+0000","last_active":"2024-04-22T07:23:20.804973+0000","last_peered":"2024-04-22T07:23:20.804973+0000","last_clean":"2024-04-22T07:23:20.804973+0000","last_became_active":"2024-04-22T07:20:52.863285+0000","last_became_peered":"2024-04-22T07:20:52.863285+0000","last_unstale":"2024-04-22T07:23:20.804973+0000","last_undegraded":"2024-04-22T07:23:20.804973+0000","last_fullsized":"2024-04-22T07:23:20.804973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'167","reported_seq":184,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.454086+0000","last_change":"2024-04-22T07:20:53.864955+0000","last_active":"2024-04-22T07:24:19.454086+0000","last_peered":"2024-04-22T07:24:19.454086+0000","last_clean":"2024-04-22T07:24:19.454086+0000","last_became_active":"2024-04-22T07:20:53.864694+0000","last_became_peered":"2024-04-22T07:20:53.864694+0000","last_unstale":"2024-04-22T07:24:19.454086+0000","last_undegraded":"2024-04-22T07:24:19.454086+0000","last_fullsized":"2024-04-22T07:24:19.454086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.067980+0000","last_change":"2024-04-22T07:20:52.858761+0000","last_active":"2024-04-22T07:21:35.067980+0000","last_peered":"2024-04-22T07:21:35.067980+0000","last_clean":"2024-04-22T07:21:35.067980+0000","last_became_active":"2024-04-22T07:20:52.856815+0000","last_became_peered":"2024-04-22T07:20:52.856815+0000","last_unstale":"2024-04-22T07:21:35.067980+0000","last_undegraded":"2024-04-22T07:21:35.067980+0000","last_fullsized":"2024-04-22T07:21:35.067980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:06.123308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'101","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.314030+0000","last_change":"2024-04-22T07:20:53.867290+0000","last_active":"2024-04-22T07:24:19.314030+0000","last_peered":"2024-04-22T07:24:19.314030+0000","last_clean":"2024-04-22T07:24:19.314030+0000","last_became_active":"2024-04-22T07:20:53.866955+0000","last_became_peered":"2024-04-22T07:20:53.866955+0000","last_unstale":"2024-04-22T07:24:19.314030+0000","last_undegraded":"2024-04-22T07:24:19.314030+0000","last_fullsized":"2024-04-22T07:24:19.314030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:43.442316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'6","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:23:39.194608+0000","last_change":"2024-04-22T07:20:52.863670+0000","last_active":"2024-04-22T07:23:39.194608+0000","last_peered":"2024-04-22T07:23:39.194608+0000","last_clean":"2024-04-22T07:23:39.194608+0000","last_became_active":"2024-04-22T07:20:52.863320+0000","last_became_peered":"2024-04-22T07:20:52.863320+0000","last_unstale":"2024-04-22T07:23:39.194608+0000","last_undegraded":"2024-04-22T07:23:39.194608+0000","last_fullsized":"2024-04-22T07:23:39.194608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:04.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'107","reported_seq":124,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.895654+0000","last_change":"2024-04-22T07:20:53.868286+0000","last_active":"2024-04-22T07:24:17.895654+0000","last_peered":"2024-04-22T07:24:17.895654+0000","last_clean":"2024-04-22T07:24:17.895654+0000","last_became_active":"2024-04-22T07:20:53.862811+0000","last_became_peered":"2024-04-22T07:20:53.862811+0000","last_unstale":"2024-04-22T07:24:17.895654+0000","last_undegraded":"2024-04-22T07:24:17.895654+0000","last_fullsized":"2024-04-22T07:24:17.895654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'2013","reported_seq":2032,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:12.634943+0000","last_change":"2024-04-22T07:20:52.863638+0000","last_active":"2024-04-22T07:24:12.634943+0000","last_peered":"2024-04-22T07:24:12.634943+0000","last_clean":"2024-04-22T07:24:12.634943+0000","last_became_active":"2024-04-22T07:20:52.863244+0000","last_became_peered":"2024-04-22T07:20:52.863244+0000","last_unstale":"2024-04-22T07:24:12.634943+0000","last_undegraded":"2024-04-22T07:24:12.634943+0000","last_fullsized":"2024-04-22T07:24:12.634943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2013,"log_dups_size":0,"ondisk_log_size":2013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:36:49.017537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2012,"num_write_kb":6025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'111","reported_seq":128,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.388276+0000","last_change":"2024-04-22T07:20:53.875162+0000","last_active":"2024-04-22T07:24:19.388276+0000","last_peered":"2024-04-22T07:24:19.388276+0000","last_clean":"2024-04-22T07:24:19.388276+0000","last_became_active":"2024-04-22T07:20:53.874612+0000","last_became_peered":"2024-04-22T07:20:53.874612+0000","last_unstale":"2024-04-22T07:24:19.388276+0000","last_undegraded":"2024-04-22T07:24:19.388276+0000","last_fullsized":"2024-04-22T07:24:19.388276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:13:12.303505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.991827+0000","last_change":"2024-04-22T07:20:52.855194+0000","last_active":"2024-04-22T07:21:34.991827+0000","last_peered":"2024-04-22T07:21:34.991827+0000","last_clean":"2024-04-22T07:21:34.991827+0000","last_became_active":"2024-04-22T07:20:52.854915+0000","last_became_peered":"2024-04-22T07:20:52.854915+0000","last_unstale":"2024-04-22T07:21:34.991827+0000","last_undegraded":"2024-04-22T07:21:34.991827+0000","last_fullsized":"2024-04-22T07:21:34.991827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'117","reported_seq":134,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.241266+0000","last_change":"2024-04-22T07:20:53.868695+0000","last_active":"2024-04-22T07:24:18.241266+0000","last_peered":"2024-04-22T07:24:18.241266+0000","last_clean":"2024-04-22T07:24:18.241266+0000","last_became_active":"2024-04-22T07:20:53.868400+0000","last_became_peered":"2024-04-22T07:20:53.868400+0000","last_unstale":"2024-04-22T07:24:18.241266+0000","last_undegraded":"2024-04-22T07:24:18.241266+0000","last_fullsized":"2024-04-22T07:24:18.241266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:30:23.352871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.990952+0000","last_change":"2024-04-22T07:20:52.861884+0000","last_active":"2024-04-22T07:21:34.990952+0000","last_peered":"2024-04-22T07:21:34.990952+0000","last_clean":"2024-04-22T07:21:34.990952+0000","last_became_active":"2024-04-22T07:20:52.861546+0000","last_became_peered":"2024-04-22T07:20:52.861546+0000","last_unstale":"2024-04-22T07:21:34.990952+0000","last_undegraded":"2024-04-22T07:21:34.990952+0000","last_fullsized":"2024-04-22T07:21:34.990952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:37.283262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'121","reported_seq":138,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.300317+0000","last_change":"2024-04-22T07:20:53.863071+0000","last_active":"2024-04-22T07:24:18.300317+0000","last_peered":"2024-04-22T07:24:18.300317+0000","last_clean":"2024-04-22T07:24:18.300317+0000","last_became_active":"2024-04-22T07:20:53.862763+0000","last_became_peered":"2024-04-22T07:20:53.862763+0000","last_unstale":"2024-04-22T07:24:18.300317+0000","last_undegraded":"2024-04-22T07:24:18.300317+0000","last_fullsized":"2024-04-22T07:24:18.300317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:19:57.432323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197132288,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.067474+0000","last_change":"2024-04-22T07:20:52.865285+0000","last_active":"2024-04-22T07:21:35.067474+0000","last_peered":"2024-04-22T07:21:35.067474+0000","last_clean":"2024-04-22T07:21:35.067474+0000","last_became_active":"2024-04-22T07:20:52.864725+0000","last_became_peered":"2024-04-22T07:20:52.864725+0000","last_unstale":"2024-04-22T07:21:35.067474+0000","last_undegraded":"2024-04-22T07:21:35.067474+0000","last_fullsized":"2024-04-22T07:21:35.067474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:23:28.850031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'133","reported_seq":150,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.053849+0000","last_change":"2024-04-22T07:20:53.875479+0000","last_active":"2024-04-22T07:24:18.053849+0000","last_peered":"2024-04-22T07:24:18.053849+0000","last_clean":"2024-04-22T07:24:18.053849+0000","last_became_active":"2024-04-22T07:20:53.874567+0000","last_became_peered":"2024-04-22T07:20:53.874567+0000","last_unstale":"2024-04-22T07:24:18.053849+0000","last_undegraded":"2024-04-22T07:24:18.053849+0000","last_fullsized":"2024-04-22T07:24:18.053849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.210944+0000","last_change":"2024-04-22T07:20:52.860646+0000","last_active":"2024-04-22T07:21:35.210944+0000","last_peered":"2024-04-22T07:21:35.210944+0000","last_clean":"2024-04-22T07:21:35.210944+0000","last_became_active":"2024-04-22T07:20:52.860347+0000","last_became_peered":"2024-04-22T07:20:52.860347+0000","last_unstale":"2024-04-22T07:21:35.210944+0000","last_undegraded":"2024-04-22T07:21:35.210944+0000","last_fullsized":"2024-04-22T07:21:35.210944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:53:20.912264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'145","reported_seq":162,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.262173+0000","last_change":"2024-04-22T07:20:53.859641+0000","last_active":"2024-04-22T07:24:18.262173+0000","last_peered":"2024-04-22T07:24:18.262173+0000","last_clean":"2024-04-22T07:24:18.262173+0000","last_became_active":"2024-04-22T07:20:53.859365+0000","last_became_peered":"2024-04-22T07:20:53.859365+0000","last_unstale":"2024-04-22T07:24:18.262173+0000","last_undegraded":"2024-04-22T07:24:18.262173+0000","last_fullsized":"2024-04-22T07:24:18.262173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:46:50.322722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192937984,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.068079+0000","last_change":"2024-04-22T07:20:52.866960+0000","last_active":"2024-04-22T07:21:35.068079+0000","last_peered":"2024-04-22T07:21:35.068079+0000","last_clean":"2024-04-22T07:21:35.068079+0000","last_became_active":"2024-04-22T07:20:52.866654+0000","last_became_peered":"2024-04-22T07:20:52.866654+0000","last_unstale":"2024-04-22T07:21:35.068079+0000","last_undegraded":"2024-04-22T07:21:35.068079+0000","last_fullsized":"2024-04-22T07:21:35.068079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:51.683021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'106","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.470642+0000","last_change":"2024-04-22T07:20:53.874775+0000","last_active":"2024-04-22T07:24:19.470642+0000","last_peered":"2024-04-22T07:24:19.470642+0000","last_clean":"2024-04-22T07:24:19.470642+0000","last_became_active":"2024-04-22T07:20:53.874499+0000","last_became_peered":"2024-04-22T07:20:53.874499+0000","last_unstale":"2024-04-22T07:24:19.470642+0000","last_undegraded":"2024-04-22T07:24:19.470642+0000","last_fullsized":"2024-04-22T07:24:19.470642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:23.268067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.211381+0000","last_change":"2024-04-22T07:20:52.867201+0000","last_active":"2024-04-22T07:21:35.211381+0000","last_peered":"2024-04-22T07:21:35.211381+0000","last_clean":"2024-04-22T07:21:35.211381+0000","last_became_active":"2024-04-22T07:20:52.866627+0000","last_became_peered":"2024-04-22T07:20:52.866627+0000","last_unstale":"2024-04-22T07:21:35.211381+0000","last_undegraded":"2024-04-22T07:21:35.211381+0000","last_fullsized":"2024-04-22T07:21:35.211381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:09:08.908298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'103","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.022418+0000","last_change":"2024-04-22T07:20:53.871645+0000","last_active":"2024-04-22T07:24:18.022418+0000","last_peered":"2024-04-22T07:24:18.022418+0000","last_clean":"2024-04-22T07:24:18.022418+0000","last_became_active":"2024-04-22T07:20:53.871353+0000","last_became_peered":"2024-04-22T07:20:53.871353+0000","last_unstale":"2024-04-22T07:24:18.022418+0000","last_undegraded":"2024-04-22T07:24:18.022418+0000","last_fullsized":"2024-04-22T07:24:18.022418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:48:40.630407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.211197+0000","last_change":"2024-04-22T07:20:52.866996+0000","last_active":"2024-04-22T07:21:35.211197+0000","last_peered":"2024-04-22T07:21:35.211197+0000","last_clean":"2024-04-22T07:21:35.211197+0000","last_became_active":"2024-04-22T07:20:52.866677+0000","last_became_peered":"2024-04-22T07:20:52.866677+0000","last_unstale":"2024-04-22T07:21:35.211197+0000","last_undegraded":"2024-04-22T07:21:35.211197+0000","last_fullsized":"2024-04-22T07:21:35.211197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'102","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.600972+0000","last_change":"2024-04-22T07:20:53.871064+0000","last_active":"2024-04-22T07:24:19.600972+0000","last_peered":"2024-04-22T07:24:19.600972+0000","last_clean":"2024-04-22T07:24:19.600972+0000","last_became_active":"2024-04-22T07:20:53.866968+0000","last_became_peered":"2024-04-22T07:20:53.866968+0000","last_unstale":"2024-04-22T07:24:19.600972+0000","last_undegraded":"2024-04-22T07:24:19.600972+0000","last_fullsized":"2024-04-22T07:24:19.600972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:43.442316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.211392+0000","last_change":"2024-04-22T07:20:52.856958+0000","last_active":"2024-04-22T07:21:35.211392+0000","last_peered":"2024-04-22T07:21:35.211392+0000","last_clean":"2024-04-22T07:21:35.211392+0000","last_became_active":"2024-04-22T07:20:52.856289+0000","last_became_peered":"2024-04-22T07:20:52.856289+0000","last_unstale":"2024-04-22T07:21:35.211392+0000","last_undegraded":"2024-04-22T07:21:35.211392+0000","last_fullsized":"2024-04-22T07:21:35.211392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'112","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.925311+0000","last_change":"2024-04-22T07:20:53.872915+0000","last_active":"2024-04-22T07:24:18.925311+0000","last_peered":"2024-04-22T07:24:18.925311+0000","last_clean":"2024-04-22T07:24:18.925311+0000","last_became_active":"2024-04-22T07:20:53.872005+0000","last_became_peered":"2024-04-22T07:20:53.872005+0000","last_unstale":"2024-04-22T07:24:18.925311+0000","last_undegraded":"2024-04-22T07:24:18.925311+0000","last_fullsized":"2024-04-22T07:24:18.925311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:53:29.242632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.990127+0000","last_change":"2024-04-22T07:20:43.747396+0000","last_active":"2024-04-22T07:21:34.990127+0000","last_peered":"2024-04-22T07:21:34.990127+0000","last_clean":"2024-04-22T07:21:34.990127+0000","last_became_active":"2024-04-22T07:20:43.746332+0000","last_became_peered":"2024-04-22T07:20:43.746332+0000","last_unstale":"2024-04-22T07:21:34.990127+0000","last_undegraded":"2024-04-22T07:21:34.990127+0000","last_fullsized":"2024-04-22T07:21:34.990127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:42.732916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:42.732916+0000","last_clean_scrub_stamp":"2024-04-22T07:20:42.732916+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:02:55.086445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.991064+0000","last_change":"2024-04-22T07:20:52.862492+0000","last_active":"2024-04-22T07:21:34.991064+0000","last_peered":"2024-04-22T07:21:34.991064+0000","last_clean":"2024-04-22T07:21:34.991064+0000","last_became_active":"2024-04-22T07:20:52.862201+0000","last_became_peered":"2024-04-22T07:20:52.862201+0000","last_unstale":"2024-04-22T07:21:34.991064+0000","last_undegraded":"2024-04-22T07:21:34.991064+0000","last_fullsized":"2024-04-22T07:21:34.991064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:52.015227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'112","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.991597+0000","last_change":"2024-04-22T07:20:53.868797+0000","last_active":"2024-04-22T07:24:17.991597+0000","last_peered":"2024-04-22T07:24:17.991597+0000","last_clean":"2024-04-22T07:24:17.991597+0000","last_became_active":"2024-04-22T07:20:53.868335+0000","last_became_peered":"2024-04-22T07:20:53.868335+0000","last_unstale":"2024-04-22T07:24:17.991597+0000","last_undegraded":"2024-04-22T07:24:17.991597+0000","last_fullsized":"2024-04-22T07:24:17.991597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:43:02.116289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184549376,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.990606+0000","last_change":"2024-04-22T07:20:52.867622+0000","last_active":"2024-04-22T07:21:34.990606+0000","last_peered":"2024-04-22T07:21:34.990606+0000","last_clean":"2024-04-22T07:21:34.990606+0000","last_became_active":"2024-04-22T07:20:52.866996+0000","last_became_peered":"2024-04-22T07:20:52.866996+0000","last_unstale":"2024-04-22T07:21:34.990606+0000","last_undegraded":"2024-04-22T07:21:34.990606+0000","last_fullsized":"2024-04-22T07:21:34.990606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:08.286530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'107","reported_seq":124,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.010322+0000","last_change":"2024-04-22T07:20:53.871576+0000","last_active":"2024-04-22T07:24:18.010322+0000","last_peered":"2024-04-22T07:24:18.010322+0000","last_clean":"2024-04-22T07:24:18.010322+0000","last_became_active":"2024-04-22T07:20:53.871239+0000","last_became_peered":"2024-04-22T07:20:53.871239+0000","last_unstale":"2024-04-22T07:24:18.010322+0000","last_undegraded":"2024-04-22T07:24:18.010322+0000","last_fullsized":"2024-04-22T07:24:18.010322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:23:55.981669+0000","last_change":"2024-04-22T07:20:52.866974+0000","last_active":"2024-04-22T07:23:55.981669+0000","last_peered":"2024-04-22T07:23:55.981669+0000","last_clean":"2024-04-22T07:23:55.981669+0000","last_became_active":"2024-04-22T07:20:52.866581+0000","last_became_peered":"2024-04-22T07:20:52.866581+0000","last_unstale":"2024-04-22T07:23:55.981669+0000","last_undegraded":"2024-04-22T07:23:55.981669+0000","last_fullsized":"2024-04-22T07:23:55.981669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'96","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.614662+0000","last_change":"2024-04-22T07:20:53.865035+0000","last_active":"2024-04-22T07:24:18.614662+0000","last_peered":"2024-04-22T07:24:18.614662+0000","last_clean":"2024-04-22T07:24:18.614662+0000","last_became_active":"2024-04-22T07:20:53.864523+0000","last_became_peered":"2024-04-22T07:20:53.864523+0000","last_unstale":"2024-04-22T07:24:18.614662+0000","last_undegraded":"2024-04-22T07:24:18.614662+0000","last_fullsized":"2024-04-22T07:24:18.614662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:13:12.303505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.991090+0000","last_change":"2024-04-22T07:20:52.858498+0000","last_active":"2024-04-22T07:21:34.991090+0000","last_peered":"2024-04-22T07:21:34.991090+0000","last_clean":"2024-04-22T07:21:34.991090+0000","last_became_active":"2024-04-22T07:20:52.858139+0000","last_became_peered":"2024-04-22T07:20:52.858139+0000","last_unstale":"2024-04-22T07:21:34.991090+0000","last_undegraded":"2024-04-22T07:21:34.991090+0000","last_fullsized":"2024-04-22T07:21:34.991090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:45.382709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'111","reported_seq":128,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.617500+0000","last_change":"2024-04-22T07:20:53.877595+0000","last_active":"2024-04-22T07:24:19.617500+0000","last_peered":"2024-04-22T07:24:19.617500+0000","last_clean":"2024-04-22T07:24:19.617500+0000","last_became_active":"2024-04-22T07:20:53.877208+0000","last_became_peered":"2024-04-22T07:20:53.877208+0000","last_unstale":"2024-04-22T07:24:19.617500+0000","last_undegraded":"2024-04-22T07:24:19.617500+0000","last_fullsized":"2024-04-22T07:24:19.617500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:46:50.322722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167772160,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.211230+0000","last_change":"2024-04-22T07:20:52.866224+0000","last_active":"2024-04-22T07:21:35.211230+0000","last_peered":"2024-04-22T07:21:35.211230+0000","last_clean":"2024-04-22T07:21:35.211230+0000","last_became_active":"2024-04-22T07:20:52.865903+0000","last_became_peered":"2024-04-22T07:20:52.865903+0000","last_unstale":"2024-04-22T07:21:35.211230+0000","last_undegraded":"2024-04-22T07:21:35.211230+0000","last_fullsized":"2024-04-22T07:21:35.211230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'110","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.572978+0000","last_change":"2024-04-22T07:20:53.873266+0000","last_active":"2024-04-22T07:24:17.572978+0000","last_peered":"2024-04-22T07:24:17.572978+0000","last_clean":"2024-04-22T07:24:17.572978+0000","last_became_active":"2024-04-22T07:20:53.872915+0000","last_became_peered":"2024-04-22T07:20:53.872915+0000","last_unstale":"2024-04-22T07:24:17.572978+0000","last_undegraded":"2024-04-22T07:24:17.572978+0000","last_fullsized":"2024-04-22T07:24:17.572978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:09.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.991276+0000","last_change":"2024-04-22T07:20:52.863593+0000","last_active":"2024-04-22T07:21:34.991276+0000","last_peered":"2024-04-22T07:21:34.991276+0000","last_clean":"2024-04-22T07:21:34.991276+0000","last_became_active":"2024-04-22T07:20:52.863296+0000","last_became_peered":"2024-04-22T07:20:52.863296+0000","last_unstale":"2024-04-22T07:21:34.991276+0000","last_undegraded":"2024-04-22T07:21:34.991276+0000","last_fullsized":"2024-04-22T07:21:34.991276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:22.261683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'103","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.166523+0000","last_change":"2024-04-22T07:20:53.874491+0000","last_active":"2024-04-22T07:24:18.166523+0000","last_peered":"2024-04-22T07:24:18.166523+0000","last_clean":"2024-04-22T07:24:18.166523+0000","last_became_active":"2024-04-22T07:20:53.874202+0000","last_became_peered":"2024-04-22T07:20:53.874202+0000","last_unstale":"2024-04-22T07:24:18.166523+0000","last_undegraded":"2024-04-22T07:24:18.166523+0000","last_fullsized":"2024-04-22T07:24:18.166523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:23.268067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'19","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:30.910041+0000","last_change":"2024-04-22T07:20:52.865905+0000","last_active":"2024-04-22T07:24:30.910041+0000","last_peered":"2024-04-22T07:24:30.910041+0000","last_clean":"2024-04-22T07:24:30.910041+0000","last_became_active":"2024-04-22T07:20:52.865566+0000","last_became_peered":"2024-04-22T07:20:52.865566+0000","last_unstale":"2024-04-22T07:24:30.910041+0000","last_undegraded":"2024-04-22T07:24:30.910041+0000","last_fullsized":"2024-04-22T07:24:30.910041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:38:31.271879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'114","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.964928+0000","last_change":"2024-04-22T07:20:53.869951+0000","last_active":"2024-04-22T07:24:17.964928+0000","last_peered":"2024-04-22T07:24:17.964928+0000","last_clean":"2024-04-22T07:24:17.964928+0000","last_became_active":"2024-04-22T07:20:53.869613+0000","last_became_peered":"2024-04-22T07:20:53.869613+0000","last_unstale":"2024-04-22T07:24:17.964928+0000","last_undegraded":"2024-04-22T07:24:17.964928+0000","last_fullsized":"2024-04-22T07:24:17.964928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:14:09.372107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.991409+0000","last_change":"2024-04-22T07:20:52.864740+0000","last_active":"2024-04-22T07:21:34.991409+0000","last_peered":"2024-04-22T07:21:34.991409+0000","last_clean":"2024-04-22T07:21:34.991409+0000","last_became_active":"2024-04-22T07:20:52.864434+0000","last_became_peered":"2024-04-22T07:20:52.864434+0000","last_unstale":"2024-04-22T07:21:34.991409+0000","last_undegraded":"2024-04-22T07:21:34.991409+0000","last_fullsized":"2024-04-22T07:21:34.991409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:33.937176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'116","reported_seq":133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.747016+0000","last_change":"2024-04-22T07:20:53.871156+0000","last_active":"2024-04-22T07:24:17.747016+0000","last_peered":"2024-04-22T07:24:17.747016+0000","last_clean":"2024-04-22T07:24:17.747016+0000","last_became_active":"2024-04-22T07:20:53.870664+0000","last_became_peered":"2024-04-22T07:20:53.870664+0000","last_unstale":"2024-04-22T07:24:17.747016+0000","last_undegraded":"2024-04-22T07:24:17.747016+0000","last_fullsized":"2024-04-22T07:24:17.747016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:01:02.139458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.067306+0000","last_change":"2024-04-22T07:20:52.854668+0000","last_active":"2024-04-22T07:21:35.067306+0000","last_peered":"2024-04-22T07:21:35.067306+0000","last_clean":"2024-04-22T07:21:35.067306+0000","last_became_active":"2024-04-22T07:20:52.854395+0000","last_became_peered":"2024-04-22T07:20:52.854395+0000","last_unstale":"2024-04-22T07:21:35.067306+0000","last_undegraded":"2024-04-22T07:21:35.067306+0000","last_fullsized":"2024-04-22T07:21:35.067306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:59:32.487127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'114","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.011769+0000","last_change":"2024-04-22T07:20:53.870972+0000","last_active":"2024-04-22T07:24:18.011769+0000","last_peered":"2024-04-22T07:24:18.011769+0000","last_clean":"2024-04-22T07:24:18.011769+0000","last_became_active":"2024-04-22T07:20:53.870674+0000","last_became_peered":"2024-04-22T07:20:53.870674+0000","last_unstale":"2024-04-22T07:24:18.011769+0000","last_undegraded":"2024-04-22T07:24:18.011769+0000","last_fullsized":"2024-04-22T07:24:18.011769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:10.431906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.211569+0000","last_change":"2024-04-22T07:20:52.866003+0000","last_active":"2024-04-22T07:21:35.211569+0000","last_peered":"2024-04-22T07:21:35.211569+0000","last_clean":"2024-04-22T07:21:35.211569+0000","last_became_active":"2024-04-22T07:20:52.865606+0000","last_became_peered":"2024-04-22T07:20:52.865606+0000","last_unstale":"2024-04-22T07:21:35.211569+0000","last_undegraded":"2024-04-22T07:21:35.211569+0000","last_fullsized":"2024-04-22T07:21:35.211569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:58:06.713204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'116","reported_seq":133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:17.898981+0000","last_change":"2024-04-22T07:20:53.870737+0000","last_active":"2024-04-22T07:24:17.898981+0000","last_peered":"2024-04-22T07:24:17.898981+0000","last_clean":"2024-04-22T07:24:17.898981+0000","last_became_active":"2024-04-22T07:20:53.870402+0000","last_became_peered":"2024-04-22T07:20:53.870402+0000","last_unstale":"2024-04-22T07:24:17.898981+0000","last_undegraded":"2024-04-22T07:24:17.898981+0000","last_fullsized":"2024-04-22T07:24:17.898981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:30:17.845591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.210719+0000","last_change":"2024-04-22T07:20:52.861048+0000","last_active":"2024-04-22T07:21:35.210719+0000","last_peered":"2024-04-22T07:21:35.210719+0000","last_clean":"2024-04-22T07:21:35.210719+0000","last_became_active":"2024-04-22T07:20:52.860702+0000","last_became_peered":"2024-04-22T07:20:52.860702+0000","last_unstale":"2024-04-22T07:21:35.210719+0000","last_undegraded":"2024-04-22T07:21:35.210719+0000","last_fullsized":"2024-04-22T07:21:35.210719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'105","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:16.898071+0000","last_change":"2024-04-22T07:20:53.868782+0000","last_active":"2024-04-22T07:24:16.898071+0000","last_peered":"2024-04-22T07:24:16.898071+0000","last_clean":"2024-04-22T07:24:16.898071+0000","last_became_active":"2024-04-22T07:20:53.868509+0000","last_became_peered":"2024-04-22T07:20:53.868509+0000","last_unstale":"2024-04-22T07:24:16.898071+0000","last_undegraded":"2024-04-22T07:24:16.898071+0000","last_fullsized":"2024-04-22T07:24:16.898071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:07.129692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'3","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:23:10.820295+0000","last_change":"2024-04-22T07:20:52.858508+0000","last_active":"2024-04-22T07:23:10.820295+0000","last_peered":"2024-04-22T07:23:10.820295+0000","last_clean":"2024-04-22T07:23:10.820295+0000","last_became_active":"2024-04-22T07:20:52.858215+0000","last_became_peered":"2024-04-22T07:20:52.858215+0000","last_unstale":"2024-04-22T07:23:10.820295+0000","last_undegraded":"2024-04-22T07:23:10.820295+0000","last_fullsized":"2024-04-22T07:23:10.820295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:26.618434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'94","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.924667+0000","last_change":"2024-04-22T07:20:53.867977+0000","last_active":"2024-04-22T07:24:18.924667+0000","last_peered":"2024-04-22T07:24:18.924667+0000","last_clean":"2024-04-22T07:24:18.924667+0000","last_became_active":"2024-04-22T07:20:53.867447+0000","last_became_peered":"2024-04-22T07:20:53.867447+0000","last_unstale":"2024-04-22T07:24:18.924667+0000","last_undegraded":"2024-04-22T07:24:18.924667+0000","last_fullsized":"2024-04-22T07:24:18.924667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:48:52.934171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155189248,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'131","reported_seq":148,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.110899+0000","last_change":"2024-04-22T07:20:53.875681+0000","last_active":"2024-04-22T07:24:19.110899+0000","last_peered":"2024-04-22T07:24:19.110899+0000","last_clean":"2024-04-22T07:24:19.110899+0000","last_became_active":"2024-04-22T07:20:53.875305+0000","last_became_peered":"2024-04-22T07:20:53.875305+0000","last_unstale":"2024-04-22T07:24:19.110899+0000","last_undegraded":"2024-04-22T07:24:19.110899+0000","last_fullsized":"2024-04-22T07:24:19.110899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:22:34.452869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.068077+0000","last_change":"2024-04-22T07:20:52.857445+0000","last_active":"2024-04-22T07:21:35.068077+0000","last_peered":"2024-04-22T07:21:35.068077+0000","last_clean":"2024-04-22T07:21:35.068077+0000","last_became_active":"2024-04-22T07:20:52.856293+0000","last_became_peered":"2024-04-22T07:20:52.856293+0000","last_unstale":"2024-04-22T07:21:35.068077+0000","last_undegraded":"2024-04-22T07:21:35.068077+0000","last_fullsized":"2024-04-22T07:21:35.068077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:10.640191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'106","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.277781+0000","last_change":"2024-04-22T07:20:53.870827+0000","last_active":"2024-04-22T07:24:18.277781+0000","last_peered":"2024-04-22T07:24:18.277781+0000","last_clean":"2024-04-22T07:24:18.277781+0000","last_became_active":"2024-04-22T07:20:53.870548+0000","last_became_peered":"2024-04-22T07:20:53.870548+0000","last_unstale":"2024-04-22T07:24:18.277781+0000","last_undegraded":"2024-04-22T07:24:18.277781+0000","last_fullsized":"2024-04-22T07:24:18.277781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:27.624819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'4","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:23:38.961771+0000","last_change":"2024-04-22T07:20:52.856933+0000","last_active":"2024-04-22T07:23:38.961771+0000","last_peered":"2024-04-22T07:23:38.961771+0000","last_clean":"2024-04-22T07:23:38.961771+0000","last_became_active":"2024-04-22T07:20:52.856617+0000","last_became_peered":"2024-04-22T07:20:52.856617+0000","last_unstale":"2024-04-22T07:23:38.961771+0000","last_undegraded":"2024-04-22T07:23:38.961771+0000","last_fullsized":"2024-04-22T07:23:38.961771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:08.286530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'97","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:19.032653+0000","last_change":"2024-04-22T07:20:53.866552+0000","last_active":"2024-04-22T07:24:19.032653+0000","last_peered":"2024-04-22T07:24:19.032653+0000","last_clean":"2024-04-22T07:24:19.032653+0000","last_became_active":"2024-04-22T07:20:53.866286+0000","last_became_peered":"2024-04-22T07:20:53.866286+0000","last_unstale":"2024-04-22T07:24:19.032653+0000","last_undegraded":"2024-04-22T07:24:19.032653+0000","last_fullsized":"2024-04-22T07:24:19.032653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:45:15.519469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159383552,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.211591+0000","last_change":"2024-04-22T07:20:52.863291+0000","last_active":"2024-04-22T07:21:35.211591+0000","last_peered":"2024-04-22T07:21:35.211591+0000","last_clean":"2024-04-22T07:21:35.211591+0000","last_became_active":"2024-04-22T07:20:52.862967+0000","last_became_peered":"2024-04-22T07:20:52.862967+0000","last_unstale":"2024-04-22T07:21:35.211591+0000","last_undegraded":"2024-04-22T07:21:35.211591+0000","last_fullsized":"2024-04-22T07:21:35.211591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:10.640191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'115","reported_seq":132,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:18.727128+0000","last_change":"2024-04-22T07:20:53.871045+0000","last_active":"2024-04-22T07:24:18.727128+0000","last_peered":"2024-04-22T07:24:18.727128+0000","last_clean":"2024-04-22T07:24:18.727128+0000","last_became_active":"2024-04-22T07:20:53.870715+0000","last_became_peered":"2024-04-22T07:20:53.870715+0000","last_unstale":"2024-04-22T07:24:18.727128+0000","last_undegraded":"2024-04-22T07:24:18.727128+0000","last_fullsized":"2024-04-22T07:24:18.727128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176160768,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'4","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.211838+0000","last_change":"2024-04-22T07:20:52.869553+0000","last_active":"2024-04-22T07:21:35.211838+0000","last_peered":"2024-04-22T07:21:35.211838+0000","last_clean":"2024-04-22T07:21:35.211838+0000","last_became_active":"2024-04-22T07:20:52.869300+0000","last_became_peered":"2024-04-22T07:20:52.869300+0000","last_unstale":"2024-04-22T07:21:35.211838+0000","last_undegraded":"2024-04-22T07:21:35.211838+0000","last_fullsized":"2024-04-22T07:21:35.211838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:27.709073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":10737418240,"num_objects":2560,"num_object_clones":0,"num_object_copies":5120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2560,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6656,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21474836480,"data_stored":21474836480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7171,"ondisk_log_size":7171,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4952374,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2449,"num_write_kb":7138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9969664,"data_stored":9904748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2435,"ondisk_log_size":2435,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509489,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1706704,"kb_used_data":1675528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92665136,"statfs":{"total":96636764160,"available":94889099264,"internally_reserved":0,"allocated":1715740672,"data_stored":1715563810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509489,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2190756,"kb_used_data":2159580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92181084,"statfs":{"total":96636764160,"available":94393430016,"internally_reserved":0,"allocated":2211409920,"data_stored":2211242343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509488,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2916340,"kb_used_data":2885164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":91455500,"statfs":{"total":96636764160,"available":93650432000,"internally_reserved":0,"allocated":2954407936,"data_stored":2954224813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509489,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3357384,"kb_used_data":3326208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":91014456,"statfs":{"total":96636764160,"available":93198802944,"internally_reserved":0,"allocated":3406036992,"data_stored":3405868578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509490,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3084620,"kb_used_data":3035396,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":91287220,"statfs":{"total":96636764160,"available":93478113280,"internally_reserved":0,"allocated":3108245504,"data_stored":3108073084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509489,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2231564,"kb_used_data":2200388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92140276,"statfs":{"total":96636764160,"available":94351642624,"internally_reserved":0,"allocated":2253197312,"data_stored":2253024834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509491,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3586764,"kb_used_data":3555588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":90785076,"statfs":{"total":96636764160,"available":92963917824,"internally_reserved":0,"allocated":3640922112,"data_stored":3640749076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2199956,"kb_used_data":2146572,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":92171884,"statfs":{"total":96636764160,"available":94384009216,"internally_reserved":0,"allocated":2198089728,"data_stored":2197909788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4210688,"data_stored":4195648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":770048,"data_stored":756692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":757760,"data_stored":756398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3640655872,"data_stored":3640655872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2252341248,"data_stored":2252341248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3103784960,"data_stored":3103784960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3405774848,"data_stored":3405774848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2193620992,"data_stored":2193620992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2952790016,"data_stored":2952790016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2210398208,"data_stored":2210398208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1715470336,"data_stored":1715470336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T07:24:37.680 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:24:37.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.818+0000 7f83c1a11640 1 Processor -- start 2024-04-22T07:24:37.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.818+0000 7f83c1a11640 1 -- start start 2024-04-22T07:24:37.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.819+0000 7f83c1a11640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f83bc154f50 0x7f83bc0cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:37.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.819+0000 7f83c1a11640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f83bc0cc5a0 0x7f83bc0d0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:37.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.819+0000 7f83c1a11640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f83bc0d0ad0 0x7f83bc15b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:37.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.819+0000 7f83c1a11640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f83bc15af50 con 0x7f83bc0d0ad0 2024-04-22T07:24:37.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.819+0000 7f83c1a11640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f83bc15e6e0 con 0x7f83bc154f50 2024-04-22T07:24:37.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.819+0000 7f83c1a11640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f83bc15e9c0 con 0x7f83bc0cc5a0 2024-04-22T07:24:37.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.819+0000 7f83bb7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f83bc0d0ad0 0x7f83bc15b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:37.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.819+0000 7f83bb7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f83bc0d0ad0 0x7f83bc15b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53532/0 (socket says 172.21.15.40:53532) 2024-04-22T07:24:37.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.819+0000 7f83bb7fe640 1 -- 172.21.15.40:0/2599391937 learned_addr learned my addr 172.21.15.40:0/2599391937 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:37.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.819+0000 7f83baffd640 1 --2- 172.21.15.40:0/2599391937 >> v2:172.21.15.62:3300/0 conn(0x7f83bc154f50 0x7f83bc0cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:37.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.819+0000 7f83ba7fc640 1 --2- 172.21.15.40:0/2599391937 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f83bc0cc5a0 0x7f83bc0d0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:37.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.819+0000 7f83bb7fe640 1 -- 172.21.15.40:0/2599391937 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f83bc0cc5a0 msgr2=0x7f83bc0d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:37.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.819+0000 7f83bb7fe640 1 --2- 172.21.15.40:0/2599391937 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f83bc0cc5a0 0x7f83bc0d0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.819+0000 7f83bb7fe640 1 -- 172.21.15.40:0/2599391937 >> v2:172.21.15.62:3300/0 conn(0x7f83bc154f50 msgr2=0x7f83bc0cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:37.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.819+0000 7f83bb7fe640 1 --2- 172.21.15.40:0/2599391937 >> v2:172.21.15.62:3300/0 conn(0x7f83bc154f50 0x7f83bc0cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.819+0000 7f83bb7fe640 1 -- 172.21.15.40:0/2599391937 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83bc15eca0 con 0x7f83bc0d0ad0 2024-04-22T07:24:37.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.820+0000 7f83ba7fc640 1 --2- 172.21.15.40:0/2599391937 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f83bc0cc5a0 0x7f83bc0d0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:24:37.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.820+0000 7f83baffd640 1 --2- 172.21.15.40:0/2599391937 >> v2:172.21.15.62:3300/0 conn(0x7f83bc154f50 0x7f83bc0cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:24:37.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.820+0000 7f83bb7fe640 1 --2- 172.21.15.40:0/2599391937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83bc0d0ad0 0x7f83bc15b3e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0d1320 tx=0x7f83b402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cddd93e1e4d8fe5 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:37.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.820+0000 7f83b9ffb640 1 -- 172.21.15.40:0/2599391937 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b4034070 con 0x7f83bc0d0ad0 2024-04-22T07:24:37.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.820+0000 7f83b9ffb640 1 -- 172.21.15.40:0/2599391937 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83b4030860 con 0x7f83bc0d0ad0 2024-04-22T07:24:37.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.820+0000 7f83b9ffb640 1 -- 172.21.15.40:0/2599391937 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b4030c30 con 0x7f83bc0d0ad0 2024-04-22T07:24:37.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.821+0000 7f83c1a11640 1 -- 172.21.15.40:0/2599391937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83bc0d0ad0 msgr2=0x7f83bc15b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:37.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.821+0000 7f83c1a11640 1 --2- 172.21.15.40:0/2599391937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83bc0d0ad0 0x7f83bc15b3e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0d1320 tx=0x7f83b402b9a0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.821+0000 7f83c1a11640 1 -- 172.21.15.40:0/2599391937 shutdown_connections 2024-04-22T07:24:37.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.821+0000 7f83c1a11640 1 --2- 172.21.15.40:0/2599391937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83bc0d0ad0 0x7f83bc15b3e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.821+0000 7f83c1a11640 1 --2- 172.21.15.40:0/2599391937 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f83bc0cc5a0 0x7f83bc0d0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.821+0000 7f83c1a11640 1 --2- 172.21.15.40:0/2599391937 >> v2:172.21.15.62:3300/0 conn(0x7f83bc154f50 0x7f83bc0cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.821+0000 7f83c1a11640 1 -- 172.21.15.40:0/2599391937 >> 172.21.15.40:0/2599391937 conn(0x7f83bc0676b0 msgr2=0x7f83bc067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:37.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.821+0000 7f83c1a11640 1 -- 172.21.15.40:0/2599391937 shutdown_connections 2024-04-22T07:24:37.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.821+0000 7f83c1a11640 1 -- 172.21.15.40:0/2599391937 wait complete. 2024-04-22T07:24:37.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.822+0000 7f83c1a11640 1 Processor -- start 2024-04-22T07:24:37.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.822+0000 7f83c1a11640 1 -- start start 2024-04-22T07:24:37.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.823+0000 7f83c1a11640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83bc0cc5a0 0x7f83bc0cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:37.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.823+0000 7f83c1a11640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f83bc0d0ad0 0x7f83bc1e5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:37.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.823+0000 7f83c1a11640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83bc154f50 0x7f83bc148010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:37.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.823+0000 7f83c1a11640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f83bc15e3a0 con 0x7f83bc154f50 2024-04-22T07:24:37.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.823+0000 7f83c1a11640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f83bc15f260 con 0x7f83bc0cc5a0 2024-04-22T07:24:37.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.823+0000 7f83c1a11640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f83bc155330 con 0x7f83bc0d0ad0 2024-04-22T07:24:37.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.823+0000 7f83bb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83bc154f50 0x7f83bc148010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:37.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.823+0000 7f83bb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83bc154f50 0x7f83bc148010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53540/0 (socket says 172.21.15.40:53540) 2024-04-22T07:24:37.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.823+0000 7f83bb7fe640 1 -- 172.21.15.40:0/3295151702 learned_addr learned my addr 172.21.15.40:0/3295151702 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:37.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.823+0000 7f83baffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83bc0cc5a0 0x7f83bc0cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:37.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.823+0000 7f83ba7fc640 1 --2- 172.21.15.40:0/3295151702 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f83bc0d0ad0 0x7f83bc1e5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:37.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.824+0000 7f83bb7fe640 1 -- 172.21.15.40:0/3295151702 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f83bc0d0ad0 msgr2=0x7f83bc1e5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:37.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.824+0000 7f83bb7fe640 1 --2- 172.21.15.40:0/3295151702 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f83bc0d0ad0 0x7f83bc1e5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.824+0000 7f83bb7fe640 1 -- 172.21.15.40:0/3295151702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83bc0cc5a0 msgr2=0x7f83bc0cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:37.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.824+0000 7f83bb7fe640 1 --2- 172.21.15.40:0/3295151702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83bc0cc5a0 0x7f83bc0cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:37.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.824+0000 7f83bb7fe640 1 -- 172.21.15.40:0/3295151702 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83bc0b6180 con 0x7f83bc154f50 2024-04-22T07:24:37.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.824+0000 7f83bb7fe640 1 --2- 172.21.15.40:0/3295151702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83bc154f50 0x7f83bc148010 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f83b402b9e0 tx=0x7f83b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:37.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.824+0000 7f83b3fff640 1 -- 172.21.15.40:0/3295151702 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b4048070 con 0x7f83bc154f50 2024-04-22T07:24:37.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.824+0000 7f83b3fff640 1 -- 172.21.15.40:0/3295151702 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83b4039d90 con 0x7f83bc154f50 2024-04-22T07:24:37.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.824+0000 7f83c1a11640 1 -- 172.21.15.40:0/3295151702 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83bc15e140 con 0x7f83bc154f50 2024-04-22T07:24:37.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.824+0000 7f83b3fff640 1 -- 172.21.15.40:0/3295151702 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b4034040 con 0x7f83bc154f50 2024-04-22T07:24:37.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.824+0000 7f83c1a11640 1 -- 172.21.15.40:0/3295151702 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83bc0b4c80 con 0x7f83bc154f50 2024-04-22T07:24:37.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.825+0000 7f83c1a11640 1 -- 172.21.15.40:0/3295151702 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83bc0b4a70 con 0x7f83bc154f50 2024-04-22T07:24:37.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.826+0000 7f83b3fff640 1 -- 172.21.15.40:0/3295151702 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f83b404b070 con 0x7f83bc154f50 2024-04-22T07:24:37.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.826+0000 7f83b3fff640 1 --2- 172.21.15.40:0/3295151702 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f839c06c8f0 0x7f839c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:37.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.826+0000 7f83baffd640 1 --2- 172.21.15.40:0/3295151702 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f839c06c8f0 0x7f839c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:37.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.826+0000 7f83b3fff640 1 -- 172.21.15.40:0/3295151702 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f83b40addb0 con 0x7f83bc154f50 2024-04-22T07:24:37.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.827+0000 7f83baffd640 1 --2- 172.21.15.40:0/3295151702 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f839c06c8f0 0x7f839c06edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00f500 tx=0x7f83ac007770 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:37.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:37.831+0000 7f83b3fff640 1 -- 172.21.15.40:0/3295151702 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f83b407bae0 con 0x7f83bc154f50 2024-04-22T07:24:38.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:38.019+0000 7f83c1a11640 1 -- 172.21.15.40:0/3295151702 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83bc069d40 con 0x7f83bc154f50 2024-04-22T07:24:38.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:38.020+0000 7f83b3fff640 1 -- 172.21.15.40:0/3295151702 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16586 (secure 0 0 0) 0x7f83b407fde0 con 0x7f83bc154f50 2024-04-22T07:24:38.018 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:24:38.018 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"dd5b16e4-89fe-4602-b37f-062846793158","created":"2024-04-22T07:20:29.488892+0000","modified":"2024-04-22T07:21:34.978774+0000","last_up_change":"2024-04-22T07:20:40.397383+0000","last_in_change":"2024-04-22T07:20:31.702551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:20:41.793179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:20:51.815779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:20:52.164265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32238b7e-228b-4a67-bfca-16e8f0020a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6801","nonce":1526385055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6803","nonce":1526385055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6807","nonce":1526385055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6805","nonce":1526385055}]},"public_addr":"172.21.15.40:6801/1526385055","cluster_addr":"172.21.15.40:6803/1526385055","heartbeat_back_addr":"172.21.15.40:6807/1526385055","heartbeat_front_addr":"172.21.15.40:6805/1526385055","state":["exists","up"]},{"osd":1,"uuid":"5ad8da43-39b1-4295-b4d1-0f1e1d06fc0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6809","nonce":623026645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6811","nonce":623026645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6815","nonce":623026645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6813","nonce":623026645}]},"public_addr":"172.21.15.40:6809/623026645","cluster_addr":"172.21.15.40:6811/623026645","heartbeat_back_addr":"172.21.15.40:6815/623026645","heartbeat_front_addr":"172.21.15.40:6813/623026645","state":["exists","up"]},{"osd":2,"uuid":"7d2c6d50-719d-4232-ad47-f04dcf1a8bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6820","nonce":1885686505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6824","nonce":1885686505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6831","nonce":1885686505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6828","nonce":1885686505}]},"public_addr":"172.21.15.40:6820/1885686505","cluster_addr":"172.21.15.40:6824/1885686505","heartbeat_back_addr":"172.21.15.40:6831/1885686505","heartbeat_front_addr":"172.21.15.40:6828/1885686505","state":["exists","up"]},{"osd":3,"uuid":"af42e7d6-a6bf-403e-92e7-162d7c4fbf0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6817","nonce":130276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6819","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6821","nonce":130276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6829","nonce":130276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6823","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6825","nonce":130276746}]},"public_addr":"172.21.15.40:6817/130276746","cluster_addr":"172.21.15.40:6821/130276746","heartbeat_back_addr":"172.21.15.40:6829/130276746","heartbeat_front_addr":"172.21.15.40:6825/130276746","state":["exists","up"]},{"osd":4,"uuid":"f8e89e0d-be96-4f19-88c0-69c408df7d98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6801","nonce":2251435758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6803","nonce":2251435758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6807","nonce":2251435758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6805","nonce":2251435758}]},"public_addr":"172.21.15.62:6801/2251435758","cluster_addr":"172.21.15.62:6803/2251435758","heartbeat_back_addr":"172.21.15.62:6807/2251435758","heartbeat_front_addr":"172.21.15.62:6805/2251435758","state":["exists","up"]},{"osd":5,"uuid":"ba6dc1bc-272b-4f80-b55f-40bc4a0c3ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6809","nonce":3509322231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6811","nonce":3509322231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6815","nonce":3509322231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6813","nonce":3509322231}]},"public_addr":"172.21.15.62:6809/3509322231","cluster_addr":"172.21.15.62:6811/3509322231","heartbeat_back_addr":"172.21.15.62:6815/3509322231","heartbeat_front_addr":"172.21.15.62:6813/3509322231","state":["exists","up"]},{"osd":6,"uuid":"834fcd74-14bf-45ec-a10a-0374f4ce9bf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6825","nonce":3094315954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6827","nonce":3094315954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6831","nonce":3094315954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6829","nonce":3094315954}]},"public_addr":"172.21.15.62:6825/3094315954","cluster_addr":"172.21.15.62:6827/3094315954","heartbeat_back_addr":"172.21.15.62:6831/3094315954","heartbeat_front_addr":"172.21.15.62:6829/3094315954","state":["exists","up"]},{"osd":7,"uuid":"831c9a73-960e-4d2e-b86a-33a6916be059","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6817","nonce":147453972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6819","nonce":147453972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6823","nonce":147453972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6821","nonce":147453972}]},"public_addr":"172.21.15.62:6817/147453972","cluster_addr":"172.21.15.62:6819/147453972","heartbeat_back_addr":"172.21.15.62:6823/147453972","heartbeat_front_addr":"172.21.15.62:6821/147453972","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.828738+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.873471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.908090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.894782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:37.686796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.801123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.852323+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.812139+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.34","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:24:38.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:38.022+0000 7f83c1a11640 1 -- 172.21.15.40:0/3295151702 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f839c06c8f0 msgr2=0x7f839c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:38.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:38.022+0000 7f83c1a11640 1 --2- 172.21.15.40:0/3295151702 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f839c06c8f0 0x7f839c06edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00f500 tx=0x7f83ac007770 comp rx=0 tx=0).stop 2024-04-22T07:24:38.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:38.022+0000 7f83c1a11640 1 -- 172.21.15.40:0/3295151702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83bc154f50 msgr2=0x7f83bc148010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:38.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:38.022+0000 7f83c1a11640 1 --2- 172.21.15.40:0/3295151702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83bc154f50 0x7f83bc148010 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f83b402b9e0 tx=0x7f83b4004730 comp rx=0 tx=0).stop 2024-04-22T07:24:38.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:38.022+0000 7f83c1a11640 1 -- 172.21.15.40:0/3295151702 shutdown_connections 2024-04-22T07:24:38.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:38.022+0000 7f83c1a11640 1 --2- 172.21.15.40:0/3295151702 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f839c06c8f0 0x7f839c06edb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:38.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:38.022+0000 7f83c1a11640 1 --2- 172.21.15.40:0/3295151702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83bc154f50 0x7f83bc148010 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:38.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:38.022+0000 7f83c1a11640 1 --2- 172.21.15.40:0/3295151702 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f83bc0d0ad0 0x7f83bc1e5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:38.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:38.022+0000 7f83c1a11640 1 --2- 172.21.15.40:0/3295151702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83bc0cc5a0 0x7f83bc0cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:38.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:38.022+0000 7f83c1a11640 1 -- 172.21.15.40:0/3295151702 >> 172.21.15.40:0/3295151702 conn(0x7f83bc0676b0 msgr2=0x7f83bc0c6310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:38.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:38.022+0000 7f83c1a11640 1 -- 172.21.15.40:0/3295151702 shutdown_connections 2024-04-22T07:24:38.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:38.022+0000 7f83c1a11640 1 -- 172.21.15.40:0/3295151702 wait complete. 2024-04-22T07:24:39.032 INFO:tasks.ceph:Scrubbing osd.0 2024-04-22T07:24:39.032 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-22T07:24:39.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.152+0000 7fc8f48eb640 1 Processor -- start 2024-04-22T07:24:39.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.152+0000 7fc8f48eb640 1 -- start start 2024-04-22T07:24:39.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.153+0000 7fc8f48eb640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc8f00c57c0 0x7fc8f00c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:39.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.153+0000 7fc8f48eb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc8f015b8e0 0x7fc8f00ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:39.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.153+0000 7fc8f48eb640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8f00cb5f0 con 0x7fc8f0154fb0 2024-04-22T07:24:39.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.153+0000 7fc8f48eb640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fc8f00cb8d0 con 0x7fc8f015b8e0 2024-04-22T07:24:39.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.153+0000 7fc8f48eb640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fc8f015ae00 con 0x7fc8f00c57c0 2024-04-22T07:24:39.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.153+0000 7fc8eed9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc8f015b8e0 0x7fc8f00ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:39.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.153+0000 7fc8eed9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc8f015b8e0 0x7fc8f00ccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53544/0 (socket says 172.21.15.40:53544) 2024-04-22T07:24:39.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.153+0000 7fc8eed9d640 1 -- 172.21.15.40:0/4024220928 learned_addr learned my addr 172.21.15.40:0/4024220928 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:39.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.153+0000 7fc8e7fff640 1 --2- 172.21.15.40:0/4024220928 >> v2:172.21.15.62:3300/0 conn(0x7fc8f00c57c0 0x7fc8f00c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:39.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.153+0000 7fc8eed9d640 1 -- 172.21.15.40:0/4024220928 >> v2:172.21.15.62:3300/0 conn(0x7fc8f00c57c0 msgr2=0x7fc8f00c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:39.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.153+0000 7fc8eed9d640 1 --2- 172.21.15.40:0/4024220928 >> v2:172.21.15.62:3300/0 conn(0x7fc8f00c57c0 0x7fc8f00c5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.153+0000 7fc8eed9d640 1 -- 172.21.15.40:0/4024220928 >> v1:172.21.15.62:6789/0 conn(0x7fc8f0154fb0 legacy=0x7fc8f015ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:39.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.153+0000 7fc8eed9d640 1 -- 172.21.15.40:0/4024220928 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f015b0e0 con 0x7fc8f015b8e0 2024-04-22T07:24:39.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.154+0000 7fc8eed9d640 1 --2- 172.21.15.40:0/4024220928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8f015b8e0 0x7fc8f00ccf70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc8f006c820 tx=0x7fc8e802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1224bcde0b454b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:39.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.154+0000 7fc8edd9b640 1 -- 172.21.15.40:0/4024220928 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e802c9f0 con 0x7fc8f015b8e0 2024-04-22T07:24:39.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.154+0000 7fc8edd9b640 1 -- 172.21.15.40:0/4024220928 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8e802cb90 con 0x7fc8f015b8e0 2024-04-22T07:24:39.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.154+0000 7fc8edd9b640 1 -- 172.21.15.40:0/4024220928 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e80343f0 con 0x7fc8f015b8e0 2024-04-22T07:24:39.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.155+0000 7fc8f48eb640 1 -- 172.21.15.40:0/4024220928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8f015b8e0 msgr2=0x7fc8f00ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:39.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.155+0000 7fc8f48eb640 1 --2- 172.21.15.40:0/4024220928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8f015b8e0 0x7fc8f00ccf70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc8f006c820 tx=0x7fc8e802be50 comp rx=0 tx=0).stop 2024-04-22T07:24:39.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.155+0000 7fc8f48eb640 1 -- 172.21.15.40:0/4024220928 shutdown_connections 2024-04-22T07:24:39.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.155+0000 7fc8f48eb640 1 --2- 172.21.15.40:0/4024220928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8f015b8e0 0x7fc8f00ccf70 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.155+0000 7fc8f48eb640 1 --2- 172.21.15.40:0/4024220928 >> v2:172.21.15.62:3300/0 conn(0x7fc8f00c57c0 0x7fc8f00c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.155+0000 7fc8f48eb640 1 -- 172.21.15.40:0/4024220928 >> 172.21.15.40:0/4024220928 conn(0x7fc8f0067ed0 msgr2=0x7fc8f006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:39.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.155+0000 7fc8f48eb640 1 -- 172.21.15.40:0/4024220928 shutdown_connections 2024-04-22T07:24:39.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.155+0000 7fc8f48eb640 1 -- 172.21.15.40:0/4024220928 wait complete. 2024-04-22T07:24:39.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.156+0000 7fc8f48eb640 1 Processor -- start 2024-04-22T07:24:39.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.156+0000 7fc8f48eb640 1 -- start start 2024-04-22T07:24:39.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.157+0000 7fc8f48eb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8f00c57c0 0x7fc8f01f1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:39.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.157+0000 7fc8f48eb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8f0154fb0 0x7fc8f014e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:39.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.157+0000 7fc8f48eb640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc8f015b8e0 0x7fc8f014eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:39.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.157+0000 7fc8f48eb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f00cca50 con 0x7fc8f0154fb0 2024-04-22T07:24:39.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.157+0000 7fc8f48eb640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f00cbbb0 con 0x7fc8f00c57c0 2024-04-22T07:24:39.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.157+0000 7fc8f48eb640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc8f00ccbd0 con 0x7fc8f015b8e0 2024-04-22T07:24:39.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.157+0000 7fc8e7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8f0154fb0 0x7fc8f014e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:39.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.157+0000 7fc8e7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8f0154fb0 0x7fc8f014e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53548/0 (socket says 172.21.15.40:53548) 2024-04-22T07:24:39.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.157+0000 7fc8e7fff640 1 -- 172.21.15.40:0/3331511173 learned_addr learned my addr 172.21.15.40:0/3331511173 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:39.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.157+0000 7fc8ee59c640 1 --2- 172.21.15.40:0/3331511173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8f00c57c0 0x7fc8f01f1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:39.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.157+0000 7fc8eed9d640 1 --2- 172.21.15.40:0/3331511173 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc8f015b8e0 0x7fc8f014eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:39.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.157+0000 7fc8e7fff640 1 -- 172.21.15.40:0/3331511173 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc8f015b8e0 msgr2=0x7fc8f014eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:39.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.158+0000 7fc8e7fff640 1 --2- 172.21.15.40:0/3331511173 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc8f015b8e0 0x7fc8f014eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.158+0000 7fc8e7fff640 1 -- 172.21.15.40:0/3331511173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8f00c57c0 msgr2=0x7fc8f01f1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:39.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.158+0000 7fc8e7fff640 1 --2- 172.21.15.40:0/3331511173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8f00c57c0 0x7fc8f01f1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.158+0000 7fc8e7fff640 1 -- 172.21.15.40:0/3331511173 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f00cf5f0 con 0x7fc8f0154fb0 2024-04-22T07:24:39.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.158+0000 7fc8e7fff640 1 --2- 172.21.15.40:0/3331511173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8f0154fb0 0x7fc8f014e990 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc8d800e8a0 tx=0x7fc8d800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:39.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.158+0000 7fc8e6ffd640 1 -- 172.21.15.40:0/3331511173 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8017070 con 0x7fc8f0154fb0 2024-04-22T07:24:39.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.158+0000 7fc8e6ffd640 1 -- 172.21.15.40:0/3331511173 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8d800c940 con 0x7fc8f0154fb0 2024-04-22T07:24:39.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.158+0000 7fc8e6ffd640 1 -- 172.21.15.40:0/3331511173 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d800cd30 con 0x7fc8f0154fb0 2024-04-22T07:24:39.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.158+0000 7fc8f48eb640 1 -- 172.21.15.40:0/3331511173 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8f01ef630 con 0x7fc8f0154fb0 2024-04-22T07:24:39.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.158+0000 7fc8f48eb640 1 -- 172.21.15.40:0/3331511173 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8f01efbf0 con 0x7fc8f0154fb0 2024-04-22T07:24:39.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.159+0000 7fc8f48eb640 1 -- 172.21.15.40:0/3331511173 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc8f004fdc0 con 0x7fc8f0154fb0 2024-04-22T07:24:39.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.160+0000 7fc8e6ffd640 1 -- 172.21.15.40:0/3331511173 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc8d801a070 con 0x7fc8f0154fb0 2024-04-22T07:24:39.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.160+0000 7fc8e6ffd640 1 --2- 172.21.15.40:0/3331511173 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc8d006c8f0 0x7fc8d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:39.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.160+0000 7fc8e6ffd640 1 -- 172.21.15.40:0/3331511173 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fc8d808c060 con 0x7fc8f0154fb0 2024-04-22T07:24:39.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.160+0000 7fc8ee59c640 1 --2- 172.21.15.40:0/3331511173 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc8d006c8f0 0x7fc8d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:39.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.160+0000 7fc8e6ffd640 1 --2- 172.21.15.40:0/3331511173 >> [v2:172.21.15.40:6800/1526385055,v1:172.21.15.40:6801/1526385055] conn(0x7fc8d0074b50 0x7fc8d0076f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:39.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.160+0000 7fc8e6ffd640 1 -- 172.21.15.40:0/3331511173 --> [v2:172.21.15.40:6800/1526385055,v1:172.21.15.40:6801/1526385055] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc8d0077640 con 0x7fc8d0074b50 2024-04-22T07:24:39.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.160+0000 7fc8e6ffd640 1 -- 172.21.15.40:0/3331511173 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc8d808c4f0 con 0x7fc8f0154fb0 2024-04-22T07:24:39.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.160+0000 7fc8eed9d640 1 --2- 172.21.15.40:0/3331511173 >> [v2:172.21.15.40:6800/1526385055,v1:172.21.15.40:6801/1526385055] conn(0x7fc8d0074b50 0x7fc8d0076f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:39.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.161+0000 7fc8ee59c640 1 --2- 172.21.15.40:0/3331511173 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc8d006c8f0 0x7fc8d006edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc8e00016e0 tx=0x7fc8e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:39.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.161+0000 7fc8eed9d640 1 --2- 172.21.15.40:0/3331511173 >> [v2:172.21.15.40:6800/1526385055,v1:172.21.15.40:6801/1526385055] conn(0x7fc8d0074b50 0x7fc8d0076f70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:39.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.162+0000 7fc8e6ffd640 1 -- 172.21.15.40:0/3331511173 <== osd.0 v2:172.21.15.40:6800/1526385055 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc8d0077640 con 0x7fc8d0074b50 2024-04-22T07:24:39.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.175+0000 7fc8f48eb640 1 -- 172.21.15.40:0/3331511173 --> [v2:172.21.15.40:6800/1526385055,v1:172.21.15.40:6801/1526385055] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc8f00cc0b0 con 0x7fc8d0074b50 2024-04-22T07:24:39.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.175+0000 7fc8e6ffd640 1 -- 172.21.15.40:0/3331511173 <== osd.0 v2:172.21.15.40:6800/1526385055 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc8f00cc0b0 con 0x7fc8d0074b50 2024-04-22T07:24:39.173 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-22T07:24:39.173 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T07:24:39.173 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-22T07:24:39.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.175+0000 7fc8f48eb640 1 -- 172.21.15.40:0/3331511173 >> [v2:172.21.15.40:6800/1526385055,v1:172.21.15.40:6801/1526385055] conn(0x7fc8d0074b50 msgr2=0x7fc8d0076f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:39.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.175+0000 7fc8f48eb640 1 --2- 172.21.15.40:0/3331511173 >> [v2:172.21.15.40:6800/1526385055,v1:172.21.15.40:6801/1526385055] conn(0x7fc8d0074b50 0x7fc8d0076f70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.176+0000 7fc8f48eb640 1 -- 172.21.15.40:0/3331511173 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc8d006c8f0 msgr2=0x7fc8d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:39.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.176+0000 7fc8f48eb640 1 --2- 172.21.15.40:0/3331511173 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc8d006c8f0 0x7fc8d006edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc8e00016e0 tx=0x7fc8e0009040 comp rx=0 tx=0).stop 2024-04-22T07:24:39.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.176+0000 7fc8f48eb640 1 -- 172.21.15.40:0/3331511173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8f0154fb0 msgr2=0x7fc8f014e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:39.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.176+0000 7fc8f48eb640 1 --2- 172.21.15.40:0/3331511173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8f0154fb0 0x7fc8f014e990 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc8d800e8a0 tx=0x7fc8d800ed60 comp rx=0 tx=0).stop 2024-04-22T07:24:39.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.176+0000 7fc8eed9d640 1 -- 172.21.15.40:0/3331511173 reap_dead start 2024-04-22T07:24:39.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.176+0000 7fc8f48eb640 1 -- 172.21.15.40:0/3331511173 shutdown_connections 2024-04-22T07:24:39.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.176+0000 7fc8f48eb640 1 -- 172.21.15.40:0/3331511173 >> 172.21.15.40:0/3331511173 conn(0x7fc8f0067ed0 msgr2=0x7fc8f0159330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:39.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.176+0000 7fc8f48eb640 1 -- 172.21.15.40:0/3331511173 shutdown_connections 2024-04-22T07:24:39.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.176+0000 7fc8f48eb640 1 -- 172.21.15.40:0/3331511173 wait complete. 2024-04-22T07:24:39.184 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-22T07:24:39.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.288+0000 7fe043fb6640 1 Processor -- start 2024-04-22T07:24:39.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.289+0000 7fe043fb6640 1 -- start start 2024-04-22T07:24:39.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.289+0000 7fe043fb6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe03c155130 0x7fe03c0cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:39.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.289+0000 7fe043fb6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe03c0cbe20 0x7fe03c0cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:39.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.289+0000 7fe043fb6640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe03c15b1b0 con 0x7fe03c15f0c0 2024-04-22T07:24:39.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.289+0000 7fe043fb6640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fe03c15b490 con 0x7fe03c155130 2024-04-22T07:24:39.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.289+0000 7fe043fb6640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fe03c15b770 con 0x7fe03c0cbe20 2024-04-22T07:24:39.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.289+0000 7fe041d52640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe03c155130 0x7fe03c0cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:39.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.289+0000 7fe041551640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe03c15f0c0 0x7fe03c0cb710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41298/0 (socket says 172.21.15.40:41298) 2024-04-22T07:24:39.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.290+0000 7fe041551640 1 -- 172.21.15.40:0/329415040 learned_addr learned my addr 172.21.15.40:0/329415040 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:24:39.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.290+0000 7fe042553640 1 --2- 172.21.15.40:0/329415040 >> v2:172.21.15.62:3300/0 conn(0x7fe03c0cbe20 0x7fe03c0cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:39.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.290+0000 7fe041d52640 1 -- 172.21.15.40:0/329415040 >> v2:172.21.15.62:3300/0 conn(0x7fe03c0cbe20 msgr2=0x7fe03c0cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:39.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.290+0000 7fe041d52640 1 --2- 172.21.15.40:0/329415040 >> v2:172.21.15.62:3300/0 conn(0x7fe03c0cbe20 0x7fe03c0cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.290+0000 7fe041d52640 1 -- 172.21.15.40:0/329415040 >> v1:172.21.15.40:6789/0 conn(0x7fe03c15f0c0 legacy=0x7fe03c0cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:39.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.290+0000 7fe041d52640 1 -- 172.21.15.40:0/329415040 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe03c15ba50 con 0x7fe03c155130 2024-04-22T07:24:39.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.290+0000 7fe040d50640 1 -- 172.21.15.40:0/329415040 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1322646503 0 0) 0x7fe03c15b1b0 con 0x7fe03c15f0c0 2024-04-22T07:24:39.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.291+0000 7fe041d52640 1 --2- 172.21.15.40:0/329415040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe03c155130 0x7fe03c0cd130 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe03c158a90 tx=0x7fe03802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822ad5d28bced769 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:39.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.291+0000 7fe040d50640 1 -- 172.21.15.40:0/329415040 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe038034070 con 0x7fe03c155130 2024-04-22T07:24:39.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.291+0000 7fe040d50640 1 -- 172.21.15.40:0/329415040 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe038030610 con 0x7fe03c155130 2024-04-22T07:24:39.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.291+0000 7fe040d50640 1 -- 172.21.15.40:0/329415040 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0380309e0 con 0x7fe03c155130 2024-04-22T07:24:39.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.291+0000 7fe043fb6640 1 -- 172.21.15.40:0/329415040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe03c155130 msgr2=0x7fe03c0cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:39.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.291+0000 7fe043fb6640 1 --2- 172.21.15.40:0/329415040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe03c155130 0x7fe03c0cd130 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe03c158a90 tx=0x7fe03802b960 comp rx=0 tx=0).stop 2024-04-22T07:24:39.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.291+0000 7fe043fb6640 1 -- 172.21.15.40:0/329415040 shutdown_connections 2024-04-22T07:24:39.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.291+0000 7fe043fb6640 1 --2- 172.21.15.40:0/329415040 >> v2:172.21.15.62:3300/0 conn(0x7fe03c0cbe20 0x7fe03c0cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.291+0000 7fe043fb6640 1 --2- 172.21.15.40:0/329415040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe03c155130 0x7fe03c0cd130 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.291+0000 7fe043fb6640 1 -- 172.21.15.40:0/329415040 >> 172.21.15.40:0/329415040 conn(0x7fe03c067890 msgr2=0x7fe03c072860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:39.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.291+0000 7fe043fb6640 1 -- 172.21.15.40:0/329415040 shutdown_connections 2024-04-22T07:24:39.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.291+0000 7fe043fb6640 1 -- 172.21.15.40:0/329415040 wait complete. 2024-04-22T07:24:39.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.292+0000 7fe043fb6640 1 Processor -- start 2024-04-22T07:24:39.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.292+0000 7fe043fb6640 1 -- start start 2024-04-22T07:24:39.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.293+0000 7fe043fb6640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe03c0cbe20 0x7fe03c15e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:39.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.293+0000 7fe043fb6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe03c155130 0x7fe03c14b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:39.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.293+0000 7fe043fb6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe03c15f0c0 0x7fe03c14b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:39.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.293+0000 7fe043fb6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe03c0b4bc0 con 0x7fe03c15f0c0 2024-04-22T07:24:39.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.293+0000 7fe043fb6640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe03c155510 con 0x7fe03c155130 2024-04-22T07:24:39.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.293+0000 7fe043fb6640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe03c0b4d40 con 0x7fe03c0cbe20 2024-04-22T07:24:39.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.293+0000 7fe042553640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe03c15f0c0 0x7fe03c14b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:39.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.293+0000 7fe042553640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe03c15f0c0 0x7fe03c14b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53576/0 (socket says 172.21.15.40:53576) 2024-04-22T07:24:39.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.293+0000 7fe042553640 1 -- 172.21.15.40:0/4035200245 learned_addr learned my addr 172.21.15.40:0/4035200245 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:39.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.293+0000 7fe041d52640 1 --2- 172.21.15.40:0/4035200245 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe03c0cbe20 0x7fe03c15e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:39.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.293+0000 7fe041551640 1 --2- 172.21.15.40:0/4035200245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe03c155130 0x7fe03c14b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:39.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.294+0000 7fe042553640 1 -- 172.21.15.40:0/4035200245 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe03c0cbe20 msgr2=0x7fe03c15e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:39.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.294+0000 7fe042553640 1 --2- 172.21.15.40:0/4035200245 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe03c0cbe20 0x7fe03c15e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.294+0000 7fe042553640 1 -- 172.21.15.40:0/4035200245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe03c155130 msgr2=0x7fe03c14b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:39.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.294+0000 7fe042553640 1 --2- 172.21.15.40:0/4035200245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe03c155130 0x7fe03c14b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.294+0000 7fe042553640 1 -- 172.21.15.40:0/4035200245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe03c1f0c20 con 0x7fe03c15f0c0 2024-04-22T07:24:39.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.294+0000 7fe041551640 1 --2- 172.21.15.40:0/4035200245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe03c155130 0x7fe03c14b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:24:39.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.294+0000 7fe042553640 1 --2- 172.21.15.40:0/4035200245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe03c15f0c0 0x7fe03c14b5a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe03400efc0 tx=0x7fe03400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:39.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.294+0000 7fe0327fc640 1 -- 172.21.15.40:0/4035200245 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe034018020 con 0x7fe03c15f0c0 2024-04-22T07:24:39.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.294+0000 7fe0327fc640 1 -- 172.21.15.40:0/4035200245 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe034014480 con 0x7fe03c15f0c0 2024-04-22T07:24:39.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.294+0000 7fe043fb6640 1 -- 172.21.15.40:0/4035200245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe03c1f0f00 con 0x7fe03c15f0c0 2024-04-22T07:24:39.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.294+0000 7fe0327fc640 1 -- 172.21.15.40:0/4035200245 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe034014870 con 0x7fe03c15f0c0 2024-04-22T07:24:39.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.294+0000 7fe043fb6640 1 -- 172.21.15.40:0/4035200245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe03c1f14c0 con 0x7fe03c15f0c0 2024-04-22T07:24:39.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.295+0000 7fe043fb6640 1 -- 172.21.15.40:0/4035200245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe03c159e70 con 0x7fe03c15f0c0 2024-04-22T07:24:39.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.296+0000 7fe0327fc640 1 -- 172.21.15.40:0/4035200245 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe034005d10 con 0x7fe03c15f0c0 2024-04-22T07:24:39.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.296+0000 7fe0327fc640 1 --2- 172.21.15.40:0/4035200245 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe02006c8f0 0x7fe02006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:39.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.296+0000 7fe0327fc640 1 -- 172.21.15.40:0/4035200245 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fe03408c8c0 con 0x7fe03c15f0c0 2024-04-22T07:24:39.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.296+0000 7fe041d52640 1 --2- 172.21.15.40:0/4035200245 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe02006c8f0 0x7fe02006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:39.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.296+0000 7fe041d52640 1 --2- 172.21.15.40:0/4035200245 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe02006c8f0 0x7fe02006edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe038036000 tx=0x7fe03803b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:39.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.300+0000 7fe0327fc640 1 -- 172.21.15.40:0/4035200245 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe03c159e70 con 0x7fe03c15f0c0 2024-04-22T07:24:39.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.488+0000 7fe043fb6640 1 -- 172.21.15.40:0/4035200245 --> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fe03c069d40 con 0x7fe02006c8f0 2024-04-22T07:24:39.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.489+0000 7fe0327fc640 1 -- 172.21.15.40:0/4035200245 <== mgr.4107 v2:172.21.15.40:6832/91163869 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe03c069d40 con 0x7fe02006c8f0 2024-04-22T07:24:39.487 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 0 to deep-scrub 2024-04-22T07:24:39.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.491+0000 7fe043fb6640 1 -- 172.21.15.40:0/4035200245 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe02006c8f0 msgr2=0x7fe02006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:39.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.491+0000 7fe043fb6640 1 --2- 172.21.15.40:0/4035200245 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe02006c8f0 0x7fe02006edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe038036000 tx=0x7fe03803b040 comp rx=0 tx=0).stop 2024-04-22T07:24:39.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.491+0000 7fe043fb6640 1 -- 172.21.15.40:0/4035200245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe03c15f0c0 msgr2=0x7fe03c14b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:39.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.491+0000 7fe043fb6640 1 --2- 172.21.15.40:0/4035200245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe03c15f0c0 0x7fe03c14b5a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe03400efc0 tx=0x7fe03400c490 comp rx=0 tx=0).stop 2024-04-22T07:24:39.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.491+0000 7fe043fb6640 1 -- 172.21.15.40:0/4035200245 shutdown_connections 2024-04-22T07:24:39.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.491+0000 7fe043fb6640 1 --2- 172.21.15.40:0/4035200245 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fe02006c8f0 0x7fe02006edb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.491+0000 7fe043fb6640 1 --2- 172.21.15.40:0/4035200245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe03c15f0c0 0x7fe03c14b5a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.491+0000 7fe043fb6640 1 --2- 172.21.15.40:0/4035200245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe03c155130 0x7fe03c14b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.491+0000 7fe043fb6640 1 --2- 172.21.15.40:0/4035200245 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe03c0cbe20 0x7fe03c15e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.491+0000 7fe043fb6640 1 -- 172.21.15.40:0/4035200245 >> 172.21.15.40:0/4035200245 conn(0x7fe03c067890 msgr2=0x7fe03c0b60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:39.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.491+0000 7fe043fb6640 1 -- 172.21.15.40:0/4035200245 shutdown_connections 2024-04-22T07:24:39.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.491+0000 7fe043fb6640 1 -- 172.21.15.40:0/4035200245 wait complete. 2024-04-22T07:24:39.500 INFO:tasks.ceph:Scrubbing osd.1 2024-04-22T07:24:39.501 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-22T07:24:39.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.608+0000 7f4184359640 1 Processor -- start 2024-04-22T07:24:39.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.608+0000 7f4184359640 1 -- start start 2024-04-22T07:24:39.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.609+0000 7f4184359640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f417c1584d0 0x7f417c0c5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:39.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.609+0000 7f4184359640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f417c0c3ed0 con 0x7f417c151cb0 2024-04-22T07:24:39.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.609+0000 7f4184359640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f417c06ec30 con 0x7f417c0c5990 2024-04-22T07:24:39.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.609+0000 7f4184359640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f417c06ef10 con 0x7f417c1584d0 2024-04-22T07:24:39.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.609+0000 7f41820f5640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f417c151cb0 0x7f417c0c3720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41312/0 (socket says 172.21.15.40:41312) 2024-04-22T07:24:39.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.609+0000 7f41820f5640 1 -- 172.21.15.40:0/3077855679 learned_addr learned my addr 172.21.15.40:0/3077855679 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:24:39.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.609+0000 7f41818f4640 1 --2- 172.21.15.40:0/3077855679 >> v2:172.21.15.62:3300/0 conn(0x7f417c1584d0 0x7f417c0c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:39.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.609+0000 7f41810f3640 1 -- 172.21.15.40:0/3077855679 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3128881281 0 0) 0x7f417c0c3ed0 con 0x7f417c151cb0 2024-04-22T07:24:39.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.609+0000 7f41810f3640 1 -- 172.21.15.40:0/3077855679 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4164003520 con 0x7f417c151cb0 2024-04-22T07:24:39.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.610+0000 7f41818f4640 1 -- 172.21.15.40:0/3077855679 >> v1:172.21.15.62:6789/0 conn(0x7f417c0c5990 legacy=0x7f417c0c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:39.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.610+0000 7f41810f3640 1 -- 172.21.15.40:0/3077855679 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 71918858 0 0) 0x7f417c06ec30 con 0x7f417c0c5990 2024-04-22T07:24:39.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.610+0000 7f41818f4640 1 -- 172.21.15.40:0/3077855679 >> v1:172.21.15.40:6789/0 conn(0x7f417c151cb0 legacy=0x7f417c0c3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:39.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.610+0000 7f41818f4640 1 -- 172.21.15.40:0/3077855679 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417c06f1f0 con 0x7f417c1584d0 2024-04-22T07:24:39.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.610+0000 7f41818f4640 1 --2- 172.21.15.40:0/3077855679 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f417c1584d0 0x7f417c0c5450 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f41700097a0 tx=0x7f417002b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9aa868e0e25bde39 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:39.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.611+0000 7f41810f3640 1 -- 172.21.15.40:0/3077855679 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417002f810 con 0x7f417c1584d0 2024-04-22T07:24:39.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.611+0000 7f41810f3640 1 -- 172.21.15.40:0/3077855679 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417002f9b0 con 0x7f417c1584d0 2024-04-22T07:24:39.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.611+0000 7f41810f3640 1 -- 172.21.15.40:0/3077855679 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417002fd80 con 0x7f417c1584d0 2024-04-22T07:24:39.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.611+0000 7f4184359640 1 -- 172.21.15.40:0/3077855679 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f417c1584d0 msgr2=0x7f417c0c5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:39.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.611+0000 7f4184359640 1 --2- 172.21.15.40:0/3077855679 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f417c1584d0 0x7f417c0c5450 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f41700097a0 tx=0x7f417002b9f0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.611+0000 7f4184359640 1 -- 172.21.15.40:0/3077855679 shutdown_connections 2024-04-22T07:24:39.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.611+0000 7f4184359640 1 --2- 172.21.15.40:0/3077855679 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f417c1584d0 0x7f417c0c5450 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.611+0000 7f4184359640 1 -- 172.21.15.40:0/3077855679 >> 172.21.15.40:0/3077855679 conn(0x7f417c0cc220 msgr2=0x7f417c0cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:39.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.611+0000 7f4184359640 1 -- 172.21.15.40:0/3077855679 shutdown_connections 2024-04-22T07:24:39.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.611+0000 7f4184359640 1 -- 172.21.15.40:0/3077855679 wait complete. 2024-04-22T07:24:39.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.612+0000 7f4184359640 1 Processor -- start 2024-04-22T07:24:39.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.612+0000 7f4184359640 1 -- start start 2024-04-22T07:24:39.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.613+0000 7f4184359640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f417c0c5990 0x7f417c1f2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:39.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.613+0000 7f4184359640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f417c151cb0 0x7f417c0ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:39.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.613+0000 7f4184359640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f417c1584d0 0x7f417c145420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:39.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.613+0000 7f4184359640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f417c158940 con 0x7f417c1584d0 2024-04-22T07:24:39.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.613+0000 7f4184359640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f417c06f7b0 con 0x7f417c0c5990 2024-04-22T07:24:39.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.613+0000 7f4184359640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f417c06ff50 con 0x7f417c151cb0 2024-04-22T07:24:39.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.613+0000 7f41828f6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f417c1584d0 0x7f417c145420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:39.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.613+0000 7f41820f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f417c0c5990 0x7f417c1f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:39.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.613+0000 7f41820f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f417c0c5990 0x7f417c1f2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.40:45708/0 (socket says 172.21.15.40:45708) 2024-04-22T07:24:39.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.613+0000 7f41820f5640 1 -- 172.21.15.40:0/1575805891 learned_addr learned my addr 172.21.15.40:0/1575805891 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:39.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.613+0000 7f41818f4640 1 --2- 172.21.15.40:0/1575805891 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f417c151cb0 0x7f417c0ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:39.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.614+0000 7f41828f6640 1 -- 172.21.15.40:0/1575805891 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f417c151cb0 msgr2=0x7f417c0ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:39.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.614+0000 7f41828f6640 1 --2- 172.21.15.40:0/1575805891 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f417c151cb0 0x7f417c0ca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.614+0000 7f41828f6640 1 -- 172.21.15.40:0/1575805891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f417c0c5990 msgr2=0x7f417c1f2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:39.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.614+0000 7f41828f6640 1 --2- 172.21.15.40:0/1575805891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f417c0c5990 0x7f417c1f2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.614+0000 7f41828f6640 1 -- 172.21.15.40:0/1575805891 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417c1480c0 con 0x7f417c1584d0 2024-04-22T07:24:39.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.614+0000 7f41828f6640 1 --2- 172.21.15.40:0/1575805891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f417c1584d0 0x7f417c145420 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f416c00c7b0 tx=0x7f416c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:39.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.614+0000 7f417affd640 1 -- 172.21.15.40:0/1575805891 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c017070 con 0x7f417c1584d0 2024-04-22T07:24:39.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.614+0000 7f417affd640 1 -- 172.21.15.40:0/1575805891 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f416c003b70 con 0x7f417c1584d0 2024-04-22T07:24:39.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.614+0000 7f4184359640 1 -- 172.21.15.40:0/1575805891 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f417c1eed50 con 0x7f417c1584d0 2024-04-22T07:24:39.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.614+0000 7f417affd640 1 -- 172.21.15.40:0/1575805891 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416c005070 con 0x7f417c1584d0 2024-04-22T07:24:39.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.614+0000 7f4184359640 1 -- 172.21.15.40:0/1575805891 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f417c1ef310 con 0x7f417c1584d0 2024-04-22T07:24:39.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.615+0000 7f4184359640 1 -- 172.21.15.40:0/1575805891 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f417c0695d0 con 0x7f417c1584d0 2024-04-22T07:24:39.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.616+0000 7f417affd640 1 -- 172.21.15.40:0/1575805891 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f416c01a070 con 0x7f417c1584d0 2024-04-22T07:24:39.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.616+0000 7f417affd640 1 --2- 172.21.15.40:0/1575805891 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f416806c8f0 0x7f416806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:39.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.616+0000 7f417affd640 1 -- 172.21.15.40:0/1575805891 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f416c08b8c0 con 0x7f417c1584d0 2024-04-22T07:24:39.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.616+0000 7f41820f5640 1 --2- 172.21.15.40:0/1575805891 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f416806c8f0 0x7f416806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:39.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.616+0000 7f417affd640 1 --2- 172.21.15.40:0/1575805891 >> [v2:172.21.15.40:6808/623026645,v1:172.21.15.40:6809/623026645] conn(0x7f4168074b50 0x7f4168076f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:39.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.616+0000 7f417affd640 1 -- 172.21.15.40:0/1575805891 --> [v2:172.21.15.40:6808/623026645,v1:172.21.15.40:6809/623026645] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4168077640 con 0x7f4168074b50 2024-04-22T07:24:39.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.616+0000 7f417affd640 1 -- 172.21.15.40:0/1575805891 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f416c08bd50 con 0x7f417c1584d0 2024-04-22T07:24:39.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.616+0000 7f41818f4640 1 --2- 172.21.15.40:0/1575805891 >> [v2:172.21.15.40:6808/623026645,v1:172.21.15.40:6809/623026645] conn(0x7f4168074b50 0x7f4168076f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:39.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.617+0000 7f41820f5640 1 --2- 172.21.15.40:0/1575805891 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f416806c8f0 0x7f416806edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4174005880 tx=0x7f4174009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:39.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.617+0000 7f41818f4640 1 --2- 172.21.15.40:0/1575805891 >> [v2:172.21.15.40:6808/623026645,v1:172.21.15.40:6809/623026645] conn(0x7f4168074b50 0x7f4168076f70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:39.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.617+0000 7f417affd640 1 -- 172.21.15.40:0/1575805891 <== osd.1 v2:172.21.15.40:6808/623026645 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4168077640 con 0x7f4168074b50 2024-04-22T07:24:39.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.630+0000 7f4184359640 1 -- 172.21.15.40:0/1575805891 --> [v2:172.21.15.40:6808/623026645,v1:172.21.15.40:6809/623026645] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f417c071de0 con 0x7f4168074b50 2024-04-22T07:24:39.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.631+0000 7f417affd640 1 -- 172.21.15.40:0/1575805891 <== osd.1 v2:172.21.15.40:6808/623026645 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f417c071de0 con 0x7f4168074b50 2024-04-22T07:24:39.629 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-22T07:24:39.629 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T07:24:39.629 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-22T07:24:39.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.631+0000 7f4184359640 1 -- 172.21.15.40:0/1575805891 >> [v2:172.21.15.40:6808/623026645,v1:172.21.15.40:6809/623026645] conn(0x7f4168074b50 msgr2=0x7f4168076f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:39.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.631+0000 7f4184359640 1 --2- 172.21.15.40:0/1575805891 >> [v2:172.21.15.40:6808/623026645,v1:172.21.15.40:6809/623026645] conn(0x7f4168074b50 0x7f4168076f70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.631+0000 7f4184359640 1 -- 172.21.15.40:0/1575805891 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f416806c8f0 msgr2=0x7f416806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:39.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.631+0000 7f4184359640 1 --2- 172.21.15.40:0/1575805891 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f416806c8f0 0x7f416806edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4174005880 tx=0x7f4174009040 comp rx=0 tx=0).stop 2024-04-22T07:24:39.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.631+0000 7f4184359640 1 -- 172.21.15.40:0/1575805891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f417c1584d0 msgr2=0x7f417c145420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:39.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.631+0000 7f4184359640 1 --2- 172.21.15.40:0/1575805891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f417c1584d0 0x7f417c145420 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f416c00c7b0 tx=0x7f416c00cc70 comp rx=0 tx=0).stop 2024-04-22T07:24:39.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.631+0000 7f41828f6640 1 -- 172.21.15.40:0/1575805891 reap_dead start 2024-04-22T07:24:39.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.631+0000 7f4184359640 1 -- 172.21.15.40:0/1575805891 shutdown_connections 2024-04-22T07:24:39.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.631+0000 7f4184359640 1 -- 172.21.15.40:0/1575805891 >> 172.21.15.40:0/1575805891 conn(0x7f417c0cc220 msgr2=0x7f417c0cb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:39.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.631+0000 7f4184359640 1 -- 172.21.15.40:0/1575805891 shutdown_connections 2024-04-22T07:24:39.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.631+0000 7f4184359640 1 -- 172.21.15.40:0/1575805891 wait complete. 2024-04-22T07:24:39.639 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-22T07:24:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.744+0000 7fb08da81640 1 Processor -- start 2024-04-22T07:24:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.744+0000 7fb08da81640 1 -- start start 2024-04-22T07:24:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.745+0000 7fb08da81640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0881570c0 0x7fb088162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.745+0000 7fb08da81640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0880c6dd0 con 0x7fb0880c9ac0 2024-04-22T07:24:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.745+0000 7fb08da81640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0880c7040 con 0x7fb08814dbd0 2024-04-22T07:24:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.745+0000 7fb08da81640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb0880c53b0 con 0x7fb0881570c0 2024-04-22T07:24:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.745+0000 7fb086ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb0880c9ac0 0x7fb08806f2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57270/0 (socket says 172.21.15.40:57270) 2024-04-22T07:24:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.745+0000 7fb086ffd640 1 -- 172.21.15.40:0/3991467421 learned_addr learned my addr 172.21.15.40:0/3991467421 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:24:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.745+0000 7fb087fff640 1 --2- 172.21.15.40:0/3991467421 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0881570c0 0x7fb088162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.745+0000 7fb0867fc640 1 -- 172.21.15.40:0/3991467421 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2677744138 0 0) 0x7fb0880c6dd0 con 0x7fb0880c9ac0 2024-04-22T07:24:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.745+0000 7fb0867fc640 1 -- 172.21.15.40:0/3991467421 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb070003520 con 0x7fb0880c9ac0 2024-04-22T07:24:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.745+0000 7fb0867fc640 1 -- 172.21.15.40:0/3991467421 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1526580632 0 0) 0x7fb070003520 con 0x7fb0880c9ac0 2024-04-22T07:24:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.745+0000 7fb0867fc640 1 -- 172.21.15.40:0/3991467421 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0881570c0 msgr2=0x7fb088162a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.745+0000 7fb0867fc640 1 --2- 172.21.15.40:0/3991467421 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0881570c0 0x7fb088162a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.745+0000 7fb0867fc640 1 -- 172.21.15.40:0/3991467421 >> v1:172.21.15.62:6789/0 conn(0x7fb08814dbd0 legacy=0x7fb0880c4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.745+0000 7fb0867fc640 1 -- 172.21.15.40:0/3991467421 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0880c7320 con 0x7fb0880c9ac0 2024-04-22T07:24:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.745+0000 7fb0867fc640 1 -- 172.21.15.40:0/3991467421 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7fb07c001670 con 0x7fb0880c9ac0 2024-04-22T07:24:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.746+0000 7fb0867fc640 1 -- 172.21.15.40:0/3991467421 >> v1:172.21.15.40:6789/0 conn(0x7fb0880c9ac0 legacy=0x7fb08806f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.746+0000 7fb0867fc640 1 --2- 172.21.15.40:0/3991467421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0700039e0 0x7fb070003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.746+0000 7fb0867fc640 1 --2- 172.21.15.40:0/3991467421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb070004390 0x7fb070004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.746+0000 7fb0867fc640 1 --2- 172.21.15.40:0/3991467421 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0881570c0 0x7fb0700050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.746+0000 7fb0867fc640 1 -- 172.21.15.40:0/3991467421 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb0880c53b0 con 0x7fb070004390 2024-04-22T07:24:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.746+0000 7fb0867fc640 1 -- 172.21.15.40:0/3991467421 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb07000cad0 con 0x7fb0700039e0 2024-04-22T07:24:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.746+0000 7fb0867fc640 1 -- 172.21.15.40:0/3991467421 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb070005a10 con 0x7fb0881570c0 2024-04-22T07:24:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.746+0000 7fb086ffd640 1 --2- 172.21.15.40:0/3991467421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb070004390 0x7fb070004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.746+0000 7fb0877fe640 1 --2- 172.21.15.40:0/3991467421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0700039e0 0x7fb070003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.746+0000 7fb087fff640 1 --2- 172.21.15.40:0/3991467421 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0881570c0 0x7fb0700050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.746+0000 7fb086ffd640 1 -- 172.21.15.40:0/3991467421 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0881570c0 msgr2=0x7fb0700050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.746+0000 7fb086ffd640 1 --2- 172.21.15.40:0/3991467421 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0881570c0 0x7fb0700050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.746+0000 7fb086ffd640 1 -- 172.21.15.40:0/3991467421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0700039e0 msgr2=0x7fb070003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.746+0000 7fb086ffd640 1 --2- 172.21.15.40:0/3991467421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0700039e0 0x7fb070003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.746+0000 7fb086ffd640 1 -- 172.21.15.40:0/3991467421 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb070003520 con 0x7fb070004390 2024-04-22T07:24:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.747+0000 7fb086ffd640 1 --2- 172.21.15.40:0/3991467421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb070004390 0x7fb070004860 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb07c00c210 tx=0x7fb070005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ff9f9db6957808 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.747+0000 7fb0867fc640 1 -- 172.21.15.40:0/3991467421 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07c007ce0 con 0x7fb070004390 2024-04-22T07:24:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.747+0000 7fb0867fc640 1 -- 172.21.15.40:0/3991467421 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb07c030070 con 0x7fb070004390 2024-04-22T07:24:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.747+0000 7fb0867fc640 1 -- 172.21.15.40:0/3991467421 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07c005d30 con 0x7fb070004390 2024-04-22T07:24:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.747+0000 7fb08da81640 1 -- 172.21.15.40:0/3991467421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb070004390 msgr2=0x7fb070004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.747+0000 7fb08da81640 1 --2- 172.21.15.40:0/3991467421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb070004390 0x7fb070004860 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb07c00c210 tx=0x7fb070005830 comp rx=0 tx=0).stop 2024-04-22T07:24:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.747+0000 7fb087fff640 1 -- 172.21.15.40:0/3991467421 reap_dead start 2024-04-22T07:24:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.747+0000 7fb08da81640 1 -- 172.21.15.40:0/3991467421 shutdown_connections 2024-04-22T07:24:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.747+0000 7fb08da81640 1 -- 172.21.15.40:0/3991467421 >> 172.21.15.40:0/3991467421 conn(0x7fb08806de50 msgr2=0x7fb08806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.748+0000 7fb08da81640 1 -- 172.21.15.40:0/3991467421 shutdown_connections 2024-04-22T07:24:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.748+0000 7fb08da81640 1 -- 172.21.15.40:0/3991467421 wait complete. 2024-04-22T07:24:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.749+0000 7fb08da81640 1 Processor -- start 2024-04-22T07:24:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.749+0000 7fb08da81640 1 -- start start 2024-04-22T07:24:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.749+0000 7fb08da81640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb070004390 0x7fb08814c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.749+0000 7fb08da81640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0880cbaa0 0x7fb0881efd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.749+0000 7fb08da81640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0880cb2d0 0x7fb0881e04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.749+0000 7fb08da81640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb0880c78e0 con 0x7fb070004390 2024-04-22T07:24:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.750+0000 7fb08da81640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb08814dfb0 con 0x7fb0880cbaa0 2024-04-22T07:24:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.750+0000 7fb08da81640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb0880c7bc0 con 0x7fb0880cb2d0 2024-04-22T07:24:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.750+0000 7fb0877fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb070004390 0x7fb08814c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.750+0000 7fb0877fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb070004390 0x7fb08814c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44534/0 (socket says 172.21.15.40:44534) 2024-04-22T07:24:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.750+0000 7fb0877fe640 1 -- 172.21.15.40:0/3398543185 learned_addr learned my addr 172.21.15.40:0/3398543185 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.750+0000 7fb086ffd640 1 --2- 172.21.15.40:0/3398543185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0880cbaa0 0x7fb0881efd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.750+0000 7fb087fff640 1 --2- 172.21.15.40:0/3398543185 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0880cb2d0 0x7fb0881e04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.750+0000 7fb0877fe640 1 -- 172.21.15.40:0/3398543185 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0880cb2d0 msgr2=0x7fb0881e04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.750+0000 7fb0877fe640 1 --2- 172.21.15.40:0/3398543185 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0880cb2d0 0x7fb0881e04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.750+0000 7fb0877fe640 1 -- 172.21.15.40:0/3398543185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0880cbaa0 msgr2=0x7fb0881efd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:39.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.750+0000 7fb0877fe640 1 --2- 172.21.15.40:0/3398543185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0880cbaa0 0x7fb0881efd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.750+0000 7fb0877fe640 1 -- 172.21.15.40:0/3398543185 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb088159f30 con 0x7fb070004390 2024-04-22T07:24:39.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.750+0000 7fb0877fe640 1 --2- 172.21.15.40:0/3398543185 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb070004390 0x7fb08814c030 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb07800f8a0 tx=0x7fb07800fd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:39.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.750+0000 7fb06ffff640 1 -- 172.21.15.40:0/3398543185 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07801a070 con 0x7fb070004390 2024-04-22T07:24:39.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.750+0000 7fb06ffff640 1 -- 172.21.15.40:0/3398543185 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb078005320 con 0x7fb070004390 2024-04-22T07:24:39.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.750+0000 7fb08da81640 1 -- 172.21.15.40:0/3398543185 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb08815a360 con 0x7fb070004390 2024-04-22T07:24:39.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.750+0000 7fb06ffff640 1 -- 172.21.15.40:0/3398543185 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb078007290 con 0x7fb070004390 2024-04-22T07:24:39.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.750+0000 7fb08da81640 1 -- 172.21.15.40:0/3398543185 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb08815a600 con 0x7fb070004390 2024-04-22T07:24:39.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.751+0000 7fb08da81640 1 -- 172.21.15.40:0/3398543185 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb088076050 con 0x7fb070004390 2024-04-22T07:24:39.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.752+0000 7fb06ffff640 1 -- 172.21.15.40:0/3398543185 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb07801d070 con 0x7fb070004390 2024-04-22T07:24:39.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.752+0000 7fb06ffff640 1 --2- 172.21.15.40:0/3398543185 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fb07406c920 0x7fb07406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:39.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.752+0000 7fb06ffff640 1 -- 172.21.15.40:0/3398543185 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fb07808b340 con 0x7fb070004390 2024-04-22T07:24:39.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.752+0000 7fb086ffd640 1 --2- 172.21.15.40:0/3398543185 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fb07406c920 0x7fb07406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:39.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.753+0000 7fb086ffd640 1 --2- 172.21.15.40:0/3398543185 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fb07406c920 0x7fb07406ede0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb07c00c210 tx=0x7fb07c009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:39.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.757+0000 7fb06ffff640 1 -- 172.21.15.40:0/3398543185 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb088076050 con 0x7fb070004390 2024-04-22T07:24:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.941+0000 7fb08da81640 1 -- 172.21.15.40:0/3398543185 --> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fb088072a10 con 0x7fb07406c920 2024-04-22T07:24:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.941+0000 7fb06ffff640 1 -- 172.21.15.40:0/3398543185 <== mgr.4107 v2:172.21.15.40:6832/91163869 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb088072a10 con 0x7fb07406c920 2024-04-22T07:24:39.939 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 1 to deep-scrub 2024-04-22T07:24:39.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.943+0000 7fb08da81640 1 -- 172.21.15.40:0/3398543185 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fb07406c920 msgr2=0x7fb07406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:39.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.943+0000 7fb08da81640 1 --2- 172.21.15.40:0/3398543185 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fb07406c920 0x7fb07406ede0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb07c00c210 tx=0x7fb07c009030 comp rx=0 tx=0).stop 2024-04-22T07:24:39.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.943+0000 7fb08da81640 1 -- 172.21.15.40:0/3398543185 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb070004390 msgr2=0x7fb08814c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.943+0000 7fb08da81640 1 --2- 172.21.15.40:0/3398543185 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb070004390 0x7fb08814c030 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb07800f8a0 tx=0x7fb07800fd60 comp rx=0 tx=0).stop 2024-04-22T07:24:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.943+0000 7fb08da81640 1 -- 172.21.15.40:0/3398543185 shutdown_connections 2024-04-22T07:24:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.943+0000 7fb08da81640 1 --2- 172.21.15.40:0/3398543185 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb0880cb2d0 0x7fb0881e04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.943+0000 7fb08da81640 1 --2- 172.21.15.40:0/3398543185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0880cbaa0 0x7fb0881efd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.943+0000 7fb08da81640 1 --2- 172.21.15.40:0/3398543185 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fb07406c920 0x7fb07406ede0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.943+0000 7fb08da81640 1 --2- 172.21.15.40:0/3398543185 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb070004390 0x7fb08814c030 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.943+0000 7fb08da81640 1 -- 172.21.15.40:0/3398543185 >> 172.21.15.40:0/3398543185 conn(0x7fb08806de50 msgr2=0x7fb0881574d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.943+0000 7fb08da81640 1 -- 172.21.15.40:0/3398543185 shutdown_connections 2024-04-22T07:24:39.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:39.944+0000 7fb08da81640 1 -- 172.21.15.40:0/3398543185 wait complete. 2024-04-22T07:24:39.952 INFO:tasks.ceph:Scrubbing osd.2 2024-04-22T07:24:39.952 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-22T07:24:40.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.061+0000 7fbce2411640 1 Processor -- start 2024-04-22T07:24:40.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.061+0000 7fbce2411640 1 -- start start 2024-04-22T07:24:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.062+0000 7fbce2411640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbcdc0c5550 0x7fbcdc15eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.062+0000 7fbce2411640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcdc15e450 con 0x7fbcdc15adc0 2024-04-22T07:24:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.062+0000 7fbce2411640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcdc15b6f0 con 0x7fbcdc154f10 2024-04-22T07:24:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.062+0000 7fbce2411640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fbcdc15b9d0 con 0x7fbcdc0c5550 2024-04-22T07:24:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.062+0000 7fbcdb7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbcdc0c5550 0x7fbcdc15eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.062+0000 7fbcdb7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbcdc0c5550 0x7fbcdc15eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44538/0 (socket says 172.21.15.40:44538) 2024-04-22T07:24:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.062+0000 7fbcdb7fe640 1 -- 172.21.15.40:0/1804876224 learned_addr learned my addr 172.21.15.40:0/1804876224 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.062+0000 7fbce09ae640 1 --1- 172.21.15.40:0/1804876224 >> v1:172.21.15.40:6789/0 conn(0x7fbcdc15adc0 0x7fbcdc0d05c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57278/0 (socket says 172.21.15.40:57278) 2024-04-22T07:24:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.062+0000 7fbcdb7fe640 1 -- 172.21.15.40:0/1804876224 >> v1:172.21.15.62:6789/0 conn(0x7fbcdc154f10 legacy=0x7fbcdc0cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.062+0000 7fbcdb7fe640 1 -- 172.21.15.40:0/1804876224 >> v1:172.21.15.40:6789/0 conn(0x7fbcdc15adc0 legacy=0x7fbcdc0d05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.062+0000 7fbcdb7fe640 1 -- 172.21.15.40:0/1804876224 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcdc15e6c0 con 0x7fbcdc0c5550 2024-04-22T07:24:40.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.063+0000 7fbcdb7fe640 1 --2- 172.21.15.40:0/1804876224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcdc0c5550 0x7fbcdc15eec0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0009870 tx=0x7fbcd002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57bad1487519f90b server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:40.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.063+0000 7fbcdaffd640 1 -- 172.21.15.40:0/1804876224 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0034070 con 0x7fbcdc0c5550 2024-04-22T07:24:40.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.063+0000 7fbcdaffd640 1 -- 172.21.15.40:0/1804876224 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcd0030860 con 0x7fbcdc0c5550 2024-04-22T07:24:40.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.063+0000 7fbcdaffd640 1 -- 172.21.15.40:0/1804876224 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0030c30 con 0x7fbcdc0c5550 2024-04-22T07:24:40.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.063+0000 7fbce2411640 1 -- 172.21.15.40:0/1804876224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcdc0c5550 msgr2=0x7fbcdc15eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.063+0000 7fbce2411640 1 --2- 172.21.15.40:0/1804876224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcdc0c5550 0x7fbcdc15eec0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0009870 tx=0x7fbcd002b9a0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.064+0000 7fbce2411640 1 -- 172.21.15.40:0/1804876224 shutdown_connections 2024-04-22T07:24:40.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.064+0000 7fbce2411640 1 --2- 172.21.15.40:0/1804876224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcdc0c5550 0x7fbcdc15eec0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.064+0000 7fbce2411640 1 -- 172.21.15.40:0/1804876224 >> 172.21.15.40:0/1804876224 conn(0x7fbcdc0676b0 msgr2=0x7fbcdc067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:40.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.064+0000 7fbce2411640 1 -- 172.21.15.40:0/1804876224 shutdown_connections 2024-04-22T07:24:40.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.064+0000 7fbce2411640 1 -- 172.21.15.40:0/1804876224 wait complete. 2024-04-22T07:24:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.065+0000 7fbce2411640 1 Processor -- start 2024-04-22T07:24:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.065+0000 7fbce2411640 1 -- start start 2024-04-22T07:24:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.066+0000 7fbce2411640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcdc0c5550 0x7fbcdc0cf310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.066+0000 7fbce2411640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbcdc154f10 0x7fbcdc0cf850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.066+0000 7fbce2411640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcdc15adc0 0x7fbcdc157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.066+0000 7fbce2411640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc0d0e50 con 0x7fbcdc15adc0 2024-04-22T07:24:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.066+0000 7fbce2411640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc0d0cd0 con 0x7fbcdc0c5550 2024-04-22T07:24:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.066+0000 7fbce2411640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fbcdc1552f0 con 0x7fbcdc154f10 2024-04-22T07:24:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.066+0000 7fbce09ae640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcdc15adc0 0x7fbcdc157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.066+0000 7fbce09ae640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcdc15adc0 0x7fbcdc157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44542/0 (socket says 172.21.15.40:44542) 2024-04-22T07:24:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.066+0000 7fbce09ae640 1 -- 172.21.15.40:0/2532313701 learned_addr learned my addr 172.21.15.40:0/2532313701 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:40.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.066+0000 7fbcdbfff640 1 --2- 172.21.15.40:0/2532313701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcdc0c5550 0x7fbcdc0cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.066+0000 7fbcdb7fe640 1 --2- 172.21.15.40:0/2532313701 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbcdc154f10 0x7fbcdc0cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.066+0000 7fbce09ae640 1 -- 172.21.15.40:0/2532313701 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbcdc154f10 msgr2=0x7fbcdc0cf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.066+0000 7fbce09ae640 1 --2- 172.21.15.40:0/2532313701 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbcdc154f10 0x7fbcdc0cf850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.066+0000 7fbce09ae640 1 -- 172.21.15.40:0/2532313701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcdc0c5550 msgr2=0x7fbcdc0cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.066+0000 7fbce09ae640 1 --2- 172.21.15.40:0/2532313701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbcdc0c5550 0x7fbcdc0cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.066+0000 7fbce09ae640 1 -- 172.21.15.40:0/2532313701 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcdc1f1630 con 0x7fbcdc15adc0 2024-04-22T07:24:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.066+0000 7fbce09ae640 1 --2- 172.21.15.40:0/2532313701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcdc15adc0 0x7fbcdc157da0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400c730 tx=0x7fbcd400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.066+0000 7fbcd8ff9640 1 -- 172.21.15.40:0/2532313701 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4017070 con 0x7fbcdc15adc0 2024-04-22T07:24:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.066+0000 7fbcd8ff9640 1 -- 172.21.15.40:0/2532313701 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcd400ce40 con 0x7fbcdc15adc0 2024-04-22T07:24:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.066+0000 7fbcd8ff9640 1 -- 172.21.15.40:0/2532313701 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd400a840 con 0x7fbcdc15adc0 2024-04-22T07:24:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.066+0000 7fbce2411640 1 -- 172.21.15.40:0/2532313701 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcdc15c020 con 0x7fbcdc15adc0 2024-04-22T07:24:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.067+0000 7fbce2411640 1 -- 172.21.15.40:0/2532313701 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcdc15c5e0 con 0x7fbcdc15adc0 2024-04-22T07:24:40.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.067+0000 7fbce2411640 1 -- 172.21.15.40:0/2532313701 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbcdc15a8a0 con 0x7fbcdc15adc0 2024-04-22T07:24:40.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.068+0000 7fbcd8ff9640 1 -- 172.21.15.40:0/2532313701 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbcd401a070 con 0x7fbcdc15adc0 2024-04-22T07:24:40.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.068+0000 7fbcd8ff9640 1 --2- 172.21.15.40:0/2532313701 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fbcc806c8f0 0x7fbcc806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.068+0000 7fbcd8ff9640 1 -- 172.21.15.40:0/2532313701 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fbcd408aff0 con 0x7fbcdc15adc0 2024-04-22T07:24:40.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.068+0000 7fbcdbfff640 1 --2- 172.21.15.40:0/2532313701 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fbcc806c8f0 0x7fbcc806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.069+0000 7fbcd8ff9640 1 --2- 172.21.15.40:0/2532313701 >> [v2:172.21.15.40:6818/1885686505,v1:172.21.15.40:6820/1885686505] conn(0x7fbcc8074b50 0x7fbcc8076f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.069+0000 7fbcd8ff9640 1 -- 172.21.15.40:0/2532313701 --> [v2:172.21.15.40:6818/1885686505,v1:172.21.15.40:6820/1885686505] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbcc8077640 con 0x7fbcc8074b50 2024-04-22T07:24:40.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.069+0000 7fbcd8ff9640 1 -- 172.21.15.40:0/2532313701 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbcd408d610 con 0x7fbcdc15adc0 2024-04-22T07:24:40.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.069+0000 7fbcdb7fe640 1 --2- 172.21.15.40:0/2532313701 >> [v2:172.21.15.40:6818/1885686505,v1:172.21.15.40:6820/1885686505] conn(0x7fbcc8074b50 0x7fbcc8076f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.069+0000 7fbcdbfff640 1 --2- 172.21.15.40:0/2532313701 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fbcc806c8f0 0x7fbcc806edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc15e180 tx=0x7fbccc007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:40.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.069+0000 7fbcdb7fe640 1 --2- 172.21.15.40:0/2532313701 >> [v2:172.21.15.40:6818/1885686505,v1:172.21.15.40:6820/1885686505] conn(0x7fbcc8074b50 0x7fbcc8076f70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:40.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.070+0000 7fbcd8ff9640 1 -- 172.21.15.40:0/2532313701 <== osd.2 v2:172.21.15.40:6818/1885686505 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbcc8077640 con 0x7fbcc8074b50 2024-04-22T07:24:40.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.083+0000 7fbce2411640 1 -- 172.21.15.40:0/2532313701 --> [v2:172.21.15.40:6818/1885686505,v1:172.21.15.40:6820/1885686505] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbcdc15ca00 con 0x7fbcc8074b50 2024-04-22T07:24:40.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.083+0000 7fbcd8ff9640 1 -- 172.21.15.40:0/2532313701 <== osd.2 v2:172.21.15.40:6818/1885686505 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbcdc15ca00 con 0x7fbcc8074b50 2024-04-22T07:24:40.081 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-22T07:24:40.081 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T07:24:40.081 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-22T07:24:40.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.083+0000 7fbce2411640 1 -- 172.21.15.40:0/2532313701 >> [v2:172.21.15.40:6818/1885686505,v1:172.21.15.40:6820/1885686505] conn(0x7fbcc8074b50 msgr2=0x7fbcc8076f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.083+0000 7fbce2411640 1 --2- 172.21.15.40:0/2532313701 >> [v2:172.21.15.40:6818/1885686505,v1:172.21.15.40:6820/1885686505] conn(0x7fbcc8074b50 0x7fbcc8076f70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.084+0000 7fbce2411640 1 -- 172.21.15.40:0/2532313701 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fbcc806c8f0 msgr2=0x7fbcc806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.084+0000 7fbce2411640 1 --2- 172.21.15.40:0/2532313701 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fbcc806c8f0 0x7fbcc806edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc15e180 tx=0x7fbccc007e30 comp rx=0 tx=0).stop 2024-04-22T07:24:40.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.084+0000 7fbce2411640 1 -- 172.21.15.40:0/2532313701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcdc15adc0 msgr2=0x7fbcdc157da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.084+0000 7fbce2411640 1 --2- 172.21.15.40:0/2532313701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcdc15adc0 0x7fbcdc157da0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400c730 tx=0x7fbcd400cbf0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.084+0000 7fbce09ae640 1 -- 172.21.15.40:0/2532313701 reap_dead start 2024-04-22T07:24:40.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.084+0000 7fbce2411640 1 -- 172.21.15.40:0/2532313701 shutdown_connections 2024-04-22T07:24:40.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.084+0000 7fbce2411640 1 -- 172.21.15.40:0/2532313701 >> 172.21.15.40:0/2532313701 conn(0x7fbcdc0676b0 msgr2=0x7fbcdc14b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:40.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.084+0000 7fbce2411640 1 -- 172.21.15.40:0/2532313701 shutdown_connections 2024-04-22T07:24:40.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.084+0000 7fbce2411640 1 -- 172.21.15.40:0/2532313701 wait complete. 2024-04-22T07:24:40.092 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-22T07:24:40.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.196+0000 7f8324a77640 1 Processor -- start 2024-04-22T07:24:40.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.196+0000 7f8324a77640 1 -- start start 2024-04-22T07:24:40.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.197+0000 7f8324a77640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8320154ed0 0x7f832015ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.197+0000 7f8324a77640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8320072a40 0x7f8320071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.197+0000 7f8324a77640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f832015f270 con 0x7f83201552b0 2024-04-22T07:24:40.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.197+0000 7f8324a77640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f83200cafb0 con 0x7f8320072a40 2024-04-22T07:24:40.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.197+0000 7f8324a77640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f83200cb210 con 0x7f8320154ed0 2024-04-22T07:24:40.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.197+0000 7f831ed9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8320072a40 0x7f8320071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.197+0000 7f8317fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f83201552b0 0x7f83200cbf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57292/0 (socket says 172.21.15.40:57292) 2024-04-22T07:24:40.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.197+0000 7f8317fff640 1 -- 172.21.15.40:0/3615054966 learned_addr learned my addr 172.21.15.40:0/3615054966 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:24:40.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.197+0000 7f831e59c640 1 --2- 172.21.15.40:0/3615054966 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8320154ed0 0x7f832015ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.197+0000 7f831ed9d640 1 -- 172.21.15.40:0/3615054966 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8320154ed0 msgr2=0x7f832015ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:40.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.197+0000 7f831ed9d640 1 --2- 172.21.15.40:0/3615054966 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8320154ed0 0x7f832015ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.197+0000 7f831ed9d640 1 -- 172.21.15.40:0/3615054966 >> v1:172.21.15.40:6789/0 conn(0x7f83201552b0 legacy=0x7f83200cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.197+0000 7f831ed9d640 1 -- 172.21.15.40:0/3615054966 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83200c66c0 con 0x7f8320072a40 2024-04-22T07:24:40.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.197+0000 7f831dd9b640 1 -- 172.21.15.40:0/3615054966 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1629693651 0 0) 0x7f8308001110 con 0x7f83201552b0 2024-04-22T07:24:40.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.198+0000 7f831ed9d640 1 --2- 172.21.15.40:0/3615054966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8320072a40 0x7f8320071f40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8318009d90 tx=0x7f831802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb8381b0ff64e44a server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:40.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.198+0000 7f831dd9b640 1 -- 172.21.15.40:0/3615054966 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8318039070 con 0x7f8320072a40 2024-04-22T07:24:40.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.198+0000 7f831dd9b640 1 -- 172.21.15.40:0/3615054966 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f831802cce0 con 0x7f8320072a40 2024-04-22T07:24:40.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.198+0000 7f831dd9b640 1 -- 172.21.15.40:0/3615054966 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8318034660 con 0x7f8320072a40 2024-04-22T07:24:40.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.199+0000 7f8324a77640 1 -- 172.21.15.40:0/3615054966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8320072a40 msgr2=0x7f8320071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.199+0000 7f8324a77640 1 --2- 172.21.15.40:0/3615054966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8320072a40 0x7f8320071f40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8318009d90 tx=0x7f831802bf30 comp rx=0 tx=0).stop 2024-04-22T07:24:40.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.199+0000 7f8324a77640 1 -- 172.21.15.40:0/3615054966 shutdown_connections 2024-04-22T07:24:40.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.199+0000 7f8324a77640 1 --2- 172.21.15.40:0/3615054966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8320072a40 0x7f8320071f40 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.199+0000 7f8324a77640 1 --2- 172.21.15.40:0/3615054966 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8320154ed0 0x7f832015ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.199+0000 7f8324a77640 1 -- 172.21.15.40:0/3615054966 >> 172.21.15.40:0/3615054966 conn(0x7f83200736e0 msgr2=0x7f832006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:40.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.199+0000 7f8324a77640 1 -- 172.21.15.40:0/3615054966 shutdown_connections 2024-04-22T07:24:40.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.199+0000 7f8324a77640 1 -- 172.21.15.40:0/3615054966 wait complete. 2024-04-22T07:24:40.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.200+0000 7f8324a77640 1 Processor -- start 2024-04-22T07:24:40.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.200+0000 7f8324a77640 1 -- start start 2024-04-22T07:24:40.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.201+0000 7f8324a77640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8320072a40 0x7f83200b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.201+0000 7f8324a77640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8320154ed0 0x7f8320146f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.201+0000 7f8324a77640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83201552b0 0x7f8320147470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.201+0000 7f8324a77640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f83200c5900 con 0x7f8320154ed0 2024-04-22T07:24:40.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.201+0000 7f8324a77640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f83200c5620 con 0x7f83201552b0 2024-04-22T07:24:40.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.201+0000 7f8324a77640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f83200c5be0 con 0x7f8320072a40 2024-04-22T07:24:40.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.201+0000 7f8317fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8320154ed0 0x7f8320146f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.201+0000 7f8317fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8320154ed0 0x7f8320146f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44556/0 (socket says 172.21.15.40:44556) 2024-04-22T07:24:40.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.201+0000 7f8317fff640 1 -- 172.21.15.40:0/2202301057 learned_addr learned my addr 172.21.15.40:0/2202301057 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:40.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.201+0000 7f831ed9d640 1 --2- 172.21.15.40:0/2202301057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83201552b0 0x7f8320147470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.201+0000 7f831e59c640 1 --2- 172.21.15.40:0/2202301057 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8320072a40 0x7f83200b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.201+0000 7f8317fff640 1 -- 172.21.15.40:0/2202301057 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8320072a40 msgr2=0x7f83200b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.201+0000 7f8317fff640 1 --2- 172.21.15.40:0/2202301057 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8320072a40 0x7f83200b3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.201+0000 7f8317fff640 1 -- 172.21.15.40:0/2202301057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83201552b0 msgr2=0x7f8320147470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.201+0000 7f8317fff640 1 --2- 172.21.15.40:0/2202301057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83201552b0 0x7f8320147470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.201+0000 7f8317fff640 1 -- 172.21.15.40:0/2202301057 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f832015c4f0 con 0x7f8320154ed0 2024-04-22T07:24:40.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.201+0000 7f831ed9d640 1 --2- 172.21.15.40:0/2202301057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83201552b0 0x7f8320147470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:24:40.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.201+0000 7f8317fff640 1 --2- 172.21.15.40:0/2202301057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8320154ed0 0x7f8320146f30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f830800c780 tx=0x7f830800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:40.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.201+0000 7f8316ffd640 1 -- 172.21.15.40:0/2202301057 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8308018070 con 0x7f8320154ed0 2024-04-22T07:24:40.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.202+0000 7f8316ffd640 1 -- 172.21.15.40:0/2202301057 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83080072d0 con 0x7f8320154ed0 2024-04-22T07:24:40.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.202+0000 7f8324a77640 1 -- 172.21.15.40:0/2202301057 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83200cdb00 con 0x7f8320154ed0 2024-04-22T07:24:40.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.202+0000 7f8316ffd640 1 -- 172.21.15.40:0/2202301057 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83080047e0 con 0x7f8320154ed0 2024-04-22T07:24:40.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.202+0000 7f8324a77640 1 -- 172.21.15.40:0/2202301057 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f832015d2e0 con 0x7f8320154ed0 2024-04-22T07:24:40.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.203+0000 7f8324a77640 1 -- 172.21.15.40:0/2202301057 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83201524c0 con 0x7f8320154ed0 2024-04-22T07:24:40.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.203+0000 7f8316ffd640 1 -- 172.21.15.40:0/2202301057 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8308004980 con 0x7f8320154ed0 2024-04-22T07:24:40.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.203+0000 7f8316ffd640 1 --2- 172.21.15.40:0/2202301057 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f830006c920 0x7f830006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.204+0000 7f8316ffd640 1 -- 172.21.15.40:0/2202301057 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f830808adc0 con 0x7f8320154ed0 2024-04-22T07:24:40.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.204+0000 7f831e59c640 1 --2- 172.21.15.40:0/2202301057 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f830006c920 0x7f830006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.204+0000 7f831e59c640 1 --2- 172.21.15.40:0/2202301057 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f830006c920 0x7f830006ede0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8310009a30 tx=0x7f8310008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:40.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.208+0000 7f8316ffd640 1 -- 172.21.15.40:0/2202301057 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f83201524c0 con 0x7f8320154ed0 2024-04-22T07:24:40.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.393+0000 7f8324a77640 1 -- 172.21.15.40:0/2202301057 --> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f832014ade0 con 0x7f830006c920 2024-04-22T07:24:40.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.393+0000 7f8316ffd640 1 -- 172.21.15.40:0/2202301057 <== mgr.4107 v2:172.21.15.40:6832/91163869 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f832014ade0 con 0x7f830006c920 2024-04-22T07:24:40.391 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 2 to deep-scrub 2024-04-22T07:24:40.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.395+0000 7f8324a77640 1 -- 172.21.15.40:0/2202301057 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f830006c920 msgr2=0x7f830006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.395+0000 7f8324a77640 1 --2- 172.21.15.40:0/2202301057 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f830006c920 0x7f830006ede0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8310009a30 tx=0x7f8310008040 comp rx=0 tx=0).stop 2024-04-22T07:24:40.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.395+0000 7f8324a77640 1 -- 172.21.15.40:0/2202301057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8320154ed0 msgr2=0x7f8320146f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.395+0000 7f8324a77640 1 --2- 172.21.15.40:0/2202301057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8320154ed0 0x7f8320146f30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f830800c780 tx=0x7f830800cc40 comp rx=0 tx=0).stop 2024-04-22T07:24:40.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.395+0000 7f8324a77640 1 -- 172.21.15.40:0/2202301057 shutdown_connections 2024-04-22T07:24:40.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.395+0000 7f8324a77640 1 --2- 172.21.15.40:0/2202301057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83201552b0 0x7f8320147470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.395+0000 7f8324a77640 1 --2- 172.21.15.40:0/2202301057 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f830006c920 0x7f830006ede0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.395+0000 7f8324a77640 1 --2- 172.21.15.40:0/2202301057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8320154ed0 0x7f8320146f30 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.395+0000 7f8324a77640 1 --2- 172.21.15.40:0/2202301057 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8320072a40 0x7f83200b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.395+0000 7f8324a77640 1 -- 172.21.15.40:0/2202301057 >> 172.21.15.40:0/2202301057 conn(0x7f83200736e0 msgr2=0x7f8320153070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:40.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.395+0000 7f8324a77640 1 -- 172.21.15.40:0/2202301057 shutdown_connections 2024-04-22T07:24:40.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.395+0000 7f8324a77640 1 -- 172.21.15.40:0/2202301057 wait complete. 2024-04-22T07:24:40.405 INFO:tasks.ceph:Scrubbing osd.3 2024-04-22T07:24:40.405 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-22T07:24:40.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.511+0000 7f72bbb84640 1 Processor -- start 2024-04-22T07:24:40.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.511+0000 7f72bbb84640 1 -- start start 2024-04-22T07:24:40.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.512+0000 7f72bbb84640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f72b4154f10 0x7f72b40c5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.512+0000 7f72bbb84640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72b415adc0 0x7f72b40d05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.512+0000 7f72bbb84640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72b415e450 con 0x7f72b415eec0 2024-04-22T07:24:40.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.512+0000 7f72bbb84640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f72b415f310 con 0x7f72b4154f10 2024-04-22T07:24:40.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.512+0000 7f72bbb84640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f72b415b6f0 con 0x7f72b415adc0 2024-04-22T07:24:40.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.512+0000 7f72b911f640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f72b415eec0 0x7f72b40cb3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57304/0 (socket says 172.21.15.40:57304) 2024-04-22T07:24:40.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.512+0000 7f72b911f640 1 -- 172.21.15.40:0/1563427606 learned_addr learned my addr 172.21.15.40:0/1563427606 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:24:40.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.513+0000 7f72b9920640 1 --2- 172.21.15.40:0/1563427606 >> v2:172.21.15.62:3300/0 conn(0x7f72b4154f10 0x7f72b40c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.513+0000 7f72ba121640 1 --2- 172.21.15.40:0/1563427606 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72b415adc0 0x7f72b40d05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.513+0000 7f72b891e640 1 -- 172.21.15.40:0/1563427606 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1829082724 0 0) 0x7f72b415e450 con 0x7f72b415eec0 2024-04-22T07:24:40.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.513+0000 7f72b891e640 1 -- 172.21.15.40:0/1563427606 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f729c003520 con 0x7f72b415eec0 2024-04-22T07:24:40.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.513+0000 7f72b891e640 1 -- 172.21.15.40:0/1563427606 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3088936993 0 0) 0x7f729c003520 con 0x7f72b415eec0 2024-04-22T07:24:40.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.513+0000 7f72b891e640 1 -- 172.21.15.40:0/1563427606 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72b415adc0 msgr2=0x7f72b40d05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:40.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.513+0000 7f72b891e640 1 --2- 172.21.15.40:0/1563427606 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72b415adc0 0x7f72b40d05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.513+0000 7f72b891e640 1 -- 172.21.15.40:0/1563427606 >> v2:172.21.15.62:3300/0 conn(0x7f72b4154f10 msgr2=0x7f72b40c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:40.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.513+0000 7f72b891e640 1 --2- 172.21.15.40:0/1563427606 >> v2:172.21.15.62:3300/0 conn(0x7f72b4154f10 0x7f72b40c5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.513+0000 7f72b891e640 1 -- 172.21.15.40:0/1563427606 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b415b9d0 con 0x7f72b415eec0 2024-04-22T07:24:40.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.513+0000 7f72b891e640 1 -- 172.21.15.40:0/1563427606 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7f72a8001670 con 0x7f72b415eec0 2024-04-22T07:24:40.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.513+0000 7f72b891e640 1 -- 172.21.15.40:0/1563427606 >> v1:172.21.15.40:6789/0 conn(0x7f72b415eec0 legacy=0x7f72b40cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.513+0000 7f72b891e640 1 --2- 172.21.15.40:0/1563427606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f729c0039b0 0x7f729c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.513+0000 7f72b891e640 1 --2- 172.21.15.40:0/1563427606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f729c004800 0x7f729c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.513+0000 7f72b891e640 1 --2- 172.21.15.40:0/1563427606 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72b415adc0 0x7f729c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.513+0000 7f72b891e640 1 -- 172.21.15.40:0/1563427606 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f72b415f310 con 0x7f729c004800 2024-04-22T07:24:40.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.513+0000 7f72b891e640 1 -- 172.21.15.40:0/1563427606 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f72b415b6f0 con 0x7f729c0039b0 2024-04-22T07:24:40.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.513+0000 7f72b891e640 1 -- 172.21.15.40:0/1563427606 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f729c00b9c0 con 0x7f72b415adc0 2024-04-22T07:24:40.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.513+0000 7f72b911f640 1 --2- 172.21.15.40:0/1563427606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f729c004800 0x7f729c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.513+0000 7f72b9920640 1 --2- 172.21.15.40:0/1563427606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f729c0039b0 0x7f729c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.513+0000 7f72ba121640 1 --2- 172.21.15.40:0/1563427606 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72b415adc0 0x7f729c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.513+0000 7f72b911f640 1 -- 172.21.15.40:0/1563427606 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72b415adc0 msgr2=0x7f729c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:40.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.513+0000 7f72b911f640 1 --2- 172.21.15.40:0/1563427606 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72b415adc0 0x7f729c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.513+0000 7f72b911f640 1 -- 172.21.15.40:0/1563427606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f729c0039b0 msgr2=0x7f729c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:40.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.513+0000 7f72b911f640 1 --2- 172.21.15.40:0/1563427606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f729c0039b0 0x7f729c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.513+0000 7f72b911f640 1 -- 172.21.15.40:0/1563427606 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f729c003520 con 0x7f729c004800 2024-04-22T07:24:40.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.514+0000 7f72b911f640 1 --2- 172.21.15.40:0/1563427606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f729c004800 0x7f729c004c80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f72a8007fd0 tx=0x7f729c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a787d340ee792e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:40.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.514+0000 7f72b891e640 1 -- 172.21.15.40:0/1563427606 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a8007d50 con 0x7f729c004800 2024-04-22T07:24:40.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.514+0000 7f72b891e640 1 -- 172.21.15.40:0/1563427606 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a8030070 con 0x7f729c004800 2024-04-22T07:24:40.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.514+0000 7f72b891e640 1 -- 172.21.15.40:0/1563427606 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a802cd40 con 0x7f729c004800 2024-04-22T07:24:40.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.515+0000 7f72bbb84640 1 -- 172.21.15.40:0/1563427606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f729c004800 msgr2=0x7f729c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.515+0000 7f72bbb84640 1 --2- 172.21.15.40:0/1563427606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f729c004800 0x7f729c004c80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f72a8007fd0 tx=0x7f729c005830 comp rx=0 tx=0).stop 2024-04-22T07:24:40.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.515+0000 7f72ba121640 1 -- 172.21.15.40:0/1563427606 reap_dead start 2024-04-22T07:24:40.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.515+0000 7f72bbb84640 1 -- 172.21.15.40:0/1563427606 shutdown_connections 2024-04-22T07:24:40.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.515+0000 7f72bbb84640 1 -- 172.21.15.40:0/1563427606 >> 172.21.15.40:0/1563427606 conn(0x7f72b40676b0 msgr2=0x7f72b4067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:40.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.515+0000 7f72bbb84640 1 -- 172.21.15.40:0/1563427606 shutdown_connections 2024-04-22T07:24:40.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.515+0000 7f72bbb84640 1 -- 172.21.15.40:0/1563427606 wait complete. 2024-04-22T07:24:40.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.516+0000 7f72bbb84640 1 Processor -- start 2024-04-22T07:24:40.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.516+0000 7f72bbb84640 1 -- start start 2024-04-22T07:24:40.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.517+0000 7f72bbb84640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f729c004800 0x7f72b41e79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.517+0000 7f72bbb84640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72b4152840 0x7f72b41f16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.517+0000 7f72bbb84640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72b41f4d90 0x7f72b4153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.517+0000 7f72bbb84640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f72b41552f0 con 0x7f729c004800 2024-04-22T07:24:40.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.517+0000 7f72bbb84640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f72b415bcb0 con 0x7f72b4152840 2024-04-22T07:24:40.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.517+0000 7f72bbb84640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f72b4155470 con 0x7f72b41f4d90 2024-04-22T07:24:40.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.517+0000 7f72b9920640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f729c004800 0x7f72b41e79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.517+0000 7f72b9920640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f729c004800 0x7f72b41e79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44578/0 (socket says 172.21.15.40:44578) 2024-04-22T07:24:40.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.517+0000 7f72b9920640 1 -- 172.21.15.40:0/742896070 learned_addr learned my addr 172.21.15.40:0/742896070 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:40.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.517+0000 7f72ba121640 1 --2- 172.21.15.40:0/742896070 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72b41f4d90 0x7f72b4153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.517+0000 7f72b911f640 1 --2- 172.21.15.40:0/742896070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72b4152840 0x7f72b41f16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.517+0000 7f72b9920640 1 -- 172.21.15.40:0/742896070 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72b41f4d90 msgr2=0x7f72b4153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.517+0000 7f72b9920640 1 --2- 172.21.15.40:0/742896070 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f72b41f4d90 0x7f72b4153da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.517+0000 7f72b9920640 1 -- 172.21.15.40:0/742896070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72b4152840 msgr2=0x7f72b41f16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.517+0000 7f72b9920640 1 --2- 172.21.15.40:0/742896070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72b4152840 0x7f72b41f16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.517+0000 7f72b9920640 1 -- 172.21.15.40:0/742896070 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b41f0f20 con 0x7f729c004800 2024-04-22T07:24:40.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.517+0000 7f72b9920640 1 --2- 172.21.15.40:0/742896070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f729c004800 0x7f72b41e79f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f72ac011940 tx=0x7f72ac011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:40.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.518+0000 7f72b27fc640 1 -- 172.21.15.40:0/742896070 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ac00fa90 con 0x7f729c004800 2024-04-22T07:24:40.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.518+0000 7f72b27fc640 1 -- 172.21.15.40:0/742896070 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72ac00fc30 con 0x7f729c004800 2024-04-22T07:24:40.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.518+0000 7f72bbb84640 1 -- 172.21.15.40:0/742896070 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72b40cac40 con 0x7f729c004800 2024-04-22T07:24:40.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.518+0000 7f72b27fc640 1 -- 172.21.15.40:0/742896070 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ac014440 con 0x7f729c004800 2024-04-22T07:24:40.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.518+0000 7f72bbb84640 1 -- 172.21.15.40:0/742896070 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72b41531b0 con 0x7f729c004800 2024-04-22T07:24:40.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.518+0000 7f72bbb84640 1 -- 172.21.15.40:0/742896070 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f72b41f1290 con 0x7f729c004800 2024-04-22T07:24:40.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.519+0000 7f72b27fc640 1 -- 172.21.15.40:0/742896070 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f72ac012040 con 0x7f729c004800 2024-04-22T07:24:40.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.520+0000 7f72b27fc640 1 --2- 172.21.15.40:0/742896070 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f72a006c8f0 0x7f72a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.520+0000 7f72b27fc640 1 -- 172.21.15.40:0/742896070 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f72ac08cad0 con 0x7f729c004800 2024-04-22T07:24:40.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.520+0000 7f72b911f640 1 --2- 172.21.15.40:0/742896070 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f72a006c8f0 0x7f72a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.520+0000 7f72b27fc640 1 --2- 172.21.15.40:0/742896070 >> [v2:172.21.15.40:6816/130276746,v1:172.21.15.40:6817/130276746] conn(0x7f72a0074b50 0x7f72a0076f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.520+0000 7f72b27fc640 1 -- 172.21.15.40:0/742896070 --> [v2:172.21.15.40:6816/130276746,v1:172.21.15.40:6817/130276746] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f72ac015e50 con 0x7f72a0074b50 2024-04-22T07:24:40.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.520+0000 7f72b27fc640 1 -- 172.21.15.40:0/742896070 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f72ac08cf60 con 0x7f729c004800 2024-04-22T07:24:40.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.520+0000 7f72ba121640 1 --2- 172.21.15.40:0/742896070 >> [v2:172.21.15.40:6816/130276746,v1:172.21.15.40:6817/130276746] conn(0x7f72a0074b50 0x7f72a0076f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.520+0000 7f72b911f640 1 --2- 172.21.15.40:0/742896070 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f72a006c8f0 0x7f72a006edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f72a8034000 tx=0x7f72a8007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:40.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.520+0000 7f72ba121640 1 --2- 172.21.15.40:0/742896070 >> [v2:172.21.15.40:6816/130276746,v1:172.21.15.40:6817/130276746] conn(0x7f72a0074b50 0x7f72a0076f70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:40.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.521+0000 7f72b27fc640 1 -- 172.21.15.40:0/742896070 <== osd.3 v2:172.21.15.40:6816/130276746 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f72ac015e50 con 0x7f72a0074b50 2024-04-22T07:24:40.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.534+0000 7f72bbb84640 1 -- 172.21.15.40:0/742896070 --> [v2:172.21.15.40:6816/130276746,v1:172.21.15.40:6817/130276746] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f72b404fdc0 con 0x7f72a0074b50 2024-04-22T07:24:40.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.535+0000 7f72b27fc640 1 -- 172.21.15.40:0/742896070 <== osd.3 v2:172.21.15.40:6816/130276746 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f72b404fdc0 con 0x7f72a0074b50 2024-04-22T07:24:40.532 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-22T07:24:40.532 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T07:24:40.533 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-22T07:24:40.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.535+0000 7f72bbb84640 1 -- 172.21.15.40:0/742896070 >> [v2:172.21.15.40:6816/130276746,v1:172.21.15.40:6817/130276746] conn(0x7f72a0074b50 msgr2=0x7f72a0076f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.535+0000 7f72bbb84640 1 --2- 172.21.15.40:0/742896070 >> [v2:172.21.15.40:6816/130276746,v1:172.21.15.40:6817/130276746] conn(0x7f72a0074b50 0x7f72a0076f70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.535+0000 7f72bbb84640 1 -- 172.21.15.40:0/742896070 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f72a006c8f0 msgr2=0x7f72a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.535+0000 7f72bbb84640 1 --2- 172.21.15.40:0/742896070 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f72a006c8f0 0x7f72a006edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f72a8034000 tx=0x7f72a8007000 comp rx=0 tx=0).stop 2024-04-22T07:24:40.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.535+0000 7f72bbb84640 1 -- 172.21.15.40:0/742896070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f729c004800 msgr2=0x7f72b41e79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.535+0000 7f72bbb84640 1 --2- 172.21.15.40:0/742896070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f729c004800 0x7f72b41e79f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f72ac011940 tx=0x7f72ac011e00 comp rx=0 tx=0).stop 2024-04-22T07:24:40.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.535+0000 7f72ba121640 1 -- 172.21.15.40:0/742896070 reap_dead start 2024-04-22T07:24:40.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.535+0000 7f72bbb84640 1 -- 172.21.15.40:0/742896070 shutdown_connections 2024-04-22T07:24:40.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.535+0000 7f72bbb84640 1 -- 172.21.15.40:0/742896070 >> 172.21.15.40:0/742896070 conn(0x7f72b40676b0 msgr2=0x7f72b40cecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:40.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.535+0000 7f72bbb84640 1 -- 172.21.15.40:0/742896070 shutdown_connections 2024-04-22T07:24:40.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.535+0000 7f72bbb84640 1 -- 172.21.15.40:0/742896070 wait complete. 2024-04-22T07:24:40.543 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-22T07:24:40.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.647+0000 7f471bb2b640 1 Processor -- start 2024-04-22T07:24:40.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.648+0000 7f471bb2b640 1 -- start start 2024-04-22T07:24:40.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.648+0000 7f471bb2b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f47140cbe20 0x7f47140b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.648+0000 7f471bb2b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f471415b1b0 con 0x7f4714155130 2024-04-22T07:24:40.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.648+0000 7f471bb2b640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f471415b490 con 0x7f471415f0c0 2024-04-22T07:24:40.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.648+0000 7f471bb2b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f471415b770 con 0x7f47140cbe20 2024-04-22T07:24:40.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.649+0000 7f471a0c8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f47140cbe20 0x7f47140b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.649+0000 7f47198c7640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4714155130 0x7f47140cd130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57316/0 (socket says 172.21.15.40:57316) 2024-04-22T07:24:40.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.649+0000 7f47198c7640 1 -- 172.21.15.40:0/633782344 learned_addr learned my addr 172.21.15.40:0/633782344 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:24:40.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.649+0000 7f471a0c8640 1 -- 172.21.15.40:0/633782344 >> v1:172.21.15.62:6789/0 conn(0x7f471415f0c0 legacy=0x7f47140cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.649+0000 7f471a0c8640 1 -- 172.21.15.40:0/633782344 >> v1:172.21.15.40:6789/0 conn(0x7f4714155130 legacy=0x7f47140cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.649+0000 7f47188c5640 1 -- 172.21.15.40:0/633782344 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3710562772 0 0) 0x7f471415b1b0 con 0x7f4714155130 2024-04-22T07:24:40.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.649+0000 7f471a0c8640 1 -- 172.21.15.40:0/633782344 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f471415ba50 con 0x7f47140cbe20 2024-04-22T07:24:40.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.650+0000 7f471a0c8640 1 --2- 172.21.15.40:0/633782344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47140cbe20 0x7f47140b4bc0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f470c009d90 tx=0x7f470c02bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b52af903dbdbce2e server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:40.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.650+0000 7f47188c5640 1 -- 172.21.15.40:0/633782344 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c039070 con 0x7f47140cbe20 2024-04-22T07:24:40.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.650+0000 7f47188c5640 1 -- 172.21.15.40:0/633782344 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f470c02cd80 con 0x7f47140cbe20 2024-04-22T07:24:40.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.650+0000 7f47188c5640 1 -- 172.21.15.40:0/633782344 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c034660 con 0x7f47140cbe20 2024-04-22T07:24:40.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.650+0000 7f471bb2b640 1 -- 172.21.15.40:0/633782344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47140cbe20 msgr2=0x7f47140b4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.650+0000 7f471bb2b640 1 --2- 172.21.15.40:0/633782344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47140cbe20 0x7f47140b4bc0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f470c009d90 tx=0x7f470c02bfd0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.650+0000 7f471bb2b640 1 -- 172.21.15.40:0/633782344 shutdown_connections 2024-04-22T07:24:40.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.650+0000 7f471bb2b640 1 --2- 172.21.15.40:0/633782344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47140cbe20 0x7f47140b4bc0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.650+0000 7f471bb2b640 1 -- 172.21.15.40:0/633782344 >> 172.21.15.40:0/633782344 conn(0x7f4714067890 msgr2=0x7f4714072860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:40.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.651+0000 7f471bb2b640 1 -- 172.21.15.40:0/633782344 shutdown_connections 2024-04-22T07:24:40.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.651+0000 7f471bb2b640 1 -- 172.21.15.40:0/633782344 wait complete. 2024-04-22T07:24:40.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.652+0000 7f471bb2b640 1 Processor -- start 2024-04-22T07:24:40.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.652+0000 7f471bb2b640 1 -- start start 2024-04-22T07:24:40.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.652+0000 7f471bb2b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47140cbe20 0x7f47140c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.652+0000 7f471bb2b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4714155130 0x7f471414ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.652+0000 7f471bb2b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f471415f0c0 0x7f4714152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.652+0000 7f471bb2b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f47140cd840 con 0x7f471415f0c0 2024-04-22T07:24:40.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.652+0000 7f471bb2b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4714155510 con 0x7f4714155130 2024-04-22T07:24:40.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.652+0000 7f471bb2b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f47140cd9c0 con 0x7f47140cbe20 2024-04-22T07:24:40.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.652+0000 7f471a0c8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f471415f0c0 0x7f4714152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.652+0000 7f471a0c8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f471415f0c0 0x7f4714152cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44604/0 (socket says 172.21.15.40:44604) 2024-04-22T07:24:40.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.652+0000 7f471a0c8640 1 -- 172.21.15.40:0/3615482356 learned_addr learned my addr 172.21.15.40:0/3615482356 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:40.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.653+0000 7f47198c7640 1 --2- 172.21.15.40:0/3615482356 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47140cbe20 0x7f47140c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.653+0000 7f47190c6640 1 --2- 172.21.15.40:0/3615482356 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4714155130 0x7f471414ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.653+0000 7f471a0c8640 1 -- 172.21.15.40:0/3615482356 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47140cbe20 msgr2=0x7f47140c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.653+0000 7f471a0c8640 1 --2- 172.21.15.40:0/3615482356 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47140cbe20 0x7f47140c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.653+0000 7f471a0c8640 1 -- 172.21.15.40:0/3615482356 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4714155130 msgr2=0x7f471414ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.653+0000 7f471a0c8640 1 --2- 172.21.15.40:0/3615482356 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4714155130 0x7f471414ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.653+0000 7f471a0c8640 1 -- 172.21.15.40:0/3615482356 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4714154590 con 0x7f471415f0c0 2024-04-22T07:24:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.653+0000 7f47190c6640 1 --2- 172.21.15.40:0/3615482356 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4714155130 0x7f471414ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:24:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.653+0000 7f471a0c8640 1 --2- 172.21.15.40:0/3615482356 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f471415f0c0 0x7f4714152cc0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f470c009d90 tx=0x7f470c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.653+0000 7f470a7fc640 1 -- 172.21.15.40:0/3615482356 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c039050 con 0x7f471415f0c0 2024-04-22T07:24:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.653+0000 7f470a7fc640 1 -- 172.21.15.40:0/3615482356 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f470c03a040 con 0x7f471415f0c0 2024-04-22T07:24:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.653+0000 7f471bb2b640 1 -- 172.21.15.40:0/3615482356 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47141521b0 con 0x7f471415f0c0 2024-04-22T07:24:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.653+0000 7f470a7fc640 1 -- 172.21.15.40:0/3615482356 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c03e610 con 0x7f471415f0c0 2024-04-22T07:24:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.653+0000 7f471bb2b640 1 -- 172.21.15.40:0/3615482356 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47140ca700 con 0x7f471415f0c0 2024-04-22T07:24:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.654+0000 7f471bb2b640 1 -- 172.21.15.40:0/3615482356 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4714076050 con 0x7f471415f0c0 2024-04-22T07:24:40.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.655+0000 7f470a7fc640 1 -- 172.21.15.40:0/3615482356 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f470c047030 con 0x7f471415f0c0 2024-04-22T07:24:40.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.655+0000 7f470a7fc640 1 --2- 172.21.15.40:0/3615482356 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f46f806c920 0x7f46f806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.655+0000 7f470a7fc640 1 -- 172.21.15.40:0/3615482356 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f470c0adbe0 con 0x7f471415f0c0 2024-04-22T07:24:40.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.655+0000 7f47198c7640 1 --2- 172.21.15.40:0/3615482356 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f46f806c920 0x7f46f806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.656+0000 7f47198c7640 1 --2- 172.21.15.40:0/3615482356 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f46f806c920 0x7f46f806ede0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4710000f60 tx=0x7f4710007b90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:40.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.659+0000 7f470a7fc640 1 -- 172.21.15.40:0/3615482356 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4714076050 con 0x7f471415f0c0 2024-04-22T07:24:40.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.847+0000 7f471bb2b640 1 -- 172.21.15.40:0/3615482356 --> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f4714154860 con 0x7f46f806c920 2024-04-22T07:24:40.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.847+0000 7f470a7fc640 1 -- 172.21.15.40:0/3615482356 <== mgr.4107 v2:172.21.15.40:6832/91163869 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4714154860 con 0x7f46f806c920 2024-04-22T07:24:40.845 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 3 to deep-scrub 2024-04-22T07:24:40.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.849+0000 7f471bb2b640 1 -- 172.21.15.40:0/3615482356 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f46f806c920 msgr2=0x7f46f806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.849+0000 7f471bb2b640 1 --2- 172.21.15.40:0/3615482356 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f46f806c920 0x7f46f806ede0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4710000f60 tx=0x7f4710007b90 comp rx=0 tx=0).stop 2024-04-22T07:24:40.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.849+0000 7f471bb2b640 1 -- 172.21.15.40:0/3615482356 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f471415f0c0 msgr2=0x7f4714152cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.849+0000 7f471bb2b640 1 --2- 172.21.15.40:0/3615482356 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f471415f0c0 0x7f4714152cc0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f470c009d90 tx=0x7f470c004a40 comp rx=0 tx=0).stop 2024-04-22T07:24:40.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.849+0000 7f471bb2b640 1 -- 172.21.15.40:0/3615482356 shutdown_connections 2024-04-22T07:24:40.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.849+0000 7f471bb2b640 1 --2- 172.21.15.40:0/3615482356 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f46f806c920 0x7f46f806ede0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.849+0000 7f471bb2b640 1 --2- 172.21.15.40:0/3615482356 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f471415f0c0 0x7f4714152cc0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.849+0000 7f471bb2b640 1 --2- 172.21.15.40:0/3615482356 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4714155130 0x7f471414ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.849+0000 7f471bb2b640 1 --2- 172.21.15.40:0/3615482356 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47140cbe20 0x7f47140c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.849+0000 7f471bb2b640 1 -- 172.21.15.40:0/3615482356 >> 172.21.15.40:0/3615482356 conn(0x7f4714067890 msgr2=0x7f47140cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:40.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.849+0000 7f471bb2b640 1 -- 172.21.15.40:0/3615482356 shutdown_connections 2024-04-22T07:24:40.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.849+0000 7f471bb2b640 1 -- 172.21.15.40:0/3615482356 wait complete. 2024-04-22T07:24:40.858 INFO:tasks.ceph:Scrubbing osd.4 2024-04-22T07:24:40.858 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-22T07:24:40.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.966+0000 7f212c0e4640 1 Processor -- start 2024-04-22T07:24:40.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.967+0000 7f212c0e4640 1 -- start start 2024-04-22T07:24:40.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.967+0000 7f212c0e4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f212415eec0 0x7f21240d05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.967+0000 7f212c0e4640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f212415e450 con 0x7f2124154f10 2024-04-22T07:24:40.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.967+0000 7f212c0e4640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f212415f330 con 0x7f21240c5550 2024-04-22T07:24:40.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.967+0000 7f212c0e4640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f212415b4d0 con 0x7f212415eec0 2024-04-22T07:24:40.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.967+0000 7f212a681640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f212415eec0 0x7f21240d05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.968+0000 7f2129e80640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2124154f10 0x7f21240cb3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57318/0 (socket says 172.21.15.40:57318) 2024-04-22T07:24:40.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.968+0000 7f2129e80640 1 -- 172.21.15.40:0/3356795455 learned_addr learned my addr 172.21.15.40:0/3356795455 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:24:40.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.968+0000 7f212a681640 1 -- 172.21.15.40:0/3356795455 >> v1:172.21.15.62:6789/0 conn(0x7f21240c5550 legacy=0x7f212415adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.968+0000 7f212a681640 1 -- 172.21.15.40:0/3356795455 >> v1:172.21.15.40:6789/0 conn(0x7f2124154f10 legacy=0x7f21240cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.968+0000 7f212a681640 1 -- 172.21.15.40:0/3356795455 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f212415b6f0 con 0x7f212415eec0 2024-04-22T07:24:40.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.968+0000 7f2128e7e640 1 -- 172.21.15.40:0/3356795455 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2063505186 0 0) 0x7f212415e450 con 0x7f2124154f10 2024-04-22T07:24:40.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.969+0000 7f212a681640 1 --2- 172.21.15.40:0/3356795455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f212415eec0 0x7f21240d05c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f211c009d90 tx=0x7f211c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec01af59155c96f server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:40.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.969+0000 7f2128e7e640 1 -- 172.21.15.40:0/3356795455 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211c039070 con 0x7f212415eec0 2024-04-22T07:24:40.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.969+0000 7f2128e7e640 1 -- 172.21.15.40:0/3356795455 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f211c02cd00 con 0x7f212415eec0 2024-04-22T07:24:40.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.969+0000 7f2128e7e640 1 -- 172.21.15.40:0/3356795455 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211c034660 con 0x7f212415eec0 2024-04-22T07:24:40.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.969+0000 7f212c0e4640 1 -- 172.21.15.40:0/3356795455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f212415eec0 msgr2=0x7f21240d05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.969+0000 7f212c0e4640 1 --2- 172.21.15.40:0/3356795455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f212415eec0 0x7f21240d05c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f211c009d90 tx=0x7f211c02bf50 comp rx=0 tx=0).stop 2024-04-22T07:24:40.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.969+0000 7f212c0e4640 1 -- 172.21.15.40:0/3356795455 shutdown_connections 2024-04-22T07:24:40.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.969+0000 7f212c0e4640 1 --2- 172.21.15.40:0/3356795455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f212415eec0 0x7f21240d05c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.969+0000 7f212c0e4640 1 -- 172.21.15.40:0/3356795455 >> 172.21.15.40:0/3356795455 conn(0x7f21240676b0 msgr2=0x7f2124067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:40.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.969+0000 7f212c0e4640 1 -- 172.21.15.40:0/3356795455 shutdown_connections 2024-04-22T07:24:40.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.969+0000 7f212c0e4640 1 -- 172.21.15.40:0/3356795455 wait complete. 2024-04-22T07:24:40.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.971+0000 7f212c0e4640 1 Processor -- start 2024-04-22T07:24:40.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.971+0000 7f212c0e4640 1 -- start start 2024-04-22T07:24:40.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.971+0000 7f212c0e4640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21240c5550 0x7f2124147510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.971+0000 7f212c0e4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2124154f10 0x7f21240ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.971+0000 7f212c0e4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f212415eec0 0x7f21240cef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.971+0000 7f212c0e4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f212415bcb0 con 0x7f2124154f10 2024-04-22T07:24:40.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.971+0000 7f212c0e4640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f212415e6c0 con 0x7f212415eec0 2024-04-22T07:24:40.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.971+0000 7f212c0e4640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f21241552f0 con 0x7f21240c5550 2024-04-22T07:24:40.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.971+0000 7f212967f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2124154f10 0x7f21240ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.971+0000 7f212967f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2124154f10 0x7f21240ce9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44614/0 (socket says 172.21.15.40:44614) 2024-04-22T07:24:40.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.971+0000 7f212967f640 1 -- 172.21.15.40:0/538662550 learned_addr learned my addr 172.21.15.40:0/538662550 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:40.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.971+0000 7f212a681640 1 --2- 172.21.15.40:0/538662550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f212415eec0 0x7f21240cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.972+0000 7f2129e80640 1 --2- 172.21.15.40:0/538662550 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21240c5550 0x7f2124147510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.972+0000 7f212967f640 1 -- 172.21.15.40:0/538662550 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21240c5550 msgr2=0x7f2124147510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.972+0000 7f212967f640 1 --2- 172.21.15.40:0/538662550 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f21240c5550 0x7f2124147510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.972+0000 7f212967f640 1 -- 172.21.15.40:0/538662550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f212415eec0 msgr2=0x7f21240cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.972+0000 7f212967f640 1 --2- 172.21.15.40:0/538662550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f212415eec0 0x7f21240cef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.972+0000 7f212967f640 1 -- 172.21.15.40:0/538662550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2124146dd0 con 0x7f2124154f10 2024-04-22T07:24:40.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.972+0000 7f212a681640 1 --2- 172.21.15.40:0/538662550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f212415eec0 0x7f21240cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:24:40.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.972+0000 7f212967f640 1 --2- 172.21.15.40:0/538662550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2124154f10 0x7f21240ce9e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f211400c480 tx=0x7f211400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:40.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.972+0000 7f211a7fc640 1 -- 172.21.15.40:0/538662550 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21140052d0 con 0x7f2124154f10 2024-04-22T07:24:40.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.972+0000 7f211a7fc640 1 -- 172.21.15.40:0/538662550 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2114005470 con 0x7f2124154f10 2024-04-22T07:24:40.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.972+0000 7f211a7fc640 1 -- 172.21.15.40:0/538662550 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2114012870 con 0x7f2124154f10 2024-04-22T07:24:40.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.972+0000 7f212c0e4640 1 -- 172.21.15.40:0/538662550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21241470b0 con 0x7f2124154f10 2024-04-22T07:24:40.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.972+0000 7f212c0e4640 1 -- 172.21.15.40:0/538662550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21240d0e20 con 0x7f2124154f10 2024-04-22T07:24:40.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.973+0000 7f212c0e4640 1 -- 172.21.15.40:0/538662550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2124147b30 con 0x7f2124154f10 2024-04-22T07:24:40.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.973+0000 7f211a7fc640 1 -- 172.21.15.40:0/538662550 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2114012a10 con 0x7f2124154f10 2024-04-22T07:24:40.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.974+0000 7f211a7fc640 1 --2- 172.21.15.40:0/538662550 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f210806c920 0x7f210806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.974+0000 7f211a7fc640 1 -- 172.21.15.40:0/538662550 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f211408b810 con 0x7f2124154f10 2024-04-22T07:24:40.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.974+0000 7f2129e80640 1 --2- 172.21.15.40:0/538662550 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f210806c920 0x7f210806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.974+0000 7f211a7fc640 1 --2- 172.21.15.40:0/538662550 >> [v2:172.21.15.62:6800/2251435758,v1:172.21.15.62:6801/2251435758] conn(0x7f2108074b80 0x7f2108076fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:40.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.974+0000 7f211a7fc640 1 -- 172.21.15.40:0/538662550 --> [v2:172.21.15.62:6800/2251435758,v1:172.21.15.62:6801/2251435758] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2114004ec0 con 0x7f2108074b80 2024-04-22T07:24:40.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.974+0000 7f211a7fc640 1 -- 172.21.15.40:0/538662550 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f21140902c0 con 0x7f2124154f10 2024-04-22T07:24:40.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.974+0000 7f212a681640 1 --2- 172.21.15.40:0/538662550 >> [v2:172.21.15.62:6800/2251435758,v1:172.21.15.62:6801/2251435758] conn(0x7f2108074b80 0x7f2108076fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:40.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.974+0000 7f2129e80640 1 --2- 172.21.15.40:0/538662550 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f210806c920 0x7f210806ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2120000f60 tx=0x7f2120007b90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:40.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.975+0000 7f212a681640 1 --2- 172.21.15.40:0/538662550 >> [v2:172.21.15.62:6800/2251435758,v1:172.21.15.62:6801/2251435758] conn(0x7f2108074b80 0x7f2108076fa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:40.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.975+0000 7f211a7fc640 1 -- 172.21.15.40:0/538662550 <== osd.4 v2:172.21.15.62:6800/2251435758 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2114004ec0 con 0x7f2108074b80 2024-04-22T07:24:40.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.988+0000 7f212c0e4640 1 -- 172.21.15.40:0/538662550 --> [v2:172.21.15.62:6800/2251435758,v1:172.21.15.62:6801/2251435758] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f212404fdc0 con 0x7f2108074b80 2024-04-22T07:24:40.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.989+0000 7f211a7fc640 1 -- 172.21.15.40:0/538662550 <== osd.4 v2:172.21.15.62:6800/2251435758 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f212404fdc0 con 0x7f2108074b80 2024-04-22T07:24:40.987 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-22T07:24:40.987 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T07:24:40.987 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-22T07:24:40.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.989+0000 7f212c0e4640 1 -- 172.21.15.40:0/538662550 >> [v2:172.21.15.62:6800/2251435758,v1:172.21.15.62:6801/2251435758] conn(0x7f2108074b80 msgr2=0x7f2108076fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.989+0000 7f212c0e4640 1 --2- 172.21.15.40:0/538662550 >> [v2:172.21.15.62:6800/2251435758,v1:172.21.15.62:6801/2251435758] conn(0x7f2108074b80 0x7f2108076fa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:40.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.989+0000 7f212c0e4640 1 -- 172.21.15.40:0/538662550 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f210806c920 msgr2=0x7f210806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.989+0000 7f212c0e4640 1 --2- 172.21.15.40:0/538662550 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f210806c920 0x7f210806ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2120000f60 tx=0x7f2120007b90 comp rx=0 tx=0).stop 2024-04-22T07:24:40.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.989+0000 7f212c0e4640 1 -- 172.21.15.40:0/538662550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2124154f10 msgr2=0x7f21240ce9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:40.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.989+0000 7f212c0e4640 1 --2- 172.21.15.40:0/538662550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2124154f10 0x7f21240ce9e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f211400c480 tx=0x7f211400c940 comp rx=0 tx=0).stop 2024-04-22T07:24:40.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.989+0000 7f212a681640 1 -- 172.21.15.40:0/538662550 reap_dead start 2024-04-22T07:24:40.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.990+0000 7f212c0e4640 1 -- 172.21.15.40:0/538662550 shutdown_connections 2024-04-22T07:24:40.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.990+0000 7f212c0e4640 1 -- 172.21.15.40:0/538662550 >> 172.21.15.40:0/538662550 conn(0x7f21240676b0 msgr2=0x7f2124159f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:40.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.990+0000 7f212c0e4640 1 -- 172.21.15.40:0/538662550 shutdown_connections 2024-04-22T07:24:40.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:40.990+0000 7f212c0e4640 1 -- 172.21.15.40:0/538662550 wait complete. 2024-04-22T07:24:40.998 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-22T07:24:41.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.104+0000 7faa73323640 1 Processor -- start 2024-04-22T07:24:41.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.104+0000 7faa73323640 1 -- start start 2024-04-22T07:24:41.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.105+0000 7faa73323640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa6c154dc0 0x7faa6c15adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.105+0000 7faa73323640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faa6c06f7f0 0x7faa6c15ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.105+0000 7faa73323640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa6c15b3f0 con 0x7faa6c0ce340 2024-04-22T07:24:41.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.105+0000 7faa73323640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7faa6c15e7b0 con 0x7faa6c06f7f0 2024-04-22T07:24:41.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.105+0000 7faa73323640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7faa6c15b6d0 con 0x7faa6c154dc0 2024-04-22T07:24:41.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.105+0000 7faa708be640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faa6c06f7f0 0x7faa6c15ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.105+0000 7faa718c0640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7faa6c0ce340 0x7faa6c0cae60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.40:60942/0 (socket says 172.21.15.40:60942) 2024-04-22T07:24:41.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.105+0000 7faa710bf640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa6c154dc0 0x7faa6c15adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.105+0000 7faa718c0640 1 -- 172.21.15.40:0/3866205194 learned_addr learned my addr 172.21.15.40:0/3866205194 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:24:41.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.105+0000 7faa63fff640 1 -- 172.21.15.40:0/3866205194 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3683793381 0 0) 0x7faa6c15b3f0 con 0x7faa6c0ce340 2024-04-22T07:24:41.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.105+0000 7faa63fff640 1 -- 172.21.15.40:0/3866205194 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa58003520 con 0x7faa6c0ce340 2024-04-22T07:24:41.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.105+0000 7faa708be640 1 -- 172.21.15.40:0/3866205194 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa6c154dc0 msgr2=0x7faa6c15adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:41.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.105+0000 7faa708be640 1 --2- 172.21.15.40:0/3866205194 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa6c154dc0 0x7faa6c15adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.105+0000 7faa708be640 1 -- 172.21.15.40:0/3866205194 >> v1:172.21.15.62:6789/0 conn(0x7faa6c0ce340 legacy=0x7faa6c0cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:41.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.105+0000 7faa708be640 1 -- 172.21.15.40:0/3866205194 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6c15b9b0 con 0x7faa6c06f7f0 2024-04-22T07:24:41.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.105+0000 7faa710bf640 1 --2- 172.21.15.40:0/3866205194 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa6c154dc0 0x7faa6c15adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:24:41.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.106+0000 7faa708be640 1 --2- 172.21.15.40:0/3866205194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa6c06f7f0 0x7faa6c15ec40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faa5c0097a0 tx=0x7faa5c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44effbde3b42b57b server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:41.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.106+0000 7faa63fff640 1 -- 172.21.15.40:0/3866205194 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5c035020 con 0x7faa6c06f7f0 2024-04-22T07:24:41.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.106+0000 7faa63fff640 1 -- 172.21.15.40:0/3866205194 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa5c031830 con 0x7faa6c06f7f0 2024-04-22T07:24:41.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.106+0000 7faa63fff640 1 -- 172.21.15.40:0/3866205194 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5c031be0 con 0x7faa6c06f7f0 2024-04-22T07:24:41.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.107+0000 7faa73323640 1 -- 172.21.15.40:0/3866205194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa6c06f7f0 msgr2=0x7faa6c15ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:41.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.107+0000 7faa73323640 1 --2- 172.21.15.40:0/3866205194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa6c06f7f0 0x7faa6c15ec40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faa5c0097a0 tx=0x7faa5c02b8d0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.107+0000 7faa73323640 1 -- 172.21.15.40:0/3866205194 shutdown_connections 2024-04-22T07:24:41.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.107+0000 7faa73323640 1 --2- 172.21.15.40:0/3866205194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa6c06f7f0 0x7faa6c15ec40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.107+0000 7faa73323640 1 --2- 172.21.15.40:0/3866205194 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa6c154dc0 0x7faa6c15adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.107+0000 7faa73323640 1 -- 172.21.15.40:0/3866205194 >> 172.21.15.40:0/3866205194 conn(0x7faa6c06db30 msgr2=0x7faa6c06df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:41.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.107+0000 7faa73323640 1 -- 172.21.15.40:0/3866205194 shutdown_connections 2024-04-22T07:24:41.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.107+0000 7faa73323640 1 -- 172.21.15.40:0/3866205194 wait complete. 2024-04-22T07:24:41.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.108+0000 7faa73323640 1 Processor -- start 2024-04-22T07:24:41.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.108+0000 7faa73323640 1 -- start start 2024-04-22T07:24:41.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.109+0000 7faa73323640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa6c06f7f0 0x7faa6c0717e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.109+0000 7faa73323640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa6c0ce340 0x7faa6c1e6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.109+0000 7faa73323640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa6c154dc0 0x7faa6c1f0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.109+0000 7faa73323640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c15bc90 con 0x7faa6c0ce340 2024-04-22T07:24:41.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.109+0000 7faa73323640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c0c97c0 con 0x7faa6c06f7f0 2024-04-22T07:24:41.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.109+0000 7faa73323640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7faa6c1551a0 con 0x7faa6c154dc0 2024-04-22T07:24:41.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.109+0000 7faa708be640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa6c0ce340 0x7faa6c1e6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.109+0000 7faa708be640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa6c0ce340 0x7faa6c1e6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44628/0 (socket says 172.21.15.40:44628) 2024-04-22T07:24:41.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.109+0000 7faa708be640 1 -- 172.21.15.40:0/418320781 learned_addr learned my addr 172.21.15.40:0/418320781 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:41.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.109+0000 7faa710bf640 1 --2- 172.21.15.40:0/418320781 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa6c06f7f0 0x7faa6c0717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.109+0000 7faa718c0640 1 --2- 172.21.15.40:0/418320781 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa6c154dc0 0x7faa6c1f0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.109+0000 7faa708be640 1 -- 172.21.15.40:0/418320781 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa6c154dc0 msgr2=0x7faa6c1f0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:41.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.109+0000 7faa708be640 1 --2- 172.21.15.40:0/418320781 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa6c154dc0 0x7faa6c1f0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.109+0000 7faa708be640 1 -- 172.21.15.40:0/418320781 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa6c06f7f0 msgr2=0x7faa6c0717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:41.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.109+0000 7faa708be640 1 --2- 172.21.15.40:0/418320781 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa6c06f7f0 0x7faa6c0717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.109+0000 7faa708be640 1 -- 172.21.15.40:0/418320781 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6c14a7f0 con 0x7faa6c0ce340 2024-04-22T07:24:41.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.110+0000 7faa708be640 1 --2- 172.21.15.40:0/418320781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa6c0ce340 0x7faa6c1e6150 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7faa5c034040 tx=0x7faa5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:41.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.110+0000 7faa61ffb640 1 -- 172.21.15.40:0/418320781 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5c040070 con 0x7faa6c0ce340 2024-04-22T07:24:41.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.110+0000 7faa61ffb640 1 -- 172.21.15.40:0/418320781 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa5c03e070 con 0x7faa6c0ce340 2024-04-22T07:24:41.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.110+0000 7faa73323640 1 -- 172.21.15.40:0/418320781 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa6c14a510 con 0x7faa6c0ce340 2024-04-22T07:24:41.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.110+0000 7faa61ffb640 1 -- 172.21.15.40:0/418320781 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5c035040 con 0x7faa6c0ce340 2024-04-22T07:24:41.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.110+0000 7faa73323640 1 -- 172.21.15.40:0/418320781 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa6c14e8b0 con 0x7faa6c0ce340 2024-04-22T07:24:41.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.111+0000 7faa73323640 1 -- 172.21.15.40:0/418320781 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa6c153290 con 0x7faa6c0ce340 2024-04-22T07:24:41.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.112+0000 7faa61ffb640 1 -- 172.21.15.40:0/418320781 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faa5c038020 con 0x7faa6c0ce340 2024-04-22T07:24:41.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.112+0000 7faa61ffb640 1 --2- 172.21.15.40:0/418320781 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7faa5006c8f0 0x7faa5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.112+0000 7faa61ffb640 1 -- 172.21.15.40:0/418320781 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7faa5c0ad2c0 con 0x7faa6c0ce340 2024-04-22T07:24:41.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.112+0000 7faa710bf640 1 --2- 172.21.15.40:0/418320781 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7faa5006c8f0 0x7faa5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.112+0000 7faa710bf640 1 --2- 172.21.15.40:0/418320781 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7faa5006c8f0 0x7faa5006edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faa68009560 tx=0x7faa68009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:41.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.117+0000 7faa61ffb640 1 -- 172.21.15.40:0/418320781 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faa6c153290 con 0x7faa6c0ce340 2024-04-22T07:24:41.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.301+0000 7faa73323640 1 -- 172.21.15.40:0/418320781 --> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7faa6c1e5ad0 con 0x7faa5006c8f0 2024-04-22T07:24:41.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.301+0000 7faa61ffb640 1 -- 172.21.15.40:0/418320781 <== mgr.4107 v2:172.21.15.40:6832/91163869 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7faa6c1e5ad0 con 0x7faa5006c8f0 2024-04-22T07:24:41.299 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 4 to deep-scrub 2024-04-22T07:24:41.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.303+0000 7faa73323640 1 -- 172.21.15.40:0/418320781 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7faa5006c8f0 msgr2=0x7faa5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:41.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.303+0000 7faa73323640 1 --2- 172.21.15.40:0/418320781 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7faa5006c8f0 0x7faa5006edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faa68009560 tx=0x7faa68009190 comp rx=0 tx=0).stop 2024-04-22T07:24:41.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.303+0000 7faa73323640 1 -- 172.21.15.40:0/418320781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa6c0ce340 msgr2=0x7faa6c1e6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:41.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.303+0000 7faa73323640 1 --2- 172.21.15.40:0/418320781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa6c0ce340 0x7faa6c1e6150 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7faa5c034040 tx=0x7faa5c0046c0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.303+0000 7faa73323640 1 -- 172.21.15.40:0/418320781 shutdown_connections 2024-04-22T07:24:41.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.303+0000 7faa73323640 1 --2- 172.21.15.40:0/418320781 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7faa6c154dc0 0x7faa6c1f0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.303+0000 7faa73323640 1 --2- 172.21.15.40:0/418320781 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7faa5006c8f0 0x7faa5006edb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.303+0000 7faa73323640 1 --2- 172.21.15.40:0/418320781 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa6c0ce340 0x7faa6c1e6150 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.303+0000 7faa73323640 1 --2- 172.21.15.40:0/418320781 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa6c06f7f0 0x7faa6c0717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.303+0000 7faa73323640 1 -- 172.21.15.40:0/418320781 >> 172.21.15.40:0/418320781 conn(0x7faa6c06db30 msgr2=0x7faa6c0cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:41.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.303+0000 7faa73323640 1 -- 172.21.15.40:0/418320781 shutdown_connections 2024-04-22T07:24:41.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.303+0000 7faa73323640 1 -- 172.21.15.40:0/418320781 wait complete. 2024-04-22T07:24:41.312 INFO:tasks.ceph:Scrubbing osd.5 2024-04-22T07:24:41.313 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-22T07:24:41.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.420+0000 7f205bd9d640 1 Processor -- start 2024-04-22T07:24:41.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.420+0000 7f205bd9d640 1 -- start start 2024-04-22T07:24:41.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.421+0000 7f205bd9d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20540d0bc0 0x7f20540cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.421+0000 7f205bd9d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2054155320 0x7f205415e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.421+0000 7f205bd9d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f205415b880 con 0x7f20540d0fa0 2024-04-22T07:24:41.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.421+0000 7f205bd9d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f205415e370 con 0x7f2054155320 2024-04-22T07:24:41.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.421+0000 7f205bd9d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f205415bb60 con 0x7f20540d0bc0 2024-04-22T07:24:41.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.421+0000 7f2059338640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f20540d0fa0 0x7f2054154c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57334/0 (socket says 172.21.15.40:57334) 2024-04-22T07:24:41.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.421+0000 7f2059338640 1 -- 172.21.15.40:0/3192720971 learned_addr learned my addr 172.21.15.40:0/3192720971 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:24:41.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.421+0000 7f205a33a640 1 --2- 172.21.15.40:0/3192720971 >> v2:172.21.15.62:3300/0 conn(0x7f2054155320 0x7f205415e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.421+0000 7f2058b37640 1 -- 172.21.15.40:0/3192720971 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2098719942 0 0) 0x7f205415b880 con 0x7f20540d0fa0 2024-04-22T07:24:41.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.421+0000 7f2059b39640 1 --2- 172.21.15.40:0/3192720971 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20540d0bc0 0x7f20540cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.421+0000 7f2058b37640 1 -- 172.21.15.40:0/3192720971 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2040003520 con 0x7f20540d0fa0 2024-04-22T07:24:41.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.421+0000 7f2058b37640 1 -- 172.21.15.40:0/3192720971 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2750130337 0 0) 0x7f2040003520 con 0x7f20540d0fa0 2024-04-22T07:24:41.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.421+0000 7f2058b37640 1 -- 172.21.15.40:0/3192720971 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20540d0bc0 msgr2=0x7f20540cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:41.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.421+0000 7f2058b37640 1 --2- 172.21.15.40:0/3192720971 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20540d0bc0 0x7f20540cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.421+0000 7f2058b37640 1 -- 172.21.15.40:0/3192720971 >> v2:172.21.15.62:3300/0 conn(0x7f2054155320 msgr2=0x7f205415e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:41.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.421+0000 7f2058b37640 1 --2- 172.21.15.40:0/3192720971 >> v2:172.21.15.62:3300/0 conn(0x7f2054155320 0x7f205415e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.421+0000 7f2058b37640 1 -- 172.21.15.40:0/3192720971 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20540cb0e0 con 0x7f20540d0fa0 2024-04-22T07:24:41.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.422+0000 7f2058b37640 1 -- 172.21.15.40:0/3192720971 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7f2044001670 con 0x7f20540d0fa0 2024-04-22T07:24:41.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.422+0000 7f2058b37640 1 -- 172.21.15.40:0/3192720971 >> v1:172.21.15.40:6789/0 conn(0x7f20540d0fa0 legacy=0x7f2054154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:41.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.422+0000 7f2058b37640 1 --2- 172.21.15.40:0/3192720971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20400039b0 0x7f2040003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.422+0000 7f2058b37640 1 --2- 172.21.15.40:0/3192720971 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20540d0bc0 0x7f2040004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.422+0000 7f2058b37640 1 --2- 172.21.15.40:0/3192720971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2040004d40 0x7f20400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.422+0000 7f2058b37640 1 -- 172.21.15.40:0/3192720971 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f205415e370 con 0x7f2040004d40 2024-04-22T07:24:41.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.422+0000 7f2058b37640 1 -- 172.21.15.40:0/3192720971 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f205415bb60 con 0x7f20400039b0 2024-04-22T07:24:41.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.422+0000 7f2058b37640 1 -- 172.21.15.40:0/3192720971 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f204000b9c0 con 0x7f20540d0bc0 2024-04-22T07:24:41.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.422+0000 7f205a33a640 1 --2- 172.21.15.40:0/3192720971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2040004d40 0x7f20400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.422+0000 7f2059338640 1 --2- 172.21.15.40:0/3192720971 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20540d0bc0 0x7f2040004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.422+0000 7f2059b39640 1 --2- 172.21.15.40:0/3192720971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20400039b0 0x7f2040003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.422+0000 7f205a33a640 1 -- 172.21.15.40:0/3192720971 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20540d0bc0 msgr2=0x7f2040004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:41.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.422+0000 7f205a33a640 1 --2- 172.21.15.40:0/3192720971 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f20540d0bc0 0x7f2040004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.422+0000 7f205a33a640 1 -- 172.21.15.40:0/3192720971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20400039b0 msgr2=0x7f2040003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:41.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.422+0000 7f205a33a640 1 --2- 172.21.15.40:0/3192720971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20400039b0 0x7f2040003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.422+0000 7f205a33a640 1 -- 172.21.15.40:0/3192720971 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2040003520 con 0x7f2040004d40 2024-04-22T07:24:41.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.423+0000 7f205a33a640 1 --2- 172.21.15.40:0/3192720971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2040004d40 0x7f20400051c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f204c009fc0 tx=0x7f2040005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d336abf407cef9ac server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:41.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.423+0000 7f2058b37640 1 -- 172.21.15.40:0/3192720971 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c039070 con 0x7f2040004d40 2024-04-22T07:24:41.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.423+0000 7f2058b37640 1 -- 172.21.15.40:0/3192720971 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f204c02cc60 con 0x7f2040004d40 2024-04-22T07:24:41.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.423+0000 7f2058b37640 1 -- 172.21.15.40:0/3192720971 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c009c10 con 0x7f2040004d40 2024-04-22T07:24:41.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.423+0000 7f205bd9d640 1 -- 172.21.15.40:0/3192720971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2040004d40 msgr2=0x7f20400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:41.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.423+0000 7f205bd9d640 1 --2- 172.21.15.40:0/3192720971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2040004d40 0x7f20400051c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f204c009fc0 tx=0x7f2040005830 comp rx=0 tx=0).stop 2024-04-22T07:24:41.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.423+0000 7f205a33a640 1 -- 172.21.15.40:0/3192720971 reap_dead start 2024-04-22T07:24:41.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.423+0000 7f205bd9d640 1 -- 172.21.15.40:0/3192720971 shutdown_connections 2024-04-22T07:24:41.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.423+0000 7f205bd9d640 1 -- 172.21.15.40:0/3192720971 >> 172.21.15.40:0/3192720971 conn(0x7f205406ce70 msgr2=0x7f205406d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:41.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.424+0000 7f205bd9d640 1 -- 172.21.15.40:0/3192720971 shutdown_connections 2024-04-22T07:24:41.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.424+0000 7f205bd9d640 1 -- 172.21.15.40:0/3192720971 wait complete. 2024-04-22T07:24:41.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.425+0000 7f205bd9d640 1 Processor -- start 2024-04-22T07:24:41.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.425+0000 7f205bd9d640 1 -- start start 2024-04-22T07:24:41.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.425+0000 7f205bd9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2040004d40 0x7f20541f4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.425+0000 7f205bd9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20541f1640 0x7f20540c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.425+0000 7f205bd9d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2054147d60 0x7f20541481e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.425+0000 7f205bd9d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f20540cc060 con 0x7f20541f1640 2024-04-22T07:24:41.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.425+0000 7f205bd9d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f20540cbee0 con 0x7f2040004d40 2024-04-22T07:24:41.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.425+0000 7f205bd9d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f20540cc1e0 con 0x7f2054147d60 2024-04-22T07:24:41.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.426+0000 7f2059338640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20541f1640 0x7f20540c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.426+0000 7f2059338640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20541f1640 0x7f20540c5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44636/0 (socket says 172.21.15.40:44636) 2024-04-22T07:24:41.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.426+0000 7f2059338640 1 -- 172.21.15.40:0/3660339437 learned_addr learned my addr 172.21.15.40:0/3660339437 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:41.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.426+0000 7f2059b39640 1 --2- 172.21.15.40:0/3660339437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2040004d40 0x7f20541f4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.426+0000 7f205a33a640 1 --2- 172.21.15.40:0/3660339437 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2054147d60 0x7f20541481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.426+0000 7f2059338640 1 -- 172.21.15.40:0/3660339437 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2054147d60 msgr2=0x7f20541481e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:41.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.426+0000 7f2059338640 1 --2- 172.21.15.40:0/3660339437 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2054147d60 0x7f20541481e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.426+0000 7f2059338640 1 -- 172.21.15.40:0/3660339437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2040004d40 msgr2=0x7f20541f4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:41.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.426+0000 7f2059338640 1 --2- 172.21.15.40:0/3660339437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2040004d40 0x7f20541f4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.426+0000 7f2059338640 1 -- 172.21.15.40:0/3660339437 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20541f51a0 con 0x7f20541f1640 2024-04-22T07:24:41.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.426+0000 7f205a33a640 1 --2- 172.21.15.40:0/3660339437 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2054147d60 0x7f20541481e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:24:41.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.426+0000 7f2059b39640 1 --2- 172.21.15.40:0/3660339437 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2040004d40 0x7f20541f4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:24:41.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.426+0000 7f2059338640 1 --2- 172.21.15.40:0/3660339437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20541f1640 0x7f20540c5e30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2044007340 tx=0x7f2044007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:41.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.426+0000 7f204a7fc640 1 -- 172.21.15.40:0/3660339437 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204401a070 con 0x7f20541f1640 2024-04-22T07:24:41.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.426+0000 7f204a7fc640 1 -- 172.21.15.40:0/3660339437 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f204400fa00 con 0x7f20541f1640 2024-04-22T07:24:41.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.426+0000 7f205bd9d640 1 -- 172.21.15.40:0/3660339437 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2054148720 con 0x7f20541f1640 2024-04-22T07:24:41.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.426+0000 7f204a7fc640 1 -- 172.21.15.40:0/3660339437 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204400fdd0 con 0x7f20541f1640 2024-04-22T07:24:41.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.426+0000 7f205bd9d640 1 -- 172.21.15.40:0/3660339437 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2054157ec0 con 0x7f20541f1640 2024-04-22T07:24:41.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.427+0000 7f205bd9d640 1 -- 172.21.15.40:0/3660339437 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2054157c70 con 0x7f20541f1640 2024-04-22T07:24:41.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.428+0000 7f204a7fc640 1 -- 172.21.15.40:0/3660339437 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f204401d070 con 0x7f20541f1640 2024-04-22T07:24:41.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.428+0000 7f204a7fc640 1 --2- 172.21.15.40:0/3660339437 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f203806c8f0 0x7f203806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.428+0000 7f204a7fc640 1 -- 172.21.15.40:0/3660339437 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f204408b660 con 0x7f20541f1640 2024-04-22T07:24:41.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.428+0000 7f2059b39640 1 --2- 172.21.15.40:0/3660339437 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f203806c8f0 0x7f203806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.428+0000 7f204a7fc640 1 --2- 172.21.15.40:0/3660339437 >> [v2:172.21.15.62:6808/3509322231,v1:172.21.15.62:6809/3509322231] conn(0x7f2038074b50 0x7f2038076f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.428+0000 7f204a7fc640 1 -- 172.21.15.40:0/3660339437 --> [v2:172.21.15.62:6808/3509322231,v1:172.21.15.62:6809/3509322231] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2038077640 con 0x7f2038074b50 2024-04-22T07:24:41.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.428+0000 7f204a7fc640 1 -- 172.21.15.40:0/3660339437 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2044092050 con 0x7f20541f1640 2024-04-22T07:24:41.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.429+0000 7f205a33a640 1 --2- 172.21.15.40:0/3660339437 >> [v2:172.21.15.62:6808/3509322231,v1:172.21.15.62:6809/3509322231] conn(0x7f2038074b50 0x7f2038076f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.429+0000 7f2059b39640 1 --2- 172.21.15.40:0/3660339437 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f203806c8f0 0x7f203806edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2050009a40 tx=0x7f2050008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:41.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.429+0000 7f205a33a640 1 --2- 172.21.15.40:0/3660339437 >> [v2:172.21.15.62:6808/3509322231,v1:172.21.15.62:6809/3509322231] conn(0x7f2038074b50 0x7f2038076f70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:41.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.430+0000 7f204a7fc640 1 -- 172.21.15.40:0/3660339437 <== osd.5 v2:172.21.15.62:6808/3509322231 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2038077640 con 0x7f2038074b50 2024-04-22T07:24:41.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.443+0000 7f205bd9d640 1 -- 172.21.15.40:0/3660339437 --> [v2:172.21.15.62:6808/3509322231,v1:172.21.15.62:6809/3509322231] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f20540cc3f0 con 0x7f2038074b50 2024-04-22T07:24:41.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.444+0000 7f204a7fc640 1 -- 172.21.15.40:0/3660339437 <== osd.5 v2:172.21.15.62:6808/3509322231 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f20540cc3f0 con 0x7f2038074b50 2024-04-22T07:24:41.442 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-22T07:24:41.442 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T07:24:41.442 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-22T07:24:41.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.444+0000 7f205bd9d640 1 -- 172.21.15.40:0/3660339437 >> [v2:172.21.15.62:6808/3509322231,v1:172.21.15.62:6809/3509322231] conn(0x7f2038074b50 msgr2=0x7f2038076f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:41.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.444+0000 7f205bd9d640 1 --2- 172.21.15.40:0/3660339437 >> [v2:172.21.15.62:6808/3509322231,v1:172.21.15.62:6809/3509322231] conn(0x7f2038074b50 0x7f2038076f70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.444+0000 7f205bd9d640 1 -- 172.21.15.40:0/3660339437 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f203806c8f0 msgr2=0x7f203806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:41.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.444+0000 7f205bd9d640 1 --2- 172.21.15.40:0/3660339437 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f203806c8f0 0x7f203806edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2050009a40 tx=0x7f2050008040 comp rx=0 tx=0).stop 2024-04-22T07:24:41.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.444+0000 7f205bd9d640 1 -- 172.21.15.40:0/3660339437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20541f1640 msgr2=0x7f20540c5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:41.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.444+0000 7f205bd9d640 1 --2- 172.21.15.40:0/3660339437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20541f1640 0x7f20540c5e30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2044007340 tx=0x7f2044007800 comp rx=0 tx=0).stop 2024-04-22T07:24:41.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.444+0000 7f205a33a640 1 -- 172.21.15.40:0/3660339437 reap_dead start 2024-04-22T07:24:41.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.444+0000 7f205bd9d640 1 -- 172.21.15.40:0/3660339437 shutdown_connections 2024-04-22T07:24:41.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.444+0000 7f205bd9d640 1 -- 172.21.15.40:0/3660339437 >> 172.21.15.40:0/3660339437 conn(0x7f205406ce70 msgr2=0x7f205406d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:41.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.444+0000 7f205bd9d640 1 -- 172.21.15.40:0/3660339437 shutdown_connections 2024-04-22T07:24:41.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.445+0000 7f205bd9d640 1 -- 172.21.15.40:0/3660339437 wait complete. 2024-04-22T07:24:41.453 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-22T07:24:41.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.556+0000 7f64b5dce640 1 Processor -- start 2024-04-22T07:24:41.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.556+0000 7f64b5dce640 1 -- start start 2024-04-22T07:24:41.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.557+0000 7f64b5dce640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f64b0154fa0 0x7f64b015b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.557+0000 7f64b5dce640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64b00cb930 con 0x7f64b00cb4b0 2024-04-22T07:24:41.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.557+0000 7f64b5dce640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64b015e4b0 con 0x7f64b00cc990 2024-04-22T07:24:41.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.557+0000 7f64b5dce640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f64b015e260 con 0x7f64b0154fa0 2024-04-22T07:24:41.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.557+0000 7f64aeffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f64b00cb4b0 0x7f64b00c54c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57342/0 (socket says 172.21.15.40:57342) 2024-04-22T07:24:41.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.557+0000 7f64aeffd640 1 -- 172.21.15.40:0/3162710547 learned_addr learned my addr 172.21.15.40:0/3162710547 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:24:41.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.557+0000 7f64ae7fc640 1 -- 172.21.15.40:0/3162710547 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3968067762 0 0) 0x7f64b00cb930 con 0x7f64b00cb4b0 2024-04-22T07:24:41.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.557+0000 7f64ae7fc640 1 -- 172.21.15.40:0/3162710547 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f649c003520 con 0x7f64b00cb4b0 2024-04-22T07:24:41.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.557+0000 7f64af7fe640 1 --2- 172.21.15.40:0/3162710547 >> v2:172.21.15.62:3300/0 conn(0x7f64b0154fa0 0x7f64b015b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.558+0000 7f64ae7fc640 1 -- 172.21.15.40:0/3162710547 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4268135080 0 0) 0x7f649c003520 con 0x7f64b00cb4b0 2024-04-22T07:24:41.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.558+0000 7f64ae7fc640 1 -- 172.21.15.40:0/3162710547 >> v2:172.21.15.62:3300/0 conn(0x7f64b0154fa0 msgr2=0x7f64b015b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:41.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.558+0000 7f64ae7fc640 1 --2- 172.21.15.40:0/3162710547 >> v2:172.21.15.62:3300/0 conn(0x7f64b0154fa0 0x7f64b015b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.558+0000 7f64ae7fc640 1 -- 172.21.15.40:0/3162710547 >> v1:172.21.15.62:6789/0 conn(0x7f64b00cc990 legacy=0x7f64b00d0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:41.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.558+0000 7f64ae7fc640 1 -- 172.21.15.40:0/3162710547 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b015e790 con 0x7f64b00cb4b0 2024-04-22T07:24:41.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.558+0000 7f64ae7fc640 1 -- 172.21.15.40:0/3162710547 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7f64a0001670 con 0x7f64b00cb4b0 2024-04-22T07:24:41.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.558+0000 7f64ae7fc640 1 -- 172.21.15.40:0/3162710547 >> v1:172.21.15.40:6789/0 conn(0x7f64b00cb4b0 legacy=0x7f64b00c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:41.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.558+0000 7f64ae7fc640 1 --2- 172.21.15.40:0/3162710547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f649c0039b0 0x7f649c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.558+0000 7f64ae7fc640 1 --2- 172.21.15.40:0/3162710547 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f649c004800 0x7f649c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.558+0000 7f64ae7fc640 1 --2- 172.21.15.40:0/3162710547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f649c0051c0 0x7f649c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.558+0000 7f64ae7fc640 1 -- 172.21.15.40:0/3162710547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f64b015e260 con 0x7f649c0051c0 2024-04-22T07:24:41.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.558+0000 7f64ae7fc640 1 -- 172.21.15.40:0/3162710547 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f649c00c060 con 0x7f649c0039b0 2024-04-22T07:24:41.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.558+0000 7f64ae7fc640 1 -- 172.21.15.40:0/3162710547 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f649c00c260 con 0x7f649c004800 2024-04-22T07:24:41.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.558+0000 7f64af7fe640 1 --2- 172.21.15.40:0/3162710547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f649c0039b0 0x7f649c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.558+0000 7f64affff640 1 --2- 172.21.15.40:0/3162710547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f649c0051c0 0x7f649c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.558+0000 7f64aeffd640 1 --2- 172.21.15.40:0/3162710547 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f649c004800 0x7f649c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.558+0000 7f64affff640 1 -- 172.21.15.40:0/3162710547 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f649c004800 msgr2=0x7f649c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:41.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.558+0000 7f64affff640 1 --2- 172.21.15.40:0/3162710547 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f649c004800 0x7f649c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.558+0000 7f64affff640 1 -- 172.21.15.40:0/3162710547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f649c0039b0 msgr2=0x7f649c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:41.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.558+0000 7f64affff640 1 --2- 172.21.15.40:0/3162710547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f649c0039b0 0x7f649c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.558+0000 7f64affff640 1 -- 172.21.15.40:0/3162710547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f649c003520 con 0x7f649c0051c0 2024-04-22T07:24:41.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.558+0000 7f64aeffd640 1 --2- 172.21.15.40:0/3162710547 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f649c004800 0x7f649c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:24:41.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.559+0000 7f64affff640 1 -- 172.21.15.40:0/3162710547 reap_dead start 2024-04-22T07:24:41.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.559+0000 7f64affff640 1 --2- 172.21.15.40:0/3162710547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f649c0051c0 0x7f649c00b9c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f64a8001e50 tx=0x7f649c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105371666b268d87 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:41.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.559+0000 7f64ae7fc640 1 -- 172.21.15.40:0/3162710547 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a8001a70 con 0x7f649c0051c0 2024-04-22T07:24:41.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.559+0000 7f64ae7fc640 1 -- 172.21.15.40:0/3162710547 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a8003bb0 con 0x7f649c0051c0 2024-04-22T07:24:41.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.559+0000 7f64ae7fc640 1 -- 172.21.15.40:0/3162710547 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a80050d0 con 0x7f649c0051c0 2024-04-22T07:24:41.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.560+0000 7f64b5dce640 1 -- 172.21.15.40:0/3162710547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f649c0051c0 msgr2=0x7f649c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:41.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.560+0000 7f64b5dce640 1 --2- 172.21.15.40:0/3162710547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f649c0051c0 0x7f649c00b9c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f64a8001e50 tx=0x7f649c005830 comp rx=0 tx=0).stop 2024-04-22T07:24:41.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.560+0000 7f64b5dce640 1 -- 172.21.15.40:0/3162710547 shutdown_connections 2024-04-22T07:24:41.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.560+0000 7f64b5dce640 1 --2- 172.21.15.40:0/3162710547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f649c0051c0 0x7f649c00b9c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.560+0000 7f64b5dce640 1 -- 172.21.15.40:0/3162710547 >> 172.21.15.40:0/3162710547 conn(0x7f64b0072360 msgr2=0x7f64b006cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:41.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.560+0000 7f64b5dce640 1 -- 172.21.15.40:0/3162710547 shutdown_connections 2024-04-22T07:24:41.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.560+0000 7f64b5dce640 1 -- 172.21.15.40:0/3162710547 wait complete. 2024-04-22T07:24:41.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.561+0000 7f64b5dce640 1 Processor -- start 2024-04-22T07:24:41.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.561+0000 7f64b5dce640 1 -- start start 2024-04-22T07:24:41.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.562+0000 7f64b5dce640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f649c0051c0 0x7f64b00c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.562+0000 7f64b5dce640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64b0158300 0x7f64b015d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.562+0000 7f64b5dce640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64b01f41f0 0x7f64b00cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.562+0000 7f64b5dce640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f64b0155380 con 0x7f649c0051c0 2024-04-22T07:24:41.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.562+0000 7f64b5dce640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f64b015ede0 con 0x7f64b0158300 2024-04-22T07:24:41.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.562+0000 7f64b5dce640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f64b015b6f0 con 0x7f64b01f41f0 2024-04-22T07:24:41.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.562+0000 7f64af7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f649c0051c0 0x7f64b00c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.562+0000 7f64af7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f649c0051c0 0x7f64b00c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44654/0 (socket says 172.21.15.40:44654) 2024-04-22T07:24:41.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.562+0000 7f64af7fe640 1 -- 172.21.15.40:0/4292993693 learned_addr learned my addr 172.21.15.40:0/4292993693 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:41.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.562+0000 7f64aeffd640 1 --2- 172.21.15.40:0/4292993693 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64b0158300 0x7f64b015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.562+0000 7f64affff640 1 --2- 172.21.15.40:0/4292993693 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64b01f41f0 0x7f64b00cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.562+0000 7f64af7fe640 1 -- 172.21.15.40:0/4292993693 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64b01f41f0 msgr2=0x7f64b00cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:41.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.562+0000 7f64af7fe640 1 --2- 172.21.15.40:0/4292993693 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64b01f41f0 0x7f64b00cf6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.562+0000 7f64af7fe640 1 -- 172.21.15.40:0/4292993693 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64b0158300 msgr2=0x7f64b015d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:41.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.562+0000 7f64af7fe640 1 --2- 172.21.15.40:0/4292993693 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64b0158300 0x7f64b015d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.562+0000 7f64af7fe640 1 -- 172.21.15.40:0/4292993693 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b00c5d40 con 0x7f649c0051c0 2024-04-22T07:24:41.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.562+0000 7f64affff640 1 --2- 172.21.15.40:0/4292993693 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64b01f41f0 0x7f64b00cf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:24:41.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.562+0000 7f64af7fe640 1 --2- 172.21.15.40:0/4292993693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f649c0051c0 0x7f64b00c6300 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f64980118e0 tx=0x7f6498011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:41.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.562+0000 7f64a7fff640 1 -- 172.21.15.40:0/4292993693 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649800faf0 con 0x7f649c0051c0 2024-04-22T07:24:41.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.562+0000 7f64a7fff640 1 -- 172.21.15.40:0/4292993693 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f649800fc90 con 0x7f649c0051c0 2024-04-22T07:24:41.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.562+0000 7f64b5dce640 1 -- 172.21.15.40:0/4292993693 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64b00c6020 con 0x7f649c0051c0 2024-04-22T07:24:41.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.562+0000 7f64a7fff640 1 -- 172.21.15.40:0/4292993693 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6498014440 con 0x7f649c0051c0 2024-04-22T07:24:41.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.562+0000 7f64b5dce640 1 -- 172.21.15.40:0/4292993693 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64b01f1290 con 0x7f649c0051c0 2024-04-22T07:24:41.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.563+0000 7f64b5dce640 1 -- 172.21.15.40:0/4292993693 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64b0076050 con 0x7f649c0051c0 2024-04-22T07:24:41.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.564+0000 7f64a7fff640 1 -- 172.21.15.40:0/4292993693 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6498012040 con 0x7f649c0051c0 2024-04-22T07:24:41.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.564+0000 7f64a7fff640 1 --2- 172.21.15.40:0/4292993693 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f649006c8f0 0x7f649006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.564+0000 7f64a7fff640 1 -- 172.21.15.40:0/4292993693 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f649808c130 con 0x7f649c0051c0 2024-04-22T07:24:41.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.564+0000 7f64aeffd640 1 --2- 172.21.15.40:0/4292993693 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f649006c8f0 0x7f649006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.565+0000 7f64aeffd640 1 --2- 172.21.15.40:0/4292993693 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f649006c8f0 0x7f649006edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f64b01532d0 tx=0x7f64a0007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:41.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.569+0000 7f64a7fff640 1 -- 172.21.15.40:0/4292993693 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f64b0076050 con 0x7f649c0051c0 2024-04-22T07:24:41.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.755+0000 7f64b5dce640 1 -- 172.21.15.40:0/4292993693 --> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f64b0069d40 con 0x7f649006c8f0 2024-04-22T07:24:41.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.755+0000 7f64a7fff640 1 -- 172.21.15.40:0/4292993693 <== mgr.4107 v2:172.21.15.40:6832/91163869 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f64b0069d40 con 0x7f649006c8f0 2024-04-22T07:24:41.753 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 5 to deep-scrub 2024-04-22T07:24:41.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.757+0000 7f64b5dce640 1 -- 172.21.15.40:0/4292993693 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f649006c8f0 msgr2=0x7f649006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:41.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.757+0000 7f64b5dce640 1 --2- 172.21.15.40:0/4292993693 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f649006c8f0 0x7f649006edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f64b01532d0 tx=0x7f64a0007040 comp rx=0 tx=0).stop 2024-04-22T07:24:41.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.757+0000 7f64b5dce640 1 -- 172.21.15.40:0/4292993693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f649c0051c0 msgr2=0x7f64b00c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:41.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.757+0000 7f64b5dce640 1 --2- 172.21.15.40:0/4292993693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f649c0051c0 0x7f64b00c6300 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f64980118e0 tx=0x7f6498011da0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.757+0000 7f64b5dce640 1 -- 172.21.15.40:0/4292993693 shutdown_connections 2024-04-22T07:24:41.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.757+0000 7f64b5dce640 1 --2- 172.21.15.40:0/4292993693 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f64b01f41f0 0x7f64b00cf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.757+0000 7f64b5dce640 1 --2- 172.21.15.40:0/4292993693 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f64b0158300 0x7f64b015d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.757+0000 7f64b5dce640 1 --2- 172.21.15.40:0/4292993693 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f649006c8f0 0x7f649006edb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.757+0000 7f64b5dce640 1 --2- 172.21.15.40:0/4292993693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f649c0051c0 0x7f64b00c6300 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.757+0000 7f64b5dce640 1 -- 172.21.15.40:0/4292993693 >> 172.21.15.40:0/4292993693 conn(0x7f64b0072360 msgr2=0x7f64b0159f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:41.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.758+0000 7f64b5dce640 1 -- 172.21.15.40:0/4292993693 shutdown_connections 2024-04-22T07:24:41.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.758+0000 7f64b5dce640 1 -- 172.21.15.40:0/4292993693 wait complete. 2024-04-22T07:24:41.766 INFO:tasks.ceph:Scrubbing osd.6 2024-04-22T07:24:41.767 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-22T07:24:41.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.875+0000 7fb899396640 1 Processor -- start 2024-04-22T07:24:41.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.875+0000 7fb899396640 1 -- start start 2024-04-22T07:24:41.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.876+0000 7fb899396640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb894155320 0x7fb8940cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.876+0000 7fb899396640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb89415b880 con 0x7fb8940d0bc0 2024-04-22T07:24:41.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.876+0000 7fb899396640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb89415bb60 con 0x7fb8940d0fa0 2024-04-22T07:24:41.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.876+0000 7fb899396640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fb89415e370 con 0x7fb894155320 2024-04-22T07:24:41.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.876+0000 7fb892ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb8940d0bc0 0x7fb894154c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57350/0 (socket says 172.21.15.40:57350) 2024-04-22T07:24:41.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.876+0000 7fb892ffd640 1 -- 172.21.15.40:0/3617856754 learned_addr learned my addr 172.21.15.40:0/3617856754 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:24:41.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.876+0000 7fb8937fe640 1 --2- 172.21.15.40:0/3617856754 >> v2:172.21.15.62:3300/0 conn(0x7fb894155320 0x7fb8940cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.876+0000 7fb8927fc640 1 -- 172.21.15.40:0/3617856754 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 439334951 0 0) 0x7fb89415b880 con 0x7fb8940d0bc0 2024-04-22T07:24:41.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.876+0000 7fb8927fc640 1 -- 172.21.15.40:0/3617856754 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb880003520 con 0x7fb8940d0bc0 2024-04-22T07:24:41.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.876+0000 7fb8937fe640 1 -- 172.21.15.40:0/3617856754 >> v1:172.21.15.62:6789/0 conn(0x7fb8940d0fa0 legacy=0x7fb89415e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:41.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.876+0000 7fb8927fc640 1 -- 172.21.15.40:0/3617856754 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3399577798 0 0) 0x7fb880003520 con 0x7fb8940d0bc0 2024-04-22T07:24:41.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.876+0000 7fb8937fe640 1 -- 172.21.15.40:0/3617856754 >> v1:172.21.15.40:6789/0 conn(0x7fb8940d0bc0 legacy=0x7fb894154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:41.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.876+0000 7fb8937fe640 1 -- 172.21.15.40:0/3617856754 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8940cb0e0 con 0x7fb894155320 2024-04-22T07:24:41.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.877+0000 7fb8937fe640 1 --2- 172.21.15.40:0/3617856754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb894155320 0x7fb8940cc610 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb89415e4f0 tx=0x7fb88c02bc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea68e6cef072676b server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:41.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.877+0000 7fb8927fc640 1 -- 172.21.15.40:0/3617856754 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88c039070 con 0x7fb894155320 2024-04-22T07:24:41.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.877+0000 7fb8927fc640 1 -- 172.21.15.40:0/3617856754 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb88c02c790 con 0x7fb894155320 2024-04-22T07:24:41.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.877+0000 7fb8927fc640 1 -- 172.21.15.40:0/3617856754 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb884001670 con 0x7fb894155320 2024-04-22T07:24:41.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.878+0000 7fb899396640 1 -- 172.21.15.40:0/3617856754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb894155320 msgr2=0x7fb8940cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:41.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.878+0000 7fb899396640 1 --2- 172.21.15.40:0/3617856754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb894155320 0x7fb8940cc610 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb89415e4f0 tx=0x7fb88c02bc60 comp rx=0 tx=0).stop 2024-04-22T07:24:41.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.878+0000 7fb899396640 1 -- 172.21.15.40:0/3617856754 shutdown_connections 2024-04-22T07:24:41.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.878+0000 7fb899396640 1 --2- 172.21.15.40:0/3617856754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb894155320 0x7fb8940cc610 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.878+0000 7fb899396640 1 -- 172.21.15.40:0/3617856754 >> 172.21.15.40:0/3617856754 conn(0x7fb89406ce70 msgr2=0x7fb89406d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:41.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.878+0000 7fb899396640 1 -- 172.21.15.40:0/3617856754 shutdown_connections 2024-04-22T07:24:41.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.878+0000 7fb899396640 1 -- 172.21.15.40:0/3617856754 wait complete. 2024-04-22T07:24:41.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.879+0000 7fb899396640 1 Processor -- start 2024-04-22T07:24:41.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.879+0000 7fb899396640 1 -- start start 2024-04-22T07:24:41.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.880+0000 7fb899396640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8940d0bc0 0x7fb89415d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.880+0000 7fb899396640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8940d0fa0 0x7fb8941559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.880+0000 7fb899396640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb894155320 0x7fb8941568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.880+0000 7fb899396640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb89415f090 con 0x7fb8940d0bc0 2024-04-22T07:24:41.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.880+0000 7fb899396640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb89415ef10 con 0x7fb894155320 2024-04-22T07:24:41.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.880+0000 7fb899396640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb8941f08d0 con 0x7fb8940d0fa0 2024-04-22T07:24:41.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.880+0000 7fb892ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8940d0bc0 0x7fb89415d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.880+0000 7fb892ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8940d0bc0 0x7fb89415d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44668/0 (socket says 172.21.15.40:44668) 2024-04-22T07:24:41.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.880+0000 7fb892ffd640 1 -- 172.21.15.40:0/1991935480 learned_addr learned my addr 172.21.15.40:0/1991935480 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:41.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.880+0000 7fb8937fe640 1 --2- 172.21.15.40:0/1991935480 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb894155320 0x7fb8941568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.880+0000 7fb88bfff640 1 --2- 172.21.15.40:0/1991935480 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8940d0fa0 0x7fb8941559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.880+0000 7fb892ffd640 1 -- 172.21.15.40:0/1991935480 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8940d0fa0 msgr2=0x7fb8941559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:41.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.880+0000 7fb892ffd640 1 --2- 172.21.15.40:0/1991935480 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8940d0fa0 0x7fb8941559e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.880+0000 7fb892ffd640 1 -- 172.21.15.40:0/1991935480 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb894155320 msgr2=0x7fb8941568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:41.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.880+0000 7fb892ffd640 1 --2- 172.21.15.40:0/1991935480 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb894155320 0x7fb8941568a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.880+0000 7fb892ffd640 1 -- 172.21.15.40:0/1991935480 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8941f0bb0 con 0x7fb8940d0bc0 2024-04-22T07:24:41.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.880+0000 7fb88bfff640 1 --2- 172.21.15.40:0/1991935480 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8940d0fa0 0x7fb8941559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:24:41.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.880+0000 7fb892ffd640 1 --2- 172.21.15.40:0/1991935480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8940d0bc0 0x7fb89415d2e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb88400c550 tx=0x7fb88400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:41.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.880+0000 7fb88b7fe640 1 -- 172.21.15.40:0/1991935480 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb884018070 con 0x7fb8940d0bc0 2024-04-22T07:24:41.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.881+0000 7fb88b7fe640 1 -- 172.21.15.40:0/1991935480 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8840074e0 con 0x7fb8940d0bc0 2024-04-22T07:24:41.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.881+0000 7fb899396640 1 -- 172.21.15.40:0/1991935480 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8941f0e90 con 0x7fb8940d0bc0 2024-04-22T07:24:41.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.881+0000 7fb88b7fe640 1 -- 172.21.15.40:0/1991935480 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb884004a20 con 0x7fb8940d0bc0 2024-04-22T07:24:41.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.881+0000 7fb899396640 1 -- 172.21.15.40:0/1991935480 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb894158400 con 0x7fb8940d0bc0 2024-04-22T07:24:41.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.882+0000 7fb899396640 1 -- 172.21.15.40:0/1991935480 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb8941f1550 con 0x7fb8940d0bc0 2024-04-22T07:24:41.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.882+0000 7fb88b7fe640 1 -- 172.21.15.40:0/1991935480 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb884004bc0 con 0x7fb8940d0bc0 2024-04-22T07:24:41.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.882+0000 7fb88b7fe640 1 --2- 172.21.15.40:0/1991935480 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fb87406c920 0x7fb87406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.883+0000 7fb88bfff640 1 --2- 172.21.15.40:0/1991935480 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fb87406c920 0x7fb87406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.883+0000 7fb88b7fe640 1 -- 172.21.15.40:0/1991935480 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7fb88408af90 con 0x7fb8940d0bc0 2024-04-22T07:24:41.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.883+0000 7fb88b7fe640 1 --2- 172.21.15.40:0/1991935480 >> [v2:172.21.15.62:6824/3094315954,v1:172.21.15.62:6825/3094315954] conn(0x7fb874074b80 0x7fb874076fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:41.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.883+0000 7fb88b7fe640 1 -- 172.21.15.40:0/1991935480 --> [v2:172.21.15.62:6824/3094315954,v1:172.21.15.62:6825/3094315954] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb874077670 con 0x7fb874074b80 2024-04-22T07:24:41.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.883+0000 7fb88b7fe640 1 -- 172.21.15.40:0/1991935480 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb88408d5b0 con 0x7fb8940d0bc0 2024-04-22T07:24:41.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.883+0000 7fb88bfff640 1 --2- 172.21.15.40:0/1991935480 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fb87406c920 0x7fb87406ede0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb8940cce70 tx=0x7fb87c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:41.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.883+0000 7fb8937fe640 1 --2- 172.21.15.40:0/1991935480 >> [v2:172.21.15.62:6824/3094315954,v1:172.21.15.62:6825/3094315954] conn(0x7fb874074b80 0x7fb874076fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:41.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.883+0000 7fb8937fe640 1 --2- 172.21.15.40:0/1991935480 >> [v2:172.21.15.62:6824/3094315954,v1:172.21.15.62:6825/3094315954] conn(0x7fb874074b80 0x7fb874076fa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:41.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.884+0000 7fb88b7fe640 1 -- 172.21.15.40:0/1991935480 <== osd.6 v2:172.21.15.62:6824/3094315954 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb874077670 con 0x7fb874074b80 2024-04-22T07:24:41.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.898+0000 7fb899396640 1 -- 172.21.15.40:0/1991935480 --> [v2:172.21.15.62:6824/3094315954,v1:172.21.15.62:6825/3094315954] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb8940d0300 con 0x7fb874074b80 2024-04-22T07:24:41.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.898+0000 7fb88b7fe640 1 -- 172.21.15.40:0/1991935480 <== osd.6 v2:172.21.15.62:6824/3094315954 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb8940d0300 con 0x7fb874074b80 2024-04-22T07:24:41.896 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-22T07:24:41.897 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T07:24:41.897 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-22T07:24:41.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.899+0000 7fb899396640 1 -- 172.21.15.40:0/1991935480 >> [v2:172.21.15.62:6824/3094315954,v1:172.21.15.62:6825/3094315954] conn(0x7fb874074b80 msgr2=0x7fb874076fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:41.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.899+0000 7fb899396640 1 --2- 172.21.15.40:0/1991935480 >> [v2:172.21.15.62:6824/3094315954,v1:172.21.15.62:6825/3094315954] conn(0x7fb874074b80 0x7fb874076fa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:41.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.899+0000 7fb899396640 1 -- 172.21.15.40:0/1991935480 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fb87406c920 msgr2=0x7fb87406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:41.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.899+0000 7fb899396640 1 --2- 172.21.15.40:0/1991935480 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fb87406c920 0x7fb87406ede0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb8940cce70 tx=0x7fb87c009040 comp rx=0 tx=0).stop 2024-04-22T07:24:41.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.899+0000 7fb899396640 1 -- 172.21.15.40:0/1991935480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8940d0bc0 msgr2=0x7fb89415d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:41.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.899+0000 7fb899396640 1 --2- 172.21.15.40:0/1991935480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8940d0bc0 0x7fb89415d2e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb88400c550 tx=0x7fb88400ca10 comp rx=0 tx=0).stop 2024-04-22T07:24:41.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.899+0000 7fb8937fe640 1 -- 172.21.15.40:0/1991935480 reap_dead start 2024-04-22T07:24:41.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.899+0000 7fb899396640 1 -- 172.21.15.40:0/1991935480 shutdown_connections 2024-04-22T07:24:41.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.899+0000 7fb899396640 1 -- 172.21.15.40:0/1991935480 >> 172.21.15.40:0/1991935480 conn(0x7fb89406ce70 msgr2=0x7fb89406d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:41.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.899+0000 7fb899396640 1 -- 172.21.15.40:0/1991935480 shutdown_connections 2024-04-22T07:24:41.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:41.899+0000 7fb899396640 1 -- 172.21.15.40:0/1991935480 wait complete. 2024-04-22T07:24:41.907 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-22T07:24:42.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.012+0000 7efe83ba4640 1 Processor -- start 2024-04-22T07:24:42.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.012+0000 7efe83ba4640 1 -- start start 2024-04-22T07:24:42.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.013+0000 7efe83ba4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efe7c15f0c0 0x7efe7c0cb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:42.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.013+0000 7efe83ba4640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efe7c0cbc50 0x7efe7c0b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:42.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.013+0000 7efe83ba4640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe7c15b1b0 con 0x7efe7c155130 2024-04-22T07:24:42.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.013+0000 7efe83ba4640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7efe7c15b490 con 0x7efe7c15f0c0 2024-04-22T07:24:42.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.013+0000 7efe83ba4640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7efe7c15b770 con 0x7efe7c0cbc50 2024-04-22T07:24:42.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.013+0000 7efe8113f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efe7c15f0c0 0x7efe7c0cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:42.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.013+0000 7efe8113f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efe7c15f0c0 0x7efe7c0cb710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44670/0 (socket says 172.21.15.40:44670) 2024-04-22T07:24:42.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.013+0000 7efe8113f640 1 -- 172.21.15.40:0/3698822783 learned_addr learned my addr 172.21.15.40:0/3698822783 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:42.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.013+0000 7efe8113f640 1 -- 172.21.15.40:0/3698822783 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efe7c0cbc50 msgr2=0x7efe7c0b4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:42.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.013+0000 7efe82141640 1 --2- 172.21.15.40:0/3698822783 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efe7c0cbc50 0x7efe7c0b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:42.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.013+0000 7efe8113f640 1 --2- 172.21.15.40:0/3698822783 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efe7c0cbc50 0x7efe7c0b4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.014+0000 7efe8113f640 1 -- 172.21.15.40:0/3698822783 >> v1:172.21.15.62:6789/0 conn(0x7efe7c155130 legacy=0x7efe7c0cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:42.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.014+0000 7efe8113f640 1 -- 172.21.15.40:0/3698822783 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe7c15ba50 con 0x7efe7c15f0c0 2024-04-22T07:24:42.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.014+0000 7efe8113f640 1 --2- 172.21.15.40:0/3698822783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe7c15f0c0 0x7efe7c0cb710 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7efe70009870 tx=0x7efe7002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a06eef6f25ecb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:42.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.014+0000 7efe8093e640 1 -- 172.21.15.40:0/3698822783 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe70034070 con 0x7efe7c15f0c0 2024-04-22T07:24:42.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.014+0000 7efe8093e640 1 -- 172.21.15.40:0/3698822783 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe70030840 con 0x7efe7c15f0c0 2024-04-22T07:24:42.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.014+0000 7efe8093e640 1 -- 172.21.15.40:0/3698822783 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe70030c10 con 0x7efe7c15f0c0 2024-04-22T07:24:42.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.015+0000 7efe83ba4640 1 -- 172.21.15.40:0/3698822783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe7c15f0c0 msgr2=0x7efe7c0cb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:42.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.015+0000 7efe83ba4640 1 --2- 172.21.15.40:0/3698822783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe7c15f0c0 0x7efe7c0cb710 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7efe70009870 tx=0x7efe7002b980 comp rx=0 tx=0).stop 2024-04-22T07:24:42.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.015+0000 7efe83ba4640 1 -- 172.21.15.40:0/3698822783 shutdown_connections 2024-04-22T07:24:42.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.015+0000 7efe83ba4640 1 --2- 172.21.15.40:0/3698822783 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efe7c0cbc50 0x7efe7c0b4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.015+0000 7efe83ba4640 1 --2- 172.21.15.40:0/3698822783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe7c15f0c0 0x7efe7c0cb710 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.015+0000 7efe83ba4640 1 -- 172.21.15.40:0/3698822783 >> 172.21.15.40:0/3698822783 conn(0x7efe7c067890 msgr2=0x7efe7c072860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:42.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.015+0000 7efe83ba4640 1 -- 172.21.15.40:0/3698822783 shutdown_connections 2024-04-22T07:24:42.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.015+0000 7efe83ba4640 1 -- 172.21.15.40:0/3698822783 wait complete. 2024-04-22T07:24:42.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.016+0000 7efe83ba4640 1 Processor -- start 2024-04-22T07:24:42.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.016+0000 7efe83ba4640 1 -- start start 2024-04-22T07:24:42.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.017+0000 7efe83ba4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe7c0cbc50 0x7efe7c1e6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:42.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.017+0000 7efe83ba4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe7c155130 0x7efe7c0cf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:42.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.017+0000 7efe83ba4640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efe7c0ca730 0x7efe7c1e61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:42.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.017+0000 7efe83ba4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7efe7c0cd840 con 0x7efe7c0cbc50 2024-04-22T07:24:42.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.017+0000 7efe83ba4640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efe7c155510 con 0x7efe7c155130 2024-04-22T07:24:42.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.017+0000 7efe83ba4640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7efe7c0cd9c0 con 0x7efe7c0ca730 2024-04-22T07:24:42.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.017+0000 7efe81940640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe7c0cbc50 0x7efe7c1e6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:42.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.017+0000 7efe81940640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe7c0cbc50 0x7efe7c1e6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44674/0 (socket says 172.21.15.40:44674) 2024-04-22T07:24:42.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.017+0000 7efe81940640 1 -- 172.21.15.40:0/386190206 learned_addr learned my addr 172.21.15.40:0/386190206 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:42.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.017+0000 7efe81940640 1 -- 172.21.15.40:0/386190206 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efe7c0ca730 msgr2=0x7efe7c1e61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:42.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.017+0000 7efe8113f640 1 --2- 172.21.15.40:0/386190206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe7c155130 0x7efe7c0cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:42.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.017+0000 7efe82141640 1 --2- 172.21.15.40:0/386190206 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efe7c0ca730 0x7efe7c1e61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:42.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.017+0000 7efe81940640 1 --2- 172.21.15.40:0/386190206 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efe7c0ca730 0x7efe7c1e61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.017+0000 7efe81940640 1 -- 172.21.15.40:0/386190206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe7c155130 msgr2=0x7efe7c0cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:42.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.017+0000 7efe81940640 1 --2- 172.21.15.40:0/386190206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe7c155130 0x7efe7c0cf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.017+0000 7efe81940640 1 -- 172.21.15.40:0/386190206 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe7c15cb80 con 0x7efe7c0cbc50 2024-04-22T07:24:42.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.017+0000 7efe81940640 1 --2- 172.21.15.40:0/386190206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe7c0cbc50 0x7efe7c1e6ee0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7efe7400b3f0 tx=0x7efe7400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:42.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.018+0000 7efe7a7fc640 1 -- 172.21.15.40:0/386190206 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe74015020 con 0x7efe7c0cbc50 2024-04-22T07:24:42.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.018+0000 7efe7a7fc640 1 -- 172.21.15.40:0/386190206 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe74011830 con 0x7efe7c0cbc50 2024-04-22T07:24:42.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.018+0000 7efe7a7fc640 1 -- 172.21.15.40:0/386190206 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe74011c20 con 0x7efe7c0cbc50 2024-04-22T07:24:42.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.018+0000 7efe83ba4640 1 -- 172.21.15.40:0/386190206 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe7c15ce40 con 0x7efe7c0cbc50 2024-04-22T07:24:42.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.018+0000 7efe83ba4640 1 -- 172.21.15.40:0/386190206 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe7c1e59d0 con 0x7efe7c0cbc50 2024-04-22T07:24:42.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.019+0000 7efe83ba4640 1 -- 172.21.15.40:0/386190206 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe7c069d40 con 0x7efe7c0cbc50 2024-04-22T07:24:42.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.019+0000 7efe7a7fc640 1 -- 172.21.15.40:0/386190206 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efe74018020 con 0x7efe7c0cbc50 2024-04-22T07:24:42.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.020+0000 7efe7a7fc640 1 --2- 172.21.15.40:0/386190206 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7efe6806c8f0 0x7efe6806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:42.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.020+0000 7efe7a7fc640 1 -- 172.21.15.40:0/386190206 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7efe7408b850 con 0x7efe7c0cbc50 2024-04-22T07:24:42.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.020+0000 7efe8113f640 1 --2- 172.21.15.40:0/386190206 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7efe6806c8f0 0x7efe6806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:42.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.020+0000 7efe8113f640 1 --2- 172.21.15.40:0/386190206 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7efe6806c8f0 0x7efe6806edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efe70036000 tx=0x7efe7003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:42.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.024+0000 7efe7a7fc640 1 -- 172.21.15.40:0/386190206 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efe7401f030 con 0x7efe7c0cbc50 2024-04-22T07:24:42.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.213+0000 7efe83ba4640 1 -- 172.21.15.40:0/386190206 --> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7efe7c0cc2e0 con 0x7efe6806c8f0 2024-04-22T07:24:42.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.214+0000 7efe7a7fc640 1 -- 172.21.15.40:0/386190206 <== mgr.4107 v2:172.21.15.40:6832/91163869 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7efe7c0cc2e0 con 0x7efe6806c8f0 2024-04-22T07:24:42.212 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 6 to deep-scrub 2024-04-22T07:24:42.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.216+0000 7efe83ba4640 1 -- 172.21.15.40:0/386190206 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7efe6806c8f0 msgr2=0x7efe6806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:42.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.216+0000 7efe83ba4640 1 --2- 172.21.15.40:0/386190206 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7efe6806c8f0 0x7efe6806edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efe70036000 tx=0x7efe7003b040 comp rx=0 tx=0).stop 2024-04-22T07:24:42.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.216+0000 7efe83ba4640 1 -- 172.21.15.40:0/386190206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe7c0cbc50 msgr2=0x7efe7c1e6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:42.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.216+0000 7efe83ba4640 1 --2- 172.21.15.40:0/386190206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe7c0cbc50 0x7efe7c1e6ee0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7efe7400b3f0 tx=0x7efe7400b8b0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.216+0000 7efe83ba4640 1 -- 172.21.15.40:0/386190206 shutdown_connections 2024-04-22T07:24:42.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.216+0000 7efe83ba4640 1 --2- 172.21.15.40:0/386190206 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efe7c0ca730 0x7efe7c1e61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.216+0000 7efe83ba4640 1 --2- 172.21.15.40:0/386190206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe7c155130 0x7efe7c0cf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.216+0000 7efe83ba4640 1 --2- 172.21.15.40:0/386190206 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7efe6806c8f0 0x7efe6806edb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.216+0000 7efe83ba4640 1 --2- 172.21.15.40:0/386190206 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe7c0cbc50 0x7efe7c1e6ee0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.216+0000 7efe83ba4640 1 -- 172.21.15.40:0/386190206 >> 172.21.15.40:0/386190206 conn(0x7efe7c067890 msgr2=0x7efe7c15a570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:42.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.216+0000 7efe83ba4640 1 -- 172.21.15.40:0/386190206 shutdown_connections 2024-04-22T07:24:42.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.216+0000 7efe83ba4640 1 -- 172.21.15.40:0/386190206 wait complete. 2024-04-22T07:24:42.225 INFO:tasks.ceph:Scrubbing osd.7 2024-04-22T07:24:42.225 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-22T07:24:42.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.333+0000 7f2216c43640 1 Processor -- start 2024-04-22T07:24:42.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.333+0000 7f2216c43640 1 -- start start 2024-04-22T07:24:42.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.334+0000 7f2216c43640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f221006bb90 0x7f221006f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:42.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.334+0000 7f2216c43640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f221006bf70 0x7f22100ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:42.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.334+0000 7f2216c43640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f221006fbb0 con 0x7f22100cade0 2024-04-22T07:24:42.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.334+0000 7f2216c43640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f221006fe90 con 0x7f221006bf70 2024-04-22T07:24:42.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.334+0000 7f2216c43640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f22100cbbd0 con 0x7f221006bb90 2024-04-22T07:24:42.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.334+0000 7f2207fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f221006bf70 0x7f22100ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:42.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.334+0000 7f2207fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f221006bf70 0x7f22100ca8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44690/0 (socket says 172.21.15.40:44690) 2024-04-22T07:24:42.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.334+0000 7f2207fff640 1 -- 172.21.15.40:0/4216503427 learned_addr learned my addr 172.21.15.40:0/4216503427 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:42.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.334+0000 7f22149df640 1 --2- 172.21.15.40:0/4216503427 >> v2:172.21.15.62:3300/0 conn(0x7f221006bb90 0x7f221006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:42.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.334+0000 7f2207fff640 1 -- 172.21.15.40:0/4216503427 >> v2:172.21.15.62:3300/0 conn(0x7f221006bb90 msgr2=0x7f221006f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:42.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.334+0000 7f2207fff640 1 --2- 172.21.15.40:0/4216503427 >> v2:172.21.15.62:3300/0 conn(0x7f221006bb90 0x7f221006f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.334+0000 7f2207fff640 1 -- 172.21.15.40:0/4216503427 >> v1:172.21.15.62:6789/0 conn(0x7f22100cade0 legacy=0x7f221015ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:42.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.334+0000 7f2207fff640 1 -- 172.21.15.40:0/4216503427 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22100cb330 con 0x7f221006bf70 2024-04-22T07:24:42.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.335+0000 7f2207fff640 1 --2- 172.21.15.40:0/4216503427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f221006bf70 0x7f22100ca8a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f22100702c0 tx=0x7f220002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e3ceb508a1baf1 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:42.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.335+0000 7f22077fe640 1 -- 172.21.15.40:0/4216503427 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220002e070 con 0x7f221006bf70 2024-04-22T07:24:42.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.335+0000 7f22077fe640 1 -- 172.21.15.40:0/4216503427 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2200037070 con 0x7f221006bf70 2024-04-22T07:24:42.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.335+0000 7f22077fe640 1 -- 172.21.15.40:0/4216503427 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2200031a00 con 0x7f221006bf70 2024-04-22T07:24:42.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.336+0000 7f2216c43640 1 -- 172.21.15.40:0/4216503427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f221006bf70 msgr2=0x7f22100ca8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:42.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.336+0000 7f2216c43640 1 --2- 172.21.15.40:0/4216503427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f221006bf70 0x7f22100ca8a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f22100702c0 tx=0x7f220002b880 comp rx=0 tx=0).stop 2024-04-22T07:24:42.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.336+0000 7f2216c43640 1 -- 172.21.15.40:0/4216503427 shutdown_connections 2024-04-22T07:24:42.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.336+0000 7f2216c43640 1 --2- 172.21.15.40:0/4216503427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f221006bf70 0x7f22100ca8a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.336+0000 7f2216c43640 1 --2- 172.21.15.40:0/4216503427 >> v2:172.21.15.62:3300/0 conn(0x7f221006bb90 0x7f221006f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.336+0000 7f2216c43640 1 -- 172.21.15.40:0/4216503427 >> 172.21.15.40:0/4216503427 conn(0x7f22100676b0 msgr2=0x7f221006db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:42.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.336+0000 7f2216c43640 1 -- 172.21.15.40:0/4216503427 shutdown_connections 2024-04-22T07:24:42.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.336+0000 7f2216c43640 1 -- 172.21.15.40:0/4216503427 wait complete. 2024-04-22T07:24:42.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.337+0000 7f2216c43640 1 Processor -- start 2024-04-22T07:24:42.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.337+0000 7f2216c43640 1 -- start start 2024-04-22T07:24:42.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.338+0000 7f2216c43640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f221006bb90 0x7f22101f4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:42.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.338+0000 7f2216c43640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f221006bf70 0x7f22100b2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:42.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.338+0000 7f2216c43640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22100cade0 0x7f2210150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:42.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.338+0000 7f2216c43640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f221015e5d0 con 0x7f22100cade0 2024-04-22T07:24:42.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.338+0000 7f2216c43640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f22100cb8f0 con 0x7f221006bf70 2024-04-22T07:24:42.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.338+0000 7f2216c43640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f221015f320 con 0x7f221006bb90 2024-04-22T07:24:42.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.338+0000 7f22151e0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22100cade0 0x7f2210150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:42.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.338+0000 7f22151e0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22100cade0 0x7f2210150b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44696/0 (socket says 172.21.15.40:44696) 2024-04-22T07:24:42.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.338+0000 7f22151e0640 1 -- 172.21.15.40:0/3065603567 learned_addr learned my addr 172.21.15.40:0/3065603567 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:42.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.338+0000 7f2207fff640 1 --2- 172.21.15.40:0/3065603567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f221006bf70 0x7f22100b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:42.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.338+0000 7f22149df640 1 --2- 172.21.15.40:0/3065603567 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f221006bb90 0x7f22101f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:42.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.338+0000 7f22151e0640 1 -- 172.21.15.40:0/3065603567 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f221006bb90 msgr2=0x7f22101f4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:42.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.338+0000 7f22151e0640 1 --2- 172.21.15.40:0/3065603567 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f221006bb90 0x7f22101f4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.338+0000 7f22151e0640 1 -- 172.21.15.40:0/3065603567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f221006bf70 msgr2=0x7f22100b2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:42.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.338+0000 7f22151e0640 1 --2- 172.21.15.40:0/3065603567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f221006bf70 0x7f22100b2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.338+0000 7f22151e0640 1 -- 172.21.15.40:0/3065603567 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f221015b3b0 con 0x7f22100cade0 2024-04-22T07:24:42.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.338+0000 7f22149df640 1 --2- 172.21.15.40:0/3065603567 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f221006bb90 0x7f22101f4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:24:42.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.339+0000 7f22151e0640 1 --2- 172.21.15.40:0/3065603567 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22100cade0 0x7f2210150b00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f220800c7b0 tx=0x7f220800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:42.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.339+0000 7f22057fa640 1 -- 172.21.15.40:0/3065603567 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2208004b60 con 0x7f22100cade0 2024-04-22T07:24:42.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.339+0000 7f22057fa640 1 -- 172.21.15.40:0/3065603567 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2208004d00 con 0x7f22100cade0 2024-04-22T07:24:42.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.339+0000 7f2216c43640 1 -- 172.21.15.40:0/3065603567 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f221015b690 con 0x7f22100cade0 2024-04-22T07:24:42.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.339+0000 7f22057fa640 1 -- 172.21.15.40:0/3065603567 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220800aa90 con 0x7f22100cade0 2024-04-22T07:24:42.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.339+0000 7f2216c43640 1 -- 172.21.15.40:0/3065603567 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f221015bc50 con 0x7f22100cade0 2024-04-22T07:24:42.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.340+0000 7f2216c43640 1 -- 172.21.15.40:0/3065603567 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2210069e60 con 0x7f22100cade0 2024-04-22T07:24:42.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.340+0000 7f22057fa640 1 -- 172.21.15.40:0/3065603567 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f220800ac30 con 0x7f22100cade0 2024-04-22T07:24:42.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.341+0000 7f22057fa640 1 --2- 172.21.15.40:0/3065603567 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f21fc06c920 0x7f21fc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:42.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.341+0000 7f22057fa640 1 -- 172.21.15.40:0/3065603567 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f220808c0d0 con 0x7f22100cade0 2024-04-22T07:24:42.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.341+0000 7f22149df640 1 --2- 172.21.15.40:0/3065603567 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f21fc06c920 0x7f21fc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:42.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.341+0000 7f22057fa640 1 --2- 172.21.15.40:0/3065603567 >> [v2:172.21.15.62:6816/147453972,v1:172.21.15.62:6817/147453972] conn(0x7f21fc074b80 0x7f21fc076fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:42.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.341+0000 7f22057fa640 1 -- 172.21.15.40:0/3065603567 --> [v2:172.21.15.62:6816/147453972,v1:172.21.15.62:6817/147453972] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f21fc077670 con 0x7f21fc074b80 2024-04-22T07:24:42.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.341+0000 7f22057fa640 1 -- 172.21.15.40:0/3065603567 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2208093050 con 0x7f22100cade0 2024-04-22T07:24:42.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.341+0000 7f2207fff640 1 --2- 172.21.15.40:0/3065603567 >> [v2:172.21.15.62:6816/147453972,v1:172.21.15.62:6817/147453972] conn(0x7f21fc074b80 0x7f21fc076fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:42.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.341+0000 7f22149df640 1 --2- 172.21.15.40:0/3065603567 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f21fc06c920 0x7f21fc06ede0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f220c00b820 tx=0x7f220c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:42.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.342+0000 7f2207fff640 1 --2- 172.21.15.40:0/3065603567 >> [v2:172.21.15.62:6816/147453972,v1:172.21.15.62:6817/147453972] conn(0x7f21fc074b80 0x7f21fc076fa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:42.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.342+0000 7f22057fa640 1 -- 172.21.15.40:0/3065603567 <== osd.7 v2:172.21.15.62:6816/147453972 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f21fc077670 con 0x7f21fc074b80 2024-04-22T07:24:42.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.356+0000 7f2216c43640 1 -- 172.21.15.40:0/3065603567 --> [v2:172.21.15.62:6816/147453972,v1:172.21.15.62:6817/147453972] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f22101f0e80 con 0x7f21fc074b80 2024-04-22T07:24:42.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.356+0000 7f22057fa640 1 -- 172.21.15.40:0/3065603567 <== osd.7 v2:172.21.15.62:6816/147453972 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f22101f0e80 con 0x7f21fc074b80 2024-04-22T07:24:42.354 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-22T07:24:42.354 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-22T07:24:42.354 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-22T07:24:42.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.357+0000 7f2216c43640 1 -- 172.21.15.40:0/3065603567 >> [v2:172.21.15.62:6816/147453972,v1:172.21.15.62:6817/147453972] conn(0x7f21fc074b80 msgr2=0x7f21fc076fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:42.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.357+0000 7f2216c43640 1 --2- 172.21.15.40:0/3065603567 >> [v2:172.21.15.62:6816/147453972,v1:172.21.15.62:6817/147453972] conn(0x7f21fc074b80 0x7f21fc076fa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.357+0000 7f2216c43640 1 -- 172.21.15.40:0/3065603567 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f21fc06c920 msgr2=0x7f21fc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:42.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.357+0000 7f2216c43640 1 --2- 172.21.15.40:0/3065603567 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f21fc06c920 0x7f21fc06ede0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f220c00b820 tx=0x7f220c008040 comp rx=0 tx=0).stop 2024-04-22T07:24:42.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.357+0000 7f2216c43640 1 -- 172.21.15.40:0/3065603567 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22100cade0 msgr2=0x7f2210150b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:42.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.357+0000 7f2216c43640 1 --2- 172.21.15.40:0/3065603567 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22100cade0 0x7f2210150b00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f220800c7b0 tx=0x7f220800cc70 comp rx=0 tx=0).stop 2024-04-22T07:24:42.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.357+0000 7f22151e0640 1 -- 172.21.15.40:0/3065603567 reap_dead start 2024-04-22T07:24:42.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.357+0000 7f2216c43640 1 -- 172.21.15.40:0/3065603567 shutdown_connections 2024-04-22T07:24:42.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.357+0000 7f2216c43640 1 -- 172.21.15.40:0/3065603567 >> 172.21.15.40:0/3065603567 conn(0x7f22100676b0 msgr2=0x7f2210154000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:42.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.357+0000 7f2216c43640 1 -- 172.21.15.40:0/3065603567 shutdown_connections 2024-04-22T07:24:42.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.357+0000 7f2216c43640 1 -- 172.21.15.40:0/3065603567 wait complete. 2024-04-22T07:24:42.365 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-22T07:24:42.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.469+0000 7f694c8d2640 1 Processor -- start 2024-04-22T07:24:42.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.469+0000 7f694c8d2640 1 -- start start 2024-04-22T07:24:42.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.470+0000 7f694c8d2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6948154ed0 0x7f694815ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:42.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.470+0000 7f694c8d2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6948072a40 0x7f6948071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:42.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.470+0000 7f694c8d2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f694815f270 con 0x7f69481552b0 2024-04-22T07:24:42.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.470+0000 7f694c8d2640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f69480cafb0 con 0x7f6948154ed0 2024-04-22T07:24:42.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.470+0000 7f694c8d2640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f69480cb210 con 0x7f6948072a40 2024-04-22T07:24:42.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.470+0000 7f694659c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6948154ed0 0x7f694815ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:42.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.470+0000 7f694659c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6948154ed0 0x7f694815ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44712/0 (socket says 172.21.15.40:44712) 2024-04-22T07:24:42.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.470+0000 7f694659c640 1 -- 172.21.15.40:0/2642134605 learned_addr learned my addr 172.21.15.40:0/2642134605 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:42.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.470+0000 7f6946d9d640 1 --2- 172.21.15.40:0/2642134605 >> v2:172.21.15.62:3300/0 conn(0x7f6948072a40 0x7f6948071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:42.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.470+0000 7f694659c640 1 -- 172.21.15.40:0/2642134605 >> v2:172.21.15.62:3300/0 conn(0x7f6948072a40 msgr2=0x7f6948071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:42.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.470+0000 7f694659c640 1 --2- 172.21.15.40:0/2642134605 >> v2:172.21.15.62:3300/0 conn(0x7f6948072a40 0x7f6948071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.470+0000 7f694659c640 1 -- 172.21.15.40:0/2642134605 >> v1:172.21.15.62:6789/0 conn(0x7f69481552b0 legacy=0x7f69480cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:42.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.470+0000 7f694659c640 1 -- 172.21.15.40:0/2642134605 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69480c66c0 con 0x7f6948154ed0 2024-04-22T07:24:42.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.470+0000 7f6946d9d640 1 --2- 172.21.15.40:0/2642134605 >> v2:172.21.15.62:3300/0 conn(0x7f6948072a40 0x7f6948071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:24:42.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.471+0000 7f694659c640 1 --2- 172.21.15.40:0/2642134605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6948154ed0 0x7f694815ed30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f694806c960 tx=0x7f693802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3519ccc80d404394 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:42.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.471+0000 7f694559a640 1 -- 172.21.15.40:0/2642134605 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6938034070 con 0x7f6948154ed0 2024-04-22T07:24:42.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.471+0000 7f694559a640 1 -- 172.21.15.40:0/2642134605 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6938030860 con 0x7f6948154ed0 2024-04-22T07:24:42.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.471+0000 7f694559a640 1 -- 172.21.15.40:0/2642134605 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6938030c30 con 0x7f6948154ed0 2024-04-22T07:24:42.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.472+0000 7f694c8d2640 1 -- 172.21.15.40:0/2642134605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6948154ed0 msgr2=0x7f694815ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:42.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.472+0000 7f694c8d2640 1 --2- 172.21.15.40:0/2642134605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6948154ed0 0x7f694815ed30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f694806c960 tx=0x7f693802b9a0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.472+0000 7f694c8d2640 1 -- 172.21.15.40:0/2642134605 shutdown_connections 2024-04-22T07:24:42.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.472+0000 7f694c8d2640 1 --2- 172.21.15.40:0/2642134605 >> v2:172.21.15.62:3300/0 conn(0x7f6948072a40 0x7f6948071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.472+0000 7f694c8d2640 1 --2- 172.21.15.40:0/2642134605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6948154ed0 0x7f694815ed30 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.472+0000 7f694c8d2640 1 -- 172.21.15.40:0/2642134605 >> 172.21.15.40:0/2642134605 conn(0x7f69480736e0 msgr2=0x7f694806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:42.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.472+0000 7f694c8d2640 1 -- 172.21.15.40:0/2642134605 shutdown_connections 2024-04-22T07:24:42.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.472+0000 7f694c8d2640 1 -- 172.21.15.40:0/2642134605 wait complete. 2024-04-22T07:24:42.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.473+0000 7f694c8d2640 1 Processor -- start 2024-04-22T07:24:42.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.473+0000 7f694c8d2640 1 -- start start 2024-04-22T07:24:42.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.474+0000 7f694c8d2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6948072a40 0x7f69481f13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:42.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.474+0000 7f694c8d2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6948154ed0 0x7f694814e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:42.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.474+0000 7f694c8d2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69481552b0 0x7f694815c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:42.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.474+0000 7f694c8d2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f69480c5900 con 0x7f69481552b0 2024-04-22T07:24:42.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.474+0000 7f694c8d2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f69480c5620 con 0x7f6948154ed0 2024-04-22T07:24:42.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.474+0000 7f694c8d2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f69480c5be0 con 0x7f6948072a40 2024-04-22T07:24:42.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.474+0000 7f6946d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69481552b0 0x7f694815c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:42.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.474+0000 7f6946d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69481552b0 0x7f694815c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44714/0 (socket says 172.21.15.40:44714) 2024-04-22T07:24:42.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.474+0000 7f6946d9d640 1 -- 172.21.15.40:0/2634652960 learned_addr learned my addr 172.21.15.40:0/2634652960 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:42.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.474+0000 7f694659c640 1 --2- 172.21.15.40:0/2634652960 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6948072a40 0x7f69481f13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:42.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.474+0000 7f6945d9b640 1 --2- 172.21.15.40:0/2634652960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6948154ed0 0x7f694814e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:42.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.474+0000 7f6946d9d640 1 -- 172.21.15.40:0/2634652960 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6948072a40 msgr2=0x7f69481f13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:42.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.474+0000 7f6946d9d640 1 --2- 172.21.15.40:0/2634652960 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6948072a40 0x7f69481f13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.474+0000 7f6946d9d640 1 -- 172.21.15.40:0/2634652960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6948154ed0 msgr2=0x7f694814e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:42.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.474+0000 7f6946d9d640 1 --2- 172.21.15.40:0/2634652960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6948154ed0 0x7f694814e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.474+0000 7f6946d9d640 1 -- 172.21.15.40:0/2634652960 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f694814f080 con 0x7f69481552b0 2024-04-22T07:24:42.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.474+0000 7f694659c640 1 --2- 172.21.15.40:0/2634652960 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6948072a40 0x7f69481f13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:24:42.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.474+0000 7f6945d9b640 1 --2- 172.21.15.40:0/2634652960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6948154ed0 0x7f694814e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:24:42.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.475+0000 7f6946d9d640 1 --2- 172.21.15.40:0/2634652960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69481552b0 0x7f694815c6b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f694000cd80 tx=0x7f694000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:42.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.475+0000 7f6936ffd640 1 -- 172.21.15.40:0/2634652960 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694000f680 con 0x7f69481552b0 2024-04-22T07:24:42.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.475+0000 7f6936ffd640 1 -- 172.21.15.40:0/2634652960 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f694000f840 con 0x7f69481552b0 2024-04-22T07:24:42.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.475+0000 7f6936ffd640 1 -- 172.21.15.40:0/2634652960 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694000fc30 con 0x7f69481552b0 2024-04-22T07:24:42.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.475+0000 7f694c8d2640 1 -- 172.21.15.40:0/2634652960 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f694815bed0 con 0x7f69481552b0 2024-04-22T07:24:42.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.475+0000 7f694c8d2640 1 -- 172.21.15.40:0/2634652960 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f694814c260 con 0x7f69481552b0 2024-04-22T07:24:42.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.476+0000 7f694c8d2640 1 -- 172.21.15.40:0/2634652960 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69480b5b40 con 0x7f69481552b0 2024-04-22T07:24:42.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.476+0000 7f6936ffd640 1 -- 172.21.15.40:0/2634652960 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f694000e3e0 con 0x7f69481552b0 2024-04-22T07:24:42.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.477+0000 7f6936ffd640 1 --2- 172.21.15.40:0/2634652960 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f692806c8f0 0x7f692806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:42.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.477+0000 7f6936ffd640 1 -- 172.21.15.40:0/2634652960 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f694008c920 con 0x7f69481552b0 2024-04-22T07:24:42.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.477+0000 7f694659c640 1 --2- 172.21.15.40:0/2634652960 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f692806c8f0 0x7f692806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:42.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.477+0000 7f694659c640 1 --2- 172.21.15.40:0/2634652960 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f692806c8f0 0x7f692806edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6938036000 tx=0x7f693803b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:42.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.481+0000 7f6936ffd640 1 -- 172.21.15.40:0/2634652960 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f69480b5b40 con 0x7f69481552b0 2024-04-22T07:24:42.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.665+0000 7f694c8d2640 1 -- 172.21.15.40:0/2634652960 --> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f6948069d40 con 0x7f692806c8f0 2024-04-22T07:24:42.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.665+0000 7f6936ffd640 1 -- 172.21.15.40:0/2634652960 <== mgr.4107 v2:172.21.15.40:6832/91163869 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6948069d40 con 0x7f692806c8f0 2024-04-22T07:24:42.663 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 7 to deep-scrub 2024-04-22T07:24:42.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.667+0000 7f694c8d2640 1 -- 172.21.15.40:0/2634652960 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f692806c8f0 msgr2=0x7f692806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:42.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.667+0000 7f694c8d2640 1 --2- 172.21.15.40:0/2634652960 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f692806c8f0 0x7f692806edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6938036000 tx=0x7f693803b040 comp rx=0 tx=0).stop 2024-04-22T07:24:42.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.667+0000 7f694c8d2640 1 -- 172.21.15.40:0/2634652960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69481552b0 msgr2=0x7f694815c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:42.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.667+0000 7f694c8d2640 1 --2- 172.21.15.40:0/2634652960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69481552b0 0x7f694815c6b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f694000cd80 tx=0x7f694000a650 comp rx=0 tx=0).stop 2024-04-22T07:24:42.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.667+0000 7f694c8d2640 1 -- 172.21.15.40:0/2634652960 shutdown_connections 2024-04-22T07:24:42.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.667+0000 7f694c8d2640 1 --2- 172.21.15.40:0/2634652960 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f692806c8f0 0x7f692806edb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.667+0000 7f694c8d2640 1 --2- 172.21.15.40:0/2634652960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69481552b0 0x7f694815c6b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.667+0000 7f694c8d2640 1 --2- 172.21.15.40:0/2634652960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6948154ed0 0x7f694814e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.667+0000 7f694c8d2640 1 --2- 172.21.15.40:0/2634652960 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6948072a40 0x7f69481f13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.667+0000 7f694c8d2640 1 -- 172.21.15.40:0/2634652960 >> 172.21.15.40:0/2634652960 conn(0x7f69480736e0 msgr2=0x7f69480d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:42.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.667+0000 7f694c8d2640 1 -- 172.21.15.40:0/2634652960 shutdown_connections 2024-04-22T07:24:42.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.667+0000 7f694c8d2640 1 -- 172.21.15.40:0/2634652960 wait complete. 2024-04-22T07:24:42.676 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T07:24:42.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.779+0000 7f47eaae4640 1 Processor -- start 2024-04-22T07:24:42.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.779+0000 7f47eaae4640 1 -- start start 2024-04-22T07:24:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.780+0000 7f47eaae4640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47e4155270 0x7f47e40c7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.780+0000 7f47eaae4640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f47e40cbc60 0x7f47e415ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.780+0000 7f47eaae4640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47e40cc860 con 0x7f47e40cc080 2024-04-22T07:24:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.780+0000 7f47eaae4640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f47e415eeb0 con 0x7f47e40cbc60 2024-04-22T07:24:42.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.780+0000 7f47eaae4640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f47e40cba40 con 0x7f47e4155270 2024-04-22T07:24:42.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.780+0000 7f47e9081640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f47e40cc080 0x7f47e40ccae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57366/0 (socket says 172.21.15.40:57366) 2024-04-22T07:24:42.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.780+0000 7f47e9081640 1 -- 172.21.15.40:0/3525862205 learned_addr learned my addr 172.21.15.40:0/3525862205 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:24:42.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.780+0000 7f47e3fff640 1 --2- 172.21.15.40:0/3525862205 >> v2:172.21.15.62:3300/0 conn(0x7f47e40cbc60 0x7f47e415ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:42.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.780+0000 7f47e8880640 1 --2- 172.21.15.40:0/3525862205 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47e4155270 0x7f47e40c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:42.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.780+0000 7f47e37fe640 1 -- 172.21.15.40:0/3525862205 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 415599115 0 0) 0x7f47e40cc860 con 0x7f47e40cc080 2024-04-22T07:24:42.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.780+0000 7f47e37fe640 1 -- 172.21.15.40:0/3525862205 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47d4003520 con 0x7f47e40cc080 2024-04-22T07:24:42.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.780+0000 7f47e37fe640 1 -- 172.21.15.40:0/3525862205 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 734989675 0 0) 0x7f47d4003520 con 0x7f47e40cc080 2024-04-22T07:24:42.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.780+0000 7f47e37fe640 1 -- 172.21.15.40:0/3525862205 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47e4155270 msgr2=0x7f47e40c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:42.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.780+0000 7f47e37fe640 1 --2- 172.21.15.40:0/3525862205 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47e4155270 0x7f47e40c7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.780+0000 7f47e37fe640 1 -- 172.21.15.40:0/3525862205 >> v2:172.21.15.62:3300/0 conn(0x7f47e40cbc60 msgr2=0x7f47e415ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:42.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.780+0000 7f47e37fe640 1 --2- 172.21.15.40:0/3525862205 >> v2:172.21.15.62:3300/0 conn(0x7f47e40cbc60 0x7f47e415ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.780+0000 7f47e37fe640 1 -- 172.21.15.40:0/3525862205 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e415f340 con 0x7f47e40cc080 2024-04-22T07:24:42.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.780+0000 7f47e37fe640 1 -- 172.21.15.40:0/3525862205 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7f47dc001a10 con 0x7f47e40cc080 2024-04-22T07:24:42.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.780+0000 7f47e37fe640 1 -- 172.21.15.40:0/3525862205 >> v1:172.21.15.40:6789/0 conn(0x7f47e40cc080 legacy=0x7f47e40ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:42.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.780+0000 7f47e37fe640 1 --2- 172.21.15.40:0/3525862205 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47e4155270 0x7f47d40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:42.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.780+0000 7f47e37fe640 1 --2- 172.21.15.40:0/3525862205 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47d4003f30 0x7f47d4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:42.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.780+0000 7f47e37fe640 1 --2- 172.21.15.40:0/3525862205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47d4004d40 0x7f47d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:42.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.780+0000 7f47e37fe640 1 -- 172.21.15.40:0/3525862205 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f47e415eeb0 con 0x7f47d4004d40 2024-04-22T07:24:42.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.780+0000 7f47e37fe640 1 -- 172.21.15.40:0/3525862205 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f47e40cba40 con 0x7f47d4003f30 2024-04-22T07:24:42.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.780+0000 7f47e37fe640 1 -- 172.21.15.40:0/3525862205 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f47d400b9f0 con 0x7f47e4155270 2024-04-22T07:24:42.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.781+0000 7f47e9081640 1 --2- 172.21.15.40:0/3525862205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47d4004d40 0x7f47d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:42.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.781+0000 7f47e3fff640 1 --2- 172.21.15.40:0/3525862205 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47d4003f30 0x7f47d4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:42.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.781+0000 7f47e8880640 1 --2- 172.21.15.40:0/3525862205 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47e4155270 0x7f47d40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:42.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.781+0000 7f47e9081640 1 -- 172.21.15.40:0/3525862205 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47e4155270 msgr2=0x7f47d40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:42.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.781+0000 7f47e9081640 1 --2- 172.21.15.40:0/3525862205 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47e4155270 0x7f47d40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.781+0000 7f47e9081640 1 -- 172.21.15.40:0/3525862205 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47d4003f30 msgr2=0x7f47d4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:24:42.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.781+0000 7f47e9081640 1 --2- 172.21.15.40:0/3525862205 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47d4003f30 0x7f47d4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.781+0000 7f47e9081640 1 -- 172.21.15.40:0/3525862205 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d4003520 con 0x7f47d4004d40 2024-04-22T07:24:42.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.782+0000 7f47e9081640 1 --2- 172.21.15.40:0/3525862205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47d4004d40 0x7f47d40051c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f47e40c7a80 tx=0x7f47d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1edcc5f9652047ee server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:42.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.782+0000 7f47e37fe640 1 -- 172.21.15.40:0/3525862205 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc00a4e0 con 0x7f47d4004d40 2024-04-22T07:24:42.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.782+0000 7f47e37fe640 1 -- 172.21.15.40:0/3525862205 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47dc034650 con 0x7f47d4004d40 2024-04-22T07:24:42.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.782+0000 7f47e37fe640 1 -- 172.21.15.40:0/3525862205 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47dc034a80 con 0x7f47d4004d40 2024-04-22T07:24:42.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.782+0000 7f47eaae4640 1 -- 172.21.15.40:0/3525862205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47d4004d40 msgr2=0x7f47d40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:42.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.782+0000 7f47eaae4640 1 --2- 172.21.15.40:0/3525862205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47d4004d40 0x7f47d40051c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f47e40c7a80 tx=0x7f47d4005830 comp rx=0 tx=0).stop 2024-04-22T07:24:42.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.782+0000 7f47e9081640 1 -- 172.21.15.40:0/3525862205 reap_dead start 2024-04-22T07:24:42.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.782+0000 7f47eaae4640 1 -- 172.21.15.40:0/3525862205 shutdown_connections 2024-04-22T07:24:42.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.782+0000 7f47eaae4640 1 -- 172.21.15.40:0/3525862205 >> 172.21.15.40:0/3525862205 conn(0x7f47e406b920 msgr2=0x7f47e406bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:42.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.782+0000 7f47eaae4640 1 -- 172.21.15.40:0/3525862205 shutdown_connections 2024-04-22T07:24:42.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.782+0000 7f47eaae4640 1 -- 172.21.15.40:0/3525862205 wait complete. 2024-04-22T07:24:42.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.783+0000 7f47eaae4640 1 Processor -- start 2024-04-22T07:24:42.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.784+0000 7f47eaae4640 1 -- start start 2024-04-22T07:24:42.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.784+0000 7f47eaae4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47e414e930 0x7f47e4158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:42.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.784+0000 7f47eaae4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47e415a0b0 0x7f47e41f0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:42.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.784+0000 7f47eaae4640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47e41f0f60 0x7f47e41520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:42.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.784+0000 7f47eaae4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f47e415e860 con 0x7f47e415a0b0 2024-04-22T07:24:42.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.784+0000 7f47eaae4640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f47e415e580 con 0x7f47e414e930 2024-04-22T07:24:42.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.784+0000 7f47eaae4640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f47e415eb40 con 0x7f47e41f0f60 2024-04-22T07:24:42.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.784+0000 7f47e3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47e415a0b0 0x7f47e41f0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:42.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.784+0000 7f47e3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47e415a0b0 0x7f47e41f0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44740/0 (socket says 172.21.15.40:44740) 2024-04-22T07:24:42.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.784+0000 7f47e3fff640 1 -- 172.21.15.40:0/4012062265 learned_addr learned my addr 172.21.15.40:0/4012062265 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:24:42.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.785+0000 7f47e8880640 1 --2- 172.21.15.40:0/4012062265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47e414e930 0x7f47e4158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:42.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.785+0000 7f47e9081640 1 --2- 172.21.15.40:0/4012062265 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47e41f0f60 0x7f47e41520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:42.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.785+0000 7f47e3fff640 1 -- 172.21.15.40:0/4012062265 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47e41f0f60 msgr2=0x7f47e41520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:42.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.785+0000 7f47e3fff640 1 --2- 172.21.15.40:0/4012062265 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47e41f0f60 0x7f47e41520b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.785+0000 7f47e3fff640 1 -- 172.21.15.40:0/4012062265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47e414e930 msgr2=0x7f47e4158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:42.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.785+0000 7f47e3fff640 1 --2- 172.21.15.40:0/4012062265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47e414e930 0x7f47e4158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.785+0000 7f47e3fff640 1 -- 172.21.15.40:0/4012062265 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e415bce0 con 0x7f47e415a0b0 2024-04-22T07:24:42.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.785+0000 7f47e3fff640 1 --2- 172.21.15.40:0/4012062265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47e415a0b0 0x7f47e41f0a20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f47d0011990 tx=0x7f47d0011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:42.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.785+0000 7f47e17fa640 1 -- 172.21.15.40:0/4012062265 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d000fa30 con 0x7f47e415a0b0 2024-04-22T07:24:42.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.785+0000 7f47e17fa640 1 -- 172.21.15.40:0/4012062265 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d000fbd0 con 0x7f47e415a0b0 2024-04-22T07:24:42.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.785+0000 7f47eaae4640 1 -- 172.21.15.40:0/4012062265 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47e414f050 con 0x7f47e415a0b0 2024-04-22T07:24:42.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.785+0000 7f47e17fa640 1 -- 172.21.15.40:0/4012062265 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d0014440 con 0x7f47e415a0b0 2024-04-22T07:24:42.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.785+0000 7f47eaae4640 1 -- 172.21.15.40:0/4012062265 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47e415a860 con 0x7f47e415a0b0 2024-04-22T07:24:42.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.786+0000 7f47eaae4640 1 -- 172.21.15.40:0/4012062265 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47e4069d40 con 0x7f47e415a0b0 2024-04-22T07:24:42.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.787+0000 7f47e17fa640 1 -- 172.21.15.40:0/4012062265 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f47d0012040 con 0x7f47e415a0b0 2024-04-22T07:24:42.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.787+0000 7f47e17fa640 1 --2- 172.21.15.40:0/4012062265 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f47c806c8f0 0x7f47c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:24:42.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.787+0000 7f47e17fa640 1 -- 172.21.15.40:0/4012062265 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f47d008c130 con 0x7f47e415a0b0 2024-04-22T07:24:42.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.787+0000 7f47e8880640 1 --2- 172.21.15.40:0/4012062265 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f47c806c8f0 0x7f47c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:24:42.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.788+0000 7f47e8880640 1 --2- 172.21.15.40:0/4012062265 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f47c806c8f0 0x7f47c806edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009bc0 tx=0x7f47d8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:24:42.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.791+0000 7f47e17fa640 1 -- 172.21.15.40:0/4012062265 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f47d0019030 con 0x7f47e415a0b0 2024-04-22T07:24:42.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.978+0000 7f47eaae4640 1 -- 172.21.15.40:0/4012062265 --> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f47e40cb3d0 con 0x7f47c806c8f0 2024-04-22T07:24:42.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.984+0000 7f47e17fa640 1 -- 172.21.15.40:0/4012062265 <== mgr.4107 v2:172.21.15.40:6832/91163869 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252880 (secure 0 0 0) 0x7f47e40cb3d0 con 0x7f47c806c8f0 2024-04-22T07:24:42.985 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:24:42.986 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-22T07:24:42.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.987+0000 7f47eaae4640 1 -- 172.21.15.40:0/4012062265 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f47c806c8f0 msgr2=0x7f47c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:42.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.987+0000 7f47eaae4640 1 --2- 172.21.15.40:0/4012062265 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f47c806c8f0 0x7f47c806edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009bc0 tx=0x7f47d8009190 comp rx=0 tx=0).stop 2024-04-22T07:24:42.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.987+0000 7f47eaae4640 1 -- 172.21.15.40:0/4012062265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47e415a0b0 msgr2=0x7f47e41f0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:24:42.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.987+0000 7f47eaae4640 1 --2- 172.21.15.40:0/4012062265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47e415a0b0 0x7f47e41f0a20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f47d0011990 tx=0x7f47d0011d90 comp rx=0 tx=0).stop 2024-04-22T07:24:42.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.987+0000 7f47eaae4640 1 -- 172.21.15.40:0/4012062265 shutdown_connections 2024-04-22T07:24:42.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.987+0000 7f47eaae4640 1 --2- 172.21.15.40:0/4012062265 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f47e41f0f60 0x7f47e41520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.987+0000 7f47eaae4640 1 --2- 172.21.15.40:0/4012062265 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f47c806c8f0 0x7f47c806edb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.987+0000 7f47eaae4640 1 --2- 172.21.15.40:0/4012062265 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47e415a0b0 0x7f47e41f0a20 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.987+0000 7f47eaae4640 1 --2- 172.21.15.40:0/4012062265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47e414e930 0x7f47e4158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:24:42.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.987+0000 7f47eaae4640 1 -- 172.21.15.40:0/4012062265 >> 172.21.15.40:0/4012062265 conn(0x7f47e406b920 msgr2=0x7f47e40c9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:24:42.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.988+0000 7f47eaae4640 1 -- 172.21.15.40:0/4012062265 shutdown_connections 2024-04-22T07:24:42.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:24:42.988+0000 7f47eaae4640 1 -- 172.21.15.40:0/4012062265 wait complete. 2024-04-22T07:24:42.997 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-04-22T07:24:41.830360+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5554807,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":120,"num_read_kb":104,"num_write":11840,"num_write_kb":25175399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13824,"ondisk_log_size":13824,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":327560,"kb_used_data":12936,"kb_used_omap":12,"kb_used_meta":314547,"kb_avail":754647160,"statfs":{"total":773094113280,"available":772758691840,"internally_reserved":0,"allocated":13246464,"data_stored":11854798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":322096692},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10737400764,"num_objects":-2560,"num_object_clones":0,"num_object_copies":-5120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2560,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2582,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002760"},"pg_stats":[{"pgid":"3.3f","version":"25'167","reported_seq":184,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.628011+0000","last_change":"2024-04-22T07:20:53.873662+0000","last_active":"2024-04-22T07:24:36.628011+0000","last_peered":"2024-04-22T07:24:36.628011+0000","last_clean":"2024-04-22T07:24:36.628011+0000","last_became_active":"2024-04-22T07:20:53.873384+0000","last_became_peered":"2024-04-22T07:20:53.873384+0000","last_unstale":"2024-04-22T07:24:36.628011+0000","last_undegraded":"2024-04-22T07:24:36.628011+0000","last_fullsized":"2024-04-22T07:24:36.628011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'152","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.618894+0000","last_change":"2024-04-22T07:20:53.870454+0000","last_active":"2024-04-22T07:24:36.618894+0000","last_peered":"2024-04-22T07:24:36.618894+0000","last_clean":"2024-04-22T07:24:36.618894+0000","last_became_active":"2024-04-22T07:20:53.869964+0000","last_became_peered":"2024-04-22T07:20:53.869964+0000","last_unstale":"2024-04-22T07:24:36.618894+0000","last_undegraded":"2024-04-22T07:24:36.618894+0000","last_fullsized":"2024-04-22T07:24:36.618894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'178","reported_seq":195,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.660196+0000","last_change":"2024-04-22T07:20:53.871145+0000","last_active":"2024-04-22T07:24:36.660196+0000","last_peered":"2024-04-22T07:24:36.660196+0000","last_clean":"2024-04-22T07:24:36.660196+0000","last_became_active":"2024-04-22T07:20:53.870819+0000","last_became_peered":"2024-04-22T07:20:53.870819+0000","last_unstale":"2024-04-22T07:24:36.660196+0000","last_undegraded":"2024-04-22T07:24:36.660196+0000","last_fullsized":"2024-04-22T07:24:36.660196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:02:16.373202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'193","reported_seq":210,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.663245+0000","last_change":"2024-04-22T07:20:53.870458+0000","last_active":"2024-04-22T07:24:36.663245+0000","last_peered":"2024-04-22T07:24:36.663245+0000","last_clean":"2024-04-22T07:24:36.663245+0000","last_became_active":"2024-04-22T07:20:53.870125+0000","last_became_peered":"2024-04-22T07:20:53.870125+0000","last_unstale":"2024-04-22T07:24:36.663245+0000","last_undegraded":"2024-04-22T07:24:36.663245+0000","last_fullsized":"2024-04-22T07:24:36.663245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'174","reported_seq":191,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.633014+0000","last_change":"2024-04-22T07:20:53.877301+0000","last_active":"2024-04-22T07:24:36.633014+0000","last_peered":"2024-04-22T07:24:36.633014+0000","last_clean":"2024-04-22T07:24:36.633014+0000","last_became_active":"2024-04-22T07:20:53.874941+0000","last_became_peered":"2024-04-22T07:20:53.874941+0000","last_unstale":"2024-04-22T07:24:36.633014+0000","last_undegraded":"2024-04-22T07:24:36.633014+0000","last_fullsized":"2024-04-22T07:24:36.633014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:52.686229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"25'162","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.656586+0000","last_change":"2024-04-22T07:20:53.869735+0000","last_active":"2024-04-22T07:24:36.656586+0000","last_peered":"2024-04-22T07:24:36.656586+0000","last_clean":"2024-04-22T07:24:36.656586+0000","last_became_active":"2024-04-22T07:20:53.869369+0000","last_became_peered":"2024-04-22T07:20:53.869369+0000","last_unstale":"2024-04-22T07:24:36.656586+0000","last_undegraded":"2024-04-22T07:24:36.656586+0000","last_fullsized":"2024-04-22T07:24:36.656586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:27.624819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'188","reported_seq":205,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.585749+0000","last_change":"2024-04-22T07:20:53.873492+0000","last_active":"2024-04-22T07:24:36.585749+0000","last_peered":"2024-04-22T07:24:36.585749+0000","last_clean":"2024-04-22T07:24:36.585749+0000","last_became_active":"2024-04-22T07:20:53.873220+0000","last_became_peered":"2024-04-22T07:20:53.873220+0000","last_unstale":"2024-04-22T07:24:36.585749+0000","last_undegraded":"2024-04-22T07:24:36.585749+0000","last_fullsized":"2024-04-22T07:24:36.585749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:35:26.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'204","reported_seq":221,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.656699+0000","last_change":"2024-04-22T07:20:53.875847+0000","last_active":"2024-04-22T07:24:36.656699+0000","last_peered":"2024-04-22T07:24:36.656699+0000","last_clean":"2024-04-22T07:24:36.656699+0000","last_became_active":"2024-04-22T07:20:53.875017+0000","last_became_peered":"2024-04-22T07:20:53.875017+0000","last_unstale":"2024-04-22T07:24:36.656699+0000","last_undegraded":"2024-04-22T07:24:36.656699+0000","last_fullsized":"2024-04-22T07:24:36.656699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:07.080135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'178","reported_seq":196,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.667013+0000","last_change":"2024-04-22T07:20:53.869174+0000","last_active":"2024-04-22T07:24:36.667013+0000","last_peered":"2024-04-22T07:24:36.667013+0000","last_clean":"2024-04-22T07:24:36.667013+0000","last_became_active":"2024-04-22T07:20:53.868906+0000","last_became_peered":"2024-04-22T07:20:53.868906+0000","last_unstale":"2024-04-22T07:24:36.667013+0000","last_undegraded":"2024-04-22T07:24:36.667013+0000","last_fullsized":"2024-04-22T07:24:36.667013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'190","reported_seq":207,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.638609+0000","last_change":"2024-04-22T07:20:53.874933+0000","last_active":"2024-04-22T07:24:36.638609+0000","last_peered":"2024-04-22T07:24:36.638609+0000","last_clean":"2024-04-22T07:24:36.638609+0000","last_became_active":"2024-04-22T07:20:53.874673+0000","last_became_peered":"2024-04-22T07:20:53.874673+0000","last_unstale":"2024-04-22T07:24:36.638609+0000","last_undegraded":"2024-04-22T07:24:36.638609+0000","last_fullsized":"2024-04-22T07:24:36.638609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'214","reported_seq":231,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.649286+0000","last_change":"2024-04-22T07:20:53.874909+0000","last_active":"2024-04-22T07:24:36.649286+0000","last_peered":"2024-04-22T07:24:36.649286+0000","last_clean":"2024-04-22T07:24:36.649286+0000","last_became_active":"2024-04-22T07:20:53.873945+0000","last_became_peered":"2024-04-22T07:20:53.873945+0000","last_unstale":"2024-04-22T07:24:36.649286+0000","last_undegraded":"2024-04-22T07:24:36.649286+0000","last_fullsized":"2024-04-22T07:24:36.649286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:53.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'166","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.659455+0000","last_change":"2024-04-22T07:21:34.992848+0000","last_active":"2024-04-22T07:24:36.659455+0000","last_peered":"2024-04-22T07:24:36.659455+0000","last_clean":"2024-04-22T07:24:36.659455+0000","last_became_active":"2024-04-22T07:21:34.992633+0000","last_became_peered":"2024-04-22T07:21:34.992633+0000","last_unstale":"2024-04-22T07:24:36.659455+0000","last_undegraded":"2024-04-22T07:24:36.659455+0000","last_fullsized":"2024-04-22T07:24:36.659455+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:31:07.080135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"25'177","reported_seq":194,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.633287+0000","last_change":"2024-04-22T07:20:53.879419+0000","last_active":"2024-04-22T07:24:36.633287+0000","last_peered":"2024-04-22T07:24:36.633287+0000","last_clean":"2024-04-22T07:24:36.633287+0000","last_became_active":"2024-04-22T07:20:53.879070+0000","last_became_peered":"2024-04-22T07:20:53.879070+0000","last_unstale":"2024-04-22T07:24:36.633287+0000","last_undegraded":"2024-04-22T07:24:36.633287+0000","last_fullsized":"2024-04-22T07:24:36.633287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'172","reported_seq":189,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.583805+0000","last_change":"2024-04-22T07:20:53.877395+0000","last_active":"2024-04-22T07:24:36.583805+0000","last_peered":"2024-04-22T07:24:36.583805+0000","last_clean":"2024-04-22T07:24:36.583805+0000","last_became_active":"2024-04-22T07:20:53.877116+0000","last_became_peered":"2024-04-22T07:20:53.877116+0000","last_unstale":"2024-04-22T07:24:36.583805+0000","last_undegraded":"2024-04-22T07:24:36.583805+0000","last_fullsized":"2024-04-22T07:24:36.583805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:21:25.001413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'177","reported_seq":194,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.638770+0000","last_change":"2024-04-22T07:20:53.875156+0000","last_active":"2024-04-22T07:24:36.638770+0000","last_peered":"2024-04-22T07:24:36.638770+0000","last_clean":"2024-04-22T07:24:36.638770+0000","last_became_active":"2024-04-22T07:20:53.874468+0000","last_became_peered":"2024-04-22T07:20:53.874468+0000","last_unstale":"2024-04-22T07:24:36.638770+0000","last_undegraded":"2024-04-22T07:24:36.638770+0000","last_fullsized":"2024-04-22T07:24:36.638770+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:42:03.637655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'162","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.606966+0000","last_change":"2024-04-22T07:20:53.867178+0000","last_active":"2024-04-22T07:24:36.606966+0000","last_peered":"2024-04-22T07:24:36.606966+0000","last_clean":"2024-04-22T07:24:36.606966+0000","last_became_active":"2024-04-22T07:20:53.865491+0000","last_became_peered":"2024-04-22T07:20:53.865491+0000","last_unstale":"2024-04-22T07:24:36.606966+0000","last_undegraded":"2024-04-22T07:24:36.606966+0000","last_fullsized":"2024-04-22T07:24:36.606966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:27:27.872998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'176","reported_seq":193,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.630580+0000","last_change":"2024-04-22T07:20:53.876797+0000","last_active":"2024-04-22T07:24:36.630580+0000","last_peered":"2024-04-22T07:24:36.630580+0000","last_clean":"2024-04-22T07:24:36.630580+0000","last_became_active":"2024-04-22T07:20:53.876321+0000","last_became_peered":"2024-04-22T07:20:53.876321+0000","last_unstale":"2024-04-22T07:24:36.630580+0000","last_undegraded":"2024-04-22T07:24:36.630580+0000","last_fullsized":"2024-04-22T07:24:36.630580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:22:45.699676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'179","reported_seq":196,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.637120+0000","last_change":"2024-04-22T07:20:53.868760+0000","last_active":"2024-04-22T07:24:36.637120+0000","last_peered":"2024-04-22T07:24:36.637120+0000","last_clean":"2024-04-22T07:24:36.637120+0000","last_became_active":"2024-04-22T07:20:53.868441+0000","last_became_peered":"2024-04-22T07:20:53.868441+0000","last_unstale":"2024-04-22T07:24:36.637120+0000","last_undegraded":"2024-04-22T07:24:36.637120+0000","last_fullsized":"2024-04-22T07:24:36.637120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'205","reported_seq":222,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.654560+0000","last_change":"2024-04-22T07:20:53.864806+0000","last_active":"2024-04-22T07:24:36.654560+0000","last_peered":"2024-04-22T07:24:36.654560+0000","last_clean":"2024-04-22T07:24:36.654560+0000","last_became_active":"2024-04-22T07:20:53.864535+0000","last_became_peered":"2024-04-22T07:20:53.864535+0000","last_unstale":"2024-04-22T07:24:36.654560+0000","last_undegraded":"2024-04-22T07:24:36.654560+0000","last_fullsized":"2024-04-22T07:24:36.654560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:22:07.227993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'179","reported_seq":196,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.660545+0000","last_change":"2024-04-22T07:20:53.878013+0000","last_active":"2024-04-22T07:24:36.660545+0000","last_peered":"2024-04-22T07:24:36.660545+0000","last_clean":"2024-04-22T07:24:36.660545+0000","last_became_active":"2024-04-22T07:20:53.876641+0000","last_became_peered":"2024-04-22T07:20:53.876641+0000","last_unstale":"2024-04-22T07:24:36.660545+0000","last_undegraded":"2024-04-22T07:24:36.660545+0000","last_fullsized":"2024-04-22T07:24:36.660545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:45:15.519469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'154","reported_seq":171,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.610493+0000","last_change":"2024-04-22T07:20:53.868319+0000","last_active":"2024-04-22T07:24:36.610493+0000","last_peered":"2024-04-22T07:24:36.610493+0000","last_clean":"2024-04-22T07:24:36.610493+0000","last_became_active":"2024-04-22T07:20:53.868014+0000","last_became_peered":"2024-04-22T07:20:53.868014+0000","last_unstale":"2024-04-22T07:24:36.610493+0000","last_undegraded":"2024-04-22T07:24:36.610493+0000","last_fullsized":"2024-04-22T07:24:36.610493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:09:27.178992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'199","reported_seq":217,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.640085+0000","last_change":"2024-04-22T07:20:53.867684+0000","last_active":"2024-04-22T07:24:36.640085+0000","last_peered":"2024-04-22T07:24:36.640085+0000","last_clean":"2024-04-22T07:24:36.640085+0000","last_became_active":"2024-04-22T07:20:53.867403+0000","last_became_peered":"2024-04-22T07:20:53.867403+0000","last_unstale":"2024-04-22T07:24:36.640085+0000","last_undegraded":"2024-04-22T07:24:36.640085+0000","last_fullsized":"2024-04-22T07:24:36.640085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'150","reported_seq":167,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.608013+0000","last_change":"2024-04-22T07:20:53.869595+0000","last_active":"2024-04-22T07:24:36.608013+0000","last_peered":"2024-04-22T07:24:36.608013+0000","last_clean":"2024-04-22T07:24:36.608013+0000","last_became_active":"2024-04-22T07:20:53.868519+0000","last_became_peered":"2024-04-22T07:20:53.868519+0000","last_unstale":"2024-04-22T07:24:36.608013+0000","last_undegraded":"2024-04-22T07:24:36.608013+0000","last_fullsized":"2024-04-22T07:24:36.608013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:35:26.705306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'207","reported_seq":224,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.657927+0000","last_change":"2024-04-22T07:20:53.865275+0000","last_active":"2024-04-22T07:24:36.657927+0000","last_peered":"2024-04-22T07:24:36.657927+0000","last_clean":"2024-04-22T07:24:36.657927+0000","last_became_active":"2024-04-22T07:20:53.865026+0000","last_became_peered":"2024-04-22T07:20:53.865026+0000","last_unstale":"2024-04-22T07:24:36.657927+0000","last_undegraded":"2024-04-22T07:24:36.657927+0000","last_fullsized":"2024-04-22T07:24:36.657927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:48:40.630407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'160","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.617263+0000","last_change":"2024-04-22T07:20:53.873457+0000","last_active":"2024-04-22T07:24:36.617263+0000","last_peered":"2024-04-22T07:24:36.617263+0000","last_clean":"2024-04-22T07:24:36.617263+0000","last_became_active":"2024-04-22T07:20:53.873147+0000","last_became_peered":"2024-04-22T07:20:53.873147+0000","last_unstale":"2024-04-22T07:24:36.617263+0000","last_undegraded":"2024-04-22T07:24:36.617263+0000","last_fullsized":"2024-04-22T07:24:36.617263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:57:53.113815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'217","reported_seq":234,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.579299+0000","last_change":"2024-04-22T07:20:53.865327+0000","last_active":"2024-04-22T07:24:36.579299+0000","last_peered":"2024-04-22T07:24:36.579299+0000","last_clean":"2024-04-22T07:24:36.579299+0000","last_became_active":"2024-04-22T07:20:53.865030+0000","last_became_peered":"2024-04-22T07:20:53.865030+0000","last_unstale":"2024-04-22T07:24:36.579299+0000","last_undegraded":"2024-04-22T07:24:36.579299+0000","last_fullsized":"2024-04-22T07:24:36.579299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'166","reported_seq":183,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.625398+0000","last_change":"2024-04-22T07:20:53.876792+0000","last_active":"2024-04-22T07:24:36.625398+0000","last_peered":"2024-04-22T07:24:36.625398+0000","last_clean":"2024-04-22T07:24:36.625398+0000","last_became_active":"2024-04-22T07:20:53.876446+0000","last_became_peered":"2024-04-22T07:20:53.876446+0000","last_unstale":"2024-04-22T07:24:36.625398+0000","last_undegraded":"2024-04-22T07:24:36.625398+0000","last_fullsized":"2024-04-22T07:24:36.625398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:34.943561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'152","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.594405+0000","last_change":"2024-04-22T07:20:53.878147+0000","last_active":"2024-04-22T07:24:36.594405+0000","last_peered":"2024-04-22T07:24:36.594405+0000","last_clean":"2024-04-22T07:24:36.594405+0000","last_became_active":"2024-04-22T07:20:53.877867+0000","last_became_peered":"2024-04-22T07:20:53.877867+0000","last_unstale":"2024-04-22T07:24:36.594405+0000","last_undegraded":"2024-04-22T07:24:36.594405+0000","last_fullsized":"2024-04-22T07:24:36.594405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:53.021611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'134","reported_seq":151,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.594590+0000","last_change":"2024-04-22T07:20:53.872447+0000","last_active":"2024-04-22T07:24:36.594590+0000","last_peered":"2024-04-22T07:24:36.594590+0000","last_clean":"2024-04-22T07:24:36.594590+0000","last_became_active":"2024-04-22T07:20:53.871862+0000","last_became_peered":"2024-04-22T07:20:53.871862+0000","last_unstale":"2024-04-22T07:24:36.594590+0000","last_undegraded":"2024-04-22T07:24:36.594590+0000","last_fullsized":"2024-04-22T07:24:36.594590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:08:33.063318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'153","reported_seq":170,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.588851+0000","last_change":"2024-04-22T07:20:53.862483+0000","last_active":"2024-04-22T07:24:36.588851+0000","last_peered":"2024-04-22T07:24:36.588851+0000","last_clean":"2024-04-22T07:24:36.588851+0000","last_became_active":"2024-04-22T07:20:53.862199+0000","last_became_peered":"2024-04-22T07:20:53.862199+0000","last_unstale":"2024-04-22T07:24:36.588851+0000","last_undegraded":"2024-04-22T07:24:36.588851+0000","last_fullsized":"2024-04-22T07:24:36.588851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:10:12.276510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'158","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.587674+0000","last_change":"2024-04-22T07:20:53.872507+0000","last_active":"2024-04-22T07:24:36.587674+0000","last_peered":"2024-04-22T07:24:36.587674+0000","last_clean":"2024-04-22T07:24:36.587674+0000","last_became_active":"2024-04-22T07:20:53.872199+0000","last_became_peered":"2024-04-22T07:20:53.872199+0000","last_unstale":"2024-04-22T07:24:36.587674+0000","last_undegraded":"2024-04-22T07:24:36.587674+0000","last_fullsized":"2024-04-22T07:24:36.587674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:09.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'180","reported_seq":197,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.650745+0000","last_change":"2024-04-22T07:20:53.863946+0000","last_active":"2024-04-22T07:24:36.650745+0000","last_peered":"2024-04-22T07:24:36.650745+0000","last_clean":"2024-04-22T07:24:36.650745+0000","last_became_active":"2024-04-22T07:20:53.863688+0000","last_became_peered":"2024-04-22T07:20:53.863688+0000","last_unstale":"2024-04-22T07:24:36.650745+0000","last_undegraded":"2024-04-22T07:24:36.650745+0000","last_fullsized":"2024-04-22T07:24:36.650745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:52.689405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'149","reported_seq":167,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.633270+0000","last_change":"2024-04-22T07:20:53.874785+0000","last_active":"2024-04-22T07:24:36.633270+0000","last_peered":"2024-04-22T07:24:36.633270+0000","last_clean":"2024-04-22T07:24:36.633270+0000","last_became_active":"2024-04-22T07:20:53.874524+0000","last_became_peered":"2024-04-22T07:20:53.874524+0000","last_unstale":"2024-04-22T07:24:36.633270+0000","last_undegraded":"2024-04-22T07:24:36.633270+0000","last_fullsized":"2024-04-22T07:24:36.633270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'369","reported_seq":388,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.389090+0000","last_change":"2024-04-22T07:20:52.860712+0000","last_active":"2024-04-22T07:24:36.389090+0000","last_peered":"2024-04-22T07:24:36.389090+0000","last_clean":"2024-04-22T07:24:36.389090+0000","last_became_active":"2024-04-22T07:20:52.860015+0000","last_became_peered":"2024-04-22T07:20:52.860015+0000","last_unstale":"2024-04-22T07:24:36.389090+0000","last_undegraded":"2024-04-22T07:24:36.389090+0000","last_fullsized":"2024-04-22T07:24:36.389090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:59:32.487127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":768160,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":1101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'162","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.581230+0000","last_change":"2024-04-22T07:20:53.879570+0000","last_active":"2024-04-22T07:24:36.581230+0000","last_peered":"2024-04-22T07:24:36.581230+0000","last_clean":"2024-04-22T07:24:36.581230+0000","last_became_active":"2024-04-22T07:20:53.879191+0000","last_became_peered":"2024-04-22T07:20:53.879191+0000","last_unstale":"2024-04-22T07:24:36.581230+0000","last_undegraded":"2024-04-22T07:24:36.581230+0000","last_fullsized":"2024-04-22T07:24:36.581230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:34:52.306691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.990925+0000","last_change":"2024-04-22T07:20:52.862510+0000","last_active":"2024-04-22T07:21:34.990925+0000","last_peered":"2024-04-22T07:21:34.990925+0000","last_clean":"2024-04-22T07:21:34.990925+0000","last_became_active":"2024-04-22T07:20:52.862228+0000","last_became_peered":"2024-04-22T07:20:52.862228+0000","last_unstale":"2024-04-22T07:21:34.990925+0000","last_undegraded":"2024-04-22T07:21:34.990925+0000","last_fullsized":"2024-04-22T07:21:34.990925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:51.683021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.210531+0000","last_change":"2024-04-22T07:20:52.856651+0000","last_active":"2024-04-22T07:21:35.210531+0000","last_peered":"2024-04-22T07:21:35.210531+0000","last_clean":"2024-04-22T07:21:35.210531+0000","last_became_active":"2024-04-22T07:20:52.856096+0000","last_became_peered":"2024-04-22T07:20:52.856096+0000","last_unstale":"2024-04-22T07:21:35.210531+0000","last_undegraded":"2024-04-22T07:21:35.210531+0000","last_fullsized":"2024-04-22T07:21:35.210531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:04.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'190","reported_seq":207,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.645374+0000","last_change":"2024-04-22T07:20:53.873708+0000","last_active":"2024-04-22T07:24:36.645374+0000","last_peered":"2024-04-22T07:24:36.645374+0000","last_clean":"2024-04-22T07:24:36.645374+0000","last_became_active":"2024-04-22T07:20:53.872793+0000","last_became_peered":"2024-04-22T07:20:53.872793+0000","last_unstale":"2024-04-22T07:24:36.645374+0000","last_undegraded":"2024-04-22T07:24:36.645374+0000","last_fullsized":"2024-04-22T07:24:36.645374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:52.686229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.990502+0000","last_change":"2024-04-22T07:20:52.861133+0000","last_active":"2024-04-22T07:21:34.990502+0000","last_peered":"2024-04-22T07:21:34.990502+0000","last_clean":"2024-04-22T07:21:34.990502+0000","last_became_active":"2024-04-22T07:20:52.860736+0000","last_became_peered":"2024-04-22T07:20:52.860736+0000","last_unstale":"2024-04-22T07:21:34.990502+0000","last_undegraded":"2024-04-22T07:21:34.990502+0000","last_fullsized":"2024-04-22T07:21:34.990502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:06.123308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'187","reported_seq":204,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.646657+0000","last_change":"2024-04-22T07:20:53.867477+0000","last_active":"2024-04-22T07:24:36.646657+0000","last_peered":"2024-04-22T07:24:36.646657+0000","last_clean":"2024-04-22T07:24:36.646657+0000","last_became_active":"2024-04-22T07:20:53.867086+0000","last_became_peered":"2024-04-22T07:20:53.867086+0000","last_unstale":"2024-04-22T07:24:36.646657+0000","last_undegraded":"2024-04-22T07:24:36.646657+0000","last_fullsized":"2024-04-22T07:24:36.646657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:56:55.644168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'1","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:40.963836+0000","last_change":"2024-04-22T07:24:40.963882+0000","last_active":"2024-04-22T07:24:40.963836+0000","last_peered":"2024-04-22T07:24:40.963836+0000","last_clean":"2024-04-22T07:24:40.963836+0000","last_became_active":"2024-04-22T07:20:52.863285+0000","last_became_peered":"2024-04-22T07:20:52.863285+0000","last_unstale":"2024-04-22T07:24:40.963836+0000","last_undegraded":"2024-04-22T07:24:40.963836+0000","last_fullsized":"2024-04-22T07:24:40.963836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-04-22T07:24:40.963712+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-04-22T07:24:40.963712+0000","last_clean_scrub_stamp":"2024-04-22T07:24:40.963712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:21:53.213306+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'251","reported_seq":268,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.641367+0000","last_change":"2024-04-22T07:20:53.864955+0000","last_active":"2024-04-22T07:24:36.641367+0000","last_peered":"2024-04-22T07:24:36.641367+0000","last_clean":"2024-04-22T07:24:36.641367+0000","last_became_active":"2024-04-22T07:20:53.864694+0000","last_became_peered":"2024-04-22T07:20:53.864694+0000","last_unstale":"2024-04-22T07:24:36.641367+0000","last_undegraded":"2024-04-22T07:24:36.641367+0000","last_fullsized":"2024-04-22T07:24:36.641367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:46.389093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.067980+0000","last_change":"2024-04-22T07:20:52.858761+0000","last_active":"2024-04-22T07:21:35.067980+0000","last_peered":"2024-04-22T07:21:35.067980+0000","last_clean":"2024-04-22T07:21:35.067980+0000","last_became_active":"2024-04-22T07:20:52.856815+0000","last_became_peered":"2024-04-22T07:20:52.856815+0000","last_unstale":"2024-04-22T07:21:35.067980+0000","last_undegraded":"2024-04-22T07:21:35.067980+0000","last_fullsized":"2024-04-22T07:21:35.067980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:06.123308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'160","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.622696+0000","last_change":"2024-04-22T07:20:53.867290+0000","last_active":"2024-04-22T07:24:36.622696+0000","last_peered":"2024-04-22T07:24:36.622696+0000","last_clean":"2024-04-22T07:24:36.622696+0000","last_became_active":"2024-04-22T07:20:53.866955+0000","last_became_peered":"2024-04-22T07:20:53.866955+0000","last_unstale":"2024-04-22T07:24:36.622696+0000","last_undegraded":"2024-04-22T07:24:36.622696+0000","last_fullsized":"2024-04-22T07:24:36.622696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:43.442316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'8","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.669023+0000","last_change":"2024-04-22T07:20:52.863670+0000","last_active":"2024-04-22T07:24:36.669023+0000","last_peered":"2024-04-22T07:24:36.669023+0000","last_clean":"2024-04-22T07:24:36.669023+0000","last_became_active":"2024-04-22T07:20:52.863320+0000","last_became_peered":"2024-04-22T07:20:52.863320+0000","last_unstale":"2024-04-22T07:24:36.669023+0000","last_undegraded":"2024-04-22T07:24:36.669023+0000","last_fullsized":"2024-04-22T07:24:36.669023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:16:04.571443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'168","reported_seq":185,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.593396+0000","last_change":"2024-04-22T07:20:53.868286+0000","last_active":"2024-04-22T07:24:36.593396+0000","last_peered":"2024-04-22T07:24:36.593396+0000","last_clean":"2024-04-22T07:24:36.593396+0000","last_became_active":"2024-04-22T07:20:53.862811+0000","last_became_peered":"2024-04-22T07:20:53.862811+0000","last_unstale":"2024-04-22T07:24:36.593396+0000","last_undegraded":"2024-04-22T07:24:36.593396+0000","last_fullsized":"2024-04-22T07:24:36.593396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'2013","reported_seq":2032,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:12.634943+0000","last_change":"2024-04-22T07:20:52.863638+0000","last_active":"2024-04-22T07:24:12.634943+0000","last_peered":"2024-04-22T07:24:12.634943+0000","last_clean":"2024-04-22T07:24:12.634943+0000","last_became_active":"2024-04-22T07:20:52.863244+0000","last_became_peered":"2024-04-22T07:20:52.863244+0000","last_unstale":"2024-04-22T07:24:12.634943+0000","last_undegraded":"2024-04-22T07:24:12.634943+0000","last_fullsized":"2024-04-22T07:24:12.634943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2013,"log_dups_size":0,"ondisk_log_size":2013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:36:49.017537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2012,"num_write_kb":6025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'176","reported_seq":193,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.638442+0000","last_change":"2024-04-22T07:20:53.875162+0000","last_active":"2024-04-22T07:24:36.638442+0000","last_peered":"2024-04-22T07:24:36.638442+0000","last_clean":"2024-04-22T07:24:36.638442+0000","last_became_active":"2024-04-22T07:20:53.874612+0000","last_became_peered":"2024-04-22T07:20:53.874612+0000","last_unstale":"2024-04-22T07:24:36.638442+0000","last_undegraded":"2024-04-22T07:24:36.638442+0000","last_fullsized":"2024-04-22T07:24:36.638442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:13:12.303505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.991827+0000","last_change":"2024-04-22T07:20:52.855194+0000","last_active":"2024-04-22T07:21:34.991827+0000","last_peered":"2024-04-22T07:21:34.991827+0000","last_clean":"2024-04-22T07:21:34.991827+0000","last_became_active":"2024-04-22T07:20:52.854915+0000","last_became_peered":"2024-04-22T07:20:52.854915+0000","last_unstale":"2024-04-22T07:21:34.991827+0000","last_undegraded":"2024-04-22T07:21:34.991827+0000","last_fullsized":"2024-04-22T07:21:34.991827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'177","reported_seq":194,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.583770+0000","last_change":"2024-04-22T07:20:53.868695+0000","last_active":"2024-04-22T07:24:36.583770+0000","last_peered":"2024-04-22T07:24:36.583770+0000","last_clean":"2024-04-22T07:24:36.583770+0000","last_became_active":"2024-04-22T07:20:53.868400+0000","last_became_peered":"2024-04-22T07:20:53.868400+0000","last_unstale":"2024-04-22T07:24:36.583770+0000","last_undegraded":"2024-04-22T07:24:36.583770+0000","last_fullsized":"2024-04-22T07:24:36.583770+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:30:23.352871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.990952+0000","last_change":"2024-04-22T07:20:52.861884+0000","last_active":"2024-04-22T07:21:34.990952+0000","last_peered":"2024-04-22T07:21:34.990952+0000","last_clean":"2024-04-22T07:21:34.990952+0000","last_became_active":"2024-04-22T07:20:52.861546+0000","last_became_peered":"2024-04-22T07:20:52.861546+0000","last_unstale":"2024-04-22T07:21:34.990952+0000","last_undegraded":"2024-04-22T07:21:34.990952+0000","last_fullsized":"2024-04-22T07:21:34.990952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:37.283262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'201","reported_seq":218,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.646598+0000","last_change":"2024-04-22T07:20:53.863071+0000","last_active":"2024-04-22T07:24:36.646598+0000","last_peered":"2024-04-22T07:24:36.646598+0000","last_clean":"2024-04-22T07:24:36.646598+0000","last_became_active":"2024-04-22T07:20:53.862763+0000","last_became_peered":"2024-04-22T07:20:53.862763+0000","last_unstale":"2024-04-22T07:24:36.646598+0000","last_undegraded":"2024-04-22T07:24:36.646598+0000","last_fullsized":"2024-04-22T07:24:36.646598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:19:57.432323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.067474+0000","last_change":"2024-04-22T07:20:52.865285+0000","last_active":"2024-04-22T07:21:35.067474+0000","last_peered":"2024-04-22T07:21:35.067474+0000","last_clean":"2024-04-22T07:21:35.067474+0000","last_became_active":"2024-04-22T07:20:52.864725+0000","last_became_peered":"2024-04-22T07:20:52.864725+0000","last_unstale":"2024-04-22T07:21:35.067474+0000","last_undegraded":"2024-04-22T07:21:35.067474+0000","last_fullsized":"2024-04-22T07:21:35.067474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:23:28.850031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'197","reported_seq":215,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.663361+0000","last_change":"2024-04-22T07:20:53.875479+0000","last_active":"2024-04-22T07:24:36.663361+0000","last_peered":"2024-04-22T07:24:36.663361+0000","last_clean":"2024-04-22T07:24:36.663361+0000","last_became_active":"2024-04-22T07:20:53.874567+0000","last_became_peered":"2024-04-22T07:20:53.874567+0000","last_unstale":"2024-04-22T07:24:36.663361+0000","last_undegraded":"2024-04-22T07:24:36.663361+0000","last_fullsized":"2024-04-22T07:24:36.663361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'9","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:23:12.805376+0000","last_change":"2024-04-22T07:20:52.860646+0000","last_active":"2024-04-22T07:23:12.805376+0000","last_peered":"2024-04-22T07:23:12.805376+0000","last_clean":"2024-04-22T07:23:12.805376+0000","last_became_active":"2024-04-22T07:20:52.860347+0000","last_became_peered":"2024-04-22T07:20:52.860347+0000","last_unstale":"2024-04-22T07:23:12.805376+0000","last_undegraded":"2024-04-22T07:23:12.805376+0000","last_fullsized":"2024-04-22T07:23:12.805376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:53:20.912264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'215","reported_seq":232,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.591761+0000","last_change":"2024-04-22T07:20:53.859641+0000","last_active":"2024-04-22T07:24:36.591761+0000","last_peered":"2024-04-22T07:24:36.591761+0000","last_clean":"2024-04-22T07:24:36.591761+0000","last_became_active":"2024-04-22T07:20:53.859365+0000","last_became_peered":"2024-04-22T07:20:53.859365+0000","last_unstale":"2024-04-22T07:24:36.591761+0000","last_undegraded":"2024-04-22T07:24:36.591761+0000","last_fullsized":"2024-04-22T07:24:36.591761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:46:50.322722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.068079+0000","last_change":"2024-04-22T07:20:52.866960+0000","last_active":"2024-04-22T07:21:35.068079+0000","last_peered":"2024-04-22T07:21:35.068079+0000","last_clean":"2024-04-22T07:21:35.068079+0000","last_became_active":"2024-04-22T07:20:52.866654+0000","last_became_peered":"2024-04-22T07:20:52.866654+0000","last_unstale":"2024-04-22T07:21:35.068079+0000","last_undegraded":"2024-04-22T07:21:35.068079+0000","last_fullsized":"2024-04-22T07:21:35.068079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:34:51.683021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'175","reported_seq":192,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.666327+0000","last_change":"2024-04-22T07:20:53.874775+0000","last_active":"2024-04-22T07:24:36.666327+0000","last_peered":"2024-04-22T07:24:36.666327+0000","last_clean":"2024-04-22T07:24:36.666327+0000","last_became_active":"2024-04-22T07:20:53.874499+0000","last_became_peered":"2024-04-22T07:20:53.874499+0000","last_unstale":"2024-04-22T07:24:36.666327+0000","last_undegraded":"2024-04-22T07:24:36.666327+0000","last_fullsized":"2024-04-22T07:24:36.666327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:23.268067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.211381+0000","last_change":"2024-04-22T07:20:52.867201+0000","last_active":"2024-04-22T07:21:35.211381+0000","last_peered":"2024-04-22T07:21:35.211381+0000","last_clean":"2024-04-22T07:21:35.211381+0000","last_became_active":"2024-04-22T07:20:52.866627+0000","last_became_peered":"2024-04-22T07:20:52.866627+0000","last_unstale":"2024-04-22T07:21:35.211381+0000","last_undegraded":"2024-04-22T07:21:35.211381+0000","last_fullsized":"2024-04-22T07:21:35.211381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:09:08.908298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'162","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.576336+0000","last_change":"2024-04-22T07:20:53.871645+0000","last_active":"2024-04-22T07:24:36.576336+0000","last_peered":"2024-04-22T07:24:36.576336+0000","last_clean":"2024-04-22T07:24:36.576336+0000","last_became_active":"2024-04-22T07:20:53.871353+0000","last_became_peered":"2024-04-22T07:20:53.871353+0000","last_unstale":"2024-04-22T07:24:36.576336+0000","last_undegraded":"2024-04-22T07:24:36.576336+0000","last_fullsized":"2024-04-22T07:24:36.576336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:48:40.630407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.211197+0000","last_change":"2024-04-22T07:20:52.866996+0000","last_active":"2024-04-22T07:21:35.211197+0000","last_peered":"2024-04-22T07:21:35.211197+0000","last_clean":"2024-04-22T07:21:35.211197+0000","last_became_active":"2024-04-22T07:20:52.866677+0000","last_became_peered":"2024-04-22T07:20:52.866677+0000","last_unstale":"2024-04-22T07:21:35.211197+0000","last_undegraded":"2024-04-22T07:21:35.211197+0000","last_fullsized":"2024-04-22T07:21:35.211197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'165","reported_seq":182,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.653935+0000","last_change":"2024-04-22T07:20:53.871064+0000","last_active":"2024-04-22T07:24:36.653935+0000","last_peered":"2024-04-22T07:24:36.653935+0000","last_clean":"2024-04-22T07:24:36.653935+0000","last_became_active":"2024-04-22T07:20:53.866968+0000","last_became_peered":"2024-04-22T07:20:53.866968+0000","last_unstale":"2024-04-22T07:24:36.653935+0000","last_undegraded":"2024-04-22T07:24:36.653935+0000","last_fullsized":"2024-04-22T07:24:36.653935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:32:43.442316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.211392+0000","last_change":"2024-04-22T07:20:52.856958+0000","last_active":"2024-04-22T07:21:35.211392+0000","last_peered":"2024-04-22T07:21:35.211392+0000","last_clean":"2024-04-22T07:21:35.211392+0000","last_became_active":"2024-04-22T07:20:52.856289+0000","last_became_peered":"2024-04-22T07:20:52.856289+0000","last_unstale":"2024-04-22T07:21:35.211392+0000","last_undegraded":"2024-04-22T07:21:35.211392+0000","last_fullsized":"2024-04-22T07:21:35.211392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'175","reported_seq":192,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.627877+0000","last_change":"2024-04-22T07:20:53.872915+0000","last_active":"2024-04-22T07:24:36.627877+0000","last_peered":"2024-04-22T07:24:36.627877+0000","last_clean":"2024-04-22T07:24:36.627877+0000","last_became_active":"2024-04-22T07:20:53.872005+0000","last_became_peered":"2024-04-22T07:20:53.872005+0000","last_unstale":"2024-04-22T07:24:36.627877+0000","last_undegraded":"2024-04-22T07:24:36.627877+0000","last_fullsized":"2024-04-22T07:24:36.627877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:53:29.242632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"25'119","reported_seq":186,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:39.959810+0000","last_change":"2024-04-22T07:24:39.959840+0000","last_active":"2024-04-22T07:24:39.959810+0000","last_peered":"2024-04-22T07:24:39.959810+0000","last_clean":"2024-04-22T07:24:39.959810+0000","last_became_active":"2024-04-22T07:20:43.746332+0000","last_became_peered":"2024-04-22T07:20:43.746332+0000","last_unstale":"2024-04-22T07:24:39.959810+0000","last_undegraded":"2024-04-22T07:24:39.959810+0000","last_fullsized":"2024-04-22T07:24:39.959810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'119","last_scrub_stamp":"2024-04-22T07:24:39.959739+0000","last_deep_scrub":"25'119","last_deep_scrub_stamp":"2024-04-22T07:24:39.959739+0000","last_clean_scrub_stamp":"2024-04-22T07:24:39.959739+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:08:48.217818+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.991064+0000","last_change":"2024-04-22T07:20:52.862492+0000","last_active":"2024-04-22T07:21:34.991064+0000","last_peered":"2024-04-22T07:21:34.991064+0000","last_clean":"2024-04-22T07:21:34.991064+0000","last_became_active":"2024-04-22T07:20:52.862201+0000","last_became_peered":"2024-04-22T07:20:52.862201+0000","last_unstale":"2024-04-22T07:21:34.991064+0000","last_undegraded":"2024-04-22T07:21:34.991064+0000","last_fullsized":"2024-04-22T07:21:34.991064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:46:52.015227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'183","reported_seq":200,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.573219+0000","last_change":"2024-04-22T07:20:53.868797+0000","last_active":"2024-04-22T07:24:36.573219+0000","last_peered":"2024-04-22T07:24:36.573219+0000","last_clean":"2024-04-22T07:24:36.573219+0000","last_became_active":"2024-04-22T07:20:53.868335+0000","last_became_peered":"2024-04-22T07:20:53.868335+0000","last_unstale":"2024-04-22T07:24:36.573219+0000","last_undegraded":"2024-04-22T07:24:36.573219+0000","last_fullsized":"2024-04-22T07:24:36.573219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:43:02.116289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.990606+0000","last_change":"2024-04-22T07:20:52.867622+0000","last_active":"2024-04-22T07:21:34.990606+0000","last_peered":"2024-04-22T07:21:34.990606+0000","last_clean":"2024-04-22T07:21:34.990606+0000","last_became_active":"2024-04-22T07:20:52.866996+0000","last_became_peered":"2024-04-22T07:20:52.866996+0000","last_unstale":"2024-04-22T07:21:34.990606+0000","last_undegraded":"2024-04-22T07:21:34.990606+0000","last_fullsized":"2024-04-22T07:21:34.990606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:08.286530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'165","reported_seq":182,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.665162+0000","last_change":"2024-04-22T07:20:53.871576+0000","last_active":"2024-04-22T07:24:36.665162+0000","last_peered":"2024-04-22T07:24:36.665162+0000","last_clean":"2024-04-22T07:24:36.665162+0000","last_became_active":"2024-04-22T07:20:53.871239+0000","last_became_peered":"2024-04-22T07:20:53.871239+0000","last_unstale":"2024-04-22T07:24:36.665162+0000","last_undegraded":"2024-04-22T07:24:36.665162+0000","last_fullsized":"2024-04-22T07:24:36.665162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:46:38.289647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'5","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:34.991234+0000","last_change":"2024-04-22T07:20:52.866974+0000","last_active":"2024-04-22T07:24:34.991234+0000","last_peered":"2024-04-22T07:24:34.991234+0000","last_clean":"2024-04-22T07:24:34.991234+0000","last_became_active":"2024-04-22T07:20:52.866581+0000","last_became_peered":"2024-04-22T07:20:52.866581+0000","last_unstale":"2024-04-22T07:24:34.991234+0000","last_undegraded":"2024-04-22T07:24:34.991234+0000","last_fullsized":"2024-04-22T07:24:34.991234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'165","reported_seq":182,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.642731+0000","last_change":"2024-04-22T07:20:53.865035+0000","last_active":"2024-04-22T07:24:36.642731+0000","last_peered":"2024-04-22T07:24:36.642731+0000","last_clean":"2024-04-22T07:24:36.642731+0000","last_became_active":"2024-04-22T07:20:53.864523+0000","last_became_peered":"2024-04-22T07:20:53.864523+0000","last_unstale":"2024-04-22T07:24:36.642731+0000","last_undegraded":"2024-04-22T07:24:36.642731+0000","last_fullsized":"2024-04-22T07:24:36.642731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:13:12.303505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.991090+0000","last_change":"2024-04-22T07:20:52.858498+0000","last_active":"2024-04-22T07:21:34.991090+0000","last_peered":"2024-04-22T07:21:34.991090+0000","last_clean":"2024-04-22T07:21:34.991090+0000","last_became_active":"2024-04-22T07:20:52.858139+0000","last_became_peered":"2024-04-22T07:20:52.858139+0000","last_unstale":"2024-04-22T07:21:34.991090+0000","last_undegraded":"2024-04-22T07:21:34.991090+0000","last_fullsized":"2024-04-22T07:21:34.991090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:20:45.382709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'177","reported_seq":194,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.664829+0000","last_change":"2024-04-22T07:20:53.877595+0000","last_active":"2024-04-22T07:24:36.664829+0000","last_peered":"2024-04-22T07:24:36.664829+0000","last_clean":"2024-04-22T07:24:36.664829+0000","last_became_active":"2024-04-22T07:20:53.877208+0000","last_became_peered":"2024-04-22T07:20:53.877208+0000","last_unstale":"2024-04-22T07:24:36.664829+0000","last_undegraded":"2024-04-22T07:24:36.664829+0000","last_fullsized":"2024-04-22T07:24:36.664829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:46:50.322722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.211230+0000","last_change":"2024-04-22T07:20:52.866224+0000","last_active":"2024-04-22T07:21:35.211230+0000","last_peered":"2024-04-22T07:21:35.211230+0000","last_clean":"2024-04-22T07:21:35.211230+0000","last_became_active":"2024-04-22T07:20:52.865903+0000","last_became_peered":"2024-04-22T07:20:52.865903+0000","last_unstale":"2024-04-22T07:21:35.211230+0000","last_undegraded":"2024-04-22T07:21:35.211230+0000","last_fullsized":"2024-04-22T07:21:35.211230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:08:21.630964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'160","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.609503+0000","last_change":"2024-04-22T07:20:53.873266+0000","last_active":"2024-04-22T07:24:36.609503+0000","last_peered":"2024-04-22T07:24:36.609503+0000","last_clean":"2024-04-22T07:24:36.609503+0000","last_became_active":"2024-04-22T07:20:53.872915+0000","last_became_peered":"2024-04-22T07:20:53.872915+0000","last_unstale":"2024-04-22T07:24:36.609503+0000","last_undegraded":"2024-04-22T07:24:36.609503+0000","last_fullsized":"2024-04-22T07:24:36.609503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:09.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:34.991276+0000","last_change":"2024-04-22T07:20:52.863593+0000","last_active":"2024-04-22T07:21:34.991276+0000","last_peered":"2024-04-22T07:21:34.991276+0000","last_clean":"2024-04-22T07:21:34.991276+0000","last_became_active":"2024-04-22T07:20:52.863296+0000","last_became_peered":"2024-04-22T07:20:52.863296+0000","last_unstale":"2024-04-22T07:21:34.991276+0000","last_undegraded":"2024-04-22T07:21:34.991276+0000","last_fullsized":"2024-04-22T07:21:34.991276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:22.261683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'162","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.659444+0000","last_change":"2024-04-22T07:20:53.874491+0000","last_active":"2024-04-22T07:24:36.659444+0000","last_peered":"2024-04-22T07:24:36.659444+0000","last_clean":"2024-04-22T07:24:36.659444+0000","last_became_active":"2024-04-22T07:20:53.874202+0000","last_became_peered":"2024-04-22T07:20:53.874202+0000","last_unstale":"2024-04-22T07:24:36.659444+0000","last_undegraded":"2024-04-22T07:24:36.659444+0000","last_fullsized":"2024-04-22T07:24:36.659444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:23.268067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'21","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:34.911001+0000","last_change":"2024-04-22T07:20:52.865905+0000","last_active":"2024-04-22T07:24:34.911001+0000","last_peered":"2024-04-22T07:24:34.911001+0000","last_clean":"2024-04-22T07:24:34.911001+0000","last_became_active":"2024-04-22T07:20:52.865566+0000","last_became_peered":"2024-04-22T07:20:52.865566+0000","last_unstale":"2024-04-22T07:24:34.911001+0000","last_undegraded":"2024-04-22T07:24:34.911001+0000","last_fullsized":"2024-04-22T07:24:34.911001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:38:31.271879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'166","reported_seq":183,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.640194+0000","last_change":"2024-04-22T07:20:53.869951+0000","last_active":"2024-04-22T07:24:36.640194+0000","last_peered":"2024-04-22T07:24:36.640194+0000","last_clean":"2024-04-22T07:24:36.640194+0000","last_became_active":"2024-04-22T07:20:53.869613+0000","last_became_peered":"2024-04-22T07:20:53.869613+0000","last_unstale":"2024-04-22T07:24:36.640194+0000","last_undegraded":"2024-04-22T07:24:36.640194+0000","last_fullsized":"2024-04-22T07:24:36.640194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:14:09.372107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'3","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:23:05.819747+0000","last_change":"2024-04-22T07:20:52.864740+0000","last_active":"2024-04-22T07:23:05.819747+0000","last_peered":"2024-04-22T07:23:05.819747+0000","last_clean":"2024-04-22T07:23:05.819747+0000","last_became_active":"2024-04-22T07:20:52.864434+0000","last_became_peered":"2024-04-22T07:20:52.864434+0000","last_unstale":"2024-04-22T07:23:05.819747+0000","last_undegraded":"2024-04-22T07:23:05.819747+0000","last_fullsized":"2024-04-22T07:23:05.819747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:04:33.937176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'183","reported_seq":200,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.654599+0000","last_change":"2024-04-22T07:20:53.871156+0000","last_active":"2024-04-22T07:24:36.654599+0000","last_peered":"2024-04-22T07:24:36.654599+0000","last_clean":"2024-04-22T07:24:36.654599+0000","last_became_active":"2024-04-22T07:20:53.870664+0000","last_became_peered":"2024-04-22T07:20:53.870664+0000","last_unstale":"2024-04-22T07:24:36.654599+0000","last_undegraded":"2024-04-22T07:24:36.654599+0000","last_fullsized":"2024-04-22T07:24:36.654599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:01:02.139458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.067306+0000","last_change":"2024-04-22T07:20:52.854668+0000","last_active":"2024-04-22T07:21:35.067306+0000","last_peered":"2024-04-22T07:21:35.067306+0000","last_clean":"2024-04-22T07:21:35.067306+0000","last_became_active":"2024-04-22T07:20:52.854395+0000","last_became_peered":"2024-04-22T07:20:52.854395+0000","last_unstale":"2024-04-22T07:21:35.067306+0000","last_undegraded":"2024-04-22T07:21:35.067306+0000","last_fullsized":"2024-04-22T07:21:35.067306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:59:32.487127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'162","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.663943+0000","last_change":"2024-04-22T07:20:53.870972+0000","last_active":"2024-04-22T07:24:36.663943+0000","last_peered":"2024-04-22T07:24:36.663943+0000","last_clean":"2024-04-22T07:24:36.663943+0000","last_became_active":"2024-04-22T07:20:53.870674+0000","last_became_peered":"2024-04-22T07:20:53.870674+0000","last_unstale":"2024-04-22T07:24:36.663943+0000","last_undegraded":"2024-04-22T07:24:36.663943+0000","last_fullsized":"2024-04-22T07:24:36.663943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:36:10.431906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.211569+0000","last_change":"2024-04-22T07:20:52.866003+0000","last_active":"2024-04-22T07:21:35.211569+0000","last_peered":"2024-04-22T07:21:35.211569+0000","last_clean":"2024-04-22T07:21:35.211569+0000","last_became_active":"2024-04-22T07:20:52.865606+0000","last_became_peered":"2024-04-22T07:20:52.865606+0000","last_unstale":"2024-04-22T07:21:35.211569+0000","last_undegraded":"2024-04-22T07:21:35.211569+0000","last_fullsized":"2024-04-22T07:21:35.211569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:58:06.713204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'173","reported_seq":190,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.580942+0000","last_change":"2024-04-22T07:20:53.870737+0000","last_active":"2024-04-22T07:24:36.580942+0000","last_peered":"2024-04-22T07:24:36.580942+0000","last_clean":"2024-04-22T07:24:36.580942+0000","last_became_active":"2024-04-22T07:20:53.870402+0000","last_became_peered":"2024-04-22T07:20:53.870402+0000","last_unstale":"2024-04-22T07:24:36.580942+0000","last_undegraded":"2024-04-22T07:24:36.580942+0000","last_fullsized":"2024-04-22T07:24:36.580942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:30:17.845591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.210719+0000","last_change":"2024-04-22T07:20:52.861048+0000","last_active":"2024-04-22T07:21:35.210719+0000","last_peered":"2024-04-22T07:21:35.210719+0000","last_clean":"2024-04-22T07:21:35.210719+0000","last_became_active":"2024-04-22T07:20:52.860702+0000","last_became_peered":"2024-04-22T07:20:52.860702+0000","last_unstale":"2024-04-22T07:21:35.210719+0000","last_undegraded":"2024-04-22T07:21:35.210719+0000","last_fullsized":"2024-04-22T07:21:35.210719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:53:58.939066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'164","reported_seq":181,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.642642+0000","last_change":"2024-04-22T07:20:53.868782+0000","last_active":"2024-04-22T07:24:36.642642+0000","last_peered":"2024-04-22T07:24:36.642642+0000","last_clean":"2024-04-22T07:24:36.642642+0000","last_became_active":"2024-04-22T07:20:53.868509+0000","last_became_peered":"2024-04-22T07:20:53.868509+0000","last_unstale":"2024-04-22T07:24:36.642642+0000","last_undegraded":"2024-04-22T07:24:36.642642+0000","last_fullsized":"2024-04-22T07:24:36.642642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:07.129692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'3","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:23:10.820295+0000","last_change":"2024-04-22T07:20:52.858508+0000","last_active":"2024-04-22T07:23:10.820295+0000","last_peered":"2024-04-22T07:23:10.820295+0000","last_clean":"2024-04-22T07:23:10.820295+0000","last_became_active":"2024-04-22T07:20:52.858215+0000","last_became_peered":"2024-04-22T07:20:52.858215+0000","last_unstale":"2024-04-22T07:23:10.820295+0000","last_undegraded":"2024-04-22T07:23:10.820295+0000","last_fullsized":"2024-04-22T07:23:10.820295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:11:26.618434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'154","reported_seq":171,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.657177+0000","last_change":"2024-04-22T07:20:53.867977+0000","last_active":"2024-04-22T07:24:36.657177+0000","last_peered":"2024-04-22T07:24:36.657177+0000","last_clean":"2024-04-22T07:24:36.657177+0000","last_became_active":"2024-04-22T07:20:53.867447+0000","last_became_peered":"2024-04-22T07:20:53.867447+0000","last_unstale":"2024-04-22T07:24:36.657177+0000","last_undegraded":"2024-04-22T07:24:36.657177+0000","last_fullsized":"2024-04-22T07:24:36.657177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:48:52.934171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'205","reported_seq":222,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.654659+0000","last_change":"2024-04-22T07:20:53.875681+0000","last_active":"2024-04-22T07:24:36.654659+0000","last_peered":"2024-04-22T07:24:36.654659+0000","last_clean":"2024-04-22T07:24:36.654659+0000","last_became_active":"2024-04-22T07:20:53.875305+0000","last_became_peered":"2024-04-22T07:20:53.875305+0000","last_unstale":"2024-04-22T07:24:36.654659+0000","last_undegraded":"2024-04-22T07:24:36.654659+0000","last_fullsized":"2024-04-22T07:24:36.654659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:22:34.452869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.068077+0000","last_change":"2024-04-22T07:20:52.857445+0000","last_active":"2024-04-22T07:21:35.068077+0000","last_peered":"2024-04-22T07:21:35.068077+0000","last_clean":"2024-04-22T07:21:35.068077+0000","last_became_active":"2024-04-22T07:20:52.856293+0000","last_became_peered":"2024-04-22T07:20:52.856293+0000","last_unstale":"2024-04-22T07:21:35.068077+0000","last_undegraded":"2024-04-22T07:21:35.068077+0000","last_fullsized":"2024-04-22T07:21:35.068077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:10.640191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'162","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.654309+0000","last_change":"2024-04-22T07:20:53.870827+0000","last_active":"2024-04-22T07:24:36.654309+0000","last_peered":"2024-04-22T07:24:36.654309+0000","last_clean":"2024-04-22T07:24:36.654309+0000","last_became_active":"2024-04-22T07:20:53.870548+0000","last_became_peered":"2024-04-22T07:20:53.870548+0000","last_unstale":"2024-04-22T07:24:36.654309+0000","last_undegraded":"2024-04-22T07:24:36.654309+0000","last_fullsized":"2024-04-22T07:24:36.654309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'4","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:23:38.961771+0000","last_change":"2024-04-22T07:20:52.856933+0000","last_active":"2024-04-22T07:23:38.961771+0000","last_peered":"2024-04-22T07:23:38.961771+0000","last_clean":"2024-04-22T07:23:38.961771+0000","last_became_active":"2024-04-22T07:20:52.856617+0000","last_became_peered":"2024-04-22T07:20:52.856617+0000","last_unstale":"2024-04-22T07:23:38.961771+0000","last_undegraded":"2024-04-22T07:23:38.961771+0000","last_fullsized":"2024-04-22T07:23:38.961771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:50:08.286530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'160","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.602527+0000","last_change":"2024-04-22T07:20:53.866552+0000","last_active":"2024-04-22T07:24:36.602527+0000","last_peered":"2024-04-22T07:24:36.602527+0000","last_clean":"2024-04-22T07:24:36.602527+0000","last_became_active":"2024-04-22T07:20:53.866286+0000","last_became_peered":"2024-04-22T07:20:53.866286+0000","last_unstale":"2024-04-22T07:24:36.602527+0000","last_undegraded":"2024-04-22T07:24:36.602527+0000","last_fullsized":"2024-04-22T07:24:36.602527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:45:15.519469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.211591+0000","last_change":"2024-04-22T07:20:52.863291+0000","last_active":"2024-04-22T07:21:35.211591+0000","last_peered":"2024-04-22T07:21:35.211591+0000","last_clean":"2024-04-22T07:21:35.211591+0000","last_became_active":"2024-04-22T07:20:52.862967+0000","last_became_peered":"2024-04-22T07:20:52.862967+0000","last_unstale":"2024-04-22T07:21:35.211591+0000","last_undegraded":"2024-04-22T07:21:35.211591+0000","last_fullsized":"2024-04-22T07:21:35.211591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:38:10.640191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'181","reported_seq":198,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.638533+0000","last_change":"2024-04-22T07:20:53.871045+0000","last_active":"2024-04-22T07:24:36.638533+0000","last_peered":"2024-04-22T07:24:36.638533+0000","last_clean":"2024-04-22T07:24:36.638533+0000","last_became_active":"2024-04-22T07:20:53.870715+0000","last_became_peered":"2024-04-22T07:20:53.870715+0000","last_unstale":"2024-04-22T07:24:36.638533+0000","last_undegraded":"2024-04-22T07:24:36.638533+0000","last_fullsized":"2024-04-22T07:24:36.638533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:14:59.534532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"23'4","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:21:35.211838+0000","last_change":"2024-04-22T07:20:52.869553+0000","last_active":"2024-04-22T07:21:35.211838+0000","last_peered":"2024-04-22T07:21:35.211838+0000","last_clean":"2024-04-22T07:21:35.211838+0000","last_became_active":"2024-04-22T07:20:52.869300+0000","last_became_peered":"2024-04-22T07:20:52.869300+0000","last_unstale":"2024-04-22T07:21:35.211838+0000","last_undegraded":"2024-04-22T07:21:35.211838+0000","last_fullsized":"2024-04-22T07:21:35.211838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:51.829465+0000","last_clean_scrub_stamp":"2024-04-22T07:20:51.829465+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:22:27.709073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11255,"ondisk_log_size":11255,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4964439,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2465,"num_write_kb":7159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9994240,"data_stored":9928878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2450,"ondisk_log_size":2450,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509491,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":270336,"data_stored":93777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509491,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1028096,"data_stored":861308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509490,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36932,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334908,"statfs":{"total":96636764160,"available":96598945792,"internally_reserved":0,"allocated":1634304,"data_stored":1452273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509490,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":262144,"data_stored":93730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509491,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57740,"kb_used_data":4356,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94314100,"statfs":{"total":96636764160,"available":96577638400,"internally_reserved":0,"allocated":4460544,"data_stored":4288124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509491,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36172,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335668,"statfs":{"total":96636764160,"available":96599724032,"internally_reserved":0,"allocated":856064,"data_stored":683586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509492,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35596,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336244,"statfs":{"total":96636764160,"available":96600313856,"internally_reserved":0,"allocated":266240,"data_stored":93204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61908,"kb_used_data":4364,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94309932,"statfs":{"total":96636764160,"available":96573370368,"internally_reserved":0,"allocated":4468736,"data_stored":4288796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4210688,"data_stored":4195648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":782336,"data_stored":768757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":770048,"data_stored":768160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T07:24:43.003 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.003 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.004 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.004 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.004 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.004 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.004 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.004 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.004 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.004 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.005 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.005 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.005 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.005 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.005 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.005 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.005 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.005 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.005 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.005 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.006 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.006 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.006 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.006 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.006 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.006 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.006 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.006 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.006 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.007 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.007 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.007 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.007 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.007 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.007 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.007 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.007 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.007 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.008 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.008 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.008 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.008 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.008 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.008 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.008 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.008 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.008 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.008 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.009 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.009 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.009 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.009 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.009 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.009 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.009 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.009 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.009 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.009 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.010 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.010 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.010 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.010 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.010 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.010 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.010 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.010 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.011 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.011 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.011 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.011 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.011 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.011 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.011 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.011 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.011 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.011 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.011 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.012 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.012 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.012 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.012 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.012 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.012 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.012 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.012 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.012 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.012 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.013 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.013 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.013 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.013 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.013 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.013 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.013 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.013 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-22T07:20:51.829465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=51, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:24:43.013 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-22T07:24:53.995 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:24:54.133 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:25:03.015 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T07:25:03.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.132+0000 7f2e4a86a640 1 Processor -- start 2024-04-22T07:25:03.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.132+0000 7f2e4a86a640 1 -- start start 2024-04-22T07:25:03.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.132+0000 7f2e4a86a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2e44154f50 0x7f2e440cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:03.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.132+0000 7f2e4a86a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e4415e6e0 con 0x7f2e4415b3e0 2024-04-22T07:25:03.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.132+0000 7f2e4a86a640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e4415e9c0 con 0x7f2e440cc5a0 2024-04-22T07:25:03.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.132+0000 7f2e4a86a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f2e4415af50 con 0x7f2e44154f50 2024-04-22T07:25:03.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.133+0000 7f2e43fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2e44154f50 0x7f2e440cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:03.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.133+0000 7f2e48e07640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2e4415b3e0 0x7f2e44165730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35070/0 (socket says 172.21.15.40:35070) 2024-04-22T07:25:03.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.133+0000 7f2e48e07640 1 -- 172.21.15.40:0/159195868 learned_addr learned my addr 172.21.15.40:0/159195868 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:25:03.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.133+0000 7f2e43fff640 1 -- 172.21.15.40:0/159195868 >> v1:172.21.15.62:6789/0 conn(0x7f2e440cc5a0 legacy=0x7f2e440d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:03.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.133+0000 7f2e43fff640 1 -- 172.21.15.40:0/159195868 >> v1:172.21.15.40:6789/0 conn(0x7f2e4415b3e0 legacy=0x7f2e44165730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:03.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.133+0000 7f2e43fff640 1 -- 172.21.15.40:0/159195868 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e4415eca0 con 0x7f2e44154f50 2024-04-22T07:25:03.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.134+0000 7f2e43fff640 1 --2- 172.21.15.40:0/159195868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e44154f50 0x7f2e440cc060 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2e340097a0 tx=0x7f2e3402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32dd00b34b3ec5dc server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:03.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.134+0000 7f2e42ffd640 1 -- 172.21.15.40:0/159195868 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3402f810 con 0x7f2e44154f50 2024-04-22T07:25:03.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.134+0000 7f2e42ffd640 1 -- 172.21.15.40:0/159195868 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e3402f9b0 con 0x7f2e44154f50 2024-04-22T07:25:03.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.134+0000 7f2e42ffd640 1 -- 172.21.15.40:0/159195868 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3402fd80 con 0x7f2e44154f50 2024-04-22T07:25:03.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.134+0000 7f2e4a86a640 1 -- 172.21.15.40:0/159195868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e44154f50 msgr2=0x7f2e440cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:03.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.134+0000 7f2e4a86a640 1 --2- 172.21.15.40:0/159195868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e44154f50 0x7f2e440cc060 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2e340097a0 tx=0x7f2e3402b9f0 comp rx=0 tx=0).stop 2024-04-22T07:25:03.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.134+0000 7f2e4a86a640 1 -- 172.21.15.40:0/159195868 shutdown_connections 2024-04-22T07:25:03.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.134+0000 7f2e4a86a640 1 --2- 172.21.15.40:0/159195868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e44154f50 0x7f2e440cc060 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:03.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.134+0000 7f2e4a86a640 1 -- 172.21.15.40:0/159195868 >> 172.21.15.40:0/159195868 conn(0x7f2e440676b0 msgr2=0x7f2e44067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:25:03.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.134+0000 7f2e4a86a640 1 -- 172.21.15.40:0/159195868 shutdown_connections 2024-04-22T07:25:03.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.135+0000 7f2e4a86a640 1 -- 172.21.15.40:0/159195868 wait complete. 2024-04-22T07:25:03.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.136+0000 7f2e4a86a640 1 Processor -- start 2024-04-22T07:25:03.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.136+0000 7f2e4a86a640 1 -- start start 2024-04-22T07:25:03.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.137+0000 7f2e4a86a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e440cc5a0 0x7f2e44149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:03.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.137+0000 7f2e4a86a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e44154f50 0x7f2e44152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:03.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.137+0000 7f2e4a86a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e4415b3e0 0x7f2e441e6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:03.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.137+0000 7f2e4a86a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4415e3a0 con 0x7f2e440cc5a0 2024-04-22T07:25:03.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.137+0000 7f2e4a86a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4415f260 con 0x7f2e44154f50 2024-04-22T07:25:03.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.137+0000 7f2e4a86a640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f2e44155330 con 0x7f2e4415b3e0 2024-04-22T07:25:03.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.137+0000 7f2e43fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e440cc5a0 0x7f2e44149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:03.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.137+0000 7f2e43fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e440cc5a0 0x7f2e44149ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46632/0 (socket says 172.21.15.40:46632) 2024-04-22T07:25:03.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.137+0000 7f2e43fff640 1 -- 172.21.15.40:0/664407383 learned_addr learned my addr 172.21.15.40:0/664407383 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:25:03.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.137+0000 7f2e437fe640 1 --2- 172.21.15.40:0/664407383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e44154f50 0x7f2e44152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:03.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.137+0000 7f2e48e07640 1 --2- 172.21.15.40:0/664407383 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e4415b3e0 0x7f2e441e6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:03.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.137+0000 7f2e43fff640 1 -- 172.21.15.40:0/664407383 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e4415b3e0 msgr2=0x7f2e441e6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:03.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.137+0000 7f2e43fff640 1 --2- 172.21.15.40:0/664407383 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e4415b3e0 0x7f2e441e6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:03.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.137+0000 7f2e43fff640 1 -- 172.21.15.40:0/664407383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e44154f50 msgr2=0x7f2e44152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:03.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.137+0000 7f2e43fff640 1 --2- 172.21.15.40:0/664407383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e44154f50 0x7f2e44152640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:03.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.137+0000 7f2e43fff640 1 -- 172.21.15.40:0/664407383 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e441f09c0 con 0x7f2e440cc5a0 2024-04-22T07:25:03.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.137+0000 7f2e43fff640 1 --2- 172.21.15.40:0/664407383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e440cc5a0 0x7f2e44149ea0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2e3402c000 tx=0x7f2e34004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:03.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.137+0000 7f2e40ff9640 1 -- 172.21.15.40:0/664407383 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e34047070 con 0x7f2e440cc5a0 2024-04-22T07:25:03.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.137+0000 7f2e40ff9640 1 -- 172.21.15.40:0/664407383 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e34037c60 con 0x7f2e440cc5a0 2024-04-22T07:25:03.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.137+0000 7f2e40ff9640 1 -- 172.21.15.40:0/664407383 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3402fe60 con 0x7f2e440cc5a0 2024-04-22T07:25:03.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.137+0000 7f2e4a86a640 1 -- 172.21.15.40:0/664407383 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e441f0ca0 con 0x7f2e440cc5a0 2024-04-22T07:25:03.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.138+0000 7f2e4a86a640 1 -- 172.21.15.40:0/664407383 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e441f1260 con 0x7f2e440cc5a0 2024-04-22T07:25:03.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.139+0000 7f2e4a86a640 1 -- 172.21.15.40:0/664407383 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e44069d40 con 0x7f2e440cc5a0 2024-04-22T07:25:03.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.139+0000 7f2e40ff9640 1 -- 172.21.15.40:0/664407383 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2e3402f840 con 0x7f2e440cc5a0 2024-04-22T07:25:03.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.139+0000 7f2e40ff9640 1 --2- 172.21.15.40:0/664407383 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2e3006c8f0 0x7f2e3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:03.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.139+0000 7f2e40ff9640 1 -- 172.21.15.40:0/664407383 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f2e340ad970 con 0x7f2e440cc5a0 2024-04-22T07:25:03.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.140+0000 7f2e437fe640 1 --2- 172.21.15.40:0/664407383 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2e3006c8f0 0x7f2e3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:03.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.140+0000 7f2e437fe640 1 --2- 172.21.15.40:0/664407383 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2e3006c8f0 0x7f2e3006edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2e44151a20 tx=0x7f2e38009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:03.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.144+0000 7f2e40ff9640 1 -- 172.21.15.40:0/664407383 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2e34033030 con 0x7f2e440cc5a0 2024-04-22T07:25:03.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.326+0000 7f2e4a86a640 1 -- 172.21.15.40:0/664407383 --> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2e440c61b0 con 0x7f2e3006c8f0 2024-04-22T07:25:03.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.332+0000 7f2e40ff9640 1 -- 172.21.15.40:0/664407383 <== mgr.4107 v2:172.21.15.40:6832/91163869 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253290 (secure 0 0 0) 0x7f2e440c61b0 con 0x7f2e3006c8f0 2024-04-22T07:25:03.331 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:25:03.332 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-22T07:25:03.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.335+0000 7f2e4a86a640 1 -- 172.21.15.40:0/664407383 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2e3006c8f0 msgr2=0x7f2e3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:03.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.335+0000 7f2e4a86a640 1 --2- 172.21.15.40:0/664407383 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2e3006c8f0 0x7f2e3006edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2e44151a20 tx=0x7f2e38009040 comp rx=0 tx=0).stop 2024-04-22T07:25:03.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.335+0000 7f2e4a86a640 1 -- 172.21.15.40:0/664407383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e440cc5a0 msgr2=0x7f2e44149ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:03.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.335+0000 7f2e4a86a640 1 --2- 172.21.15.40:0/664407383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e440cc5a0 0x7f2e44149ea0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2e3402c000 tx=0x7f2e34004730 comp rx=0 tx=0).stop 2024-04-22T07:25:03.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.335+0000 7f2e4a86a640 1 -- 172.21.15.40:0/664407383 shutdown_connections 2024-04-22T07:25:03.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.335+0000 7f2e4a86a640 1 --2- 172.21.15.40:0/664407383 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2e4415b3e0 0x7f2e441e6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:03.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.335+0000 7f2e4a86a640 1 --2- 172.21.15.40:0/664407383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e44154f50 0x7f2e44152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:03.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.335+0000 7f2e4a86a640 1 --2- 172.21.15.40:0/664407383 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2e3006c8f0 0x7f2e3006edb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:03.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.335+0000 7f2e4a86a640 1 --2- 172.21.15.40:0/664407383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e440cc5a0 0x7f2e44149ea0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:03.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.335+0000 7f2e4a86a640 1 -- 172.21.15.40:0/664407383 >> 172.21.15.40:0/664407383 conn(0x7f2e440676b0 msgr2=0x7f2e440b52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:25:03.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.335+0000 7f2e4a86a640 1 -- 172.21.15.40:0/664407383 shutdown_connections 2024-04-22T07:25:03.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:03.335+0000 7f2e4a86a640 1 -- 172.21.15.40:0/664407383 wait complete. 2024-04-22T07:25:03.343 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-04-22T07:25:01.835748+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5554807,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":120,"num_read_kb":104,"num_write":11840,"num_write_kb":25175399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13842,"ondisk_log_size":13842,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":331720,"kb_used_data":12936,"kb_used_omap":12,"kb_used_meta":318707,"kb_avail":754643000,"statfs":{"total":773094113280,"available":772754432000,"internally_reserved":0,"allocated":13246464,"data_stored":11854798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":326356532},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003277"},"pg_stats":[{"pgid":"3.3f","version":"25'167","reported_seq":193,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:49.235130+0000","last_change":"2024-04-22T07:24:49.235155+0000","last_active":"2024-04-22T07:24:49.235130+0000","last_peered":"2024-04-22T07:24:49.235130+0000","last_clean":"2024-04-22T07:24:49.235130+0000","last_became_active":"2024-04-22T07:20:53.873384+0000","last_became_peered":"2024-04-22T07:20:53.873384+0000","last_unstale":"2024-04-22T07:24:49.235130+0000","last_undegraded":"2024-04-22T07:24:49.235130+0000","last_fullsized":"2024-04-22T07:24:49.235130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'167","last_scrub_stamp":"2024-04-22T07:24:49.235025+0000","last_deep_scrub":"25'167","last_deep_scrub_stamp":"2024-04-22T07:24:49.235025+0000","last_clean_scrub_stamp":"2024-04-22T07:24:49.235025+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:03:32.788875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'152","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:50.016805+0000","last_change":"2024-04-22T07:24:50.016835+0000","last_active":"2024-04-22T07:24:50.016805+0000","last_peered":"2024-04-22T07:24:50.016805+0000","last_clean":"2024-04-22T07:24:50.016805+0000","last_became_active":"2024-04-22T07:20:53.869964+0000","last_became_peered":"2024-04-22T07:20:53.869964+0000","last_unstale":"2024-04-22T07:24:50.016805+0000","last_undegraded":"2024-04-22T07:24:50.016805+0000","last_fullsized":"2024-04-22T07:24:50.016805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'152","last_scrub_stamp":"2024-04-22T07:24:50.016709+0000","last_deep_scrub":"25'152","last_deep_scrub_stamp":"2024-04-22T07:24:50.016709+0000","last_clean_scrub_stamp":"2024-04-22T07:24:50.016709+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:45:30.584580+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'178","reported_seq":204,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:52.006147+0000","last_change":"2024-04-22T07:24:52.006173+0000","last_active":"2024-04-22T07:24:52.006147+0000","last_peered":"2024-04-22T07:24:52.006147+0000","last_clean":"2024-04-22T07:24:52.006147+0000","last_became_active":"2024-04-22T07:20:53.870819+0000","last_became_peered":"2024-04-22T07:20:53.870819+0000","last_unstale":"2024-04-22T07:24:52.006147+0000","last_undegraded":"2024-04-22T07:24:52.006147+0000","last_fullsized":"2024-04-22T07:24:52.006147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'178","last_scrub_stamp":"2024-04-22T07:24:52.006052+0000","last_deep_scrub":"25'178","last_deep_scrub_stamp":"2024-04-22T07:24:52.006052+0000","last_clean_scrub_stamp":"2024-04-22T07:24:52.006052+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:03:35.559902+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'193","reported_seq":220,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:46.423617+0000","last_change":"2024-04-22T07:24:46.423617+0000","last_active":"2024-04-22T07:24:46.423617+0000","last_peered":"2024-04-22T07:24:46.423617+0000","last_clean":"2024-04-22T07:24:46.423617+0000","last_became_active":"2024-04-22T07:20:53.870125+0000","last_became_peered":"2024-04-22T07:20:53.870125+0000","last_unstale":"2024-04-22T07:24:46.423617+0000","last_undegraded":"2024-04-22T07:24:46.423617+0000","last_fullsized":"2024-04-22T07:24:46.423617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'193","last_scrub_stamp":"2024-04-22T07:24:46.423497+0000","last_deep_scrub":"25'193","last_deep_scrub_stamp":"2024-04-22T07:24:46.423497+0000","last_clean_scrub_stamp":"2024-04-22T07:24:46.423497+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:40:57.527410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'174","reported_seq":200,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:53.203397+0000","last_change":"2024-04-22T07:24:53.203473+0000","last_active":"2024-04-22T07:24:53.203397+0000","last_peered":"2024-04-22T07:24:53.203397+0000","last_clean":"2024-04-22T07:24:53.203397+0000","last_became_active":"2024-04-22T07:20:53.874941+0000","last_became_peered":"2024-04-22T07:20:53.874941+0000","last_unstale":"2024-04-22T07:24:53.203397+0000","last_undegraded":"2024-04-22T07:24:53.203397+0000","last_fullsized":"2024-04-22T07:24:53.203397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'174","last_scrub_stamp":"2024-04-22T07:24:53.203285+0000","last_deep_scrub":"25'174","last_deep_scrub_stamp":"2024-04-22T07:24:53.203285+0000","last_clean_scrub_stamp":"2024-04-22T07:24:53.203285+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:10:06.332874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"25'162","reported_seq":188,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:45.410521+0000","last_change":"2024-04-22T07:24:45.410548+0000","last_active":"2024-04-22T07:24:45.410521+0000","last_peered":"2024-04-22T07:24:45.410521+0000","last_clean":"2024-04-22T07:24:45.410521+0000","last_became_active":"2024-04-22T07:20:53.869369+0000","last_became_peered":"2024-04-22T07:20:53.869369+0000","last_unstale":"2024-04-22T07:24:45.410521+0000","last_undegraded":"2024-04-22T07:24:45.410521+0000","last_fullsized":"2024-04-22T07:24:45.410521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'162","last_scrub_stamp":"2024-04-22T07:24:45.410421+0000","last_deep_scrub":"25'162","last_deep_scrub_stamp":"2024-04-22T07:24:45.410421+0000","last_clean_scrub_stamp":"2024-04-22T07:24:45.410421+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:41:20.784684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'188","reported_seq":214,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:48.267406+0000","last_change":"2024-04-22T07:24:48.267431+0000","last_active":"2024-04-22T07:24:48.267406+0000","last_peered":"2024-04-22T07:24:48.267406+0000","last_clean":"2024-04-22T07:24:48.267406+0000","last_became_active":"2024-04-22T07:20:53.873220+0000","last_became_peered":"2024-04-22T07:20:53.873220+0000","last_unstale":"2024-04-22T07:24:48.267406+0000","last_undegraded":"2024-04-22T07:24:48.267406+0000","last_fullsized":"2024-04-22T07:24:48.267406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'188","last_scrub_stamp":"2024-04-22T07:24:48.267293+0000","last_deep_scrub":"25'188","last_deep_scrub_stamp":"2024-04-22T07:24:48.267293+0000","last_clean_scrub_stamp":"2024-04-22T07:24:48.267293+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:36.215935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'204","reported_seq":230,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:57.055245+0000","last_change":"2024-04-22T07:24:57.055318+0000","last_active":"2024-04-22T07:24:57.055245+0000","last_peered":"2024-04-22T07:24:57.055245+0000","last_clean":"2024-04-22T07:24:57.055245+0000","last_became_active":"2024-04-22T07:20:53.875017+0000","last_became_peered":"2024-04-22T07:20:53.875017+0000","last_unstale":"2024-04-22T07:24:57.055245+0000","last_undegraded":"2024-04-22T07:24:57.055245+0000","last_fullsized":"2024-04-22T07:24:57.055245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'204","last_scrub_stamp":"2024-04-22T07:24:57.055130+0000","last_deep_scrub":"25'204","last_deep_scrub_stamp":"2024-04-22T07:24:57.055130+0000","last_clean_scrub_stamp":"2024-04-22T07:24:57.055130+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:23:57.979604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'178","reported_seq":204,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:42.953275+0000","last_change":"2024-04-22T07:24:42.953295+0000","last_active":"2024-04-22T07:24:42.953275+0000","last_peered":"2024-04-22T07:24:42.953275+0000","last_clean":"2024-04-22T07:24:42.953275+0000","last_became_active":"2024-04-22T07:20:53.868906+0000","last_became_peered":"2024-04-22T07:20:53.868906+0000","last_unstale":"2024-04-22T07:24:42.953275+0000","last_undegraded":"2024-04-22T07:24:42.953275+0000","last_fullsized":"2024-04-22T07:24:42.953275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'178","last_scrub_stamp":"2024-04-22T07:24:42.953197+0000","last_deep_scrub":"25'178","last_deep_scrub_stamp":"2024-04-22T07:24:42.953197+0000","last_clean_scrub_stamp":"2024-04-22T07:24:42.953197+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:57:22.421120+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'190","reported_seq":216,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:51.239546+0000","last_change":"2024-04-22T07:24:51.239574+0000","last_active":"2024-04-22T07:24:51.239546+0000","last_peered":"2024-04-22T07:24:51.239546+0000","last_clean":"2024-04-22T07:24:51.239546+0000","last_became_active":"2024-04-22T07:20:53.874673+0000","last_became_peered":"2024-04-22T07:20:53.874673+0000","last_unstale":"2024-04-22T07:24:51.239546+0000","last_undegraded":"2024-04-22T07:24:51.239546+0000","last_fullsized":"2024-04-22T07:24:51.239546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'190","last_scrub_stamp":"2024-04-22T07:24:51.239450+0000","last_deep_scrub":"25'190","last_deep_scrub_stamp":"2024-04-22T07:24:51.239450+0000","last_clean_scrub_stamp":"2024-04-22T07:24:51.239450+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:18:21.263673+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'214","reported_seq":240,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:50.274433+0000","last_change":"2024-04-22T07:24:50.274497+0000","last_active":"2024-04-22T07:24:50.274433+0000","last_peered":"2024-04-22T07:24:50.274433+0000","last_clean":"2024-04-22T07:24:50.274433+0000","last_became_active":"2024-04-22T07:20:53.873945+0000","last_became_peered":"2024-04-22T07:20:53.873945+0000","last_unstale":"2024-04-22T07:24:50.274433+0000","last_undegraded":"2024-04-22T07:24:50.274433+0000","last_fullsized":"2024-04-22T07:24:50.274433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'214","last_scrub_stamp":"2024-04-22T07:24:50.274309+0000","last_deep_scrub":"25'214","last_deep_scrub_stamp":"2024-04-22T07:24:50.274309+0000","last_clean_scrub_stamp":"2024-04-22T07:24:50.274309+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:32:22.606221+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'166","reported_seq":186,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:49.365775+0000","last_change":"2024-04-22T07:24:49.365799+0000","last_active":"2024-04-22T07:24:49.365775+0000","last_peered":"2024-04-22T07:24:49.365775+0000","last_clean":"2024-04-22T07:24:49.365775+0000","last_became_active":"2024-04-22T07:21:34.992633+0000","last_became_peered":"2024-04-22T07:21:34.992633+0000","last_unstale":"2024-04-22T07:24:49.365775+0000","last_undegraded":"2024-04-22T07:24:49.365775+0000","last_fullsized":"2024-04-22T07:24:49.365775+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'166","last_scrub_stamp":"2024-04-22T07:24:49.365683+0000","last_deep_scrub":"25'166","last_deep_scrub_stamp":"2024-04-22T07:24:49.365683+0000","last_clean_scrub_stamp":"2024-04-22T07:24:49.365683+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:45:31.463215+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"25'177","reported_seq":203,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:52.011493+0000","last_change":"2024-04-22T07:24:52.011521+0000","last_active":"2024-04-22T07:24:52.011493+0000","last_peered":"2024-04-22T07:24:52.011493+0000","last_clean":"2024-04-22T07:24:52.011493+0000","last_became_active":"2024-04-22T07:20:53.879070+0000","last_became_peered":"2024-04-22T07:20:53.879070+0000","last_unstale":"2024-04-22T07:24:52.011493+0000","last_undegraded":"2024-04-22T07:24:52.011493+0000","last_fullsized":"2024-04-22T07:24:52.011493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'177","last_scrub_stamp":"2024-04-22T07:24:52.011400+0000","last_deep_scrub":"25'177","last_deep_scrub_stamp":"2024-04-22T07:24:52.011400+0000","last_clean_scrub_stamp":"2024-04-22T07:24:52.011400+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:18:50.884138+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'172","reported_seq":198,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:50.047282+0000","last_change":"2024-04-22T07:24:50.047310+0000","last_active":"2024-04-22T07:24:50.047282+0000","last_peered":"2024-04-22T07:24:50.047282+0000","last_clean":"2024-04-22T07:24:50.047282+0000","last_became_active":"2024-04-22T07:20:53.877116+0000","last_became_peered":"2024-04-22T07:20:53.877116+0000","last_unstale":"2024-04-22T07:24:50.047282+0000","last_undegraded":"2024-04-22T07:24:50.047282+0000","last_fullsized":"2024-04-22T07:24:50.047282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'172","last_scrub_stamp":"2024-04-22T07:24:50.047192+0000","last_deep_scrub":"25'172","last_deep_scrub_stamp":"2024-04-22T07:24:50.047192+0000","last_clean_scrub_stamp":"2024-04-22T07:24:50.047192+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:55:55.670104+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'177","reported_seq":203,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:56.023640+0000","last_change":"2024-04-22T07:24:56.023678+0000","last_active":"2024-04-22T07:24:56.023640+0000","last_peered":"2024-04-22T07:24:56.023640+0000","last_clean":"2024-04-22T07:24:56.023640+0000","last_became_active":"2024-04-22T07:20:53.874468+0000","last_became_peered":"2024-04-22T07:20:53.874468+0000","last_unstale":"2024-04-22T07:24:56.023640+0000","last_undegraded":"2024-04-22T07:24:56.023640+0000","last_fullsized":"2024-04-22T07:24:56.023640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'177","last_scrub_stamp":"2024-04-22T07:24:56.023543+0000","last_deep_scrub":"25'177","last_deep_scrub_stamp":"2024-04-22T07:24:56.023543+0000","last_clean_scrub_stamp":"2024-04-22T07:24:56.023543+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:10:09.153132+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'162","reported_seq":188,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:54.930214+0000","last_change":"2024-04-22T07:24:54.930240+0000","last_active":"2024-04-22T07:24:54.930214+0000","last_peered":"2024-04-22T07:24:54.930214+0000","last_clean":"2024-04-22T07:24:54.930214+0000","last_became_active":"2024-04-22T07:20:53.865491+0000","last_became_peered":"2024-04-22T07:20:53.865491+0000","last_unstale":"2024-04-22T07:24:54.930214+0000","last_undegraded":"2024-04-22T07:24:54.930214+0000","last_fullsized":"2024-04-22T07:24:54.930214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'162","last_scrub_stamp":"2024-04-22T07:24:54.930109+0000","last_deep_scrub":"25'162","last_deep_scrub_stamp":"2024-04-22T07:24:54.930109+0000","last_clean_scrub_stamp":"2024-04-22T07:24:54.930109+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:08:21.259240+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'176","reported_seq":194,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.664980+0000","last_change":"2024-04-22T07:20:53.876797+0000","last_active":"2024-04-22T07:24:36.664980+0000","last_peered":"2024-04-22T07:24:36.664980+0000","last_clean":"2024-04-22T07:24:36.664980+0000","last_became_active":"2024-04-22T07:20:53.876321+0000","last_became_peered":"2024-04-22T07:20:53.876321+0000","last_unstale":"2024-04-22T07:24:36.664980+0000","last_undegraded":"2024-04-22T07:24:36.664980+0000","last_fullsized":"2024-04-22T07:24:36.664980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'179","reported_seq":205,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:46.363560+0000","last_change":"2024-04-22T07:24:46.363604+0000","last_active":"2024-04-22T07:24:46.363560+0000","last_peered":"2024-04-22T07:24:46.363560+0000","last_clean":"2024-04-22T07:24:46.363560+0000","last_became_active":"2024-04-22T07:20:53.868441+0000","last_became_peered":"2024-04-22T07:20:53.868441+0000","last_unstale":"2024-04-22T07:24:46.363560+0000","last_undegraded":"2024-04-22T07:24:46.363560+0000","last_fullsized":"2024-04-22T07:24:46.363560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'179","last_scrub_stamp":"2024-04-22T07:24:46.363430+0000","last_deep_scrub":"25'179","last_deep_scrub_stamp":"2024-04-22T07:24:46.363430+0000","last_clean_scrub_stamp":"2024-04-22T07:24:46.363430+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:33:45.885365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'205","reported_seq":231,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:44.071143+0000","last_change":"2024-04-22T07:24:44.071216+0000","last_active":"2024-04-22T07:24:44.071143+0000","last_peered":"2024-04-22T07:24:44.071143+0000","last_clean":"2024-04-22T07:24:44.071143+0000","last_became_active":"2024-04-22T07:20:53.864535+0000","last_became_peered":"2024-04-22T07:20:53.864535+0000","last_unstale":"2024-04-22T07:24:44.071143+0000","last_undegraded":"2024-04-22T07:24:44.071143+0000","last_fullsized":"2024-04-22T07:24:44.071143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'205","last_scrub_stamp":"2024-04-22T07:24:44.071014+0000","last_deep_scrub":"25'205","last_deep_scrub_stamp":"2024-04-22T07:24:44.071014+0000","last_clean_scrub_stamp":"2024-04-22T07:24:44.071014+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:43:38.056001+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'179","reported_seq":205,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:55.215191+0000","last_change":"2024-04-22T07:24:55.215218+0000","last_active":"2024-04-22T07:24:55.215191+0000","last_peered":"2024-04-22T07:24:55.215191+0000","last_clean":"2024-04-22T07:24:55.215191+0000","last_became_active":"2024-04-22T07:20:53.876641+0000","last_became_peered":"2024-04-22T07:20:53.876641+0000","last_unstale":"2024-04-22T07:24:55.215191+0000","last_undegraded":"2024-04-22T07:24:55.215191+0000","last_fullsized":"2024-04-22T07:24:55.215191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'179","last_scrub_stamp":"2024-04-22T07:24:55.215084+0000","last_deep_scrub":"25'179","last_deep_scrub_stamp":"2024-04-22T07:24:55.215084+0000","last_clean_scrub_stamp":"2024-04-22T07:24:55.215084+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:23:13.759880+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'154","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:47.967146+0000","last_change":"2024-04-22T07:24:47.967174+0000","last_active":"2024-04-22T07:24:47.967146+0000","last_peered":"2024-04-22T07:24:47.967146+0000","last_clean":"2024-04-22T07:24:47.967146+0000","last_became_active":"2024-04-22T07:20:53.868014+0000","last_became_peered":"2024-04-22T07:20:53.868014+0000","last_unstale":"2024-04-22T07:24:47.967146+0000","last_undegraded":"2024-04-22T07:24:47.967146+0000","last_fullsized":"2024-04-22T07:24:47.967146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'154","last_scrub_stamp":"2024-04-22T07:24:47.967047+0000","last_deep_scrub":"25'154","last_deep_scrub_stamp":"2024-04-22T07:24:47.967047+0000","last_clean_scrub_stamp":"2024-04-22T07:24:47.967047+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:11:33.205772+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'199","reported_seq":225,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:41.959305+0000","last_change":"2024-04-22T07:24:41.959328+0000","last_active":"2024-04-22T07:24:41.959305+0000","last_peered":"2024-04-22T07:24:41.959305+0000","last_clean":"2024-04-22T07:24:41.959305+0000","last_became_active":"2024-04-22T07:20:53.867403+0000","last_became_peered":"2024-04-22T07:20:53.867403+0000","last_unstale":"2024-04-22T07:24:41.959305+0000","last_undegraded":"2024-04-22T07:24:41.959305+0000","last_fullsized":"2024-04-22T07:24:41.959305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'199","last_scrub_stamp":"2024-04-22T07:24:41.959216+0000","last_deep_scrub":"25'199","last_deep_scrub_stamp":"2024-04-22T07:24:41.959216+0000","last_clean_scrub_stamp":"2024-04-22T07:24:41.959216+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:30:33.694009+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'150","reported_seq":176,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:49.066591+0000","last_change":"2024-04-22T07:24:49.066622+0000","last_active":"2024-04-22T07:24:49.066591+0000","last_peered":"2024-04-22T07:24:49.066591+0000","last_clean":"2024-04-22T07:24:49.066591+0000","last_became_active":"2024-04-22T07:20:53.868519+0000","last_became_peered":"2024-04-22T07:20:53.868519+0000","last_unstale":"2024-04-22T07:24:49.066591+0000","last_undegraded":"2024-04-22T07:24:49.066591+0000","last_fullsized":"2024-04-22T07:24:49.066591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'150","last_scrub_stamp":"2024-04-22T07:24:49.066480+0000","last_deep_scrub":"25'150","last_deep_scrub_stamp":"2024-04-22T07:24:49.066480+0000","last_clean_scrub_stamp":"2024-04-22T07:24:49.066480+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:57:31.884821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'207","reported_seq":233,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:53.888140+0000","last_change":"2024-04-22T07:24:53.888166+0000","last_active":"2024-04-22T07:24:53.888140+0000","last_peered":"2024-04-22T07:24:53.888140+0000","last_clean":"2024-04-22T07:24:53.888140+0000","last_became_active":"2024-04-22T07:20:53.865026+0000","last_became_peered":"2024-04-22T07:20:53.865026+0000","last_unstale":"2024-04-22T07:24:53.888140+0000","last_undegraded":"2024-04-22T07:24:53.888140+0000","last_fullsized":"2024-04-22T07:24:53.888140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'207","last_scrub_stamp":"2024-04-22T07:24:53.888035+0000","last_deep_scrub":"25'207","last_deep_scrub_stamp":"2024-04-22T07:24:53.888035+0000","last_clean_scrub_stamp":"2024-04-22T07:24:53.888035+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:23:12.432831+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'160","reported_seq":186,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:54.038122+0000","last_change":"2024-04-22T07:24:54.038173+0000","last_active":"2024-04-22T07:24:54.038122+0000","last_peered":"2024-04-22T07:24:54.038122+0000","last_clean":"2024-04-22T07:24:54.038122+0000","last_became_active":"2024-04-22T07:20:53.873147+0000","last_became_peered":"2024-04-22T07:20:53.873147+0000","last_unstale":"2024-04-22T07:24:54.038122+0000","last_undegraded":"2024-04-22T07:24:54.038122+0000","last_fullsized":"2024-04-22T07:24:54.038122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'160","last_scrub_stamp":"2024-04-22T07:24:54.037985+0000","last_deep_scrub":"25'160","last_deep_scrub_stamp":"2024-04-22T07:24:54.037985+0000","last_clean_scrub_stamp":"2024-04-22T07:24:54.037985+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:18:24.062208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'217","reported_seq":243,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:44.392694+0000","last_change":"2024-04-22T07:24:44.392722+0000","last_active":"2024-04-22T07:24:44.392694+0000","last_peered":"2024-04-22T07:24:44.392694+0000","last_clean":"2024-04-22T07:24:44.392694+0000","last_became_active":"2024-04-22T07:20:53.865030+0000","last_became_peered":"2024-04-22T07:20:53.865030+0000","last_unstale":"2024-04-22T07:24:44.392694+0000","last_undegraded":"2024-04-22T07:24:44.392694+0000","last_fullsized":"2024-04-22T07:24:44.392694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'217","last_scrub_stamp":"2024-04-22T07:24:44.392594+0000","last_deep_scrub":"25'217","last_deep_scrub_stamp":"2024-04-22T07:24:44.392594+0000","last_clean_scrub_stamp":"2024-04-22T07:24:44.392594+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:45:26.490126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'166","reported_seq":192,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:49.058022+0000","last_change":"2024-04-22T07:24:49.058054+0000","last_active":"2024-04-22T07:24:49.058022+0000","last_peered":"2024-04-22T07:24:49.058022+0000","last_clean":"2024-04-22T07:24:49.058022+0000","last_became_active":"2024-04-22T07:20:53.876446+0000","last_became_peered":"2024-04-22T07:20:53.876446+0000","last_unstale":"2024-04-22T07:24:49.058022+0000","last_undegraded":"2024-04-22T07:24:49.058022+0000","last_fullsized":"2024-04-22T07:24:49.058022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'166","last_scrub_stamp":"2024-04-22T07:24:49.057925+0000","last_deep_scrub":"25'166","last_deep_scrub_stamp":"2024-04-22T07:24:49.057925+0000","last_clean_scrub_stamp":"2024-04-22T07:24:49.057925+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:55:53.487503+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'152","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:51.039857+0000","last_change":"2024-04-22T07:24:51.039891+0000","last_active":"2024-04-22T07:24:51.039857+0000","last_peered":"2024-04-22T07:24:51.039857+0000","last_clean":"2024-04-22T07:24:51.039857+0000","last_became_active":"2024-04-22T07:20:53.877867+0000","last_became_peered":"2024-04-22T07:20:53.877867+0000","last_unstale":"2024-04-22T07:24:51.039857+0000","last_undegraded":"2024-04-22T07:24:51.039857+0000","last_fullsized":"2024-04-22T07:24:51.039857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'152","last_scrub_stamp":"2024-04-22T07:24:51.039756+0000","last_deep_scrub":"25'152","last_deep_scrub_stamp":"2024-04-22T07:24:51.039756+0000","last_clean_scrub_stamp":"2024-04-22T07:24:51.039756+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:41:47.074817+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'134","reported_seq":160,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:53.053219+0000","last_change":"2024-04-22T07:24:53.053248+0000","last_active":"2024-04-22T07:24:53.053219+0000","last_peered":"2024-04-22T07:24:53.053219+0000","last_clean":"2024-04-22T07:24:53.053219+0000","last_became_active":"2024-04-22T07:20:53.871862+0000","last_became_peered":"2024-04-22T07:20:53.871862+0000","last_unstale":"2024-04-22T07:24:53.053219+0000","last_undegraded":"2024-04-22T07:24:53.053219+0000","last_fullsized":"2024-04-22T07:24:53.053219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'134","last_scrub_stamp":"2024-04-22T07:24:53.053126+0000","last_deep_scrub":"25'134","last_deep_scrub_stamp":"2024-04-22T07:24:53.053126+0000","last_clean_scrub_stamp":"2024-04-22T07:24:53.053126+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:32:25.385039+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'153","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:40.996837+0000","last_change":"2024-04-22T07:24:40.996886+0000","last_active":"2024-04-22T07:24:40.996837+0000","last_peered":"2024-04-22T07:24:40.996837+0000","last_clean":"2024-04-22T07:24:40.996837+0000","last_became_active":"2024-04-22T07:20:53.862199+0000","last_became_peered":"2024-04-22T07:20:53.862199+0000","last_unstale":"2024-04-22T07:24:40.996837+0000","last_undegraded":"2024-04-22T07:24:40.996837+0000","last_fullsized":"2024-04-22T07:24:40.996837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'153","last_scrub_stamp":"2024-04-22T07:24:40.996727+0000","last_deep_scrub":"25'153","last_deep_scrub_stamp":"2024-04-22T07:24:40.996727+0000","last_clean_scrub_stamp":"2024-04-22T07:24:40.996727+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:21:32.621555+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'158","reported_seq":184,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:48.339386+0000","last_change":"2024-04-22T07:24:48.339416+0000","last_active":"2024-04-22T07:24:48.339386+0000","last_peered":"2024-04-22T07:24:48.339386+0000","last_clean":"2024-04-22T07:24:48.339386+0000","last_became_active":"2024-04-22T07:20:53.872199+0000","last_became_peered":"2024-04-22T07:20:53.872199+0000","last_unstale":"2024-04-22T07:24:48.339386+0000","last_undegraded":"2024-04-22T07:24:48.339386+0000","last_fullsized":"2024-04-22T07:24:48.339386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'158","last_scrub_stamp":"2024-04-22T07:24:48.339289+0000","last_deep_scrub":"25'158","last_deep_scrub_stamp":"2024-04-22T07:24:48.339289+0000","last_clean_scrub_stamp":"2024-04-22T07:24:48.339289+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:43.156282+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'180","reported_seq":206,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:42.354874+0000","last_change":"2024-04-22T07:24:42.354902+0000","last_active":"2024-04-22T07:24:42.354874+0000","last_peered":"2024-04-22T07:24:42.354874+0000","last_clean":"2024-04-22T07:24:42.354874+0000","last_became_active":"2024-04-22T07:20:53.863688+0000","last_became_peered":"2024-04-22T07:20:53.863688+0000","last_unstale":"2024-04-22T07:24:42.354874+0000","last_undegraded":"2024-04-22T07:24:42.354874+0000","last_fullsized":"2024-04-22T07:24:42.354874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'180","last_scrub_stamp":"2024-04-22T07:24:42.354782+0000","last_deep_scrub":"25'180","last_deep_scrub_stamp":"2024-04-22T07:24:42.354782+0000","last_clean_scrub_stamp":"2024-04-22T07:24:42.354782+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:30:34.089576+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'149","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:44.960010+0000","last_change":"2024-04-22T07:24:44.960042+0000","last_active":"2024-04-22T07:24:44.960010+0000","last_peered":"2024-04-22T07:24:44.960010+0000","last_clean":"2024-04-22T07:24:44.960010+0000","last_became_active":"2024-04-22T07:20:53.874524+0000","last_became_peered":"2024-04-22T07:20:53.874524+0000","last_unstale":"2024-04-22T07:24:44.960010+0000","last_undegraded":"2024-04-22T07:24:44.960010+0000","last_fullsized":"2024-04-22T07:24:44.960010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'149","last_scrub_stamp":"2024-04-22T07:24:44.959905+0000","last_deep_scrub":"25'149","last_deep_scrub_stamp":"2024-04-22T07:24:44.959905+0000","last_clean_scrub_stamp":"2024-04-22T07:24:44.959905+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:41:20.334168+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'369","reported_seq":397,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:42.002677+0000","last_change":"2024-04-22T07:24:42.002707+0000","last_active":"2024-04-22T07:24:42.002677+0000","last_peered":"2024-04-22T07:24:42.002677+0000","last_clean":"2024-04-22T07:24:42.002677+0000","last_became_active":"2024-04-22T07:20:52.860015+0000","last_became_peered":"2024-04-22T07:20:52.860015+0000","last_unstale":"2024-04-22T07:24:42.002677+0000","last_undegraded":"2024-04-22T07:24:42.002677+0000","last_fullsized":"2024-04-22T07:24:42.002677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'369","last_scrub_stamp":"2024-04-22T07:24:42.002579+0000","last_deep_scrub":"25'369","last_deep_scrub_stamp":"2024-04-22T07:24:42.002579+0000","last_clean_scrub_stamp":"2024-04-22T07:24:42.002579+0000","objects_scrubbed":1,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:26:31.187855+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":768160,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":1101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'162","reported_seq":188,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:52.874598+0000","last_change":"2024-04-22T07:24:52.874671+0000","last_active":"2024-04-22T07:24:52.874598+0000","last_peered":"2024-04-22T07:24:52.874598+0000","last_clean":"2024-04-22T07:24:52.874598+0000","last_became_active":"2024-04-22T07:20:53.879191+0000","last_became_peered":"2024-04-22T07:20:53.879191+0000","last_unstale":"2024-04-22T07:24:52.874598+0000","last_undegraded":"2024-04-22T07:24:52.874598+0000","last_fullsized":"2024-04-22T07:24:52.874598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'162","last_scrub_stamp":"2024-04-22T07:24:52.874481+0000","last_deep_scrub":"25'162","last_deep_scrub_stamp":"2024-04-22T07:24:52.874481+0000","last_clean_scrub_stamp":"2024-04-22T07:24:52.874481+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:17:14.826206+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:50.938658+0000","last_change":"2024-04-22T07:24:50.938686+0000","last_active":"2024-04-22T07:24:50.938658+0000","last_peered":"2024-04-22T07:24:50.938658+0000","last_clean":"2024-04-22T07:24:50.938658+0000","last_became_active":"2024-04-22T07:20:52.862228+0000","last_became_peered":"2024-04-22T07:20:52.862228+0000","last_unstale":"2024-04-22T07:24:50.938658+0000","last_undegraded":"2024-04-22T07:24:50.938658+0000","last_fullsized":"2024-04-22T07:24:50.938658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2024-04-22T07:24:50.938567+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2024-04-22T07:24:50.938567+0000","last_clean_scrub_stamp":"2024-04-22T07:24:50.938567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:20:10.148046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:43.050562+0000","last_change":"2024-04-22T07:24:43.050599+0000","last_active":"2024-04-22T07:24:43.050562+0000","last_peered":"2024-04-22T07:24:43.050562+0000","last_clean":"2024-04-22T07:24:43.050562+0000","last_became_active":"2024-04-22T07:20:52.856096+0000","last_became_peered":"2024-04-22T07:20:52.856096+0000","last_unstale":"2024-04-22T07:24:43.050562+0000","last_undegraded":"2024-04-22T07:24:43.050562+0000","last_fullsized":"2024-04-22T07:24:43.050562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:24:43.050442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:24:43.050442+0000","last_clean_scrub_stamp":"2024-04-22T07:24:43.050442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:33:42.572377+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'190","reported_seq":216,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:55.005743+0000","last_change":"2024-04-22T07:24:55.005768+0000","last_active":"2024-04-22T07:24:55.005743+0000","last_peered":"2024-04-22T07:24:55.005743+0000","last_clean":"2024-04-22T07:24:55.005743+0000","last_became_active":"2024-04-22T07:20:53.872793+0000","last_became_peered":"2024-04-22T07:20:53.872793+0000","last_unstale":"2024-04-22T07:24:55.005743+0000","last_undegraded":"2024-04-22T07:24:55.005743+0000","last_fullsized":"2024-04-22T07:24:55.005743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'190","last_scrub_stamp":"2024-04-22T07:24:55.005642+0000","last_deep_scrub":"25'190","last_deep_scrub_stamp":"2024-04-22T07:24:55.005642+0000","last_clean_scrub_stamp":"2024-04-22T07:24:55.005642+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:20:14.215121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:47.963255+0000","last_change":"2024-04-22T07:24:47.963281+0000","last_active":"2024-04-22T07:24:47.963255+0000","last_peered":"2024-04-22T07:24:47.963255+0000","last_clean":"2024-04-22T07:24:47.963255+0000","last_became_active":"2024-04-22T07:20:52.860736+0000","last_became_peered":"2024-04-22T07:20:52.860736+0000","last_unstale":"2024-04-22T07:24:47.963255+0000","last_undegraded":"2024-04-22T07:24:47.963255+0000","last_fullsized":"2024-04-22T07:24:47.963255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:24:47.963157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:24:47.963157+0000","last_clean_scrub_stamp":"2024-04-22T07:24:47.963157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:03:31.517007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'187","reported_seq":213,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:46.923666+0000","last_change":"2024-04-22T07:24:46.923714+0000","last_active":"2024-04-22T07:24:46.923666+0000","last_peered":"2024-04-22T07:24:46.923666+0000","last_clean":"2024-04-22T07:24:46.923666+0000","last_became_active":"2024-04-22T07:20:53.867086+0000","last_became_peered":"2024-04-22T07:20:53.867086+0000","last_unstale":"2024-04-22T07:24:46.923666+0000","last_undegraded":"2024-04-22T07:24:46.923666+0000","last_fullsized":"2024-04-22T07:24:46.923666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'187","last_scrub_stamp":"2024-04-22T07:24:46.923523+0000","last_deep_scrub":"25'187","last_deep_scrub_stamp":"2024-04-22T07:24:46.923523+0000","last_clean_scrub_stamp":"2024-04-22T07:24:46.923523+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:37:45.471324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'1","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:40.963836+0000","last_change":"2024-04-22T07:24:40.963882+0000","last_active":"2024-04-22T07:24:40.963836+0000","last_peered":"2024-04-22T07:24:40.963836+0000","last_clean":"2024-04-22T07:24:40.963836+0000","last_became_active":"2024-04-22T07:20:52.863285+0000","last_became_peered":"2024-04-22T07:20:52.863285+0000","last_unstale":"2024-04-22T07:24:40.963836+0000","last_undegraded":"2024-04-22T07:24:40.963836+0000","last_fullsized":"2024-04-22T07:24:40.963836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-04-22T07:24:40.963712+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-04-22T07:24:40.963712+0000","last_clean_scrub_stamp":"2024-04-22T07:24:40.963712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:21:53.213306+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'251","reported_seq":277,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:43.403348+0000","last_change":"2024-04-22T07:24:43.403369+0000","last_active":"2024-04-22T07:24:43.403348+0000","last_peered":"2024-04-22T07:24:43.403348+0000","last_clean":"2024-04-22T07:24:43.403348+0000","last_became_active":"2024-04-22T07:20:53.864694+0000","last_became_peered":"2024-04-22T07:20:53.864694+0000","last_unstale":"2024-04-22T07:24:43.403348+0000","last_undegraded":"2024-04-22T07:24:43.403348+0000","last_fullsized":"2024-04-22T07:24:43.403348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'251","last_scrub_stamp":"2024-04-22T07:24:43.403270+0000","last_deep_scrub":"25'251","last_deep_scrub_stamp":"2024-04-22T07:24:43.403270+0000","last_clean_scrub_stamp":"2024-04-22T07:24:43.403270+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:57:22.871193+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:43.183709+0000","last_change":"2024-04-22T07:24:43.183732+0000","last_active":"2024-04-22T07:24:43.183709+0000","last_peered":"2024-04-22T07:24:43.183709+0000","last_clean":"2024-04-22T07:24:43.183709+0000","last_became_active":"2024-04-22T07:20:52.856815+0000","last_became_peered":"2024-04-22T07:20:52.856815+0000","last_unstale":"2024-04-22T07:24:43.183709+0000","last_undegraded":"2024-04-22T07:24:43.183709+0000","last_fullsized":"2024-04-22T07:24:43.183709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:24:43.183629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:24:43.183629+0000","last_clean_scrub_stamp":"2024-04-22T07:24:43.183629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:21:34.808457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'160","reported_seq":186,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:48.023957+0000","last_change":"2024-04-22T07:24:48.023983+0000","last_active":"2024-04-22T07:24:48.023957+0000","last_peered":"2024-04-22T07:24:48.023957+0000","last_clean":"2024-04-22T07:24:48.023957+0000","last_became_active":"2024-04-22T07:20:53.866955+0000","last_became_peered":"2024-04-22T07:20:53.866955+0000","last_unstale":"2024-04-22T07:24:48.023957+0000","last_undegraded":"2024-04-22T07:24:48.023957+0000","last_fullsized":"2024-04-22T07:24:48.023957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'160","last_scrub_stamp":"2024-04-22T07:24:48.023850+0000","last_deep_scrub":"25'160","last_deep_scrub_stamp":"2024-04-22T07:24:48.023850+0000","last_clean_scrub_stamp":"2024-04-22T07:24:48.023850+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:27:36.025219+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'9","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:44.321898+0000","last_change":"2024-04-22T07:24:44.321928+0000","last_active":"2024-04-22T07:24:44.321898+0000","last_peered":"2024-04-22T07:24:44.321898+0000","last_clean":"2024-04-22T07:24:44.321898+0000","last_became_active":"2024-04-22T07:20:52.863320+0000","last_became_peered":"2024-04-22T07:20:52.863320+0000","last_unstale":"2024-04-22T07:24:44.321898+0000","last_undegraded":"2024-04-22T07:24:44.321898+0000","last_fullsized":"2024-04-22T07:24:44.321898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'9","last_scrub_stamp":"2024-04-22T07:24:44.321779+0000","last_deep_scrub":"25'9","last_deep_scrub_stamp":"2024-04-22T07:24:44.321779+0000","last_clean_scrub_stamp":"2024-04-22T07:24:44.321779+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:37:53.985538+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'168","reported_seq":194,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:56.989341+0000","last_change":"2024-04-22T07:24:56.989371+0000","last_active":"2024-04-22T07:24:56.989341+0000","last_peered":"2024-04-22T07:24:56.989341+0000","last_clean":"2024-04-22T07:24:56.989341+0000","last_became_active":"2024-04-22T07:20:53.862811+0000","last_became_peered":"2024-04-22T07:20:53.862811+0000","last_unstale":"2024-04-22T07:24:56.989341+0000","last_undegraded":"2024-04-22T07:24:56.989341+0000","last_fullsized":"2024-04-22T07:24:56.989341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'168","last_scrub_stamp":"2024-04-22T07:24:56.989237+0000","last_deep_scrub":"25'168","last_deep_scrub_stamp":"2024-04-22T07:24:56.989237+0000","last_clean_scrub_stamp":"2024-04-22T07:24:56.989237+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:01:49.517610+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'2015","reported_seq":2043,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:41.318566+0000","last_change":"2024-04-22T07:24:41.318623+0000","last_active":"2024-04-22T07:24:41.318566+0000","last_peered":"2024-04-22T07:24:41.318566+0000","last_clean":"2024-04-22T07:24:41.318566+0000","last_became_active":"2024-04-22T07:20:52.863244+0000","last_became_peered":"2024-04-22T07:20:52.863244+0000","last_unstale":"2024-04-22T07:24:41.318566+0000","last_undegraded":"2024-04-22T07:24:41.318566+0000","last_fullsized":"2024-04-22T07:24:41.318566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2015","last_scrub_stamp":"2024-04-22T07:24:41.318479+0000","last_deep_scrub":"25'2015","last_deep_scrub_stamp":"2024-04-22T07:24:41.318479+0000","last_clean_scrub_stamp":"2024-04-22T07:24:41.318479+0000","objects_scrubbed":4,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:21:53.568073+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2012,"num_write_kb":6025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'176","reported_seq":202,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:52.212438+0000","last_change":"2024-04-22T07:24:52.212505+0000","last_active":"2024-04-22T07:24:52.212438+0000","last_peered":"2024-04-22T07:24:52.212438+0000","last_clean":"2024-04-22T07:24:52.212438+0000","last_became_active":"2024-04-22T07:20:53.874612+0000","last_became_peered":"2024-04-22T07:20:53.874612+0000","last_unstale":"2024-04-22T07:24:52.212438+0000","last_undegraded":"2024-04-22T07:24:52.212438+0000","last_fullsized":"2024-04-22T07:24:52.212438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'176","last_scrub_stamp":"2024-04-22T07:24:52.212323+0000","last_deep_scrub":"25'176","last_deep_scrub_stamp":"2024-04-22T07:24:52.212323+0000","last_clean_scrub_stamp":"2024-04-22T07:24:52.212323+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:20:11.421802+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'4","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:43.319542+0000","last_change":"2024-04-22T07:24:43.319577+0000","last_active":"2024-04-22T07:24:43.319542+0000","last_peered":"2024-04-22T07:24:43.319542+0000","last_clean":"2024-04-22T07:24:43.319542+0000","last_became_active":"2024-04-22T07:20:52.854915+0000","last_became_peered":"2024-04-22T07:20:52.854915+0000","last_unstale":"2024-04-22T07:24:43.319542+0000","last_undegraded":"2024-04-22T07:24:43.319542+0000","last_fullsized":"2024-04-22T07:24:43.319542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-04-22T07:24:43.319450+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-04-22T07:24:43.319450+0000","last_clean_scrub_stamp":"2024-04-22T07:24:43.319450+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:43:27.813482+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'177","reported_seq":203,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:46.039145+0000","last_change":"2024-04-22T07:24:46.039172+0000","last_active":"2024-04-22T07:24:46.039145+0000","last_peered":"2024-04-22T07:24:46.039145+0000","last_clean":"2024-04-22T07:24:46.039145+0000","last_became_active":"2024-04-22T07:20:53.868400+0000","last_became_peered":"2024-04-22T07:20:53.868400+0000","last_unstale":"2024-04-22T07:24:46.039145+0000","last_undegraded":"2024-04-22T07:24:46.039145+0000","last_fullsized":"2024-04-22T07:24:46.039145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'177","last_scrub_stamp":"2024-04-22T07:24:46.039051+0000","last_deep_scrub":"25'177","last_deep_scrub_stamp":"2024-04-22T07:24:46.039051+0000","last_clean_scrub_stamp":"2024-04-22T07:24:46.039051+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:41:21.413315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:48.984210+0000","last_change":"2024-04-22T07:24:48.984236+0000","last_active":"2024-04-22T07:24:48.984210+0000","last_peered":"2024-04-22T07:24:48.984210+0000","last_clean":"2024-04-22T07:24:48.984210+0000","last_became_active":"2024-04-22T07:20:52.861546+0000","last_became_peered":"2024-04-22T07:20:52.861546+0000","last_unstale":"2024-04-22T07:24:48.984210+0000","last_undegraded":"2024-04-22T07:24:48.984210+0000","last_fullsized":"2024-04-22T07:24:48.984210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:24:48.984107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:24:48.984107+0000","last_clean_scrub_stamp":"2024-04-22T07:24:48.984107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:32:21.316020+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'201","reported_seq":227,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:42.007115+0000","last_change":"2024-04-22T07:24:42.007166+0000","last_active":"2024-04-22T07:24:42.007115+0000","last_peered":"2024-04-22T07:24:42.007115+0000","last_clean":"2024-04-22T07:24:42.007115+0000","last_became_active":"2024-04-22T07:20:53.862763+0000","last_became_peered":"2024-04-22T07:20:53.862763+0000","last_unstale":"2024-04-22T07:24:42.007115+0000","last_undegraded":"2024-04-22T07:24:42.007115+0000","last_fullsized":"2024-04-22T07:24:42.007115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'201","last_scrub_stamp":"2024-04-22T07:24:42.007010+0000","last_deep_scrub":"25'201","last_deep_scrub_stamp":"2024-04-22T07:24:42.007010+0000","last_clean_scrub_stamp":"2024-04-22T07:24:42.007010+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:21:38.273585+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:44.218770+0000","last_change":"2024-04-22T07:24:44.218796+0000","last_active":"2024-04-22T07:24:44.218770+0000","last_peered":"2024-04-22T07:24:44.218770+0000","last_clean":"2024-04-22T07:24:44.218770+0000","last_became_active":"2024-04-22T07:20:52.864725+0000","last_became_peered":"2024-04-22T07:20:52.864725+0000","last_unstale":"2024-04-22T07:24:44.218770+0000","last_undegraded":"2024-04-22T07:24:44.218770+0000","last_fullsized":"2024-04-22T07:24:44.218770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:24:44.218663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:24:44.218663+0000","last_clean_scrub_stamp":"2024-04-22T07:24:44.218663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:18:48.093105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'197","reported_seq":223,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:45.959313+0000","last_change":"2024-04-22T07:24:45.959347+0000","last_active":"2024-04-22T07:24:45.959313+0000","last_peered":"2024-04-22T07:24:45.959313+0000","last_clean":"2024-04-22T07:24:45.959313+0000","last_became_active":"2024-04-22T07:20:53.874567+0000","last_became_peered":"2024-04-22T07:20:53.874567+0000","last_unstale":"2024-04-22T07:24:45.959313+0000","last_undegraded":"2024-04-22T07:24:45.959313+0000","last_fullsized":"2024-04-22T07:24:45.959313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'197","last_scrub_stamp":"2024-04-22T07:24:45.959198+0000","last_deep_scrub":"25'197","last_deep_scrub_stamp":"2024-04-22T07:24:45.959198+0000","last_clean_scrub_stamp":"2024-04-22T07:24:45.959198+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:40:57.063111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'13","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:41.901883+0000","last_change":"2024-04-22T07:24:41.901926+0000","last_active":"2024-04-22T07:24:41.901883+0000","last_peered":"2024-04-22T07:24:41.901883+0000","last_clean":"2024-04-22T07:24:41.901883+0000","last_became_active":"2024-04-22T07:20:52.860347+0000","last_became_peered":"2024-04-22T07:20:52.860347+0000","last_unstale":"2024-04-22T07:24:41.901883+0000","last_undegraded":"2024-04-22T07:24:41.901883+0000","last_fullsized":"2024-04-22T07:24:41.901883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'13","last_scrub_stamp":"2024-04-22T07:24:41.901774+0000","last_deep_scrub":"25'13","last_deep_scrub_stamp":"2024-04-22T07:24:41.901774+0000","last_clean_scrub_stamp":"2024-04-22T07:24:41.901774+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:58:19.284844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'215","reported_seq":241,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:43.044189+0000","last_change":"2024-04-22T07:24:43.044215+0000","last_active":"2024-04-22T07:24:43.044189+0000","last_peered":"2024-04-22T07:24:43.044189+0000","last_clean":"2024-04-22T07:24:43.044189+0000","last_became_active":"2024-04-22T07:20:53.859365+0000","last_became_peered":"2024-04-22T07:20:53.859365+0000","last_unstale":"2024-04-22T07:24:43.044189+0000","last_undegraded":"2024-04-22T07:24:43.044189+0000","last_fullsized":"2024-04-22T07:24:43.044189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'215","last_scrub_stamp":"2024-04-22T07:24:43.044104+0000","last_deep_scrub":"25'215","last_deep_scrub_stamp":"2024-04-22T07:24:43.044104+0000","last_clean_scrub_stamp":"2024-04-22T07:24:43.044104+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:18:50.350354+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:45.268439+0000","last_change":"2024-04-22T07:24:45.268472+0000","last_active":"2024-04-22T07:24:45.268439+0000","last_peered":"2024-04-22T07:24:45.268439+0000","last_clean":"2024-04-22T07:24:45.268439+0000","last_became_active":"2024-04-22T07:20:52.866654+0000","last_became_peered":"2024-04-22T07:20:52.866654+0000","last_unstale":"2024-04-22T07:24:45.268439+0000","last_undegraded":"2024-04-22T07:24:45.268439+0000","last_fullsized":"2024-04-22T07:24:45.268439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-04-22T07:24:45.268347+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-04-22T07:24:45.268347+0000","last_clean_scrub_stamp":"2024-04-22T07:24:45.268347+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:27:33.269716+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'175","reported_seq":201,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:48.511373+0000","last_change":"2024-04-22T07:24:48.511404+0000","last_active":"2024-04-22T07:24:48.511373+0000","last_peered":"2024-04-22T07:24:48.511373+0000","last_clean":"2024-04-22T07:24:48.511373+0000","last_became_active":"2024-04-22T07:20:53.874499+0000","last_became_peered":"2024-04-22T07:20:53.874499+0000","last_unstale":"2024-04-22T07:24:48.511373+0000","last_undegraded":"2024-04-22T07:24:48.511373+0000","last_fullsized":"2024-04-22T07:24:48.511373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'175","last_scrub_stamp":"2024-04-22T07:24:48.511280+0000","last_deep_scrub":"25'175","last_deep_scrub_stamp":"2024-04-22T07:24:48.511280+0000","last_clean_scrub_stamp":"2024-04-22T07:24:48.511280+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:20:23.179240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'3","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:44.951241+0000","last_change":"2024-04-22T07:24:44.951268+0000","last_active":"2024-04-22T07:24:44.951241+0000","last_peered":"2024-04-22T07:24:44.951241+0000","last_clean":"2024-04-22T07:24:44.951241+0000","last_became_active":"2024-04-22T07:20:52.866627+0000","last_became_peered":"2024-04-22T07:20:52.866627+0000","last_unstale":"2024-04-22T07:24:44.951241+0000","last_undegraded":"2024-04-22T07:24:44.951241+0000","last_fullsized":"2024-04-22T07:24:44.951241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2024-04-22T07:24:44.951152+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2024-04-22T07:24:44.951152+0000","last_clean_scrub_stamp":"2024-04-22T07:24:44.951152+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:18:47.818240+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'162","reported_seq":188,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:47.250725+0000","last_change":"2024-04-22T07:24:47.250781+0000","last_active":"2024-04-22T07:24:47.250725+0000","last_peered":"2024-04-22T07:24:47.250725+0000","last_clean":"2024-04-22T07:24:47.250725+0000","last_became_active":"2024-04-22T07:20:53.871353+0000","last_became_peered":"2024-04-22T07:20:53.871353+0000","last_unstale":"2024-04-22T07:24:47.250725+0000","last_undegraded":"2024-04-22T07:24:47.250725+0000","last_fullsized":"2024-04-22T07:24:47.250725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'162","last_scrub_stamp":"2024-04-22T07:24:47.250619+0000","last_deep_scrub":"25'162","last_deep_scrub_stamp":"2024-04-22T07:24:47.250619+0000","last_clean_scrub_stamp":"2024-04-22T07:24:47.250619+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:45:27.818490+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'2","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:45.053558+0000","last_change":"2024-04-22T07:24:45.053594+0000","last_active":"2024-04-22T07:24:45.053558+0000","last_peered":"2024-04-22T07:24:45.053558+0000","last_clean":"2024-04-22T07:24:45.053558+0000","last_became_active":"2024-04-22T07:20:52.866677+0000","last_became_peered":"2024-04-22T07:20:52.866677+0000","last_unstale":"2024-04-22T07:24:45.053558+0000","last_undegraded":"2024-04-22T07:24:45.053558+0000","last_fullsized":"2024-04-22T07:24:45.053558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-04-22T07:24:45.053462+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-04-22T07:24:45.053462+0000","last_clean_scrub_stamp":"2024-04-22T07:24:45.053462+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:03:22.460046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'165","reported_seq":191,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:46.232004+0000","last_change":"2024-04-22T07:24:46.232059+0000","last_active":"2024-04-22T07:24:46.232004+0000","last_peered":"2024-04-22T07:24:46.232004+0000","last_clean":"2024-04-22T07:24:46.232004+0000","last_became_active":"2024-04-22T07:20:53.866968+0000","last_became_peered":"2024-04-22T07:20:53.866968+0000","last_unstale":"2024-04-22T07:24:46.232004+0000","last_undegraded":"2024-04-22T07:24:46.232004+0000","last_fullsized":"2024-04-22T07:24:46.232004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'165","last_scrub_stamp":"2024-04-22T07:24:46.231881+0000","last_deep_scrub":"25'165","last_deep_scrub_stamp":"2024-04-22T07:24:46.231881+0000","last_clean_scrub_stamp":"2024-04-22T07:24:46.231881+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:28:27.656059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:44.010956+0000","last_change":"2024-04-22T07:24:44.011009+0000","last_active":"2024-04-22T07:24:44.010956+0000","last_peered":"2024-04-22T07:24:44.010956+0000","last_clean":"2024-04-22T07:24:44.010956+0000","last_became_active":"2024-04-22T07:20:52.856289+0000","last_became_peered":"2024-04-22T07:20:52.856289+0000","last_unstale":"2024-04-22T07:24:44.010956+0000","last_undegraded":"2024-04-22T07:24:44.010956+0000","last_fullsized":"2024-04-22T07:24:44.010956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:24:44.010824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:24:44.010824+0000","last_clean_scrub_stamp":"2024-04-22T07:24:44.010824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:57:23.478747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'175","reported_seq":201,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:59.044828+0000","last_change":"2024-04-22T07:24:59.044860+0000","last_active":"2024-04-22T07:24:59.044828+0000","last_peered":"2024-04-22T07:24:59.044828+0000","last_clean":"2024-04-22T07:24:59.044828+0000","last_became_active":"2024-04-22T07:20:53.872005+0000","last_became_peered":"2024-04-22T07:20:53.872005+0000","last_unstale":"2024-04-22T07:24:59.044828+0000","last_undegraded":"2024-04-22T07:24:59.044828+0000","last_fullsized":"2024-04-22T07:24:59.044828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'175","last_scrub_stamp":"2024-04-22T07:24:59.044722+0000","last_deep_scrub":"25'175","last_deep_scrub_stamp":"2024-04-22T07:24:59.044722+0000","last_clean_scrub_stamp":"2024-04-22T07:24:59.044722+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:36:26.449515+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"25'119","reported_seq":187,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:39.959840+0000","last_change":"2024-04-22T07:24:39.959840+0000","last_active":"2024-04-22T07:24:39.959840+0000","last_peered":"2024-04-22T07:24:39.959840+0000","last_clean":"2024-04-22T07:24:39.959840+0000","last_became_active":"2024-04-22T07:20:43.746332+0000","last_became_peered":"2024-04-22T07:20:43.746332+0000","last_unstale":"2024-04-22T07:24:39.959840+0000","last_undegraded":"2024-04-22T07:24:39.959840+0000","last_fullsized":"2024-04-22T07:24:39.959840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'119","last_scrub_stamp":"2024-04-22T07:24:39.959739+0000","last_deep_scrub":"25'119","last_deep_scrub_stamp":"2024-04-22T07:24:39.959739+0000","last_clean_scrub_stamp":"2024-04-22T07:24:39.959739+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:08:48.217818+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:49.972403+0000","last_change":"2024-04-22T07:24:49.972454+0000","last_active":"2024-04-22T07:24:49.972403+0000","last_peered":"2024-04-22T07:24:49.972403+0000","last_clean":"2024-04-22T07:24:49.972403+0000","last_became_active":"2024-04-22T07:20:52.862201+0000","last_became_peered":"2024-04-22T07:20:52.862201+0000","last_unstale":"2024-04-22T07:24:49.972403+0000","last_undegraded":"2024-04-22T07:24:49.972403+0000","last_fullsized":"2024-04-22T07:24:49.972403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:24:49.972290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:24:49.972290+0000","last_clean_scrub_stamp":"2024-04-22T07:24:49.972290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:18:19.996513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'183","reported_seq":210,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:48.936016+0000","last_change":"2024-04-22T07:24:48.936061+0000","last_active":"2024-04-22T07:24:48.936016+0000","last_peered":"2024-04-22T07:24:48.936016+0000","last_clean":"2024-04-22T07:24:48.936016+0000","last_became_active":"2024-04-22T07:20:53.868335+0000","last_became_peered":"2024-04-22T07:20:53.868335+0000","last_unstale":"2024-04-22T07:24:48.936016+0000","last_undegraded":"2024-04-22T07:24:48.936016+0000","last_fullsized":"2024-04-22T07:24:48.936016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'183","last_scrub_stamp":"2024-04-22T07:24:48.935913+0000","last_deep_scrub":"25'183","last_deep_scrub_stamp":"2024-04-22T07:24:48.935913+0000","last_clean_scrub_stamp":"2024-04-22T07:24:48.935913+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:14:12.989412+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:45.019656+0000","last_change":"2024-04-22T07:24:45.019656+0000","last_active":"2024-04-22T07:24:45.019656+0000","last_peered":"2024-04-22T07:24:45.019656+0000","last_clean":"2024-04-22T07:24:45.019656+0000","last_became_active":"2024-04-22T07:20:52.866996+0000","last_became_peered":"2024-04-22T07:20:52.866996+0000","last_unstale":"2024-04-22T07:24:45.019656+0000","last_undegraded":"2024-04-22T07:24:45.019656+0000","last_fullsized":"2024-04-22T07:24:45.019656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:24:45.019541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:24:45.019541+0000","last_clean_scrub_stamp":"2024-04-22T07:24:45.019541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:28:26.443719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'165","reported_seq":191,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:47.061488+0000","last_change":"2024-04-22T07:24:47.061519+0000","last_active":"2024-04-22T07:24:47.061488+0000","last_peered":"2024-04-22T07:24:47.061488+0000","last_clean":"2024-04-22T07:24:47.061488+0000","last_became_active":"2024-04-22T07:20:53.871239+0000","last_became_peered":"2024-04-22T07:20:53.871239+0000","last_unstale":"2024-04-22T07:24:47.061488+0000","last_undegraded":"2024-04-22T07:24:47.061488+0000","last_fullsized":"2024-04-22T07:24:47.061488+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'165","last_scrub_stamp":"2024-04-22T07:24:47.061389+0000","last_deep_scrub":"25'165","last_deep_scrub_stamp":"2024-04-22T07:24:47.061389+0000","last_clean_scrub_stamp":"2024-04-22T07:24:47.061389+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:24:54.442159+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'5","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:45.361848+0000","last_change":"2024-04-22T07:24:45.361888+0000","last_active":"2024-04-22T07:24:45.361848+0000","last_peered":"2024-04-22T07:24:45.361848+0000","last_clean":"2024-04-22T07:24:45.361848+0000","last_became_active":"2024-04-22T07:20:52.866581+0000","last_became_peered":"2024-04-22T07:20:52.866581+0000","last_unstale":"2024-04-22T07:24:45.361848+0000","last_undegraded":"2024-04-22T07:24:45.361848+0000","last_fullsized":"2024-04-22T07:24:45.361848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-04-22T07:24:45.361738+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-04-22T07:24:45.361738+0000","last_clean_scrub_stamp":"2024-04-22T07:24:45.361738+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:43:34.292338+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'165","reported_seq":192,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:46.005797+0000","last_change":"2024-04-22T07:24:46.005797+0000","last_active":"2024-04-22T07:24:46.005797+0000","last_peered":"2024-04-22T07:24:46.005797+0000","last_clean":"2024-04-22T07:24:46.005797+0000","last_became_active":"2024-04-22T07:20:53.864523+0000","last_became_peered":"2024-04-22T07:20:53.864523+0000","last_unstale":"2024-04-22T07:24:46.005797+0000","last_undegraded":"2024-04-22T07:24:46.005797+0000","last_fullsized":"2024-04-22T07:24:46.005797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'165","last_scrub_stamp":"2024-04-22T07:24:46.005256+0000","last_deep_scrub":"25'165","last_deep_scrub_stamp":"2024-04-22T07:24:46.005256+0000","last_clean_scrub_stamp":"2024-04-22T07:24:46.005256+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:21:37.630084+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:45.981330+0000","last_change":"2024-04-22T07:24:45.981359+0000","last_active":"2024-04-22T07:24:45.981330+0000","last_peered":"2024-04-22T07:24:45.981330+0000","last_clean":"2024-04-22T07:24:45.981330+0000","last_became_active":"2024-04-22T07:20:52.858139+0000","last_became_peered":"2024-04-22T07:20:52.858139+0000","last_unstale":"2024-04-22T07:24:45.981330+0000","last_undegraded":"2024-04-22T07:24:45.981330+0000","last_fullsized":"2024-04-22T07:24:45.981330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:24:45.981242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:24:45.981242+0000","last_clean_scrub_stamp":"2024-04-22T07:24:45.981242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:45:26.549113+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'177","reported_seq":203,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:54.214802+0000","last_change":"2024-04-22T07:24:54.214827+0000","last_active":"2024-04-22T07:24:54.214802+0000","last_peered":"2024-04-22T07:24:54.214802+0000","last_clean":"2024-04-22T07:24:54.214802+0000","last_became_active":"2024-04-22T07:20:53.877208+0000","last_became_peered":"2024-04-22T07:20:53.877208+0000","last_unstale":"2024-04-22T07:24:54.214802+0000","last_undegraded":"2024-04-22T07:24:54.214802+0000","last_fullsized":"2024-04-22T07:24:54.214802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'177","last_scrub_stamp":"2024-04-22T07:24:54.214704+0000","last_deep_scrub":"25'177","last_deep_scrub_stamp":"2024-04-22T07:24:54.214704+0000","last_clean_scrub_stamp":"2024-04-22T07:24:54.214704+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:23:55.139178+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:44.016486+0000","last_change":"2024-04-22T07:24:44.016510+0000","last_active":"2024-04-22T07:24:44.016486+0000","last_peered":"2024-04-22T07:24:44.016486+0000","last_clean":"2024-04-22T07:24:44.016486+0000","last_became_active":"2024-04-22T07:20:52.865903+0000","last_became_peered":"2024-04-22T07:20:52.865903+0000","last_unstale":"2024-04-22T07:24:44.016486+0000","last_undegraded":"2024-04-22T07:24:44.016486+0000","last_fullsized":"2024-04-22T07:24:44.016486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:24:44.016390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:24:44.016390+0000","last_clean_scrub_stamp":"2024-04-22T07:24:44.016390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:41.688607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'160","reported_seq":186,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:47.467386+0000","last_change":"2024-04-22T07:24:47.467413+0000","last_active":"2024-04-22T07:24:47.467386+0000","last_peered":"2024-04-22T07:24:47.467386+0000","last_clean":"2024-04-22T07:24:47.467386+0000","last_became_active":"2024-04-22T07:20:53.872915+0000","last_became_peered":"2024-04-22T07:20:53.872915+0000","last_unstale":"2024-04-22T07:24:47.467386+0000","last_undegraded":"2024-04-22T07:24:47.467386+0000","last_fullsized":"2024-04-22T07:24:47.467386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'160","last_scrub_stamp":"2024-04-22T07:24:47.467295+0000","last_deep_scrub":"25'160","last_deep_scrub_stamp":"2024-04-22T07:24:47.467295+0000","last_clean_scrub_stamp":"2024-04-22T07:24:47.467295+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:26:23.919966+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:51.935029+0000","last_change":"2024-04-22T07:24:51.935064+0000","last_active":"2024-04-22T07:24:51.935029+0000","last_peered":"2024-04-22T07:24:51.935029+0000","last_clean":"2024-04-22T07:24:51.935029+0000","last_became_active":"2024-04-22T07:20:52.863296+0000","last_became_peered":"2024-04-22T07:20:52.863296+0000","last_unstale":"2024-04-22T07:24:51.935029+0000","last_undegraded":"2024-04-22T07:24:51.935029+0000","last_fullsized":"2024-04-22T07:24:51.935029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:24:51.934922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:24:51.934922+0000","last_clean_scrub_stamp":"2024-04-22T07:24:51.934922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:10:05.064511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'162","reported_seq":188,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:48.019470+0000","last_change":"2024-04-22T07:24:48.019499+0000","last_active":"2024-04-22T07:24:48.019470+0000","last_peered":"2024-04-22T07:24:48.019470+0000","last_clean":"2024-04-22T07:24:48.019470+0000","last_became_active":"2024-04-22T07:20:53.874202+0000","last_became_peered":"2024-04-22T07:20:53.874202+0000","last_unstale":"2024-04-22T07:24:48.019470+0000","last_undegraded":"2024-04-22T07:24:48.019470+0000","last_fullsized":"2024-04-22T07:24:48.019470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'162","last_scrub_stamp":"2024-04-22T07:24:48.019376+0000","last_deep_scrub":"25'162","last_deep_scrub_stamp":"2024-04-22T07:24:48.019376+0000","last_clean_scrub_stamp":"2024-04-22T07:24:48.019376+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:00:42.937253+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'21","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:42.939939+0000","last_change":"2024-04-22T07:24:42.939967+0000","last_active":"2024-04-22T07:24:42.939939+0000","last_peered":"2024-04-22T07:24:42.939939+0000","last_clean":"2024-04-22T07:24:42.939939+0000","last_became_active":"2024-04-22T07:20:52.865566+0000","last_became_peered":"2024-04-22T07:20:52.865566+0000","last_unstale":"2024-04-22T07:24:42.939939+0000","last_undegraded":"2024-04-22T07:24:42.939939+0000","last_fullsized":"2024-04-22T07:24:42.939939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'21","last_scrub_stamp":"2024-04-22T07:24:42.939838+0000","last_deep_scrub":"25'21","last_deep_scrub_stamp":"2024-04-22T07:24:42.939838+0000","last_clean_scrub_stamp":"2024-04-22T07:24:42.939838+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:10:25.763375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'166","reported_seq":192,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:49.897189+0000","last_change":"2024-04-22T07:24:49.897219+0000","last_active":"2024-04-22T07:24:49.897189+0000","last_peered":"2024-04-22T07:24:49.897189+0000","last_clean":"2024-04-22T07:24:49.897189+0000","last_became_active":"2024-04-22T07:20:53.869613+0000","last_became_peered":"2024-04-22T07:20:53.869613+0000","last_unstale":"2024-04-22T07:24:49.897189+0000","last_undegraded":"2024-04-22T07:24:49.897189+0000","last_fullsized":"2024-04-22T07:24:49.897189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'166","last_scrub_stamp":"2024-04-22T07:24:49.897083+0000","last_deep_scrub":"25'166","last_deep_scrub_stamp":"2024-04-22T07:24:49.897083+0000","last_clean_scrub_stamp":"2024-04-22T07:24:49.897083+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:58:32.937985+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:52.934098+0000","last_change":"2024-04-22T07:24:52.934131+0000","last_active":"2024-04-22T07:24:52.934098+0000","last_peered":"2024-04-22T07:24:52.934098+0000","last_clean":"2024-04-22T07:24:52.934098+0000","last_became_active":"2024-04-22T07:20:52.864434+0000","last_became_peered":"2024-04-22T07:20:52.864434+0000","last_unstale":"2024-04-22T07:24:52.934098+0000","last_undegraded":"2024-04-22T07:24:52.934098+0000","last_fullsized":"2024-04-22T07:24:52.934098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-04-22T07:24:52.933987+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-04-22T07:24:52.933987+0000","last_clean_scrub_stamp":"2024-04-22T07:24:52.933987+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:23:53.858460+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'183","reported_seq":209,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:51.902440+0000","last_change":"2024-04-22T07:24:51.902468+0000","last_active":"2024-04-22T07:24:51.902440+0000","last_peered":"2024-04-22T07:24:51.902440+0000","last_clean":"2024-04-22T07:24:51.902440+0000","last_became_active":"2024-04-22T07:20:53.870664+0000","last_became_peered":"2024-04-22T07:20:53.870664+0000","last_unstale":"2024-04-22T07:24:51.902440+0000","last_undegraded":"2024-04-22T07:24:51.902440+0000","last_fullsized":"2024-04-22T07:24:51.902440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'183","last_scrub_stamp":"2024-04-22T07:24:51.902332+0000","last_deep_scrub":"25'183","last_deep_scrub_stamp":"2024-04-22T07:24:51.902332+0000","last_clean_scrub_stamp":"2024-04-22T07:24:51.902332+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:45:44.279324+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:40.092546+0000","last_change":"2024-04-22T07:24:40.092564+0000","last_active":"2024-04-22T07:24:40.092546+0000","last_peered":"2024-04-22T07:24:40.092546+0000","last_clean":"2024-04-22T07:24:40.092546+0000","last_became_active":"2024-04-22T07:20:52.854395+0000","last_became_peered":"2024-04-22T07:20:52.854395+0000","last_unstale":"2024-04-22T07:24:40.092546+0000","last_undegraded":"2024-04-22T07:24:40.092546+0000","last_fullsized":"2024-04-22T07:24:40.092546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:24:40.092459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:24:40.092459+0000","last_clean_scrub_stamp":"2024-04-22T07:24:40.092459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:26:29.277735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'162","reported_seq":188,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:58.023336+0000","last_change":"2024-04-22T07:24:58.023396+0000","last_active":"2024-04-22T07:24:58.023336+0000","last_peered":"2024-04-22T07:24:58.023336+0000","last_clean":"2024-04-22T07:24:58.023336+0000","last_became_active":"2024-04-22T07:20:53.870674+0000","last_became_peered":"2024-04-22T07:20:53.870674+0000","last_unstale":"2024-04-22T07:24:58.023336+0000","last_undegraded":"2024-04-22T07:24:58.023336+0000","last_fullsized":"2024-04-22T07:24:58.023336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'162","last_scrub_stamp":"2024-04-22T07:24:58.023220+0000","last_deep_scrub":"25'162","last_deep_scrub_stamp":"2024-04-22T07:24:58.023220+0000","last_clean_scrub_stamp":"2024-04-22T07:24:58.023220+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:29:18.432733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:43.944694+0000","last_change":"2024-04-22T07:24:43.944718+0000","last_active":"2024-04-22T07:24:43.944694+0000","last_peered":"2024-04-22T07:24:43.944694+0000","last_clean":"2024-04-22T07:24:43.944694+0000","last_became_active":"2024-04-22T07:20:52.865606+0000","last_became_peered":"2024-04-22T07:20:52.865606+0000","last_unstale":"2024-04-22T07:24:43.944694+0000","last_undegraded":"2024-04-22T07:24:43.944694+0000","last_fullsized":"2024-04-22T07:24:43.944694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:24:43.944596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:24:43.944596+0000","last_clean_scrub_stamp":"2024-04-22T07:24:43.944596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:55:20.814633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'173","reported_seq":199,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:50.939348+0000","last_change":"2024-04-22T07:24:50.939379+0000","last_active":"2024-04-22T07:24:50.939348+0000","last_peered":"2024-04-22T07:24:50.939348+0000","last_clean":"2024-04-22T07:24:50.939348+0000","last_became_active":"2024-04-22T07:20:53.870402+0000","last_became_peered":"2024-04-22T07:20:53.870402+0000","last_unstale":"2024-04-22T07:24:50.939348+0000","last_undegraded":"2024-04-22T07:24:50.939348+0000","last_fullsized":"2024-04-22T07:24:50.939348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'173","last_scrub_stamp":"2024-04-22T07:24:50.939238+0000","last_deep_scrub":"25'173","last_deep_scrub_stamp":"2024-04-22T07:24:50.939238+0000","last_clean_scrub_stamp":"2024-04-22T07:24:50.939238+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:23:24.596363+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:44.995938+0000","last_change":"2024-04-22T07:24:44.995965+0000","last_active":"2024-04-22T07:24:44.995938+0000","last_peered":"2024-04-22T07:24:44.995938+0000","last_clean":"2024-04-22T07:24:44.995938+0000","last_became_active":"2024-04-22T07:20:52.860702+0000","last_became_peered":"2024-04-22T07:20:52.860702+0000","last_unstale":"2024-04-22T07:24:44.995938+0000","last_undegraded":"2024-04-22T07:24:44.995938+0000","last_fullsized":"2024-04-22T07:24:44.995938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:24:44.995835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:24:44.995835+0000","last_clean_scrub_stamp":"2024-04-22T07:24:44.995835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:09:32.435026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'164","reported_seq":190,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:47.349227+0000","last_change":"2024-04-22T07:24:47.349252+0000","last_active":"2024-04-22T07:24:47.349227+0000","last_peered":"2024-04-22T07:24:47.349227+0000","last_clean":"2024-04-22T07:24:47.349227+0000","last_became_active":"2024-04-22T07:20:53.868509+0000","last_became_peered":"2024-04-22T07:20:53.868509+0000","last_unstale":"2024-04-22T07:24:47.349227+0000","last_undegraded":"2024-04-22T07:24:47.349227+0000","last_fullsized":"2024-04-22T07:24:47.349227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'164","last_scrub_stamp":"2024-04-22T07:24:47.349127+0000","last_deep_scrub":"25'164","last_deep_scrub_stamp":"2024-04-22T07:24:47.349127+0000","last_clean_scrub_stamp":"2024-04-22T07:24:47.349127+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:49:37.459692+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:46.944493+0000","last_change":"2024-04-22T07:24:46.944524+0000","last_active":"2024-04-22T07:24:46.944493+0000","last_peered":"2024-04-22T07:24:46.944493+0000","last_clean":"2024-04-22T07:24:46.944493+0000","last_became_active":"2024-04-22T07:20:52.858215+0000","last_became_peered":"2024-04-22T07:20:52.858215+0000","last_unstale":"2024-04-22T07:24:46.944493+0000","last_undegraded":"2024-04-22T07:24:46.944493+0000","last_fullsized":"2024-04-22T07:24:46.944493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-04-22T07:24:46.944401+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-04-22T07:24:46.944401+0000","last_clean_scrub_stamp":"2024-04-22T07:24:46.944401+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:34.893042+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'154","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:55.976681+0000","last_change":"2024-04-22T07:24:55.976709+0000","last_active":"2024-04-22T07:24:55.976681+0000","last_peered":"2024-04-22T07:24:55.976681+0000","last_clean":"2024-04-22T07:24:55.976681+0000","last_became_active":"2024-04-22T07:20:53.867447+0000","last_became_peered":"2024-04-22T07:20:53.867447+0000","last_unstale":"2024-04-22T07:24:55.976681+0000","last_undegraded":"2024-04-22T07:24:55.976681+0000","last_fullsized":"2024-04-22T07:24:55.976681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'154","last_scrub_stamp":"2024-04-22T07:24:55.976576+0000","last_deep_scrub":"25'154","last_deep_scrub_stamp":"2024-04-22T07:24:55.976576+0000","last_clean_scrub_stamp":"2024-04-22T07:24:55.976576+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:13:47.972205+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'205","reported_seq":223,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:36.658649+0000","last_change":"2024-04-22T07:20:53.875681+0000","last_active":"2024-04-22T07:24:36.658649+0000","last_peered":"2024-04-22T07:24:36.658649+0000","last_clean":"2024-04-22T07:24:36.658649+0000","last_became_active":"2024-04-22T07:20:53.875305+0000","last_became_peered":"2024-04-22T07:20:53.875305+0000","last_unstale":"2024-04-22T07:24:36.658649+0000","last_undegraded":"2024-04-22T07:24:36.658649+0000","last_fullsized":"2024-04-22T07:24:36.658649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:20:52.835850+0000","last_clean_scrub_stamp":"2024-04-22T07:20:52.835850+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'3","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:42.138895+0000","last_change":"2024-04-22T07:24:42.138948+0000","last_active":"2024-04-22T07:24:42.138895+0000","last_peered":"2024-04-22T07:24:42.138895+0000","last_clean":"2024-04-22T07:24:42.138895+0000","last_became_active":"2024-04-22T07:20:52.856293+0000","last_became_peered":"2024-04-22T07:20:52.856293+0000","last_unstale":"2024-04-22T07:24:42.138895+0000","last_undegraded":"2024-04-22T07:24:42.138895+0000","last_fullsized":"2024-04-22T07:24:42.138895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2024-04-22T07:24:42.138802+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2024-04-22T07:24:42.138802+0000","last_clean_scrub_stamp":"2024-04-22T07:24:42.138802+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:03:19.545386+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'162","reported_seq":188,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:43.961556+0000","last_change":"2024-04-22T07:24:43.961584+0000","last_active":"2024-04-22T07:24:43.961556+0000","last_peered":"2024-04-22T07:24:43.961556+0000","last_clean":"2024-04-22T07:24:43.961556+0000","last_became_active":"2024-04-22T07:20:53.870548+0000","last_became_peered":"2024-04-22T07:20:53.870548+0000","last_unstale":"2024-04-22T07:24:43.961556+0000","last_undegraded":"2024-04-22T07:24:43.961556+0000","last_fullsized":"2024-04-22T07:24:43.961556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'162","last_scrub_stamp":"2024-04-22T07:24:43.961453+0000","last_deep_scrub":"25'162","last_deep_scrub_stamp":"2024-04-22T07:24:43.961453+0000","last_clean_scrub_stamp":"2024-04-22T07:24:43.961453+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:45:26.058985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'5","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:41.118860+0000","last_change":"2024-04-22T07:24:41.118906+0000","last_active":"2024-04-22T07:24:41.118860+0000","last_peered":"2024-04-22T07:24:41.118860+0000","last_clean":"2024-04-22T07:24:41.118860+0000","last_became_active":"2024-04-22T07:20:52.856617+0000","last_became_peered":"2024-04-22T07:20:52.856617+0000","last_unstale":"2024-04-22T07:24:41.118860+0000","last_undegraded":"2024-04-22T07:24:41.118860+0000","last_fullsized":"2024-04-22T07:24:41.118860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-04-22T07:24:41.118748+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-04-22T07:24:41.118748+0000","last_clean_scrub_stamp":"2024-04-22T07:24:41.118748+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:49:03.047500+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'160","reported_seq":186,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:46.983165+0000","last_change":"2024-04-22T07:24:46.983211+0000","last_active":"2024-04-22T07:24:46.983165+0000","last_peered":"2024-04-22T07:24:46.983165+0000","last_clean":"2024-04-22T07:24:46.983165+0000","last_became_active":"2024-04-22T07:20:53.866286+0000","last_became_peered":"2024-04-22T07:20:53.866286+0000","last_unstale":"2024-04-22T07:24:46.983165+0000","last_undegraded":"2024-04-22T07:24:46.983165+0000","last_fullsized":"2024-04-22T07:24:46.983165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'160","last_scrub_stamp":"2024-04-22T07:24:46.983033+0000","last_deep_scrub":"25'160","last_deep_scrub_stamp":"2024-04-22T07:24:46.983033+0000","last_clean_scrub_stamp":"2024-04-22T07:24:46.983033+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:18:50.857475+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:43.038340+0000","last_change":"2024-04-22T07:24:43.038340+0000","last_active":"2024-04-22T07:24:43.038340+0000","last_peered":"2024-04-22T07:24:43.038340+0000","last_clean":"2024-04-22T07:24:43.038340+0000","last_became_active":"2024-04-22T07:20:52.862967+0000","last_became_peered":"2024-04-22T07:20:52.862967+0000","last_unstale":"2024-04-22T07:24:43.038340+0000","last_undegraded":"2024-04-22T07:24:43.038340+0000","last_fullsized":"2024-04-22T07:24:43.038340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2024-04-22T07:24:43.038203+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2024-04-22T07:24:43.038203+0000","last_clean_scrub_stamp":"2024-04-22T07:24:43.038203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:18:41.910941+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'181","reported_seq":208,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:50.987265+0000","last_change":"2024-04-22T07:24:50.987265+0000","last_active":"2024-04-22T07:24:50.987265+0000","last_peered":"2024-04-22T07:24:50.987265+0000","last_clean":"2024-04-22T07:24:50.987265+0000","last_became_active":"2024-04-22T07:20:53.870715+0000","last_became_peered":"2024-04-22T07:20:53.870715+0000","last_unstale":"2024-04-22T07:24:50.987265+0000","last_undegraded":"2024-04-22T07:24:50.987265+0000","last_fullsized":"2024-04-22T07:24:50.987265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'181","last_scrub_stamp":"2024-04-22T07:24:50.987146+0000","last_deep_scrub":"25'181","last_deep_scrub_stamp":"2024-04-22T07:24:50.987146+0000","last_clean_scrub_stamp":"2024-04-22T07:24:50.987146+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:38.935788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'6","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:45.945904+0000","last_change":"2024-04-22T07:24:45.945904+0000","last_active":"2024-04-22T07:24:45.945904+0000","last_peered":"2024-04-22T07:24:45.945904+0000","last_clean":"2024-04-22T07:24:45.945904+0000","last_became_active":"2024-04-22T07:20:52.869300+0000","last_became_peered":"2024-04-22T07:20:52.869300+0000","last_unstale":"2024-04-22T07:24:45.945904+0000","last_undegraded":"2024-04-22T07:24:45.945904+0000","last_fullsized":"2024-04-22T07:24:45.945904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2024-04-22T07:24:45.945754+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2024-04-22T07:24:45.945754+0000","last_clean_scrub_stamp":"2024-04-22T07:24:45.945754+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:44:42.989533+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11255,"ondisk_log_size":11255,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4964439,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2465,"num_write_kb":7159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9994240,"data_stored":9928878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2468,"ondisk_log_size":2468,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509495,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":270336,"data_stored":93777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509495,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1028096,"data_stored":861308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509494,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36932,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334908,"statfs":{"total":96636764160,"available":96598945792,"internally_reserved":0,"allocated":1634304,"data_stored":1452273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509494,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35592,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336248,"statfs":{"total":96636764160,"available":96600317952,"internally_reserved":0,"allocated":262144,"data_stored":93730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509495,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57740,"kb_used_data":4356,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94314100,"statfs":{"total":96636764160,"available":96577638400,"internally_reserved":0,"allocated":4460544,"data_stored":4288124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509495,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36172,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335668,"statfs":{"total":96636764160,"available":96599724032,"internally_reserved":0,"allocated":856064,"data_stored":683586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509496,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35596,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336244,"statfs":{"total":96636764160,"available":96600313856,"internally_reserved":0,"allocated":266240,"data_stored":93204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61908,"kb_used_data":4364,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94309932,"statfs":{"total":96636764160,"available":96573370368,"internally_reserved":0,"allocated":4468736,"data_stored":4288796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4210688,"data_stored":4195648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":782336,"data_stored":768757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":770048,"data_stored":768160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T07:25:03.347 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:25:03.348 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-22T07:20:52.835850+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=20, tm_sec=52, tm_wday=0, tm_yday=113, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=22, tm_hour=7, tm_min=24, tm_sec=38, tm_wday=0, tm_yday=113, tm_isdst=0) 2024-04-22T07:25:03.348 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-22T07:25:23.349 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-22T07:25:23.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.466+0000 7ffafe848640 1 Processor -- start 2024-04-22T07:25:23.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.466+0000 7ffafe848640 1 -- start start 2024-04-22T07:25:23.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.467+0000 7ffafe848640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffaf80c97a0 0x7ffaf80c5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:23.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.467+0000 7ffafe848640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaf80c93d0 con 0x7ffaf80ceb10 2024-04-22T07:25:23.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.467+0000 7ffafe848640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaf80ca750 con 0x7ffaf815c700 2024-04-22T07:25:23.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.467+0000 7ffafe848640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ffaf80cdab0 con 0x7ffaf80c97a0 2024-04-22T07:25:23.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.467+0000 7ffaf7fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ffaf80ceb10 0x7ffaf815bff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37532/0 (socket says 172.21.15.40:37532) 2024-04-22T07:25:23.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.467+0000 7ffaf7fff640 1 -- 172.21.15.40:0/2896055103 learned_addr learned my addr 172.21.15.40:0/2896055103 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:25:23.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.467+0000 7ffafcde5640 1 --2- 172.21.15.40:0/2896055103 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffaf80c97a0 0x7ffaf80c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:23.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.467+0000 7ffaf6ffd640 1 -- 172.21.15.40:0/2896055103 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2705393672 0 0) 0x7ffaf80c93d0 con 0x7ffaf80ceb10 2024-04-22T07:25:23.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.467+0000 7ffaf6ffd640 1 -- 172.21.15.40:0/2896055103 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffae4003520 con 0x7ffaf80ceb10 2024-04-22T07:25:23.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.467+0000 7ffaf6ffd640 1 -- 172.21.15.40:0/2896055103 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1593835319 0 0) 0x7ffaf80ca750 con 0x7ffaf815c700 2024-04-22T07:25:23.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.467+0000 7ffaf6ffd640 1 -- 172.21.15.40:0/2896055103 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffaf80c93d0 con 0x7ffaf815c700 2024-04-22T07:25:23.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.468+0000 7ffaf6ffd640 1 -- 172.21.15.40:0/2896055103 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1546249391 0 0) 0x7ffae4003520 con 0x7ffaf80ceb10 2024-04-22T07:25:23.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.468+0000 7ffaf6ffd640 1 -- 172.21.15.40:0/2896055103 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffaf80c97a0 msgr2=0x7ffaf80c5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:25:23.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.468+0000 7ffaf6ffd640 1 --2- 172.21.15.40:0/2896055103 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffaf80c97a0 0x7ffaf80c5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:23.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.468+0000 7ffaf6ffd640 1 -- 172.21.15.40:0/2896055103 >> v1:172.21.15.62:6789/0 conn(0x7ffaf815c700 legacy=0x7ffaf8161370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:23.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.468+0000 7ffaf6ffd640 1 -- 172.21.15.40:0/2896055103 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf80caa30 con 0x7ffaf80ceb10 2024-04-22T07:25:23.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.468+0000 7ffaf6ffd640 1 -- 172.21.15.40:0/2896055103 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7ffae0001670 con 0x7ffaf80ceb10 2024-04-22T07:25:23.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.468+0000 7ffafcde5640 1 --2- 172.21.15.40:0/2896055103 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffaf80c97a0 0x7ffaf80c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:25:23.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.468+0000 7ffaf6ffd640 1 -- 172.21.15.40:0/2896055103 >> v1:172.21.15.40:6789/0 conn(0x7ffaf80ceb10 legacy=0x7ffaf815bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:23.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.468+0000 7ffaf6ffd640 1 --2- 172.21.15.40:0/2896055103 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffaf80c97a0 0x7ffae4003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:23.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.468+0000 7ffaf6ffd640 1 --2- 172.21.15.40:0/2896055103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffae40040b0 0x7ffae4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:23.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.468+0000 7ffaf6ffd640 1 --2- 172.21.15.40:0/2896055103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffae4004d40 0x7ffae40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:23.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.468+0000 7ffaf6ffd640 1 -- 172.21.15.40:0/2896055103 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf80cdab0 con 0x7ffae4004d40 2024-04-22T07:25:23.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.468+0000 7ffaf6ffd640 1 -- 172.21.15.40:0/2896055103 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ffae400ba70 con 0x7ffae40040b0 2024-04-22T07:25:23.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.468+0000 7ffaf6ffd640 1 -- 172.21.15.40:0/2896055103 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ffae400bc70 con 0x7ffaf80c97a0 2024-04-22T07:25:23.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.468+0000 7ffafcde5640 1 --2- 172.21.15.40:0/2896055103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffae4004d40 0x7ffae40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:23.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.468+0000 7ffaf7fff640 1 --2- 172.21.15.40:0/2896055103 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffaf80c97a0 0x7ffae4003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:23.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.468+0000 7ffaf77fe640 1 --2- 172.21.15.40:0/2896055103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffae40040b0 0x7ffae4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:23.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.468+0000 7ffafcde5640 1 -- 172.21.15.40:0/2896055103 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffaf80c97a0 msgr2=0x7ffae4003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:25:23.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.468+0000 7ffafcde5640 1 --2- 172.21.15.40:0/2896055103 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffaf80c97a0 0x7ffae4003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:23.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.468+0000 7ffafcde5640 1 -- 172.21.15.40:0/2896055103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffae40040b0 msgr2=0x7ffae4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:25:23.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.468+0000 7ffafcde5640 1 --2- 172.21.15.40:0/2896055103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffae40040b0 0x7ffae4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:23.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.468+0000 7ffafcde5640 1 -- 172.21.15.40:0/2896055103 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffae4003520 con 0x7ffae4004d40 2024-04-22T07:25:23.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.469+0000 7ffafcde5640 1 --2- 172.21.15.40:0/2896055103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffae4004d40 0x7ffae40051c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000e320 tx=0x7ffae4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7080128811e21e server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:23.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.469+0000 7ffaf6ffd640 1 -- 172.21.15.40:0/2896055103 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0009dc0 con 0x7ffae4004d40 2024-04-22T07:25:23.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.469+0000 7ffaf6ffd640 1 -- 172.21.15.40:0/2896055103 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf002cd60 con 0x7ffae4004d40 2024-04-22T07:25:23.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.469+0000 7ffaf6ffd640 1 -- 172.21.15.40:0/2896055103 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0003b90 con 0x7ffae4004d40 2024-04-22T07:25:23.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.470+0000 7ffafe848640 1 -- 172.21.15.40:0/2896055103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffae4004d40 msgr2=0x7ffae40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:23.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.470+0000 7ffafe848640 1 --2- 172.21.15.40:0/2896055103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffae4004d40 0x7ffae40051c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000e320 tx=0x7ffae4005830 comp rx=0 tx=0).stop 2024-04-22T07:25:23.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.470+0000 7ffafcde5640 1 -- 172.21.15.40:0/2896055103 reap_dead start 2024-04-22T07:25:23.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.470+0000 7ffafe848640 1 -- 172.21.15.40:0/2896055103 shutdown_connections 2024-04-22T07:25:23.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.470+0000 7ffafe848640 1 -- 172.21.15.40:0/2896055103 >> 172.21.15.40:0/2896055103 conn(0x7ffaf806df50 msgr2=0x7ffaf806e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:25:23.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.470+0000 7ffafe848640 1 -- 172.21.15.40:0/2896055103 shutdown_connections 2024-04-22T07:25:23.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.470+0000 7ffafe848640 1 -- 172.21.15.40:0/2896055103 wait complete. 2024-04-22T07:25:23.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.471+0000 7ffafe848640 1 Processor -- start 2024-04-22T07:25:23.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.471+0000 7ffafe848640 1 -- start start 2024-04-22T07:25:23.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.472+0000 7ffafe848640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffae4004d40 0x7ffaf814dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:23.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.472+0000 7ffafe848640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffaf815ab70 0x7ffaf815afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:23.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.472+0000 7ffafe848640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffaf8070100 0x7ffaf8070580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:23.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.472+0000 7ffafe848640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf80cd740 con 0x7ffae4004d40 2024-04-22T07:25:23.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.472+0000 7ffafe848640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf80cd460 con 0x7ffaf8070100 2024-04-22T07:25:23.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.472+0000 7ffafe848640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ffaf81530b0 con 0x7ffaf815ab70 2024-04-22T07:25:23.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.472+0000 7ffaf7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffae4004d40 0x7ffaf814dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:23.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.472+0000 7ffaf7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffae4004d40 0x7ffaf814dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40442/0 (socket says 172.21.15.40:40442) 2024-04-22T07:25:23.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.472+0000 7ffaf7fff640 1 -- 172.21.15.40:0/2473992575 learned_addr learned my addr 172.21.15.40:0/2473992575 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:25:23.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.472+0000 7ffafcde5640 1 --2- 172.21.15.40:0/2473992575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffaf8070100 0x7ffaf8070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:23.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.472+0000 7ffaf77fe640 1 --2- 172.21.15.40:0/2473992575 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffaf815ab70 0x7ffaf815afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:23.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.472+0000 7ffaf7fff640 1 -- 172.21.15.40:0/2473992575 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffaf815ab70 msgr2=0x7ffaf815afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:23.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.472+0000 7ffaf7fff640 1 --2- 172.21.15.40:0/2473992575 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffaf815ab70 0x7ffaf815afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:23.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.472+0000 7ffaf7fff640 1 -- 172.21.15.40:0/2473992575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffaf8070100 msgr2=0x7ffaf8070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:23.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.472+0000 7ffaf7fff640 1 --2- 172.21.15.40:0/2473992575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffaf8070100 0x7ffaf8070580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:23.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.472+0000 7ffaf7fff640 1 -- 172.21.15.40:0/2473992575 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf815b5f0 con 0x7ffae4004d40 2024-04-22T07:25:23.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.473+0000 7ffaf7fff640 1 --2- 172.21.15.40:0/2473992575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffae4004d40 0x7ffaf814dd80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ffae0007340 tx=0x7ffae0007740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:23.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.473+0000 7ffaf4ff9640 1 -- 172.21.15.40:0/2473992575 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae0001630 con 0x7ffae4004d40 2024-04-22T07:25:23.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.473+0000 7ffaf4ff9640 1 -- 172.21.15.40:0/2473992575 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffae0018070 con 0x7ffae4004d40 2024-04-22T07:25:23.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.473+0000 7ffafe848640 1 -- 172.21.15.40:0/2473992575 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaf8159c60 con 0x7ffae4004d40 2024-04-22T07:25:23.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.473+0000 7ffaf4ff9640 1 -- 172.21.15.40:0/2473992575 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae000fb00 con 0x7ffae4004d40 2024-04-22T07:25:23.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.473+0000 7ffafe848640 1 -- 172.21.15.40:0/2473992575 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaf806fbe0 con 0x7ffae4004d40 2024-04-22T07:25:23.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.474+0000 7ffafe848640 1 -- 172.21.15.40:0/2473992575 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaf8069d40 con 0x7ffae4004d40 2024-04-22T07:25:23.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.474+0000 7ffaf4ff9640 1 -- 172.21.15.40:0/2473992575 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffae000fca0 con 0x7ffae4004d40 2024-04-22T07:25:23.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.475+0000 7ffaf4ff9640 1 --2- 172.21.15.40:0/2473992575 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ffad806c8f0 0x7ffad806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:23.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.475+0000 7ffaf77fe640 1 --2- 172.21.15.40:0/2473992575 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ffad806c8f0 0x7ffad806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:23.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.475+0000 7ffaf4ff9640 1 -- 172.21.15.40:0/2473992575 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7ffae008ba10 con 0x7ffae4004d40 2024-04-22T07:25:23.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.475+0000 7ffaf77fe640 1 --2- 172.21.15.40:0/2473992575 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ffad806c8f0 0x7ffad806edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ffaf815a8b0 tx=0x7ffae8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:23.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.479+0000 7ffaf4ff9640 1 -- 172.21.15.40:0/2473992575 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffae0059e10 con 0x7ffae4004d40 2024-04-22T07:25:23.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.660+0000 7ffafe848640 1 -- 172.21.15.40:0/2473992575 --> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffaf8151c40 con 0x7ffad806c8f0 2024-04-22T07:25:23.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.666+0000 7ffaf4ff9640 1 -- 172.21.15.40:0/2473992575 <== mgr.4107 v2:172.21.15.40:6832/91163869 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253376 (secure 0 0 0) 0x7ffaf8151c40 con 0x7ffad806c8f0 2024-04-22T07:25:23.666 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:25:23.668 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-22T07:25:23.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.669+0000 7ffafe848640 1 -- 172.21.15.40:0/2473992575 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ffad806c8f0 msgr2=0x7ffad806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:23.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.669+0000 7ffafe848640 1 --2- 172.21.15.40:0/2473992575 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ffad806c8f0 0x7ffad806edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ffaf815a8b0 tx=0x7ffae8009040 comp rx=0 tx=0).stop 2024-04-22T07:25:23.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.669+0000 7ffafe848640 1 -- 172.21.15.40:0/2473992575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffae4004d40 msgr2=0x7ffaf814dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:23.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.669+0000 7ffafe848640 1 --2- 172.21.15.40:0/2473992575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffae4004d40 0x7ffaf814dd80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ffae0007340 tx=0x7ffae0007740 comp rx=0 tx=0).stop 2024-04-22T07:25:23.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.669+0000 7ffafe848640 1 -- 172.21.15.40:0/2473992575 shutdown_connections 2024-04-22T07:25:23.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.669+0000 7ffafe848640 1 --2- 172.21.15.40:0/2473992575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffaf8070100 0x7ffaf8070580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:23.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.669+0000 7ffafe848640 1 --2- 172.21.15.40:0/2473992575 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffaf815ab70 0x7ffaf815afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:23.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.669+0000 7ffafe848640 1 --2- 172.21.15.40:0/2473992575 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ffad806c8f0 0x7ffad806edb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:23.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.669+0000 7ffafe848640 1 --2- 172.21.15.40:0/2473992575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffae4004d40 0x7ffaf814dd80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:23.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.669+0000 7ffafe848640 1 -- 172.21.15.40:0/2473992575 >> 172.21.15.40:0/2473992575 conn(0x7ffaf806df50 msgr2=0x7ffaf80b1580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:25:23.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.669+0000 7ffafe848640 1 -- 172.21.15.40:0/2473992575 shutdown_connections 2024-04-22T07:25:23.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.669+0000 7ffafe848640 1 -- 172.21.15.40:0/2473992575 wait complete. 2024-04-22T07:25:23.678 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-04-22T07:25:21.841239+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5554807,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":120,"num_read_kb":104,"num_write":11840,"num_write_kb":25175399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13842,"ondisk_log_size":13842,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":331720,"kb_used_data":12936,"kb_used_omap":12,"kb_used_meta":318707,"kb_avail":754643000,"statfs":{"total":773094113280,"available":772754432000,"internally_reserved":0,"allocated":13246464,"data_stored":11854798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":326356532},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003373"},"pg_stats":[{"pgid":"3.3f","version":"25'167","reported_seq":194,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:49.235155+0000","last_change":"2024-04-22T07:24:49.235155+0000","last_active":"2024-04-22T07:24:49.235155+0000","last_peered":"2024-04-22T07:24:49.235155+0000","last_clean":"2024-04-22T07:24:49.235155+0000","last_became_active":"2024-04-22T07:20:53.873384+0000","last_became_peered":"2024-04-22T07:20:53.873384+0000","last_unstale":"2024-04-22T07:24:49.235155+0000","last_undegraded":"2024-04-22T07:24:49.235155+0000","last_fullsized":"2024-04-22T07:24:49.235155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'167","last_scrub_stamp":"2024-04-22T07:24:49.235025+0000","last_deep_scrub":"25'167","last_deep_scrub_stamp":"2024-04-22T07:24:49.235025+0000","last_clean_scrub_stamp":"2024-04-22T07:24:49.235025+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:03:32.788875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"25'152","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:50.016835+0000","last_change":"2024-04-22T07:24:50.016835+0000","last_active":"2024-04-22T07:24:50.016835+0000","last_peered":"2024-04-22T07:24:50.016835+0000","last_clean":"2024-04-22T07:24:50.016835+0000","last_became_active":"2024-04-22T07:20:53.869964+0000","last_became_peered":"2024-04-22T07:20:53.869964+0000","last_unstale":"2024-04-22T07:24:50.016835+0000","last_undegraded":"2024-04-22T07:24:50.016835+0000","last_fullsized":"2024-04-22T07:24:50.016835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'152","last_scrub_stamp":"2024-04-22T07:24:50.016709+0000","last_deep_scrub":"25'152","last_deep_scrub_stamp":"2024-04-22T07:24:50.016709+0000","last_clean_scrub_stamp":"2024-04-22T07:24:50.016709+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:45:30.584580+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"25'178","reported_seq":205,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:52.006173+0000","last_change":"2024-04-22T07:24:52.006173+0000","last_active":"2024-04-22T07:24:52.006173+0000","last_peered":"2024-04-22T07:24:52.006173+0000","last_clean":"2024-04-22T07:24:52.006173+0000","last_became_active":"2024-04-22T07:20:53.870819+0000","last_became_peered":"2024-04-22T07:20:53.870819+0000","last_unstale":"2024-04-22T07:24:52.006173+0000","last_undegraded":"2024-04-22T07:24:52.006173+0000","last_fullsized":"2024-04-22T07:24:52.006173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'178","last_scrub_stamp":"2024-04-22T07:24:52.006052+0000","last_deep_scrub":"25'178","last_deep_scrub_stamp":"2024-04-22T07:24:52.006052+0000","last_clean_scrub_stamp":"2024-04-22T07:24:52.006052+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:03:35.559902+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"25'193","reported_seq":220,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:46.423617+0000","last_change":"2024-04-22T07:24:46.423617+0000","last_active":"2024-04-22T07:24:46.423617+0000","last_peered":"2024-04-22T07:24:46.423617+0000","last_clean":"2024-04-22T07:24:46.423617+0000","last_became_active":"2024-04-22T07:20:53.870125+0000","last_became_peered":"2024-04-22T07:20:53.870125+0000","last_unstale":"2024-04-22T07:24:46.423617+0000","last_undegraded":"2024-04-22T07:24:46.423617+0000","last_fullsized":"2024-04-22T07:24:46.423617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'193","last_scrub_stamp":"2024-04-22T07:24:46.423497+0000","last_deep_scrub":"25'193","last_deep_scrub_stamp":"2024-04-22T07:24:46.423497+0000","last_clean_scrub_stamp":"2024-04-22T07:24:46.423497+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:40:57.527410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"25'174","reported_seq":200,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:53.203397+0000","last_change":"2024-04-22T07:24:53.203473+0000","last_active":"2024-04-22T07:24:53.203397+0000","last_peered":"2024-04-22T07:24:53.203397+0000","last_clean":"2024-04-22T07:24:53.203397+0000","last_became_active":"2024-04-22T07:20:53.874941+0000","last_became_peered":"2024-04-22T07:20:53.874941+0000","last_unstale":"2024-04-22T07:24:53.203397+0000","last_undegraded":"2024-04-22T07:24:53.203397+0000","last_fullsized":"2024-04-22T07:24:53.203397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'174","last_scrub_stamp":"2024-04-22T07:24:53.203285+0000","last_deep_scrub":"25'174","last_deep_scrub_stamp":"2024-04-22T07:24:53.203285+0000","last_clean_scrub_stamp":"2024-04-22T07:24:53.203285+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:10:06.332874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"25'162","reported_seq":188,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:45.410521+0000","last_change":"2024-04-22T07:24:45.410548+0000","last_active":"2024-04-22T07:24:45.410521+0000","last_peered":"2024-04-22T07:24:45.410521+0000","last_clean":"2024-04-22T07:24:45.410521+0000","last_became_active":"2024-04-22T07:20:53.869369+0000","last_became_peered":"2024-04-22T07:20:53.869369+0000","last_unstale":"2024-04-22T07:24:45.410521+0000","last_undegraded":"2024-04-22T07:24:45.410521+0000","last_fullsized":"2024-04-22T07:24:45.410521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'162","last_scrub_stamp":"2024-04-22T07:24:45.410421+0000","last_deep_scrub":"25'162","last_deep_scrub_stamp":"2024-04-22T07:24:45.410421+0000","last_clean_scrub_stamp":"2024-04-22T07:24:45.410421+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:41:20.784684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"25'188","reported_seq":214,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:48.267406+0000","last_change":"2024-04-22T07:24:48.267431+0000","last_active":"2024-04-22T07:24:48.267406+0000","last_peered":"2024-04-22T07:24:48.267406+0000","last_clean":"2024-04-22T07:24:48.267406+0000","last_became_active":"2024-04-22T07:20:53.873220+0000","last_became_peered":"2024-04-22T07:20:53.873220+0000","last_unstale":"2024-04-22T07:24:48.267406+0000","last_undegraded":"2024-04-22T07:24:48.267406+0000","last_fullsized":"2024-04-22T07:24:48.267406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'188","last_scrub_stamp":"2024-04-22T07:24:48.267293+0000","last_deep_scrub":"25'188","last_deep_scrub_stamp":"2024-04-22T07:24:48.267293+0000","last_clean_scrub_stamp":"2024-04-22T07:24:48.267293+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:36.215935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"25'204","reported_seq":230,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:57.055245+0000","last_change":"2024-04-22T07:24:57.055318+0000","last_active":"2024-04-22T07:24:57.055245+0000","last_peered":"2024-04-22T07:24:57.055245+0000","last_clean":"2024-04-22T07:24:57.055245+0000","last_became_active":"2024-04-22T07:20:53.875017+0000","last_became_peered":"2024-04-22T07:20:53.875017+0000","last_unstale":"2024-04-22T07:24:57.055245+0000","last_undegraded":"2024-04-22T07:24:57.055245+0000","last_fullsized":"2024-04-22T07:24:57.055245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'204","last_scrub_stamp":"2024-04-22T07:24:57.055130+0000","last_deep_scrub":"25'204","last_deep_scrub_stamp":"2024-04-22T07:24:57.055130+0000","last_clean_scrub_stamp":"2024-04-22T07:24:57.055130+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:23:57.979604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"25'178","reported_seq":204,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:42.953275+0000","last_change":"2024-04-22T07:24:42.953295+0000","last_active":"2024-04-22T07:24:42.953275+0000","last_peered":"2024-04-22T07:24:42.953275+0000","last_clean":"2024-04-22T07:24:42.953275+0000","last_became_active":"2024-04-22T07:20:53.868906+0000","last_became_peered":"2024-04-22T07:20:53.868906+0000","last_unstale":"2024-04-22T07:24:42.953275+0000","last_undegraded":"2024-04-22T07:24:42.953275+0000","last_fullsized":"2024-04-22T07:24:42.953275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'178","last_scrub_stamp":"2024-04-22T07:24:42.953197+0000","last_deep_scrub":"25'178","last_deep_scrub_stamp":"2024-04-22T07:24:42.953197+0000","last_clean_scrub_stamp":"2024-04-22T07:24:42.953197+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:57:22.421120+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"25'190","reported_seq":216,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:51.239546+0000","last_change":"2024-04-22T07:24:51.239574+0000","last_active":"2024-04-22T07:24:51.239546+0000","last_peered":"2024-04-22T07:24:51.239546+0000","last_clean":"2024-04-22T07:24:51.239546+0000","last_became_active":"2024-04-22T07:20:53.874673+0000","last_became_peered":"2024-04-22T07:20:53.874673+0000","last_unstale":"2024-04-22T07:24:51.239546+0000","last_undegraded":"2024-04-22T07:24:51.239546+0000","last_fullsized":"2024-04-22T07:24:51.239546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'190","last_scrub_stamp":"2024-04-22T07:24:51.239450+0000","last_deep_scrub":"25'190","last_deep_scrub_stamp":"2024-04-22T07:24:51.239450+0000","last_clean_scrub_stamp":"2024-04-22T07:24:51.239450+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:18:21.263673+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"25'214","reported_seq":240,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:50.274433+0000","last_change":"2024-04-22T07:24:50.274497+0000","last_active":"2024-04-22T07:24:50.274433+0000","last_peered":"2024-04-22T07:24:50.274433+0000","last_clean":"2024-04-22T07:24:50.274433+0000","last_became_active":"2024-04-22T07:20:53.873945+0000","last_became_peered":"2024-04-22T07:20:53.873945+0000","last_unstale":"2024-04-22T07:24:50.274433+0000","last_undegraded":"2024-04-22T07:24:50.274433+0000","last_fullsized":"2024-04-22T07:24:50.274433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'214","last_scrub_stamp":"2024-04-22T07:24:50.274309+0000","last_deep_scrub":"25'214","last_deep_scrub_stamp":"2024-04-22T07:24:50.274309+0000","last_clean_scrub_stamp":"2024-04-22T07:24:50.274309+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:32:22.606221+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"25'166","reported_seq":186,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:49.365775+0000","last_change":"2024-04-22T07:24:49.365799+0000","last_active":"2024-04-22T07:24:49.365775+0000","last_peered":"2024-04-22T07:24:49.365775+0000","last_clean":"2024-04-22T07:24:49.365775+0000","last_became_active":"2024-04-22T07:21:34.992633+0000","last_became_peered":"2024-04-22T07:21:34.992633+0000","last_unstale":"2024-04-22T07:24:49.365775+0000","last_undegraded":"2024-04-22T07:24:49.365775+0000","last_fullsized":"2024-04-22T07:24:49.365775+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'166","last_scrub_stamp":"2024-04-22T07:24:49.365683+0000","last_deep_scrub":"25'166","last_deep_scrub_stamp":"2024-04-22T07:24:49.365683+0000","last_clean_scrub_stamp":"2024-04-22T07:24:49.365683+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:45:31.463215+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"25'177","reported_seq":203,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:52.011493+0000","last_change":"2024-04-22T07:24:52.011521+0000","last_active":"2024-04-22T07:24:52.011493+0000","last_peered":"2024-04-22T07:24:52.011493+0000","last_clean":"2024-04-22T07:24:52.011493+0000","last_became_active":"2024-04-22T07:20:53.879070+0000","last_became_peered":"2024-04-22T07:20:53.879070+0000","last_unstale":"2024-04-22T07:24:52.011493+0000","last_undegraded":"2024-04-22T07:24:52.011493+0000","last_fullsized":"2024-04-22T07:24:52.011493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'177","last_scrub_stamp":"2024-04-22T07:24:52.011400+0000","last_deep_scrub":"25'177","last_deep_scrub_stamp":"2024-04-22T07:24:52.011400+0000","last_clean_scrub_stamp":"2024-04-22T07:24:52.011400+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:18:50.884138+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"25'172","reported_seq":198,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:50.047282+0000","last_change":"2024-04-22T07:24:50.047310+0000","last_active":"2024-04-22T07:24:50.047282+0000","last_peered":"2024-04-22T07:24:50.047282+0000","last_clean":"2024-04-22T07:24:50.047282+0000","last_became_active":"2024-04-22T07:20:53.877116+0000","last_became_peered":"2024-04-22T07:20:53.877116+0000","last_unstale":"2024-04-22T07:24:50.047282+0000","last_undegraded":"2024-04-22T07:24:50.047282+0000","last_fullsized":"2024-04-22T07:24:50.047282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'172","last_scrub_stamp":"2024-04-22T07:24:50.047192+0000","last_deep_scrub":"25'172","last_deep_scrub_stamp":"2024-04-22T07:24:50.047192+0000","last_clean_scrub_stamp":"2024-04-22T07:24:50.047192+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:55:55.670104+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"25'177","reported_seq":203,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:56.023640+0000","last_change":"2024-04-22T07:24:56.023678+0000","last_active":"2024-04-22T07:24:56.023640+0000","last_peered":"2024-04-22T07:24:56.023640+0000","last_clean":"2024-04-22T07:24:56.023640+0000","last_became_active":"2024-04-22T07:20:53.874468+0000","last_became_peered":"2024-04-22T07:20:53.874468+0000","last_unstale":"2024-04-22T07:24:56.023640+0000","last_undegraded":"2024-04-22T07:24:56.023640+0000","last_fullsized":"2024-04-22T07:24:56.023640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'177","last_scrub_stamp":"2024-04-22T07:24:56.023543+0000","last_deep_scrub":"25'177","last_deep_scrub_stamp":"2024-04-22T07:24:56.023543+0000","last_clean_scrub_stamp":"2024-04-22T07:24:56.023543+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:10:09.153132+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"25'162","reported_seq":188,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:54.930214+0000","last_change":"2024-04-22T07:24:54.930240+0000","last_active":"2024-04-22T07:24:54.930214+0000","last_peered":"2024-04-22T07:24:54.930214+0000","last_clean":"2024-04-22T07:24:54.930214+0000","last_became_active":"2024-04-22T07:20:53.865491+0000","last_became_peered":"2024-04-22T07:20:53.865491+0000","last_unstale":"2024-04-22T07:24:54.930214+0000","last_undegraded":"2024-04-22T07:24:54.930214+0000","last_fullsized":"2024-04-22T07:24:54.930214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'162","last_scrub_stamp":"2024-04-22T07:24:54.930109+0000","last_deep_scrub":"25'162","last_deep_scrub_stamp":"2024-04-22T07:24:54.930109+0000","last_clean_scrub_stamp":"2024-04-22T07:24:54.930109+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:08:21.259240+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"25'176","reported_seq":202,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:25:00.988617+0000","last_change":"2024-04-22T07:25:00.988700+0000","last_active":"2024-04-22T07:25:00.988617+0000","last_peered":"2024-04-22T07:25:00.988617+0000","last_clean":"2024-04-22T07:25:00.988617+0000","last_became_active":"2024-04-22T07:20:53.876321+0000","last_became_peered":"2024-04-22T07:20:53.876321+0000","last_unstale":"2024-04-22T07:25:00.988617+0000","last_undegraded":"2024-04-22T07:25:00.988617+0000","last_fullsized":"2024-04-22T07:25:00.988617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'176","last_scrub_stamp":"2024-04-22T07:25:00.988504+0000","last_deep_scrub":"25'176","last_deep_scrub_stamp":"2024-04-22T07:25:00.988504+0000","last_clean_scrub_stamp":"2024-04-22T07:25:00.988504+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:16:04.851710+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"25'179","reported_seq":205,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:46.363560+0000","last_change":"2024-04-22T07:24:46.363604+0000","last_active":"2024-04-22T07:24:46.363560+0000","last_peered":"2024-04-22T07:24:46.363560+0000","last_clean":"2024-04-22T07:24:46.363560+0000","last_became_active":"2024-04-22T07:20:53.868441+0000","last_became_peered":"2024-04-22T07:20:53.868441+0000","last_unstale":"2024-04-22T07:24:46.363560+0000","last_undegraded":"2024-04-22T07:24:46.363560+0000","last_fullsized":"2024-04-22T07:24:46.363560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'179","last_scrub_stamp":"2024-04-22T07:24:46.363430+0000","last_deep_scrub":"25'179","last_deep_scrub_stamp":"2024-04-22T07:24:46.363430+0000","last_clean_scrub_stamp":"2024-04-22T07:24:46.363430+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:33:45.885365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"25'205","reported_seq":231,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:44.071143+0000","last_change":"2024-04-22T07:24:44.071216+0000","last_active":"2024-04-22T07:24:44.071143+0000","last_peered":"2024-04-22T07:24:44.071143+0000","last_clean":"2024-04-22T07:24:44.071143+0000","last_became_active":"2024-04-22T07:20:53.864535+0000","last_became_peered":"2024-04-22T07:20:53.864535+0000","last_unstale":"2024-04-22T07:24:44.071143+0000","last_undegraded":"2024-04-22T07:24:44.071143+0000","last_fullsized":"2024-04-22T07:24:44.071143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'205","last_scrub_stamp":"2024-04-22T07:24:44.071014+0000","last_deep_scrub":"25'205","last_deep_scrub_stamp":"2024-04-22T07:24:44.071014+0000","last_clean_scrub_stamp":"2024-04-22T07:24:44.071014+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:43:38.056001+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"25'179","reported_seq":205,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:55.215191+0000","last_change":"2024-04-22T07:24:55.215218+0000","last_active":"2024-04-22T07:24:55.215191+0000","last_peered":"2024-04-22T07:24:55.215191+0000","last_clean":"2024-04-22T07:24:55.215191+0000","last_became_active":"2024-04-22T07:20:53.876641+0000","last_became_peered":"2024-04-22T07:20:53.876641+0000","last_unstale":"2024-04-22T07:24:55.215191+0000","last_undegraded":"2024-04-22T07:24:55.215191+0000","last_fullsized":"2024-04-22T07:24:55.215191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'179","last_scrub_stamp":"2024-04-22T07:24:55.215084+0000","last_deep_scrub":"25'179","last_deep_scrub_stamp":"2024-04-22T07:24:55.215084+0000","last_clean_scrub_stamp":"2024-04-22T07:24:55.215084+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:23:13.759880+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"25'154","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:47.967146+0000","last_change":"2024-04-22T07:24:47.967174+0000","last_active":"2024-04-22T07:24:47.967146+0000","last_peered":"2024-04-22T07:24:47.967146+0000","last_clean":"2024-04-22T07:24:47.967146+0000","last_became_active":"2024-04-22T07:20:53.868014+0000","last_became_peered":"2024-04-22T07:20:53.868014+0000","last_unstale":"2024-04-22T07:24:47.967146+0000","last_undegraded":"2024-04-22T07:24:47.967146+0000","last_fullsized":"2024-04-22T07:24:47.967146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'154","last_scrub_stamp":"2024-04-22T07:24:47.967047+0000","last_deep_scrub":"25'154","last_deep_scrub_stamp":"2024-04-22T07:24:47.967047+0000","last_clean_scrub_stamp":"2024-04-22T07:24:47.967047+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:11:33.205772+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"25'199","reported_seq":225,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:41.959305+0000","last_change":"2024-04-22T07:24:41.959328+0000","last_active":"2024-04-22T07:24:41.959305+0000","last_peered":"2024-04-22T07:24:41.959305+0000","last_clean":"2024-04-22T07:24:41.959305+0000","last_became_active":"2024-04-22T07:20:53.867403+0000","last_became_peered":"2024-04-22T07:20:53.867403+0000","last_unstale":"2024-04-22T07:24:41.959305+0000","last_undegraded":"2024-04-22T07:24:41.959305+0000","last_fullsized":"2024-04-22T07:24:41.959305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'199","last_scrub_stamp":"2024-04-22T07:24:41.959216+0000","last_deep_scrub":"25'199","last_deep_scrub_stamp":"2024-04-22T07:24:41.959216+0000","last_clean_scrub_stamp":"2024-04-22T07:24:41.959216+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:30:33.694009+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"25'150","reported_seq":176,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:49.066591+0000","last_change":"2024-04-22T07:24:49.066622+0000","last_active":"2024-04-22T07:24:49.066591+0000","last_peered":"2024-04-22T07:24:49.066591+0000","last_clean":"2024-04-22T07:24:49.066591+0000","last_became_active":"2024-04-22T07:20:53.868519+0000","last_became_peered":"2024-04-22T07:20:53.868519+0000","last_unstale":"2024-04-22T07:24:49.066591+0000","last_undegraded":"2024-04-22T07:24:49.066591+0000","last_fullsized":"2024-04-22T07:24:49.066591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'150","last_scrub_stamp":"2024-04-22T07:24:49.066480+0000","last_deep_scrub":"25'150","last_deep_scrub_stamp":"2024-04-22T07:24:49.066480+0000","last_clean_scrub_stamp":"2024-04-22T07:24:49.066480+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:57:31.884821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"25'207","reported_seq":234,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:53.888166+0000","last_change":"2024-04-22T07:24:53.888166+0000","last_active":"2024-04-22T07:24:53.888166+0000","last_peered":"2024-04-22T07:24:53.888166+0000","last_clean":"2024-04-22T07:24:53.888166+0000","last_became_active":"2024-04-22T07:20:53.865026+0000","last_became_peered":"2024-04-22T07:20:53.865026+0000","last_unstale":"2024-04-22T07:24:53.888166+0000","last_undegraded":"2024-04-22T07:24:53.888166+0000","last_fullsized":"2024-04-22T07:24:53.888166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'207","last_scrub_stamp":"2024-04-22T07:24:53.888035+0000","last_deep_scrub":"25'207","last_deep_scrub_stamp":"2024-04-22T07:24:53.888035+0000","last_clean_scrub_stamp":"2024-04-22T07:24:53.888035+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:23:12.432831+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"25'160","reported_seq":187,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:54.038173+0000","last_change":"2024-04-22T07:24:54.038173+0000","last_active":"2024-04-22T07:24:54.038173+0000","last_peered":"2024-04-22T07:24:54.038173+0000","last_clean":"2024-04-22T07:24:54.038173+0000","last_became_active":"2024-04-22T07:20:53.873147+0000","last_became_peered":"2024-04-22T07:20:53.873147+0000","last_unstale":"2024-04-22T07:24:54.038173+0000","last_undegraded":"2024-04-22T07:24:54.038173+0000","last_fullsized":"2024-04-22T07:24:54.038173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'160","last_scrub_stamp":"2024-04-22T07:24:54.037985+0000","last_deep_scrub":"25'160","last_deep_scrub_stamp":"2024-04-22T07:24:54.037985+0000","last_clean_scrub_stamp":"2024-04-22T07:24:54.037985+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:18:24.062208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"25'217","reported_seq":244,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:44.392722+0000","last_change":"2024-04-22T07:24:44.392722+0000","last_active":"2024-04-22T07:24:44.392722+0000","last_peered":"2024-04-22T07:24:44.392722+0000","last_clean":"2024-04-22T07:24:44.392722+0000","last_became_active":"2024-04-22T07:20:53.865030+0000","last_became_peered":"2024-04-22T07:20:53.865030+0000","last_unstale":"2024-04-22T07:24:44.392722+0000","last_undegraded":"2024-04-22T07:24:44.392722+0000","last_fullsized":"2024-04-22T07:24:44.392722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'217","last_scrub_stamp":"2024-04-22T07:24:44.392594+0000","last_deep_scrub":"25'217","last_deep_scrub_stamp":"2024-04-22T07:24:44.392594+0000","last_clean_scrub_stamp":"2024-04-22T07:24:44.392594+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:45:26.490126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"25'166","reported_seq":193,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:49.058054+0000","last_change":"2024-04-22T07:24:49.058054+0000","last_active":"2024-04-22T07:24:49.058054+0000","last_peered":"2024-04-22T07:24:49.058054+0000","last_clean":"2024-04-22T07:24:49.058054+0000","last_became_active":"2024-04-22T07:20:53.876446+0000","last_became_peered":"2024-04-22T07:20:53.876446+0000","last_unstale":"2024-04-22T07:24:49.058054+0000","last_undegraded":"2024-04-22T07:24:49.058054+0000","last_fullsized":"2024-04-22T07:24:49.058054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'166","last_scrub_stamp":"2024-04-22T07:24:49.057925+0000","last_deep_scrub":"25'166","last_deep_scrub_stamp":"2024-04-22T07:24:49.057925+0000","last_clean_scrub_stamp":"2024-04-22T07:24:49.057925+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:55:53.487503+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"25'152","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:51.039891+0000","last_change":"2024-04-22T07:24:51.039891+0000","last_active":"2024-04-22T07:24:51.039891+0000","last_peered":"2024-04-22T07:24:51.039891+0000","last_clean":"2024-04-22T07:24:51.039891+0000","last_became_active":"2024-04-22T07:20:53.877867+0000","last_became_peered":"2024-04-22T07:20:53.877867+0000","last_unstale":"2024-04-22T07:24:51.039891+0000","last_undegraded":"2024-04-22T07:24:51.039891+0000","last_fullsized":"2024-04-22T07:24:51.039891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'152","last_scrub_stamp":"2024-04-22T07:24:51.039756+0000","last_deep_scrub":"25'152","last_deep_scrub_stamp":"2024-04-22T07:24:51.039756+0000","last_clean_scrub_stamp":"2024-04-22T07:24:51.039756+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:41:47.074817+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"25'134","reported_seq":161,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:53.053248+0000","last_change":"2024-04-22T07:24:53.053248+0000","last_active":"2024-04-22T07:24:53.053248+0000","last_peered":"2024-04-22T07:24:53.053248+0000","last_clean":"2024-04-22T07:24:53.053248+0000","last_became_active":"2024-04-22T07:20:53.871862+0000","last_became_peered":"2024-04-22T07:20:53.871862+0000","last_unstale":"2024-04-22T07:24:53.053248+0000","last_undegraded":"2024-04-22T07:24:53.053248+0000","last_fullsized":"2024-04-22T07:24:53.053248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'134","last_scrub_stamp":"2024-04-22T07:24:53.053126+0000","last_deep_scrub":"25'134","last_deep_scrub_stamp":"2024-04-22T07:24:53.053126+0000","last_clean_scrub_stamp":"2024-04-22T07:24:53.053126+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:32:25.385039+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"25'153","reported_seq":180,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:40.996886+0000","last_change":"2024-04-22T07:24:40.996886+0000","last_active":"2024-04-22T07:24:40.996886+0000","last_peered":"2024-04-22T07:24:40.996886+0000","last_clean":"2024-04-22T07:24:40.996886+0000","last_became_active":"2024-04-22T07:20:53.862199+0000","last_became_peered":"2024-04-22T07:20:53.862199+0000","last_unstale":"2024-04-22T07:24:40.996886+0000","last_undegraded":"2024-04-22T07:24:40.996886+0000","last_fullsized":"2024-04-22T07:24:40.996886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'153","last_scrub_stamp":"2024-04-22T07:24:40.996727+0000","last_deep_scrub":"25'153","last_deep_scrub_stamp":"2024-04-22T07:24:40.996727+0000","last_clean_scrub_stamp":"2024-04-22T07:24:40.996727+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:21:32.621555+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"25'158","reported_seq":185,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:48.339416+0000","last_change":"2024-04-22T07:24:48.339416+0000","last_active":"2024-04-22T07:24:48.339416+0000","last_peered":"2024-04-22T07:24:48.339416+0000","last_clean":"2024-04-22T07:24:48.339416+0000","last_became_active":"2024-04-22T07:20:53.872199+0000","last_became_peered":"2024-04-22T07:20:53.872199+0000","last_unstale":"2024-04-22T07:24:48.339416+0000","last_undegraded":"2024-04-22T07:24:48.339416+0000","last_fullsized":"2024-04-22T07:24:48.339416+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'158","last_scrub_stamp":"2024-04-22T07:24:48.339289+0000","last_deep_scrub":"25'158","last_deep_scrub_stamp":"2024-04-22T07:24:48.339289+0000","last_clean_scrub_stamp":"2024-04-22T07:24:48.339289+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:54:43.156282+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"25'180","reported_seq":207,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:42.354902+0000","last_change":"2024-04-22T07:24:42.354902+0000","last_active":"2024-04-22T07:24:42.354902+0000","last_peered":"2024-04-22T07:24:42.354902+0000","last_clean":"2024-04-22T07:24:42.354902+0000","last_became_active":"2024-04-22T07:20:53.863688+0000","last_became_peered":"2024-04-22T07:20:53.863688+0000","last_unstale":"2024-04-22T07:24:42.354902+0000","last_undegraded":"2024-04-22T07:24:42.354902+0000","last_fullsized":"2024-04-22T07:24:42.354902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'180","last_scrub_stamp":"2024-04-22T07:24:42.354782+0000","last_deep_scrub":"25'180","last_deep_scrub_stamp":"2024-04-22T07:24:42.354782+0000","last_clean_scrub_stamp":"2024-04-22T07:24:42.354782+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:30:34.089576+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"25'149","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:44.960010+0000","last_change":"2024-04-22T07:24:44.960042+0000","last_active":"2024-04-22T07:24:44.960010+0000","last_peered":"2024-04-22T07:24:44.960010+0000","last_clean":"2024-04-22T07:24:44.960010+0000","last_became_active":"2024-04-22T07:20:53.874524+0000","last_became_peered":"2024-04-22T07:20:53.874524+0000","last_unstale":"2024-04-22T07:24:44.960010+0000","last_undegraded":"2024-04-22T07:24:44.960010+0000","last_fullsized":"2024-04-22T07:24:44.960010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'149","last_scrub_stamp":"2024-04-22T07:24:44.959905+0000","last_deep_scrub":"25'149","last_deep_scrub_stamp":"2024-04-22T07:24:44.959905+0000","last_clean_scrub_stamp":"2024-04-22T07:24:44.959905+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:41:20.334168+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"25'369","reported_seq":397,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:42.002677+0000","last_change":"2024-04-22T07:24:42.002707+0000","last_active":"2024-04-22T07:24:42.002677+0000","last_peered":"2024-04-22T07:24:42.002677+0000","last_clean":"2024-04-22T07:24:42.002677+0000","last_became_active":"2024-04-22T07:20:52.860015+0000","last_became_peered":"2024-04-22T07:20:52.860015+0000","last_unstale":"2024-04-22T07:24:42.002677+0000","last_undegraded":"2024-04-22T07:24:42.002677+0000","last_fullsized":"2024-04-22T07:24:42.002677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'369","last_scrub_stamp":"2024-04-22T07:24:42.002579+0000","last_deep_scrub":"25'369","last_deep_scrub_stamp":"2024-04-22T07:24:42.002579+0000","last_clean_scrub_stamp":"2024-04-22T07:24:42.002579+0000","objects_scrubbed":1,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:26:31.187855+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":768160,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":368,"num_write_kb":1101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'162","reported_seq":188,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:52.874598+0000","last_change":"2024-04-22T07:24:52.874671+0000","last_active":"2024-04-22T07:24:52.874598+0000","last_peered":"2024-04-22T07:24:52.874598+0000","last_clean":"2024-04-22T07:24:52.874598+0000","last_became_active":"2024-04-22T07:20:53.879191+0000","last_became_peered":"2024-04-22T07:20:53.879191+0000","last_unstale":"2024-04-22T07:24:52.874598+0000","last_undegraded":"2024-04-22T07:24:52.874598+0000","last_fullsized":"2024-04-22T07:24:52.874598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'162","last_scrub_stamp":"2024-04-22T07:24:52.874481+0000","last_deep_scrub":"25'162","last_deep_scrub_stamp":"2024-04-22T07:24:52.874481+0000","last_clean_scrub_stamp":"2024-04-22T07:24:52.874481+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:17:14.826206+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:50.938658+0000","last_change":"2024-04-22T07:24:50.938686+0000","last_active":"2024-04-22T07:24:50.938658+0000","last_peered":"2024-04-22T07:24:50.938658+0000","last_clean":"2024-04-22T07:24:50.938658+0000","last_became_active":"2024-04-22T07:20:52.862228+0000","last_became_peered":"2024-04-22T07:20:52.862228+0000","last_unstale":"2024-04-22T07:24:50.938658+0000","last_undegraded":"2024-04-22T07:24:50.938658+0000","last_fullsized":"2024-04-22T07:24:50.938658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2024-04-22T07:24:50.938567+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2024-04-22T07:24:50.938567+0000","last_clean_scrub_stamp":"2024-04-22T07:24:50.938567+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:20:10.148046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:43.050562+0000","last_change":"2024-04-22T07:24:43.050599+0000","last_active":"2024-04-22T07:24:43.050562+0000","last_peered":"2024-04-22T07:24:43.050562+0000","last_clean":"2024-04-22T07:24:43.050562+0000","last_became_active":"2024-04-22T07:20:52.856096+0000","last_became_peered":"2024-04-22T07:20:52.856096+0000","last_unstale":"2024-04-22T07:24:43.050562+0000","last_undegraded":"2024-04-22T07:24:43.050562+0000","last_fullsized":"2024-04-22T07:24:43.050562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:24:43.050442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:24:43.050442+0000","last_clean_scrub_stamp":"2024-04-22T07:24:43.050442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T09:33:42.572377+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"25'190","reported_seq":216,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:55.005743+0000","last_change":"2024-04-22T07:24:55.005768+0000","last_active":"2024-04-22T07:24:55.005743+0000","last_peered":"2024-04-22T07:24:55.005743+0000","last_clean":"2024-04-22T07:24:55.005743+0000","last_became_active":"2024-04-22T07:20:53.872793+0000","last_became_peered":"2024-04-22T07:20:53.872793+0000","last_unstale":"2024-04-22T07:24:55.005743+0000","last_undegraded":"2024-04-22T07:24:55.005743+0000","last_fullsized":"2024-04-22T07:24:55.005743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'190","last_scrub_stamp":"2024-04-22T07:24:55.005642+0000","last_deep_scrub":"25'190","last_deep_scrub_stamp":"2024-04-22T07:24:55.005642+0000","last_clean_scrub_stamp":"2024-04-22T07:24:55.005642+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:20:14.215121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:47.963255+0000","last_change":"2024-04-22T07:24:47.963281+0000","last_active":"2024-04-22T07:24:47.963255+0000","last_peered":"2024-04-22T07:24:47.963255+0000","last_clean":"2024-04-22T07:24:47.963255+0000","last_became_active":"2024-04-22T07:20:52.860736+0000","last_became_peered":"2024-04-22T07:20:52.860736+0000","last_unstale":"2024-04-22T07:24:47.963255+0000","last_undegraded":"2024-04-22T07:24:47.963255+0000","last_fullsized":"2024-04-22T07:24:47.963255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:24:47.963157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:24:47.963157+0000","last_clean_scrub_stamp":"2024-04-22T07:24:47.963157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:03:31.517007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"25'187","reported_seq":213,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:46.923666+0000","last_change":"2024-04-22T07:24:46.923714+0000","last_active":"2024-04-22T07:24:46.923666+0000","last_peered":"2024-04-22T07:24:46.923666+0000","last_clean":"2024-04-22T07:24:46.923666+0000","last_became_active":"2024-04-22T07:20:53.867086+0000","last_became_peered":"2024-04-22T07:20:53.867086+0000","last_unstale":"2024-04-22T07:24:46.923666+0000","last_undegraded":"2024-04-22T07:24:46.923666+0000","last_fullsized":"2024-04-22T07:24:46.923666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'187","last_scrub_stamp":"2024-04-22T07:24:46.923523+0000","last_deep_scrub":"25'187","last_deep_scrub_stamp":"2024-04-22T07:24:46.923523+0000","last_clean_scrub_stamp":"2024-04-22T07:24:46.923523+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:37:45.471324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"25'1","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:40.963836+0000","last_change":"2024-04-22T07:24:40.963882+0000","last_active":"2024-04-22T07:24:40.963836+0000","last_peered":"2024-04-22T07:24:40.963836+0000","last_clean":"2024-04-22T07:24:40.963836+0000","last_became_active":"2024-04-22T07:20:52.863285+0000","last_became_peered":"2024-04-22T07:20:52.863285+0000","last_unstale":"2024-04-22T07:24:40.963836+0000","last_undegraded":"2024-04-22T07:24:40.963836+0000","last_fullsized":"2024-04-22T07:24:40.963836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-04-22T07:24:40.963712+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-04-22T07:24:40.963712+0000","last_clean_scrub_stamp":"2024-04-22T07:24:40.963712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:21:53.213306+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"25'251","reported_seq":277,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:43.403348+0000","last_change":"2024-04-22T07:24:43.403369+0000","last_active":"2024-04-22T07:24:43.403348+0000","last_peered":"2024-04-22T07:24:43.403348+0000","last_clean":"2024-04-22T07:24:43.403348+0000","last_became_active":"2024-04-22T07:20:53.864694+0000","last_became_peered":"2024-04-22T07:20:53.864694+0000","last_unstale":"2024-04-22T07:24:43.403348+0000","last_undegraded":"2024-04-22T07:24:43.403348+0000","last_fullsized":"2024-04-22T07:24:43.403348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'251","last_scrub_stamp":"2024-04-22T07:24:43.403270+0000","last_deep_scrub":"25'251","last_deep_scrub_stamp":"2024-04-22T07:24:43.403270+0000","last_clean_scrub_stamp":"2024-04-22T07:24:43.403270+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:57:22.871193+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:43.183709+0000","last_change":"2024-04-22T07:24:43.183732+0000","last_active":"2024-04-22T07:24:43.183709+0000","last_peered":"2024-04-22T07:24:43.183709+0000","last_clean":"2024-04-22T07:24:43.183709+0000","last_became_active":"2024-04-22T07:20:52.856815+0000","last_became_peered":"2024-04-22T07:20:52.856815+0000","last_unstale":"2024-04-22T07:24:43.183709+0000","last_undegraded":"2024-04-22T07:24:43.183709+0000","last_fullsized":"2024-04-22T07:24:43.183709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:24:43.183629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:24:43.183629+0000","last_clean_scrub_stamp":"2024-04-22T07:24:43.183629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:21:34.808457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"25'160","reported_seq":186,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:48.023957+0000","last_change":"2024-04-22T07:24:48.023983+0000","last_active":"2024-04-22T07:24:48.023957+0000","last_peered":"2024-04-22T07:24:48.023957+0000","last_clean":"2024-04-22T07:24:48.023957+0000","last_became_active":"2024-04-22T07:20:53.866955+0000","last_became_peered":"2024-04-22T07:20:53.866955+0000","last_unstale":"2024-04-22T07:24:48.023957+0000","last_undegraded":"2024-04-22T07:24:48.023957+0000","last_fullsized":"2024-04-22T07:24:48.023957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'160","last_scrub_stamp":"2024-04-22T07:24:48.023850+0000","last_deep_scrub":"25'160","last_deep_scrub_stamp":"2024-04-22T07:24:48.023850+0000","last_clean_scrub_stamp":"2024-04-22T07:24:48.023850+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:27:36.025219+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"25'9","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:44.321898+0000","last_change":"2024-04-22T07:24:44.321928+0000","last_active":"2024-04-22T07:24:44.321898+0000","last_peered":"2024-04-22T07:24:44.321898+0000","last_clean":"2024-04-22T07:24:44.321898+0000","last_became_active":"2024-04-22T07:20:52.863320+0000","last_became_peered":"2024-04-22T07:20:52.863320+0000","last_unstale":"2024-04-22T07:24:44.321898+0000","last_undegraded":"2024-04-22T07:24:44.321898+0000","last_fullsized":"2024-04-22T07:24:44.321898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'9","last_scrub_stamp":"2024-04-22T07:24:44.321779+0000","last_deep_scrub":"25'9","last_deep_scrub_stamp":"2024-04-22T07:24:44.321779+0000","last_clean_scrub_stamp":"2024-04-22T07:24:44.321779+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:37:53.985538+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'168","reported_seq":194,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:56.989341+0000","last_change":"2024-04-22T07:24:56.989371+0000","last_active":"2024-04-22T07:24:56.989341+0000","last_peered":"2024-04-22T07:24:56.989341+0000","last_clean":"2024-04-22T07:24:56.989341+0000","last_became_active":"2024-04-22T07:20:53.862811+0000","last_became_peered":"2024-04-22T07:20:53.862811+0000","last_unstale":"2024-04-22T07:24:56.989341+0000","last_undegraded":"2024-04-22T07:24:56.989341+0000","last_fullsized":"2024-04-22T07:24:56.989341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'168","last_scrub_stamp":"2024-04-22T07:24:56.989237+0000","last_deep_scrub":"25'168","last_deep_scrub_stamp":"2024-04-22T07:24:56.989237+0000","last_clean_scrub_stamp":"2024-04-22T07:24:56.989237+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:01:49.517610+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"25'2015","reported_seq":2043,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:41.318566+0000","last_change":"2024-04-22T07:24:41.318623+0000","last_active":"2024-04-22T07:24:41.318566+0000","last_peered":"2024-04-22T07:24:41.318566+0000","last_clean":"2024-04-22T07:24:41.318566+0000","last_became_active":"2024-04-22T07:20:52.863244+0000","last_became_peered":"2024-04-22T07:20:52.863244+0000","last_unstale":"2024-04-22T07:24:41.318566+0000","last_undegraded":"2024-04-22T07:24:41.318566+0000","last_fullsized":"2024-04-22T07:24:41.318566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2015","last_scrub_stamp":"2024-04-22T07:24:41.318479+0000","last_deep_scrub":"25'2015","last_deep_scrub_stamp":"2024-04-22T07:24:41.318479+0000","last_clean_scrub_stamp":"2024-04-22T07:24:41.318479+0000","objects_scrubbed":4,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:21:53.568073+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2012,"num_write_kb":6025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"25'176","reported_seq":202,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:52.212438+0000","last_change":"2024-04-22T07:24:52.212505+0000","last_active":"2024-04-22T07:24:52.212438+0000","last_peered":"2024-04-22T07:24:52.212438+0000","last_clean":"2024-04-22T07:24:52.212438+0000","last_became_active":"2024-04-22T07:20:53.874612+0000","last_became_peered":"2024-04-22T07:20:53.874612+0000","last_unstale":"2024-04-22T07:24:52.212438+0000","last_undegraded":"2024-04-22T07:24:52.212438+0000","last_fullsized":"2024-04-22T07:24:52.212438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'176","last_scrub_stamp":"2024-04-22T07:24:52.212323+0000","last_deep_scrub":"25'176","last_deep_scrub_stamp":"2024-04-22T07:24:52.212323+0000","last_clean_scrub_stamp":"2024-04-22T07:24:52.212323+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:20:11.421802+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'4","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:43.319542+0000","last_change":"2024-04-22T07:24:43.319577+0000","last_active":"2024-04-22T07:24:43.319542+0000","last_peered":"2024-04-22T07:24:43.319542+0000","last_clean":"2024-04-22T07:24:43.319542+0000","last_became_active":"2024-04-22T07:20:52.854915+0000","last_became_peered":"2024-04-22T07:20:52.854915+0000","last_unstale":"2024-04-22T07:24:43.319542+0000","last_undegraded":"2024-04-22T07:24:43.319542+0000","last_fullsized":"2024-04-22T07:24:43.319542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-04-22T07:24:43.319450+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-04-22T07:24:43.319450+0000","last_clean_scrub_stamp":"2024-04-22T07:24:43.319450+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:43:27.813482+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'177","reported_seq":203,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:46.039145+0000","last_change":"2024-04-22T07:24:46.039172+0000","last_active":"2024-04-22T07:24:46.039145+0000","last_peered":"2024-04-22T07:24:46.039145+0000","last_clean":"2024-04-22T07:24:46.039145+0000","last_became_active":"2024-04-22T07:20:53.868400+0000","last_became_peered":"2024-04-22T07:20:53.868400+0000","last_unstale":"2024-04-22T07:24:46.039145+0000","last_undegraded":"2024-04-22T07:24:46.039145+0000","last_fullsized":"2024-04-22T07:24:46.039145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'177","last_scrub_stamp":"2024-04-22T07:24:46.039051+0000","last_deep_scrub":"25'177","last_deep_scrub_stamp":"2024-04-22T07:24:46.039051+0000","last_clean_scrub_stamp":"2024-04-22T07:24:46.039051+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:41:21.413315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:48.984210+0000","last_change":"2024-04-22T07:24:48.984236+0000","last_active":"2024-04-22T07:24:48.984210+0000","last_peered":"2024-04-22T07:24:48.984210+0000","last_clean":"2024-04-22T07:24:48.984210+0000","last_became_active":"2024-04-22T07:20:52.861546+0000","last_became_peered":"2024-04-22T07:20:52.861546+0000","last_unstale":"2024-04-22T07:24:48.984210+0000","last_undegraded":"2024-04-22T07:24:48.984210+0000","last_fullsized":"2024-04-22T07:24:48.984210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:24:48.984107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:24:48.984107+0000","last_clean_scrub_stamp":"2024-04-22T07:24:48.984107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:32:21.316020+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'201","reported_seq":227,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:42.007115+0000","last_change":"2024-04-22T07:24:42.007166+0000","last_active":"2024-04-22T07:24:42.007115+0000","last_peered":"2024-04-22T07:24:42.007115+0000","last_clean":"2024-04-22T07:24:42.007115+0000","last_became_active":"2024-04-22T07:20:53.862763+0000","last_became_peered":"2024-04-22T07:20:53.862763+0000","last_unstale":"2024-04-22T07:24:42.007115+0000","last_undegraded":"2024-04-22T07:24:42.007115+0000","last_fullsized":"2024-04-22T07:24:42.007115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'201","last_scrub_stamp":"2024-04-22T07:24:42.007010+0000","last_deep_scrub":"25'201","last_deep_scrub_stamp":"2024-04-22T07:24:42.007010+0000","last_clean_scrub_stamp":"2024-04-22T07:24:42.007010+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:21:38.273585+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:44.218770+0000","last_change":"2024-04-22T07:24:44.218796+0000","last_active":"2024-04-22T07:24:44.218770+0000","last_peered":"2024-04-22T07:24:44.218770+0000","last_clean":"2024-04-22T07:24:44.218770+0000","last_became_active":"2024-04-22T07:20:52.864725+0000","last_became_peered":"2024-04-22T07:20:52.864725+0000","last_unstale":"2024-04-22T07:24:44.218770+0000","last_undegraded":"2024-04-22T07:24:44.218770+0000","last_fullsized":"2024-04-22T07:24:44.218770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:24:44.218663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:24:44.218663+0000","last_clean_scrub_stamp":"2024-04-22T07:24:44.218663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:18:48.093105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"25'197","reported_seq":223,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:45.959313+0000","last_change":"2024-04-22T07:24:45.959347+0000","last_active":"2024-04-22T07:24:45.959313+0000","last_peered":"2024-04-22T07:24:45.959313+0000","last_clean":"2024-04-22T07:24:45.959313+0000","last_became_active":"2024-04-22T07:20:53.874567+0000","last_became_peered":"2024-04-22T07:20:53.874567+0000","last_unstale":"2024-04-22T07:24:45.959313+0000","last_undegraded":"2024-04-22T07:24:45.959313+0000","last_fullsized":"2024-04-22T07:24:45.959313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'197","last_scrub_stamp":"2024-04-22T07:24:45.959198+0000","last_deep_scrub":"25'197","last_deep_scrub_stamp":"2024-04-22T07:24:45.959198+0000","last_clean_scrub_stamp":"2024-04-22T07:24:45.959198+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:40:57.063111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"25'13","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:41.901883+0000","last_change":"2024-04-22T07:24:41.901926+0000","last_active":"2024-04-22T07:24:41.901883+0000","last_peered":"2024-04-22T07:24:41.901883+0000","last_clean":"2024-04-22T07:24:41.901883+0000","last_became_active":"2024-04-22T07:20:52.860347+0000","last_became_peered":"2024-04-22T07:20:52.860347+0000","last_unstale":"2024-04-22T07:24:41.901883+0000","last_undegraded":"2024-04-22T07:24:41.901883+0000","last_fullsized":"2024-04-22T07:24:41.901883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'13","last_scrub_stamp":"2024-04-22T07:24:41.901774+0000","last_deep_scrub":"25'13","last_deep_scrub_stamp":"2024-04-22T07:24:41.901774+0000","last_clean_scrub_stamp":"2024-04-22T07:24:41.901774+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:58:19.284844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"25'215","reported_seq":241,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:43.044189+0000","last_change":"2024-04-22T07:24:43.044215+0000","last_active":"2024-04-22T07:24:43.044189+0000","last_peered":"2024-04-22T07:24:43.044189+0000","last_clean":"2024-04-22T07:24:43.044189+0000","last_became_active":"2024-04-22T07:20:53.859365+0000","last_became_peered":"2024-04-22T07:20:53.859365+0000","last_unstale":"2024-04-22T07:24:43.044189+0000","last_undegraded":"2024-04-22T07:24:43.044189+0000","last_fullsized":"2024-04-22T07:24:43.044189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'215","last_scrub_stamp":"2024-04-22T07:24:43.044104+0000","last_deep_scrub":"25'215","last_deep_scrub_stamp":"2024-04-22T07:24:43.044104+0000","last_clean_scrub_stamp":"2024-04-22T07:24:43.044104+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:18:50.350354+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:45.268439+0000","last_change":"2024-04-22T07:24:45.268472+0000","last_active":"2024-04-22T07:24:45.268439+0000","last_peered":"2024-04-22T07:24:45.268439+0000","last_clean":"2024-04-22T07:24:45.268439+0000","last_became_active":"2024-04-22T07:20:52.866654+0000","last_became_peered":"2024-04-22T07:20:52.866654+0000","last_unstale":"2024-04-22T07:24:45.268439+0000","last_undegraded":"2024-04-22T07:24:45.268439+0000","last_fullsized":"2024-04-22T07:24:45.268439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-04-22T07:24:45.268347+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-04-22T07:24:45.268347+0000","last_clean_scrub_stamp":"2024-04-22T07:24:45.268347+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:27:33.269716+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'175","reported_seq":201,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:48.511373+0000","last_change":"2024-04-22T07:24:48.511404+0000","last_active":"2024-04-22T07:24:48.511373+0000","last_peered":"2024-04-22T07:24:48.511373+0000","last_clean":"2024-04-22T07:24:48.511373+0000","last_became_active":"2024-04-22T07:20:53.874499+0000","last_became_peered":"2024-04-22T07:20:53.874499+0000","last_unstale":"2024-04-22T07:24:48.511373+0000","last_undegraded":"2024-04-22T07:24:48.511373+0000","last_fullsized":"2024-04-22T07:24:48.511373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'175","last_scrub_stamp":"2024-04-22T07:24:48.511280+0000","last_deep_scrub":"25'175","last_deep_scrub_stamp":"2024-04-22T07:24:48.511280+0000","last_clean_scrub_stamp":"2024-04-22T07:24:48.511280+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:20:23.179240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"25'3","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:44.951241+0000","last_change":"2024-04-22T07:24:44.951268+0000","last_active":"2024-04-22T07:24:44.951241+0000","last_peered":"2024-04-22T07:24:44.951241+0000","last_clean":"2024-04-22T07:24:44.951241+0000","last_became_active":"2024-04-22T07:20:52.866627+0000","last_became_peered":"2024-04-22T07:20:52.866627+0000","last_unstale":"2024-04-22T07:24:44.951241+0000","last_undegraded":"2024-04-22T07:24:44.951241+0000","last_fullsized":"2024-04-22T07:24:44.951241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2024-04-22T07:24:44.951152+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2024-04-22T07:24:44.951152+0000","last_clean_scrub_stamp":"2024-04-22T07:24:44.951152+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:18:47.818240+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"25'162","reported_seq":188,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:47.250725+0000","last_change":"2024-04-22T07:24:47.250781+0000","last_active":"2024-04-22T07:24:47.250725+0000","last_peered":"2024-04-22T07:24:47.250725+0000","last_clean":"2024-04-22T07:24:47.250725+0000","last_became_active":"2024-04-22T07:20:53.871353+0000","last_became_peered":"2024-04-22T07:20:53.871353+0000","last_unstale":"2024-04-22T07:24:47.250725+0000","last_undegraded":"2024-04-22T07:24:47.250725+0000","last_fullsized":"2024-04-22T07:24:47.250725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'162","last_scrub_stamp":"2024-04-22T07:24:47.250619+0000","last_deep_scrub":"25'162","last_deep_scrub_stamp":"2024-04-22T07:24:47.250619+0000","last_clean_scrub_stamp":"2024-04-22T07:24:47.250619+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:45:27.818490+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"25'2","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:45.053558+0000","last_change":"2024-04-22T07:24:45.053594+0000","last_active":"2024-04-22T07:24:45.053558+0000","last_peered":"2024-04-22T07:24:45.053558+0000","last_clean":"2024-04-22T07:24:45.053558+0000","last_became_active":"2024-04-22T07:20:52.866677+0000","last_became_peered":"2024-04-22T07:20:52.866677+0000","last_unstale":"2024-04-22T07:24:45.053558+0000","last_undegraded":"2024-04-22T07:24:45.053558+0000","last_fullsized":"2024-04-22T07:24:45.053558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-04-22T07:24:45.053462+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-04-22T07:24:45.053462+0000","last_clean_scrub_stamp":"2024-04-22T07:24:45.053462+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:03:22.460046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"25'165","reported_seq":191,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:46.232004+0000","last_change":"2024-04-22T07:24:46.232059+0000","last_active":"2024-04-22T07:24:46.232004+0000","last_peered":"2024-04-22T07:24:46.232004+0000","last_clean":"2024-04-22T07:24:46.232004+0000","last_became_active":"2024-04-22T07:20:53.866968+0000","last_became_peered":"2024-04-22T07:20:53.866968+0000","last_unstale":"2024-04-22T07:24:46.232004+0000","last_undegraded":"2024-04-22T07:24:46.232004+0000","last_fullsized":"2024-04-22T07:24:46.232004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'165","last_scrub_stamp":"2024-04-22T07:24:46.231881+0000","last_deep_scrub":"25'165","last_deep_scrub_stamp":"2024-04-22T07:24:46.231881+0000","last_clean_scrub_stamp":"2024-04-22T07:24:46.231881+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:28:27.656059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:44.010956+0000","last_change":"2024-04-22T07:24:44.011009+0000","last_active":"2024-04-22T07:24:44.010956+0000","last_peered":"2024-04-22T07:24:44.010956+0000","last_clean":"2024-04-22T07:24:44.010956+0000","last_became_active":"2024-04-22T07:20:52.856289+0000","last_became_peered":"2024-04-22T07:20:52.856289+0000","last_unstale":"2024-04-22T07:24:44.010956+0000","last_undegraded":"2024-04-22T07:24:44.010956+0000","last_fullsized":"2024-04-22T07:24:44.010956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:24:44.010824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:24:44.010824+0000","last_clean_scrub_stamp":"2024-04-22T07:24:44.010824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:57:23.478747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"25'175","reported_seq":201,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:59.044828+0000","last_change":"2024-04-22T07:24:59.044860+0000","last_active":"2024-04-22T07:24:59.044828+0000","last_peered":"2024-04-22T07:24:59.044828+0000","last_clean":"2024-04-22T07:24:59.044828+0000","last_became_active":"2024-04-22T07:20:53.872005+0000","last_became_peered":"2024-04-22T07:20:53.872005+0000","last_unstale":"2024-04-22T07:24:59.044828+0000","last_undegraded":"2024-04-22T07:24:59.044828+0000","last_fullsized":"2024-04-22T07:24:59.044828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'175","last_scrub_stamp":"2024-04-22T07:24:59.044722+0000","last_deep_scrub":"25'175","last_deep_scrub_stamp":"2024-04-22T07:24:59.044722+0000","last_clean_scrub_stamp":"2024-04-22T07:24:59.044722+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:36:26.449515+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"25'119","reported_seq":187,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:39.959840+0000","last_change":"2024-04-22T07:24:39.959840+0000","last_active":"2024-04-22T07:24:39.959840+0000","last_peered":"2024-04-22T07:24:39.959840+0000","last_clean":"2024-04-22T07:24:39.959840+0000","last_became_active":"2024-04-22T07:20:43.746332+0000","last_became_peered":"2024-04-22T07:20:43.746332+0000","last_unstale":"2024-04-22T07:24:39.959840+0000","last_undegraded":"2024-04-22T07:24:39.959840+0000","last_fullsized":"2024-04-22T07:24:39.959840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'119","last_scrub_stamp":"2024-04-22T07:24:39.959739+0000","last_deep_scrub":"25'119","last_deep_scrub_stamp":"2024-04-22T07:24:39.959739+0000","last_clean_scrub_stamp":"2024-04-22T07:24:39.959739+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:08:48.217818+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:49.972454+0000","last_change":"2024-04-22T07:24:49.972454+0000","last_active":"2024-04-22T07:24:49.972454+0000","last_peered":"2024-04-22T07:24:49.972454+0000","last_clean":"2024-04-22T07:24:49.972454+0000","last_became_active":"2024-04-22T07:20:52.862201+0000","last_became_peered":"2024-04-22T07:20:52.862201+0000","last_unstale":"2024-04-22T07:24:49.972454+0000","last_undegraded":"2024-04-22T07:24:49.972454+0000","last_fullsized":"2024-04-22T07:24:49.972454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:24:49.972290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:24:49.972290+0000","last_clean_scrub_stamp":"2024-04-22T07:24:49.972290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:18:19.996513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'183","reported_seq":210,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:48.936016+0000","last_change":"2024-04-22T07:24:48.936061+0000","last_active":"2024-04-22T07:24:48.936016+0000","last_peered":"2024-04-22T07:24:48.936016+0000","last_clean":"2024-04-22T07:24:48.936016+0000","last_became_active":"2024-04-22T07:20:53.868335+0000","last_became_peered":"2024-04-22T07:20:53.868335+0000","last_unstale":"2024-04-22T07:24:48.936016+0000","last_undegraded":"2024-04-22T07:24:48.936016+0000","last_fullsized":"2024-04-22T07:24:48.936016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'183","last_scrub_stamp":"2024-04-22T07:24:48.935913+0000","last_deep_scrub":"25'183","last_deep_scrub_stamp":"2024-04-22T07:24:48.935913+0000","last_clean_scrub_stamp":"2024-04-22T07:24:48.935913+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T19:14:12.989412+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:45.019656+0000","last_change":"2024-04-22T07:24:45.019656+0000","last_active":"2024-04-22T07:24:45.019656+0000","last_peered":"2024-04-22T07:24:45.019656+0000","last_clean":"2024-04-22T07:24:45.019656+0000","last_became_active":"2024-04-22T07:20:52.866996+0000","last_became_peered":"2024-04-22T07:20:52.866996+0000","last_unstale":"2024-04-22T07:24:45.019656+0000","last_undegraded":"2024-04-22T07:24:45.019656+0000","last_fullsized":"2024-04-22T07:24:45.019656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:24:45.019541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:24:45.019541+0000","last_clean_scrub_stamp":"2024-04-22T07:24:45.019541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:28:26.443719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'165","reported_seq":192,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:47.061519+0000","last_change":"2024-04-22T07:24:47.061519+0000","last_active":"2024-04-22T07:24:47.061519+0000","last_peered":"2024-04-22T07:24:47.061519+0000","last_clean":"2024-04-22T07:24:47.061519+0000","last_became_active":"2024-04-22T07:20:53.871239+0000","last_became_peered":"2024-04-22T07:20:53.871239+0000","last_unstale":"2024-04-22T07:24:47.061519+0000","last_undegraded":"2024-04-22T07:24:47.061519+0000","last_fullsized":"2024-04-22T07:24:47.061519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'165","last_scrub_stamp":"2024-04-22T07:24:47.061389+0000","last_deep_scrub":"25'165","last_deep_scrub_stamp":"2024-04-22T07:24:47.061389+0000","last_clean_scrub_stamp":"2024-04-22T07:24:47.061389+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:24:54.442159+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"25'5","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:45.361888+0000","last_change":"2024-04-22T07:24:45.361888+0000","last_active":"2024-04-22T07:24:45.361888+0000","last_peered":"2024-04-22T07:24:45.361888+0000","last_clean":"2024-04-22T07:24:45.361888+0000","last_became_active":"2024-04-22T07:20:52.866581+0000","last_became_peered":"2024-04-22T07:20:52.866581+0000","last_unstale":"2024-04-22T07:24:45.361888+0000","last_undegraded":"2024-04-22T07:24:45.361888+0000","last_fullsized":"2024-04-22T07:24:45.361888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-04-22T07:24:45.361738+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-04-22T07:24:45.361738+0000","last_clean_scrub_stamp":"2024-04-22T07:24:45.361738+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:43:34.292338+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'165","reported_seq":192,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:46.005797+0000","last_change":"2024-04-22T07:24:46.005797+0000","last_active":"2024-04-22T07:24:46.005797+0000","last_peered":"2024-04-22T07:24:46.005797+0000","last_clean":"2024-04-22T07:24:46.005797+0000","last_became_active":"2024-04-22T07:20:53.864523+0000","last_became_peered":"2024-04-22T07:20:53.864523+0000","last_unstale":"2024-04-22T07:24:46.005797+0000","last_undegraded":"2024-04-22T07:24:46.005797+0000","last_fullsized":"2024-04-22T07:24:46.005797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'165","last_scrub_stamp":"2024-04-22T07:24:46.005256+0000","last_deep_scrub":"25'165","last_deep_scrub_stamp":"2024-04-22T07:24:46.005256+0000","last_clean_scrub_stamp":"2024-04-22T07:24:46.005256+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:21:37.630084+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:45.981359+0000","last_change":"2024-04-22T07:24:45.981359+0000","last_active":"2024-04-22T07:24:45.981359+0000","last_peered":"2024-04-22T07:24:45.981359+0000","last_clean":"2024-04-22T07:24:45.981359+0000","last_became_active":"2024-04-22T07:20:52.858139+0000","last_became_peered":"2024-04-22T07:20:52.858139+0000","last_unstale":"2024-04-22T07:24:45.981359+0000","last_undegraded":"2024-04-22T07:24:45.981359+0000","last_fullsized":"2024-04-22T07:24:45.981359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:24:45.981242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:24:45.981242+0000","last_clean_scrub_stamp":"2024-04-22T07:24:45.981242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T15:45:26.549113+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'177","reported_seq":204,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:54.214827+0000","last_change":"2024-04-22T07:24:54.214827+0000","last_active":"2024-04-22T07:24:54.214827+0000","last_peered":"2024-04-22T07:24:54.214827+0000","last_clean":"2024-04-22T07:24:54.214827+0000","last_became_active":"2024-04-22T07:20:53.877208+0000","last_became_peered":"2024-04-22T07:20:53.877208+0000","last_unstale":"2024-04-22T07:24:54.214827+0000","last_undegraded":"2024-04-22T07:24:54.214827+0000","last_fullsized":"2024-04-22T07:24:54.214827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'177","last_scrub_stamp":"2024-04-22T07:24:54.214704+0000","last_deep_scrub":"25'177","last_deep_scrub_stamp":"2024-04-22T07:24:54.214704+0000","last_clean_scrub_stamp":"2024-04-22T07:24:54.214704+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:23:55.139178+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:44.016510+0000","last_change":"2024-04-22T07:24:44.016510+0000","last_active":"2024-04-22T07:24:44.016510+0000","last_peered":"2024-04-22T07:24:44.016510+0000","last_clean":"2024-04-22T07:24:44.016510+0000","last_became_active":"2024-04-22T07:20:52.865903+0000","last_became_peered":"2024-04-22T07:20:52.865903+0000","last_unstale":"2024-04-22T07:24:44.016510+0000","last_undegraded":"2024-04-22T07:24:44.016510+0000","last_fullsized":"2024-04-22T07:24:44.016510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:24:44.016390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:24:44.016390+0000","last_clean_scrub_stamp":"2024-04-22T07:24:44.016390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:49:41.688607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'160","reported_seq":187,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:47.467413+0000","last_change":"2024-04-22T07:24:47.467413+0000","last_active":"2024-04-22T07:24:47.467413+0000","last_peered":"2024-04-22T07:24:47.467413+0000","last_clean":"2024-04-22T07:24:47.467413+0000","last_became_active":"2024-04-22T07:20:53.872915+0000","last_became_peered":"2024-04-22T07:20:53.872915+0000","last_unstale":"2024-04-22T07:24:47.467413+0000","last_undegraded":"2024-04-22T07:24:47.467413+0000","last_fullsized":"2024-04-22T07:24:47.467413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'160","last_scrub_stamp":"2024-04-22T07:24:47.467295+0000","last_deep_scrub":"25'160","last_deep_scrub_stamp":"2024-04-22T07:24:47.467295+0000","last_clean_scrub_stamp":"2024-04-22T07:24:47.467295+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T10:26:23.919966+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:51.935064+0000","last_change":"2024-04-22T07:24:51.935064+0000","last_active":"2024-04-22T07:24:51.935064+0000","last_peered":"2024-04-22T07:24:51.935064+0000","last_clean":"2024-04-22T07:24:51.935064+0000","last_became_active":"2024-04-22T07:20:52.863296+0000","last_became_peered":"2024-04-22T07:20:52.863296+0000","last_unstale":"2024-04-22T07:24:51.935064+0000","last_undegraded":"2024-04-22T07:24:51.935064+0000","last_fullsized":"2024-04-22T07:24:51.935064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:24:51.934922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:24:51.934922+0000","last_clean_scrub_stamp":"2024-04-22T07:24:51.934922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:10:05.064511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'162","reported_seq":189,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:48.019499+0000","last_change":"2024-04-22T07:24:48.019499+0000","last_active":"2024-04-22T07:24:48.019499+0000","last_peered":"2024-04-22T07:24:48.019499+0000","last_clean":"2024-04-22T07:24:48.019499+0000","last_became_active":"2024-04-22T07:20:53.874202+0000","last_became_peered":"2024-04-22T07:20:53.874202+0000","last_unstale":"2024-04-22T07:24:48.019499+0000","last_undegraded":"2024-04-22T07:24:48.019499+0000","last_fullsized":"2024-04-22T07:24:48.019499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'162","last_scrub_stamp":"2024-04-22T07:24:48.019376+0000","last_deep_scrub":"25'162","last_deep_scrub_stamp":"2024-04-22T07:24:48.019376+0000","last_clean_scrub_stamp":"2024-04-22T07:24:48.019376+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:00:42.937253+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"25'21","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:42.939967+0000","last_change":"2024-04-22T07:24:42.939967+0000","last_active":"2024-04-22T07:24:42.939967+0000","last_peered":"2024-04-22T07:24:42.939967+0000","last_clean":"2024-04-22T07:24:42.939967+0000","last_became_active":"2024-04-22T07:20:52.865566+0000","last_became_peered":"2024-04-22T07:20:52.865566+0000","last_unstale":"2024-04-22T07:24:42.939967+0000","last_undegraded":"2024-04-22T07:24:42.939967+0000","last_fullsized":"2024-04-22T07:24:42.939967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'21","last_scrub_stamp":"2024-04-22T07:24:42.939838+0000","last_deep_scrub":"25'21","last_deep_scrub_stamp":"2024-04-22T07:24:42.939838+0000","last_clean_scrub_stamp":"2024-04-22T07:24:42.939838+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:10:25.763375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'166","reported_seq":193,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:49.897219+0000","last_change":"2024-04-22T07:24:49.897219+0000","last_active":"2024-04-22T07:24:49.897219+0000","last_peered":"2024-04-22T07:24:49.897219+0000","last_clean":"2024-04-22T07:24:49.897219+0000","last_became_active":"2024-04-22T07:20:53.869613+0000","last_became_peered":"2024-04-22T07:20:53.869613+0000","last_unstale":"2024-04-22T07:24:49.897219+0000","last_undegraded":"2024-04-22T07:24:49.897219+0000","last_fullsized":"2024-04-22T07:24:49.897219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'166","last_scrub_stamp":"2024-04-22T07:24:49.897083+0000","last_deep_scrub":"25'166","last_deep_scrub_stamp":"2024-04-22T07:24:49.897083+0000","last_clean_scrub_stamp":"2024-04-22T07:24:49.897083+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:58:32.937985+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:52.934131+0000","last_change":"2024-04-22T07:24:52.934131+0000","last_active":"2024-04-22T07:24:52.934131+0000","last_peered":"2024-04-22T07:24:52.934131+0000","last_clean":"2024-04-22T07:24:52.934131+0000","last_became_active":"2024-04-22T07:20:52.864434+0000","last_became_peered":"2024-04-22T07:20:52.864434+0000","last_unstale":"2024-04-22T07:24:52.934131+0000","last_undegraded":"2024-04-22T07:24:52.934131+0000","last_fullsized":"2024-04-22T07:24:52.934131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-04-22T07:24:52.933987+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-04-22T07:24:52.933987+0000","last_clean_scrub_stamp":"2024-04-22T07:24:52.933987+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T11:23:53.858460+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'183","reported_seq":210,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:51.902468+0000","last_change":"2024-04-22T07:24:51.902468+0000","last_active":"2024-04-22T07:24:51.902468+0000","last_peered":"2024-04-22T07:24:51.902468+0000","last_clean":"2024-04-22T07:24:51.902468+0000","last_became_active":"2024-04-22T07:20:53.870664+0000","last_became_peered":"2024-04-22T07:20:53.870664+0000","last_unstale":"2024-04-22T07:24:51.902468+0000","last_undegraded":"2024-04-22T07:24:51.902468+0000","last_fullsized":"2024-04-22T07:24:51.902468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'183","last_scrub_stamp":"2024-04-22T07:24:51.902332+0000","last_deep_scrub":"25'183","last_deep_scrub_stamp":"2024-04-22T07:24:51.902332+0000","last_clean_scrub_stamp":"2024-04-22T07:24:51.902332+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:45:44.279324+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:40.092564+0000","last_change":"2024-04-22T07:24:40.092564+0000","last_active":"2024-04-22T07:24:40.092564+0000","last_peered":"2024-04-22T07:24:40.092564+0000","last_clean":"2024-04-22T07:24:40.092564+0000","last_became_active":"2024-04-22T07:20:52.854395+0000","last_became_peered":"2024-04-22T07:20:52.854395+0000","last_unstale":"2024-04-22T07:24:40.092564+0000","last_undegraded":"2024-04-22T07:24:40.092564+0000","last_fullsized":"2024-04-22T07:24:40.092564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:24:40.092459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:24:40.092459+0000","last_clean_scrub_stamp":"2024-04-22T07:24:40.092459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:26:29.277735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'162","reported_seq":189,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:58.023396+0000","last_change":"2024-04-22T07:24:58.023396+0000","last_active":"2024-04-22T07:24:58.023396+0000","last_peered":"2024-04-22T07:24:58.023396+0000","last_clean":"2024-04-22T07:24:58.023396+0000","last_became_active":"2024-04-22T07:20:53.870674+0000","last_became_peered":"2024-04-22T07:20:53.870674+0000","last_unstale":"2024-04-22T07:24:58.023396+0000","last_undegraded":"2024-04-22T07:24:58.023396+0000","last_fullsized":"2024-04-22T07:24:58.023396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'162","last_scrub_stamp":"2024-04-22T07:24:58.023220+0000","last_deep_scrub":"25'162","last_deep_scrub_stamp":"2024-04-22T07:24:58.023220+0000","last_clean_scrub_stamp":"2024-04-22T07:24:58.023220+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T12:29:18.432733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:43.944718+0000","last_change":"2024-04-22T07:24:43.944718+0000","last_active":"2024-04-22T07:24:43.944718+0000","last_peered":"2024-04-22T07:24:43.944718+0000","last_clean":"2024-04-22T07:24:43.944718+0000","last_became_active":"2024-04-22T07:20:52.865606+0000","last_became_peered":"2024-04-22T07:20:52.865606+0000","last_unstale":"2024-04-22T07:24:43.944718+0000","last_undegraded":"2024-04-22T07:24:43.944718+0000","last_fullsized":"2024-04-22T07:24:43.944718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:24:43.944596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:24:43.944596+0000","last_clean_scrub_stamp":"2024-04-22T07:24:43.944596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T16:55:20.814633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"25'173","reported_seq":200,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:50.939379+0000","last_change":"2024-04-22T07:24:50.939379+0000","last_active":"2024-04-22T07:24:50.939379+0000","last_peered":"2024-04-22T07:24:50.939379+0000","last_clean":"2024-04-22T07:24:50.939379+0000","last_became_active":"2024-04-22T07:20:53.870402+0000","last_became_peered":"2024-04-22T07:20:53.870402+0000","last_unstale":"2024-04-22T07:24:50.939379+0000","last_undegraded":"2024-04-22T07:24:50.939379+0000","last_fullsized":"2024-04-22T07:24:50.939379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'173","last_scrub_stamp":"2024-04-22T07:24:50.939238+0000","last_deep_scrub":"25'173","last_deep_scrub_stamp":"2024-04-22T07:24:50.939238+0000","last_clean_scrub_stamp":"2024-04-22T07:24:50.939238+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:23:24.596363+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:44.995965+0000","last_change":"2024-04-22T07:24:44.995965+0000","last_active":"2024-04-22T07:24:44.995965+0000","last_peered":"2024-04-22T07:24:44.995965+0000","last_clean":"2024-04-22T07:24:44.995965+0000","last_became_active":"2024-04-22T07:20:52.860702+0000","last_became_peered":"2024-04-22T07:20:52.860702+0000","last_unstale":"2024-04-22T07:24:44.995965+0000","last_undegraded":"2024-04-22T07:24:44.995965+0000","last_fullsized":"2024-04-22T07:24:44.995965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-22T07:24:44.995835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-22T07:24:44.995835+0000","last_clean_scrub_stamp":"2024-04-22T07:24:44.995835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:09:32.435026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'164","reported_seq":190,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:47.349227+0000","last_change":"2024-04-22T07:24:47.349252+0000","last_active":"2024-04-22T07:24:47.349227+0000","last_peered":"2024-04-22T07:24:47.349227+0000","last_clean":"2024-04-22T07:24:47.349227+0000","last_became_active":"2024-04-22T07:20:53.868509+0000","last_became_peered":"2024-04-22T07:20:53.868509+0000","last_unstale":"2024-04-22T07:24:47.349227+0000","last_undegraded":"2024-04-22T07:24:47.349227+0000","last_fullsized":"2024-04-22T07:24:47.349227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'164","last_scrub_stamp":"2024-04-22T07:24:47.349127+0000","last_deep_scrub":"25'164","last_deep_scrub_stamp":"2024-04-22T07:24:47.349127+0000","last_clean_scrub_stamp":"2024-04-22T07:24:47.349127+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T14:49:37.459692+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:46.944493+0000","last_change":"2024-04-22T07:24:46.944524+0000","last_active":"2024-04-22T07:24:46.944493+0000","last_peered":"2024-04-22T07:24:46.944493+0000","last_clean":"2024-04-22T07:24:46.944493+0000","last_became_active":"2024-04-22T07:20:52.858215+0000","last_became_peered":"2024-04-22T07:20:52.858215+0000","last_unstale":"2024-04-22T07:24:46.944493+0000","last_undegraded":"2024-04-22T07:24:46.944493+0000","last_fullsized":"2024-04-22T07:24:46.944493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-04-22T07:24:46.944401+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-04-22T07:24:46.944401+0000","last_clean_scrub_stamp":"2024-04-22T07:24:46.944401+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:34.893042+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'154","reported_seq":181,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:55.976709+0000","last_change":"2024-04-22T07:24:55.976709+0000","last_active":"2024-04-22T07:24:55.976709+0000","last_peered":"2024-04-22T07:24:55.976709+0000","last_clean":"2024-04-22T07:24:55.976709+0000","last_became_active":"2024-04-22T07:20:53.867447+0000","last_became_peered":"2024-04-22T07:20:53.867447+0000","last_unstale":"2024-04-22T07:24:55.976709+0000","last_undegraded":"2024-04-22T07:24:55.976709+0000","last_fullsized":"2024-04-22T07:24:55.976709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'154","last_scrub_stamp":"2024-04-22T07:24:55.976576+0000","last_deep_scrub":"25'154","last_deep_scrub_stamp":"2024-04-22T07:24:55.976576+0000","last_clean_scrub_stamp":"2024-04-22T07:24:55.976576+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T18:13:47.972205+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'205","reported_seq":231,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:25:00.012324+0000","last_change":"2024-04-22T07:25:00.012351+0000","last_active":"2024-04-22T07:25:00.012324+0000","last_peered":"2024-04-22T07:25:00.012324+0000","last_clean":"2024-04-22T07:25:00.012324+0000","last_became_active":"2024-04-22T07:20:53.875305+0000","last_became_peered":"2024-04-22T07:20:53.875305+0000","last_unstale":"2024-04-22T07:25:00.012324+0000","last_undegraded":"2024-04-22T07:25:00.012324+0000","last_fullsized":"2024-04-22T07:25:00.012324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'205","last_scrub_stamp":"2024-04-22T07:25:00.012222+0000","last_deep_scrub":"25'205","last_deep_scrub_stamp":"2024-04-22T07:25:00.012222+0000","last_clean_scrub_stamp":"2024-04-22T07:25:00.012222+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:56:44.215436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"25'3","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:42.138895+0000","last_change":"2024-04-22T07:24:42.138948+0000","last_active":"2024-04-22T07:24:42.138895+0000","last_peered":"2024-04-22T07:24:42.138895+0000","last_clean":"2024-04-22T07:24:42.138895+0000","last_became_active":"2024-04-22T07:20:52.856293+0000","last_became_peered":"2024-04-22T07:20:52.856293+0000","last_unstale":"2024-04-22T07:24:42.138895+0000","last_undegraded":"2024-04-22T07:24:42.138895+0000","last_fullsized":"2024-04-22T07:24:42.138895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2024-04-22T07:24:42.138802+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2024-04-22T07:24:42.138802+0000","last_clean_scrub_stamp":"2024-04-22T07:24:42.138802+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:03:19.545386+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"25'162","reported_seq":188,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:43.961556+0000","last_change":"2024-04-22T07:24:43.961584+0000","last_active":"2024-04-22T07:24:43.961556+0000","last_peered":"2024-04-22T07:24:43.961556+0000","last_clean":"2024-04-22T07:24:43.961556+0000","last_became_active":"2024-04-22T07:20:53.870548+0000","last_became_peered":"2024-04-22T07:20:53.870548+0000","last_unstale":"2024-04-22T07:24:43.961556+0000","last_undegraded":"2024-04-22T07:24:43.961556+0000","last_fullsized":"2024-04-22T07:24:43.961556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'162","last_scrub_stamp":"2024-04-22T07:24:43.961453+0000","last_deep_scrub":"25'162","last_deep_scrub_stamp":"2024-04-22T07:24:43.961453+0000","last_clean_scrub_stamp":"2024-04-22T07:24:43.961453+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T17:45:26.058985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"25'5","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:41.118860+0000","last_change":"2024-04-22T07:24:41.118906+0000","last_active":"2024-04-22T07:24:41.118860+0000","last_peered":"2024-04-22T07:24:41.118860+0000","last_clean":"2024-04-22T07:24:41.118860+0000","last_became_active":"2024-04-22T07:20:52.856617+0000","last_became_peered":"2024-04-22T07:20:52.856617+0000","last_unstale":"2024-04-22T07:24:41.118860+0000","last_undegraded":"2024-04-22T07:24:41.118860+0000","last_fullsized":"2024-04-22T07:24:41.118860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-04-22T07:24:41.118748+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-04-22T07:24:41.118748+0000","last_clean_scrub_stamp":"2024-04-22T07:24:41.118748+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:49:03.047500+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"25'160","reported_seq":187,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:46.983211+0000","last_change":"2024-04-22T07:24:46.983211+0000","last_active":"2024-04-22T07:24:46.983211+0000","last_peered":"2024-04-22T07:24:46.983211+0000","last_clean":"2024-04-22T07:24:46.983211+0000","last_became_active":"2024-04-22T07:20:53.866286+0000","last_became_peered":"2024-04-22T07:20:53.866286+0000","last_unstale":"2024-04-22T07:24:46.983211+0000","last_undegraded":"2024-04-22T07:24:46.983211+0000","last_fullsized":"2024-04-22T07:24:46.983211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'160","last_scrub_stamp":"2024-04-22T07:24:46.983033+0000","last_deep_scrub":"25'160","last_deep_scrub_stamp":"2024-04-22T07:24:46.983033+0000","last_clean_scrub_stamp":"2024-04-22T07:24:46.983033+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T13:18:50.857475+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:43.038340+0000","last_change":"2024-04-22T07:24:43.038340+0000","last_active":"2024-04-22T07:24:43.038340+0000","last_peered":"2024-04-22T07:24:43.038340+0000","last_clean":"2024-04-22T07:24:43.038340+0000","last_became_active":"2024-04-22T07:20:52.862967+0000","last_became_peered":"2024-04-22T07:20:52.862967+0000","last_unstale":"2024-04-22T07:24:43.038340+0000","last_undegraded":"2024-04-22T07:24:43.038340+0000","last_fullsized":"2024-04-22T07:24:43.038340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2024-04-22T07:24:43.038203+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2024-04-22T07:24:43.038203+0000","last_clean_scrub_stamp":"2024-04-22T07:24:43.038203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:18:41.910941+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"25'181","reported_seq":208,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:50.987265+0000","last_change":"2024-04-22T07:24:50.987265+0000","last_active":"2024-04-22T07:24:50.987265+0000","last_peered":"2024-04-22T07:24:50.987265+0000","last_clean":"2024-04-22T07:24:50.987265+0000","last_became_active":"2024-04-22T07:20:53.870715+0000","last_became_peered":"2024-04-22T07:20:53.870715+0000","last_unstale":"2024-04-22T07:24:50.987265+0000","last_undegraded":"2024-04-22T07:24:50.987265+0000","last_fullsized":"2024-04-22T07:24:50.987265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'181","last_scrub_stamp":"2024-04-22T07:24:50.987146+0000","last_deep_scrub":"25'181","last_deep_scrub_stamp":"2024-04-22T07:24:50.987146+0000","last_clean_scrub_stamp":"2024-04-22T07:24:50.987146+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T08:45:38.935788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"25'6","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-22T07:24:45.945904+0000","last_change":"2024-04-22T07:24:45.945904+0000","last_active":"2024-04-22T07:24:45.945904+0000","last_peered":"2024-04-22T07:24:45.945904+0000","last_clean":"2024-04-22T07:24:45.945904+0000","last_became_active":"2024-04-22T07:20:52.869300+0000","last_became_peered":"2024-04-22T07:20:52.869300+0000","last_unstale":"2024-04-22T07:24:45.945904+0000","last_undegraded":"2024-04-22T07:24:45.945904+0000","last_fullsized":"2024-04-22T07:24:45.945904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2024-04-22T07:24:45.945754+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2024-04-22T07:24:45.945754+0000","last_clean_scrub_stamp":"2024-04-22T07:24:45.945754+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-23T07:44:42.989533+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11255,"ondisk_log_size":11255,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4964439,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2465,"num_write_kb":7159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9994240,"data_stored":9928878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2468,"ondisk_log_size":2468,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509499,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":270336,"data_stored":93777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509499,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1028096,"data_stored":861308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509498,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36932,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334908,"statfs":{"total":96636764160,"available":96598945792,"internally_reserved":0,"allocated":1634304,"data_stored":1452273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509498,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35592,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336248,"statfs":{"total":96636764160,"available":96600317952,"internally_reserved":0,"allocated":262144,"data_stored":93730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509499,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57740,"kb_used_data":4356,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94314100,"statfs":{"total":96636764160,"available":96577638400,"internally_reserved":0,"allocated":4460544,"data_stored":4288124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509499,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36172,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335668,"statfs":{"total":96636764160,"available":96599724032,"internally_reserved":0,"allocated":856064,"data_stored":683586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509500,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35596,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336244,"statfs":{"total":96636764160,"available":96600313856,"internally_reserved":0,"allocated":266240,"data_stored":93204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61908,"kb_used_data":4364,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94309932,"statfs":{"total":96636764160,"available":96573370368,"internally_reserved":0,"allocated":4468736,"data_stored":4288796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4194976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4210688,"data_stored":4195648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":782336,"data_stored":768757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":770048,"data_stored":768160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-22T07:25:23.683 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-22T07:25:23.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.821+0000 7f91dfef1640 1 Processor -- start 2024-04-22T07:25:23.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.821+0000 7f91dfef1640 1 -- start start 2024-04-22T07:25:23.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.822+0000 7f91dfef1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f91d80d08c0 0x7f91d80caef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:23.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.822+0000 7f91dfef1640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91d80d0ca0 0x7f91d80cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:23.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.822+0000 7f91dfef1640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91d80cc240 con 0x7f91d80cd380 2024-04-22T07:25:23.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.822+0000 7f91dfef1640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f91d80ccef0 con 0x7f91d80d08c0 2024-04-22T07:25:23.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.822+0000 7f91dfef1640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f91d815ac50 con 0x7f91d80d0ca0 2024-04-22T07:25:23.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.822+0000 7f91ddc8d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f91d80d08c0 0x7f91d80caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:23.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.822+0000 7f91de48e640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f91d80cd380 0x7f91d80cd7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37536/0 (socket says 172.21.15.40:37536) 2024-04-22T07:25:23.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.822+0000 7f91de48e640 1 -- 172.21.15.40:0/3958870848 learned_addr learned my addr 172.21.15.40:0/3958870848 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:25:23.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.822+0000 7f91dd48c640 1 --2- 172.21.15.40:0/3958870848 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91d80d0ca0 0x7f91d80cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:23.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.822+0000 7f91ddc8d640 1 -- 172.21.15.40:0/3958870848 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91d80d0ca0 msgr2=0x7f91d80cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:25:23.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.822+0000 7f91ddc8d640 1 --2- 172.21.15.40:0/3958870848 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91d80d0ca0 0x7f91d80cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:23.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.822+0000 7f91ddc8d640 1 -- 172.21.15.40:0/3958870848 >> v1:172.21.15.40:6789/0 conn(0x7f91d80cd380 legacy=0x7f91d80cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:23.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.822+0000 7f91ddc8d640 1 -- 172.21.15.40:0/3958870848 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d815af10 con 0x7f91d80d08c0 2024-04-22T07:25:23.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.822+0000 7f91dcc8b640 1 -- 172.21.15.40:0/3958870848 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 230735594 0 0) 0x7f91d80cc240 con 0x7f91d80cd380 2024-04-22T07:25:23.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.823+0000 7f91ddc8d640 1 --2- 172.21.15.40:0/3958870848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91d80d08c0 0x7f91d80caef0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009d90 tx=0x7f91c802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efceb4af18398fb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:23.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.823+0000 7f91dcc8b640 1 -- 172.21.15.40:0/3958870848 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c8039070 con 0x7f91d80d08c0 2024-04-22T07:25:23.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.823+0000 7f91dcc8b640 1 -- 172.21.15.40:0/3958870848 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91c802cce0 con 0x7f91d80d08c0 2024-04-22T07:25:23.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.823+0000 7f91dcc8b640 1 -- 172.21.15.40:0/3958870848 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c8034660 con 0x7f91d80d08c0 2024-04-22T07:25:23.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.824+0000 7f91dfef1640 1 -- 172.21.15.40:0/3958870848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91d80d08c0 msgr2=0x7f91d80caef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:23.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.824+0000 7f91dfef1640 1 --2- 172.21.15.40:0/3958870848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91d80d08c0 0x7f91d80caef0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009d90 tx=0x7f91c802bf30 comp rx=0 tx=0).stop 2024-04-22T07:25:23.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.824+0000 7f91dfef1640 1 -- 172.21.15.40:0/3958870848 shutdown_connections 2024-04-22T07:25:23.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.824+0000 7f91dfef1640 1 --2- 172.21.15.40:0/3958870848 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91d80d0ca0 0x7f91d80cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:23.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.824+0000 7f91dfef1640 1 --2- 172.21.15.40:0/3958870848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91d80d08c0 0x7f91d80caef0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:23.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.824+0000 7f91dfef1640 1 -- 172.21.15.40:0/3958870848 >> 172.21.15.40:0/3958870848 conn(0x7f91d806ce70 msgr2=0x7f91d806d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:25:23.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.824+0000 7f91dfef1640 1 -- 172.21.15.40:0/3958870848 shutdown_connections 2024-04-22T07:25:23.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.824+0000 7f91dfef1640 1 -- 172.21.15.40:0/3958870848 wait complete. 2024-04-22T07:25:23.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.825+0000 7f91dfef1640 1 Processor -- start 2024-04-22T07:25:23.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.825+0000 7f91dfef1640 1 -- start start 2024-04-22T07:25:23.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.826+0000 7f91dfef1640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91d80cd380 0x7f91d81f47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:23.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.826+0000 7f91dfef1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91d80d08c0 0x7f91d81f06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:23.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.826+0000 7f91dfef1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91d80d0ca0 0x7f91d8153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:23.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.826+0000 7f91dfef1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f91d815b7b0 con 0x7f91d80d0ca0 2024-04-22T07:25:23.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.826+0000 7f91dfef1640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f91d815b4d0 con 0x7f91d80d08c0 2024-04-22T07:25:23.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.826+0000 7f91dfef1640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f91d815ba90 con 0x7f91d80cd380 2024-04-22T07:25:23.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.826+0000 7f91de48e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91d80d0ca0 0x7f91d8153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:23.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.826+0000 7f91de48e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91d80d0ca0 0x7f91d8153c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40462/0 (socket says 172.21.15.40:40462) 2024-04-22T07:25:23.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.826+0000 7f91de48e640 1 -- 172.21.15.40:0/2834476278 learned_addr learned my addr 172.21.15.40:0/2834476278 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:25:23.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.826+0000 7f91ddc8d640 1 --2- 172.21.15.40:0/2834476278 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91d80cd380 0x7f91d81f47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:23.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.826+0000 7f91dd48c640 1 --2- 172.21.15.40:0/2834476278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91d80d08c0 0x7f91d81f06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:23.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.826+0000 7f91de48e640 1 -- 172.21.15.40:0/2834476278 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91d80cd380 msgr2=0x7f91d81f47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:23.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.826+0000 7f91de48e640 1 --2- 172.21.15.40:0/2834476278 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91d80cd380 0x7f91d81f47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:23.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.826+0000 7f91de48e640 1 -- 172.21.15.40:0/2834476278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91d80d08c0 msgr2=0x7f91d81f06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:23.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.826+0000 7f91de48e640 1 --2- 172.21.15.40:0/2834476278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91d80d08c0 0x7f91d81f06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:23.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.826+0000 7f91de48e640 1 -- 172.21.15.40:0/2834476278 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d80c8d40 con 0x7f91d80d0ca0 2024-04-22T07:25:23.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.827+0000 7f91de48e640 1 --2- 172.21.15.40:0/2834476278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91d80d0ca0 0x7f91d8153c80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f91d000c480 tx=0x7f91d000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:23.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.827+0000 7f91d67fc640 1 -- 172.21.15.40:0/2834476278 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d0018070 con 0x7f91d80d0ca0 2024-04-22T07:25:23.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.827+0000 7f91d67fc640 1 -- 172.21.15.40:0/2834476278 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91d0007500 con 0x7f91d80d0ca0 2024-04-22T07:25:23.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.827+0000 7f91dfef1640 1 -- 172.21.15.40:0/2834476278 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91d8144ce0 con 0x7f91d80d0ca0 2024-04-22T07:25:23.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.827+0000 7f91d67fc640 1 -- 172.21.15.40:0/2834476278 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d0004a20 con 0x7f91d80d0ca0 2024-04-22T07:25:23.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.827+0000 7f91dfef1640 1 -- 172.21.15.40:0/2834476278 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91d80c8a60 con 0x7f91d80d0ca0 2024-04-22T07:25:23.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.828+0000 7f91dfef1640 1 -- 172.21.15.40:0/2834476278 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91d804fdc0 con 0x7f91d80d0ca0 2024-04-22T07:25:23.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.828+0000 7f91d67fc640 1 -- 172.21.15.40:0/2834476278 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f91d001b070 con 0x7f91d80d0ca0 2024-04-22T07:25:23.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.829+0000 7f91d67fc640 1 --2- 172.21.15.40:0/2834476278 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f91c406c8f0 0x7f91c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:23.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.829+0000 7f91d67fc640 1 -- 172.21.15.40:0/2834476278 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f91d008ae80 con 0x7f91d80d0ca0 2024-04-22T07:25:23.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.829+0000 7f91ddc8d640 1 --2- 172.21.15.40:0/2834476278 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f91c406c8f0 0x7f91c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:23.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.829+0000 7f91ddc8d640 1 --2- 172.21.15.40:0/2834476278 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f91c406c8f0 0x7f91c406edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f91c8036000 tx=0x7f91c8030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:23.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:23.833+0000 7f91d67fc640 1 -- 172.21.15.40:0/2834476278 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f91d0059290 con 0x7f91d80d0ca0 2024-04-22T07:25:24.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.023+0000 7f91dfef1640 1 -- 172.21.15.40:0/2834476278 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f91d80cb4d0 con 0x7f91d80d0ca0 2024-04-22T07:25:24.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.027+0000 7f91d67fc640 1 -- 172.21.15.40:0/2834476278 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f91d0058b90 con 0x7f91d80d0ca0 2024-04-22T07:25:24.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.027+0000 7f91d67fc640 1 -- 172.21.15.40:0/2834476278 <== mon.0 v2:172.21.15.40:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f91d005cf40 con 0x7f91d80d0ca0 2024-04-22T07:25:24.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.029+0000 7f91dfef1640 1 -- 172.21.15.40:0/2834476278 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f91c406c8f0 msgr2=0x7f91c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:24.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.029+0000 7f91dfef1640 1 --2- 172.21.15.40:0/2834476278 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f91c406c8f0 0x7f91c406edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f91c8036000 tx=0x7f91c8030000 comp rx=0 tx=0).stop 2024-04-22T07:25:24.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.029+0000 7f91dfef1640 1 -- 172.21.15.40:0/2834476278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91d80d0ca0 msgr2=0x7f91d8153c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:24.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.029+0000 7f91dfef1640 1 --2- 172.21.15.40:0/2834476278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91d80d0ca0 0x7f91d8153c80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f91d000c480 tx=0x7f91d000c940 comp rx=0 tx=0).stop 2024-04-22T07:25:24.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.029+0000 7f91dfef1640 1 -- 172.21.15.40:0/2834476278 shutdown_connections 2024-04-22T07:25:24.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.029+0000 7f91dfef1640 1 --2- 172.21.15.40:0/2834476278 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f91c406c8f0 0x7f91c406edb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.029+0000 7f91dfef1640 1 --2- 172.21.15.40:0/2834476278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f91d80d0ca0 0x7f91d8153c80 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.029+0000 7f91dfef1640 1 --2- 172.21.15.40:0/2834476278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91d80d08c0 0x7f91d81f06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.029+0000 7f91dfef1640 1 --2- 172.21.15.40:0/2834476278 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91d80cd380 0x7f91d81f47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.029+0000 7f91dfef1640 1 -- 172.21.15.40:0/2834476278 >> 172.21.15.40:0/2834476278 conn(0x7f91d806ce70 msgr2=0x7f91d815a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:25:24.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.029+0000 7f91dfef1640 1 -- 172.21.15.40:0/2834476278 shutdown_connections 2024-04-22T07:25:24.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.029+0000 7f91dfef1640 1 -- 172.21.15.40:0/2834476278 wait complete. 2024-04-22T07:25:24.038 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-22T07:25:24.038 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:25:24.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.142+0000 7f4f09c06640 1 Processor -- start 2024-04-22T07:25:24.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.142+0000 7f4f09c06640 1 -- start start 2024-04-22T07:25:24.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.143+0000 7f4f09c06640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f0415ece0 0x7f4f040cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:24.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.143+0000 7f4f09c06640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4f0415f0c0 0x7f4f040cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:24.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.143+0000 7f4f09c06640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4f040c53d0 0x7f4f040cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:24.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.143+0000 7f4f09c06640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f4f040caa90 con 0x7f4f040c53d0 2024-04-22T07:25:24.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.143+0000 7f4f09c06640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f4f040c9940 con 0x7f4f0415f0c0 2024-04-22T07:25:24.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.143+0000 7f4f09c06640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f4f040c9c20 con 0x7f4f0415ece0 2024-04-22T07:25:24.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.143+0000 7f4f03fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4f040c53d0 0x7f4f040cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:24.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.143+0000 7f4f03fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4f040c53d0 0x7f4f040cefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40468/0 (socket says 172.21.15.40:40468) 2024-04-22T07:25:24.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.143+0000 7f4f03fff640 1 -- 172.21.15.40:0/2130227723 learned_addr learned my addr 172.21.15.40:0/2130227723 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:25:24.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.143+0000 7f4f02ffd640 1 --2- 172.21.15.40:0/2130227723 >> v2:172.21.15.62:3300/0 conn(0x7f4f0415f0c0 0x7f4f040cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:24.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.143+0000 7f4f037fe640 1 --2- 172.21.15.40:0/2130227723 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f0415ece0 0x7f4f040cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:24.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.143+0000 7f4f03fff640 1 -- 172.21.15.40:0/2130227723 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f0415ece0 msgr2=0x7f4f040cd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:25:24.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.143+0000 7f4f03fff640 1 --2- 172.21.15.40:0/2130227723 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f0415ece0 0x7f4f040cd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.143+0000 7f4f03fff640 1 -- 172.21.15.40:0/2130227723 >> v2:172.21.15.62:3300/0 conn(0x7f4f0415f0c0 msgr2=0x7f4f040cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:25:24.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.143+0000 7f4f03fff640 1 --2- 172.21.15.40:0/2130227723 >> v2:172.21.15.62:3300/0 conn(0x7f4f0415f0c0 0x7f4f040cea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.143+0000 7f4f03fff640 1 -- 172.21.15.40:0/2130227723 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f040c9f00 con 0x7f4f040c53d0 2024-04-22T07:25:24.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.143+0000 7f4f02ffd640 1 --2- 172.21.15.40:0/2130227723 >> v2:172.21.15.62:3300/0 conn(0x7f4f0415f0c0 0x7f4f040cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:25:24.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.144+0000 7f4f03fff640 1 --2- 172.21.15.40:0/2130227723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f040c53d0 0x7f4f040cefc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4f040cf5c0 tx=0x7f4efc02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32f6c46701fd2cf server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:24.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.144+0000 7f4f027fc640 1 -- 172.21.15.40:0/2130227723 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4efc02cb00 con 0x7f4f040c53d0 2024-04-22T07:25:24.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.144+0000 7f4f027fc640 1 -- 172.21.15.40:0/2130227723 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4efc02cca0 con 0x7f4f040c53d0 2024-04-22T07:25:24.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.144+0000 7f4f027fc640 1 -- 172.21.15.40:0/2130227723 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4efc034630 con 0x7f4f040c53d0 2024-04-22T07:25:24.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.145+0000 7f4f09c06640 1 -- 172.21.15.40:0/2130227723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f040c53d0 msgr2=0x7f4f040cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:24.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.145+0000 7f4f09c06640 1 --2- 172.21.15.40:0/2130227723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f040c53d0 0x7f4f040cefc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4f040cf5c0 tx=0x7f4efc02bf60 comp rx=0 tx=0).stop 2024-04-22T07:25:24.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.145+0000 7f4f09c06640 1 -- 172.21.15.40:0/2130227723 shutdown_connections 2024-04-22T07:25:24.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.145+0000 7f4f09c06640 1 --2- 172.21.15.40:0/2130227723 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f040c53d0 0x7f4f040cefc0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.145+0000 7f4f09c06640 1 --2- 172.21.15.40:0/2130227723 >> v2:172.21.15.62:3300/0 conn(0x7f4f0415f0c0 0x7f4f040cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.145+0000 7f4f09c06640 1 --2- 172.21.15.40:0/2130227723 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f0415ece0 0x7f4f040cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.145+0000 7f4f09c06640 1 -- 172.21.15.40:0/2130227723 >> 172.21.15.40:0/2130227723 conn(0x7f4f0406df50 msgr2=0x7f4f0406e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:25:24.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.145+0000 7f4f09c06640 1 -- 172.21.15.40:0/2130227723 shutdown_connections 2024-04-22T07:25:24.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.145+0000 7f4f09c06640 1 -- 172.21.15.40:0/2130227723 wait complete. 2024-04-22T07:25:24.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.146+0000 7f4f09c06640 1 Processor -- start 2024-04-22T07:25:24.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.146+0000 7f4f09c06640 1 -- start start 2024-04-22T07:25:24.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.147+0000 7f4f09c06640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f040c53d0 0x7f4f040b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:24.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.147+0000 7f4f09c06640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f0415ece0 0x7f4f04150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:24.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.147+0000 7f4f09c06640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f0415f0c0 0x7f4f041f4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:24.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.147+0000 7f4f09c06640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4f0415e570 con 0x7f4f040c53d0 2024-04-22T07:25:24.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.147+0000 7f4f09c06640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4f0415e3f0 con 0x7f4f0415f0c0 2024-04-22T07:25:24.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.147+0000 7f4f09c06640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f4f040c8fe0 con 0x7f4f0415ece0 2024-04-22T07:25:24.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.147+0000 7f4f037fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f040c53d0 0x7f4f040b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.147+0000 7f4f037fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f040c53d0 0x7f4f040b2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40470/0 (socket says 172.21.15.40:40470) 2024-04-22T07:25:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.147+0000 7f4f037fe640 1 -- 172.21.15.40:0/3680471898 learned_addr learned my addr 172.21.15.40:0/3680471898 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:25:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.147+0000 7f4f02ffd640 1 --2- 172.21.15.40:0/3680471898 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f0415ece0 0x7f4f04150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.147+0000 7f4f03fff640 1 --2- 172.21.15.40:0/3680471898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f0415f0c0 0x7f4f041f4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.148+0000 7f4f037fe640 1 -- 172.21.15.40:0/3680471898 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f0415ece0 msgr2=0x7f4f04150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.148+0000 7f4f037fe640 1 --2- 172.21.15.40:0/3680471898 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f0415ece0 0x7f4f04150c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.148+0000 7f4f037fe640 1 -- 172.21.15.40:0/3680471898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f0415f0c0 msgr2=0x7f4f041f4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.148+0000 7f4f037fe640 1 --2- 172.21.15.40:0/3680471898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f0415f0c0 0x7f4f041f4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.148+0000 7f4f037fe640 1 -- 172.21.15.40:0/3680471898 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f041f1640 con 0x7f4f040c53d0 2024-04-22T07:25:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.148+0000 7f4f037fe640 1 --2- 172.21.15.40:0/3680471898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f040c53d0 0x7f4f040b2d90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4ef400e890 tx=0x7f4ef400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.148+0000 7f4eebfff640 1 -- 172.21.15.40:0/3680471898 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef4017070 con 0x7f4f040c53d0 2024-04-22T07:25:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.148+0000 7f4eebfff640 1 -- 172.21.15.40:0/3680471898 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4ef400c940 con 0x7f4f040c53d0 2024-04-22T07:25:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.148+0000 7f4f09c06640 1 -- 172.21.15.40:0/3680471898 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f04151910 con 0x7f4f040c53d0 2024-04-22T07:25:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.148+0000 7f4eebfff640 1 -- 172.21.15.40:0/3680471898 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef400cd30 con 0x7f4f040c53d0 2024-04-22T07:25:24.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.148+0000 7f4f09c06640 1 -- 172.21.15.40:0/3680471898 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f04151bb0 con 0x7f4f040c53d0 2024-04-22T07:25:24.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.149+0000 7f4f09c06640 1 -- 172.21.15.40:0/3680471898 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f04151df0 con 0x7f4f040c53d0 2024-04-22T07:25:24.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.149+0000 7f4eebfff640 1 -- 172.21.15.40:0/3680471898 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4ef401a070 con 0x7f4f040c53d0 2024-04-22T07:25:24.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.150+0000 7f4eebfff640 1 --2- 172.21.15.40:0/3680471898 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f4ef006c920 0x7f4ef006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:24.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.150+0000 7f4eebfff640 1 -- 172.21.15.40:0/3680471898 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7f4ef408ba80 con 0x7f4f040c53d0 2024-04-22T07:25:24.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.150+0000 7f4f02ffd640 1 --2- 172.21.15.40:0/3680471898 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f4ef006c920 0x7f4ef006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:24.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.150+0000 7f4f02ffd640 1 --2- 172.21.15.40:0/3680471898 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f4ef006c920 0x7f4ef006ede0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4f041541a0 tx=0x7f4ef8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:24.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.154+0000 7f4eebfff640 1 -- 172.21.15.40:0/3680471898 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4ef4059840 con 0x7f4f040c53d0 2024-04-22T07:25:24.189 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:25:24.191 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:25:24.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.378+0000 7f4f09c06640 1 -- 172.21.15.40:0/3680471898 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f04069d40 con 0x7f4f040c53d0 2024-04-22T07:25:24.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.379+0000 7f4eebfff640 1 -- 172.21.15.40:0/3680471898 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6821 (secure 0 0 0) 0x7f4ef405db40 con 0x7f4f040c53d0 2024-04-22T07:25:24.376 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:25:24.377 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1193926607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1193926607},{"type":"v1","addr":"172.21.15.62:6835","nonce":1193926607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/602167189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":602167189},{"type":"v1","addr":"172.21.15.62:6837","nonce":602167189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2062933254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2062933254},{"type":"v1","addr":"172.21.15.40:6835","nonce":2062933254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3873524978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3873524978},{"type":"v1","addr":"172.21.15.40:6837","nonce":3873524978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/1922761385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":1922761385},{"type":"v1","addr":"172.21.15.40:6839","nonce":1922761385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:20:53.216204+0000","modified":"2024-04-22T07:20:58.875393+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.62:6836/2884673656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2884673656},{"type":"v1","addr":"172.21.15.62:6836","nonce":2884673656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4305]},"id":1}]} 2024-04-22T07:25:24.377 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-04-22T07:25:24.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.380+0000 7f4f09c06640 1 -- 172.21.15.40:0/3680471898 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f4ef006c920 msgr2=0x7f4ef006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:24.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.380+0000 7f4f09c06640 1 --2- 172.21.15.40:0/3680471898 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f4ef006c920 0x7f4ef006ede0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4f041541a0 tx=0x7f4ef8008040 comp rx=0 tx=0).stop 2024-04-22T07:25:24.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.380+0000 7f4f09c06640 1 -- 172.21.15.40:0/3680471898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f040c53d0 msgr2=0x7f4f040b2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:24.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.380+0000 7f4f09c06640 1 --2- 172.21.15.40:0/3680471898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f040c53d0 0x7f4f040b2d90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4ef400e890 tx=0x7f4ef400ed50 comp rx=0 tx=0).stop 2024-04-22T07:25:24.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.380+0000 7f4f09c06640 1 -- 172.21.15.40:0/3680471898 shutdown_connections 2024-04-22T07:25:24.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.380+0000 7f4f09c06640 1 --2- 172.21.15.40:0/3680471898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f0415f0c0 0x7f4f041f4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.380+0000 7f4f09c06640 1 --2- 172.21.15.40:0/3680471898 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4f0415ece0 0x7f4f04150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.380+0000 7f4f09c06640 1 --2- 172.21.15.40:0/3680471898 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f4ef006c920 0x7f4ef006ede0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.380+0000 7f4f09c06640 1 --2- 172.21.15.40:0/3680471898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f040c53d0 0x7f4f040b2d90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.380+0000 7f4f09c06640 1 -- 172.21.15.40:0/3680471898 >> 172.21.15.40:0/3680471898 conn(0x7f4f0406df50 msgr2=0x7f4f040c45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:25:24.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.381+0000 7f4f09c06640 1 -- 172.21.15.40:0/3680471898 shutdown_connections 2024-04-22T07:25:24.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.381+0000 7f4f09c06640 1 -- 172.21.15.40:0/3680471898 wait complete. 2024-04-22T07:25:24.390 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-22T07:25:24.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.492+0000 7febb568c640 1 Processor -- start 2024-04-22T07:25:24.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.492+0000 7febb568c640 1 -- start start 2024-04-22T07:25:24.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.493+0000 7febb568c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7febb00c4920 0x7febb006f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:24.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.493+0000 7febb568c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7febb00c9050 0x7febb006fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:24.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.493+0000 7febb568c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febb00ca1b0 con 0x7febb0152fb0 2024-04-22T07:25:24.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.493+0000 7febb568c640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7febb00ca490 con 0x7febb00c9050 2024-04-22T07:25:24.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.493+0000 7febb568c640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7febb00ca770 con 0x7febb00c4920 2024-04-22T07:25:24.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.493+0000 7febaeffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7febb0152fb0 0x7febb00c3600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37552/0 (socket says 172.21.15.40:37552) 2024-04-22T07:25:24.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.493+0000 7febaeffd640 1 -- 172.21.15.40:0/1712026026 learned_addr learned my addr 172.21.15.40:0/1712026026 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:25:24.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.494+0000 7febadffb640 1 -- 172.21.15.40:0/1712026026 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2541775607 0 0) 0x7febb00ca1b0 con 0x7febb0152fb0 2024-04-22T07:25:24.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.494+0000 7febaf7fe640 1 --2- 172.21.15.40:0/1712026026 >> v2:172.21.15.62:3300/0 conn(0x7febb00c9050 0x7febb006fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:24.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.494+0000 7febadffb640 1 -- 172.21.15.40:0/1712026026 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb9c003520 con 0x7febb0152fb0 2024-04-22T07:25:24.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.494+0000 7febae7fc640 1 --2- 172.21.15.40:0/1712026026 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7febb00c4920 0x7febb006f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:24.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.494+0000 7febadffb640 1 -- 172.21.15.40:0/1712026026 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3157488352 0 0) 0x7feb9c003520 con 0x7febb0152fb0 2024-04-22T07:25:24.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.494+0000 7febadffb640 1 -- 172.21.15.40:0/1712026026 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7febb00c4920 msgr2=0x7febb006f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:25:24.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.494+0000 7febadffb640 1 --2- 172.21.15.40:0/1712026026 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7febb00c4920 0x7febb006f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.494+0000 7febadffb640 1 -- 172.21.15.40:0/1712026026 >> v2:172.21.15.62:3300/0 conn(0x7febb00c9050 msgr2=0x7febb006fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:25:24.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.494+0000 7febadffb640 1 --2- 172.21.15.40:0/1712026026 >> v2:172.21.15.62:3300/0 conn(0x7febb00c9050 0x7febb006fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.494+0000 7febadffb640 1 -- 172.21.15.40:0/1712026026 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb00caa50 con 0x7febb0152fb0 2024-04-22T07:25:24.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.494+0000 7febadffb640 1 -- 172.21.15.40:0/1712026026 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7feba8001670 con 0x7febb0152fb0 2024-04-22T07:25:24.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.494+0000 7febadffb640 1 -- 172.21.15.40:0/1712026026 >> v1:172.21.15.40:6789/0 conn(0x7febb0152fb0 legacy=0x7febb00c3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:24.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.494+0000 7febadffb640 1 --2- 172.21.15.40:0/1712026026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb9c0039b0 0x7feb9c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:24.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.494+0000 7febadffb640 1 --2- 172.21.15.40:0/1712026026 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7febb00c4920 0x7feb9c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:24.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.494+0000 7febadffb640 1 --2- 172.21.15.40:0/1712026026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb9c004d40 0x7feb9c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:24.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.494+0000 7febadffb640 1 -- 172.21.15.40:0/1712026026 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7febb00ca490 con 0x7feb9c0039b0 2024-04-22T07:25:24.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.494+0000 7febadffb640 1 -- 172.21.15.40:0/1712026026 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7febb00ca770 con 0x7feb9c004d40 2024-04-22T07:25:24.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.494+0000 7febadffb640 1 -- 172.21.15.40:0/1712026026 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7feb9c00b9f0 con 0x7febb00c4920 2024-04-22T07:25:24.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.494+0000 7febaeffd640 1 --2- 172.21.15.40:0/1712026026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb9c0039b0 0x7feb9c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:24.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.494+0000 7febaf7fe640 1 --2- 172.21.15.40:0/1712026026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb9c004d40 0x7feb9c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:24.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.494+0000 7febae7fc640 1 --2- 172.21.15.40:0/1712026026 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7febb00c4920 0x7feb9c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:24.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.494+0000 7febaeffd640 1 -- 172.21.15.40:0/1712026026 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7febb00c4920 msgr2=0x7feb9c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:25:24.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.494+0000 7febaeffd640 1 --2- 172.21.15.40:0/1712026026 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7febb00c4920 0x7feb9c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.494+0000 7febaeffd640 1 -- 172.21.15.40:0/1712026026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb9c004d40 msgr2=0x7feb9c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:25:24.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.494+0000 7febaeffd640 1 --2- 172.21.15.40:0/1712026026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb9c004d40 0x7feb9c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.494+0000 7febaeffd640 1 -- 172.21.15.40:0/1712026026 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb9c003520 con 0x7feb9c0039b0 2024-04-22T07:25:24.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.494+0000 7febaf7fe640 1 --2- 172.21.15.40:0/1712026026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb9c004d40 0x7feb9c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:25:24.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.495+0000 7febaeffd640 1 --2- 172.21.15.40:0/1712026026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb9c0039b0 0x7feb9c003dd0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7feba800c290 tx=0x7feb9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437bd5796009ebcb server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:24.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.495+0000 7febadffb640 1 -- 172.21.15.40:0/1712026026 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba8007d50 con 0x7feb9c0039b0 2024-04-22T07:25:24.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.495+0000 7febadffb640 1 -- 172.21.15.40:0/1712026026 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7feba8030070 con 0x7feb9c0039b0 2024-04-22T07:25:24.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.495+0000 7febadffb640 1 -- 172.21.15.40:0/1712026026 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba802cda0 con 0x7feb9c0039b0 2024-04-22T07:25:24.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.496+0000 7febb568c640 1 -- 172.21.15.40:0/1712026026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb9c0039b0 msgr2=0x7feb9c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:24.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.496+0000 7febb568c640 1 --2- 172.21.15.40:0/1712026026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb9c0039b0 0x7feb9c003dd0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7feba800c290 tx=0x7feb9c005830 comp rx=0 tx=0).stop 2024-04-22T07:25:24.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.496+0000 7febaf7fe640 1 -- 172.21.15.40:0/1712026026 reap_dead start 2024-04-22T07:25:24.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.496+0000 7febb568c640 1 -- 172.21.15.40:0/1712026026 shutdown_connections 2024-04-22T07:25:24.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.496+0000 7febb568c640 1 -- 172.21.15.40:0/1712026026 >> 172.21.15.40:0/1712026026 conn(0x7febb006dd10 msgr2=0x7febb006e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:25:24.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.496+0000 7febb568c640 1 -- 172.21.15.40:0/1712026026 shutdown_connections 2024-04-22T07:25:24.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.496+0000 7febb568c640 1 -- 172.21.15.40:0/1712026026 wait complete. 2024-04-22T07:25:24.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.497+0000 7febb568c640 1 Processor -- start 2024-04-22T07:25:24.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.497+0000 7febb568c640 1 -- start start 2024-04-22T07:25:24.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.498+0000 7febb568c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feb9c0039b0 0x7febb01e3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:24.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.498+0000 7febb568c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febb0145f20 0x7febb006bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:24.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.498+0000 7febb568c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febb006c4b0 0x7febb01400f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:24.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.498+0000 7febb568c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7febb006f890 con 0x7febb006c4b0 2024-04-22T07:25:24.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.498+0000 7febb568c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7febb0158b50 con 0x7febb0145f20 2024-04-22T07:25:24.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.498+0000 7febb568c640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7febb006fa10 con 0x7feb9c0039b0 2024-04-22T07:25:24.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.498+0000 7febaf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febb006c4b0 0x7febb01400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:24.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.498+0000 7febaf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febb006c4b0 0x7febb01400f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40496/0 (socket says 172.21.15.40:40496) 2024-04-22T07:25:24.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.498+0000 7febaf7fe640 1 -- 172.21.15.40:0/3110373235 learned_addr learned my addr 172.21.15.40:0/3110373235 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:25:24.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.498+0000 7febaeffd640 1 --2- 172.21.15.40:0/3110373235 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feb9c0039b0 0x7febb01e3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:24.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.498+0000 7febae7fc640 1 --2- 172.21.15.40:0/3110373235 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febb0145f20 0x7febb006bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:24.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.498+0000 7febaf7fe640 1 -- 172.21.15.40:0/3110373235 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feb9c0039b0 msgr2=0x7febb01e3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:24.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.498+0000 7febaf7fe640 1 --2- 172.21.15.40:0/3110373235 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feb9c0039b0 0x7febb01e3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.498+0000 7febaf7fe640 1 -- 172.21.15.40:0/3110373235 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febb0145f20 msgr2=0x7febb006bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:24.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.498+0000 7febaf7fe640 1 --2- 172.21.15.40:0/3110373235 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febb0145f20 0x7febb006bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.498+0000 7febaf7fe640 1 -- 172.21.15.40:0/3110373235 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb01f12e0 con 0x7febb006c4b0 2024-04-22T07:25:24.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.498+0000 7febaf7fe640 1 --2- 172.21.15.40:0/3110373235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febb006c4b0 0x7febb01400f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7febb00cb040 tx=0x7feba0010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:24.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.499+0000 7feba77fe640 1 -- 172.21.15.40:0/3110373235 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba001a030 con 0x7febb006c4b0 2024-04-22T07:25:24.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.499+0000 7feba77fe640 1 -- 172.21.15.40:0/3110373235 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7feba0010d80 con 0x7febb006c4b0 2024-04-22T07:25:24.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.499+0000 7febb568c640 1 -- 172.21.15.40:0/3110373235 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb00b3dc0 con 0x7febb006c4b0 2024-04-22T07:25:24.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.499+0000 7feba77fe640 1 -- 172.21.15.40:0/3110373235 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba0003bf0 con 0x7febb006c4b0 2024-04-22T07:25:24.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.499+0000 7febb568c640 1 -- 172.21.15.40:0/3110373235 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febb01f1560 con 0x7febb006c4b0 2024-04-22T07:25:24.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.500+0000 7febb568c640 1 -- 172.21.15.40:0/3110373235 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febb0068b20 con 0x7febb006c4b0 2024-04-22T07:25:24.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.500+0000 7feba77fe640 1 -- 172.21.15.40:0/3110373235 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feba001d070 con 0x7febb006c4b0 2024-04-22T07:25:24.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.501+0000 7feba77fe640 1 --2- 172.21.15.40:0/3110373235 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7feb9006c8f0 0x7feb9006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:24.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.501+0000 7feba77fe640 1 -- 172.21.15.40:0/3110373235 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7feba008c1d0 con 0x7febb006c4b0 2024-04-22T07:25:24.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.501+0000 7febaeffd640 1 --2- 172.21.15.40:0/3110373235 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7feb9006c8f0 0x7feb9006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:24.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.501+0000 7febaeffd640 1 --2- 172.21.15.40:0/3110373235 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7feb9006c8f0 0x7feb9006edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7feba8034000 tx=0x7feba8007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:24.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.505+0000 7feba77fe640 1 -- 172.21.15.40:0/3110373235 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7febb01f12e0 con 0x7febb006c4b0 2024-04-22T07:25:24.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.729+0000 7febb568c640 1 -- 172.21.15.40:0/3110373235 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7febb00c9770 con 0x7febb006c4b0 2024-04-22T07:25:24.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.730+0000 7feba77fe640 1 -- 172.21.15.40:0/3110373235 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6821 (secure 0 0 0) 0x7feba005a5e0 con 0x7febb006c4b0 2024-04-22T07:25:24.728 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:25:24.728 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1193926607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1193926607},{"type":"v1","addr":"172.21.15.62:6835","nonce":1193926607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6837/602167189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":602167189},{"type":"v1","addr":"172.21.15.62:6837","nonce":602167189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2062933254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2062933254},{"type":"v1","addr":"172.21.15.40:6835","nonce":2062933254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3873524978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3873524978},{"type":"v1","addr":"172.21.15.40:6837","nonce":3873524978}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6839/1922761385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6838","nonce":1922761385},{"type":"v1","addr":"172.21.15.40:6839","nonce":1922761385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-22T07:20:53.216204+0000","modified":"2024-04-22T07:20:58.875393+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.62:6836/2884673656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2884673656},{"type":"v1","addr":"172.21.15.62:6836","nonce":2884673656}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4305]},"id":1}]} 2024-04-22T07:25:24.728 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-04-22T07:25:24.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.732+0000 7febb568c640 1 -- 172.21.15.40:0/3110373235 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7feb9006c8f0 msgr2=0x7feb9006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:24.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.732+0000 7febb568c640 1 --2- 172.21.15.40:0/3110373235 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7feb9006c8f0 0x7feb9006edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7feba8034000 tx=0x7feba8007000 comp rx=0 tx=0).stop 2024-04-22T07:25:24.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.732+0000 7febb568c640 1 -- 172.21.15.40:0/3110373235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febb006c4b0 msgr2=0x7febb01400f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:24.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.732+0000 7febb568c640 1 --2- 172.21.15.40:0/3110373235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febb006c4b0 0x7febb01400f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7febb00cb040 tx=0x7feba0010590 comp rx=0 tx=0).stop 2024-04-22T07:25:24.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.732+0000 7febb568c640 1 -- 172.21.15.40:0/3110373235 shutdown_connections 2024-04-22T07:25:24.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.732+0000 7febb568c640 1 --2- 172.21.15.40:0/3110373235 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7feb9006c8f0 0x7feb9006edb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.732+0000 7febb568c640 1 --2- 172.21.15.40:0/3110373235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febb006c4b0 0x7febb01400f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.732+0000 7febb568c640 1 --2- 172.21.15.40:0/3110373235 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febb0145f20 0x7febb006bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.732+0000 7febb568c640 1 --2- 172.21.15.40:0/3110373235 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feb9c0039b0 0x7febb01e3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.732+0000 7febb568c640 1 -- 172.21.15.40:0/3110373235 >> 172.21.15.40:0/3110373235 conn(0x7febb006dd10 msgr2=0x7febb01e44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:25:24.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.732+0000 7febb568c640 1 -- 172.21.15.40:0/3110373235 shutdown_connections 2024-04-22T07:25:24.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.732+0000 7febb568c640 1 -- 172.21.15.40:0/3110373235 wait complete. 2024-04-22T07:25:24.741 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-22T07:25:24.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.844+0000 7ff7ff1e2640 1 Processor -- start 2024-04-22T07:25:24.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.844+0000 7ff7ff1e2640 1 -- start start 2024-04-22T07:25:24.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.845+0000 7ff7ff1e2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff7f815bae0 0x7ff7f80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:24.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.845+0000 7ff7ff1e2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff7f80cbc30 0x7ff7f80b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:24.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.845+0000 7ff7ff1e2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7f815e410 con 0x7ff7f81551a0 2024-04-22T07:25:24.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.845+0000 7ff7ff1e2640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7ff7f80cc040 con 0x7ff7f80cbc30 2024-04-22T07:25:24.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.845+0000 7ff7ff1e2640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7ff7f8155580 con 0x7ff7f815bae0 2024-04-22T07:25:24.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.845+0000 7ff7fd77f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff7f80cbc30 0x7ff7f80b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:24.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.845+0000 7ff7fd77f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff7f80cbc30 0x7ff7f80b4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40500/0 (socket says 172.21.15.40:40500) 2024-04-22T07:25:24.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.845+0000 7ff7fd77f640 1 -- 172.21.15.40:0/892016890 learned_addr learned my addr 172.21.15.40:0/892016890 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:25:24.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.845+0000 7ff7f7fff640 1 --2- 172.21.15.40:0/892016890 >> v2:172.21.15.62:3300/0 conn(0x7ff7f815bae0 0x7ff7f80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:24.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.845+0000 7ff7fd77f640 1 -- 172.21.15.40:0/892016890 >> v2:172.21.15.62:3300/0 conn(0x7ff7f815bae0 msgr2=0x7ff7f80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:25:24.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.845+0000 7ff7fd77f640 1 --2- 172.21.15.40:0/892016890 >> v2:172.21.15.62:3300/0 conn(0x7ff7f815bae0 0x7ff7f80cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.845+0000 7ff7fd77f640 1 -- 172.21.15.40:0/892016890 >> v1:172.21.15.62:6789/0 conn(0x7ff7f81551a0 legacy=0x7ff7f80cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:25:24.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.845+0000 7ff7fd77f640 1 -- 172.21.15.40:0/892016890 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f815e6b0 con 0x7ff7f80cbc30 2024-04-22T07:25:24.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.845+0000 7ff7f7fff640 1 --2- 172.21.15.40:0/892016890 >> v2:172.21.15.62:3300/0 conn(0x7ff7f815bae0 0x7ff7f80cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:25:24.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.846+0000 7ff7fd77f640 1 --2- 172.21.15.40:0/892016890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7f80cbc30 0x7ff7f80b4ba0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8067f10 tx=0x7ff7f002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4a22aad32ceaab server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:24.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.846+0000 7ff7f77fe640 1 -- 172.21.15.40:0/892016890 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f002ca80 con 0x7ff7f80cbc30 2024-04-22T07:25:24.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.846+0000 7ff7f77fe640 1 -- 172.21.15.40:0/892016890 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff7f002cc20 con 0x7ff7f80cbc30 2024-04-22T07:25:24.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.846+0000 7ff7f77fe640 1 -- 172.21.15.40:0/892016890 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f00343f0 con 0x7ff7f80cbc30 2024-04-22T07:25:24.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.847+0000 7ff7ff1e2640 1 -- 172.21.15.40:0/892016890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7f80cbc30 msgr2=0x7ff7f80b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:24.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.847+0000 7ff7ff1e2640 1 --2- 172.21.15.40:0/892016890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7f80cbc30 0x7ff7f80b4ba0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8067f10 tx=0x7ff7f002bee0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.847+0000 7ff7ff1e2640 1 -- 172.21.15.40:0/892016890 shutdown_connections 2024-04-22T07:25:24.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.847+0000 7ff7ff1e2640 1 --2- 172.21.15.40:0/892016890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7f80cbc30 0x7ff7f80b4ba0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.847+0000 7ff7ff1e2640 1 --2- 172.21.15.40:0/892016890 >> v2:172.21.15.62:3300/0 conn(0x7ff7f815bae0 0x7ff7f80cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.847+0000 7ff7ff1e2640 1 -- 172.21.15.40:0/892016890 >> 172.21.15.40:0/892016890 conn(0x7ff7f80678c0 msgr2=0x7ff7f8072860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:25:24.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.847+0000 7ff7ff1e2640 1 -- 172.21.15.40:0/892016890 shutdown_connections 2024-04-22T07:25:24.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.847+0000 7ff7ff1e2640 1 -- 172.21.15.40:0/892016890 wait complete. 2024-04-22T07:25:24.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.848+0000 7ff7ff1e2640 1 Processor -- start 2024-04-22T07:25:24.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.848+0000 7ff7ff1e2640 1 -- start start 2024-04-22T07:25:24.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.849+0000 7ff7ff1e2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7f80cbc30 0x7ff7f81557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:24.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.849+0000 7ff7ff1e2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7f81551a0 0x7ff7f8151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:24.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.849+0000 7ff7ff1e2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7f815bae0 0x7ff7f81f3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:24.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.849+0000 7ff7ff1e2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f815ef50 con 0x7ff7f81551a0 2024-04-22T07:25:24.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.849+0000 7ff7ff1e2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f815ec70 con 0x7ff7f815bae0 2024-04-22T07:25:24.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.849+0000 7ff7ff1e2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ff7f815f230 con 0x7ff7f80cbc30 2024-04-22T07:25:24.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.849+0000 7ff7f7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7f81551a0 0x7ff7f8151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:24.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.849+0000 7ff7f7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7f81551a0 0x7ff7f8151270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40502/0 (socket says 172.21.15.40:40502) 2024-04-22T07:25:24.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.849+0000 7ff7f7fff640 1 -- 172.21.15.40:0/130246750 learned_addr learned my addr 172.21.15.40:0/130246750 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:25:24.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.849+0000 7ff7fd77f640 1 --2- 172.21.15.40:0/130246750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7f815bae0 0x7ff7f81f3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:24.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.849+0000 7ff7fcf7e640 1 --2- 172.21.15.40:0/130246750 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7f80cbc30 0x7ff7f81557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:24.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.849+0000 7ff7f7fff640 1 -- 172.21.15.40:0/130246750 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7f80cbc30 msgr2=0x7ff7f81557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:24.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.849+0000 7ff7f7fff640 1 --2- 172.21.15.40:0/130246750 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7f80cbc30 0x7ff7f81557b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.849+0000 7ff7f7fff640 1 -- 172.21.15.40:0/130246750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7f815bae0 msgr2=0x7ff7f81f3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:24.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.849+0000 7ff7f7fff640 1 --2- 172.21.15.40:0/130246750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7f815bae0 0x7ff7f81f3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:24.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.849+0000 7ff7f7fff640 1 -- 172.21.15.40:0/130246750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f8154370 con 0x7ff7f81551a0 2024-04-22T07:25:24.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.849+0000 7ff7fcf7e640 1 --2- 172.21.15.40:0/130246750 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7f80cbc30 0x7ff7f81557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:25:24.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.849+0000 7ff7f7fff640 1 --2- 172.21.15.40:0/130246750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7f81551a0 0x7ff7f8151270 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400c7f0 tx=0x7ff7e400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:24.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.849+0000 7ff7f57fa640 1 -- 172.21.15.40:0/130246750 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4015070 con 0x7ff7f81551a0 2024-04-22T07:25:24.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.850+0000 7ff7f57fa640 1 -- 172.21.15.40:0/130246750 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff7e4007a30 con 0x7ff7f81551a0 2024-04-22T07:25:24.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.850+0000 7ff7f57fa640 1 -- 172.21.15.40:0/130246750 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4007e20 con 0x7ff7f81551a0 2024-04-22T07:25:24.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.850+0000 7ff7ff1e2640 1 -- 172.21.15.40:0/130246750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7f8154610 con 0x7ff7f81551a0 2024-04-22T07:25:24.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.850+0000 7ff7ff1e2640 1 -- 172.21.15.40:0/130246750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7f8157770 con 0x7ff7f81551a0 2024-04-22T07:25:24.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.851+0000 7ff7ff1e2640 1 -- 172.21.15.40:0/130246750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7f80cba50 con 0x7ff7f81551a0 2024-04-22T07:25:24.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.851+0000 7ff7f57fa640 1 -- 172.21.15.40:0/130246750 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff7e4018070 con 0x7ff7f81551a0 2024-04-22T07:25:24.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.851+0000 7ff7f57fa640 1 --2- 172.21.15.40:0/130246750 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ff7dc06c920 0x7ff7dc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:24.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.852+0000 7ff7f57fa640 1 -- 172.21.15.40:0/130246750 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7ff7e408bb10 con 0x7ff7f81551a0 2024-04-22T07:25:24.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.852+0000 7ff7fcf7e640 1 --2- 172.21.15.40:0/130246750 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ff7dc06c920 0x7ff7dc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:24.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.852+0000 7ff7fcf7e640 1 --2- 172.21.15.40:0/130246750 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ff7dc06c920 0x7ff7dc06ede0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec003eb0 tx=0x7ff7ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:24.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:24.856+0000 7ff7f57fa640 1 -- 172.21.15.40:0/130246750 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff7f80cba50 con 0x7ff7f81551a0 2024-04-22T07:25:25.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.046+0000 7ff7ff1e2640 1 -- 172.21.15.40:0/130246750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff7f8069d40 con 0x7ff7f81551a0 2024-04-22T07:25:25.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.047+0000 7ff7f57fa640 1 -- 172.21.15.40:0/130246750 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16586 (secure 0 0 0) 0x7ff7e4059f20 con 0x7ff7f81551a0 2024-04-22T07:25:25.045 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-22T07:25:25.045 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"dd5b16e4-89fe-4602-b37f-062846793158","created":"2024-04-22T07:20:29.488892+0000","modified":"2024-04-22T07:21:34.978774+0000","last_up_change":"2024-04-22T07:20:40.397383+0000","last_in_change":"2024-04-22T07:20:31.702551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-22T07:20:41.793179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-22T07:20:51.815779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-22T07:20:52.164265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32238b7e-228b-4a67-bfca-16e8f0020a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6801","nonce":1526385055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6803","nonce":1526385055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6807","nonce":1526385055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1526385055},{"type":"v1","addr":"172.21.15.40:6805","nonce":1526385055}]},"public_addr":"172.21.15.40:6801/1526385055","cluster_addr":"172.21.15.40:6803/1526385055","heartbeat_back_addr":"172.21.15.40:6807/1526385055","heartbeat_front_addr":"172.21.15.40:6805/1526385055","state":["exists","up"]},{"osd":1,"uuid":"5ad8da43-39b1-4295-b4d1-0f1e1d06fc0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6809","nonce":623026645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6811","nonce":623026645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6815","nonce":623026645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":623026645},{"type":"v1","addr":"172.21.15.40:6813","nonce":623026645}]},"public_addr":"172.21.15.40:6809/623026645","cluster_addr":"172.21.15.40:6811/623026645","heartbeat_back_addr":"172.21.15.40:6815/623026645","heartbeat_front_addr":"172.21.15.40:6813/623026645","state":["exists","up"]},{"osd":2,"uuid":"7d2c6d50-719d-4232-ad47-f04dcf1a8bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6820","nonce":1885686505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6824","nonce":1885686505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6831","nonce":1885686505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":1885686505},{"type":"v1","addr":"172.21.15.40:6828","nonce":1885686505}]},"public_addr":"172.21.15.40:6820/1885686505","cluster_addr":"172.21.15.40:6824/1885686505","heartbeat_back_addr":"172.21.15.40:6831/1885686505","heartbeat_front_addr":"172.21.15.40:6828/1885686505","state":["exists","up"]},{"osd":3,"uuid":"af42e7d6-a6bf-403e-92e7-162d7c4fbf0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6817","nonce":130276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6819","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6821","nonce":130276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6827","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6829","nonce":130276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6823","nonce":130276746},{"type":"v1","addr":"172.21.15.40:6825","nonce":130276746}]},"public_addr":"172.21.15.40:6817/130276746","cluster_addr":"172.21.15.40:6821/130276746","heartbeat_back_addr":"172.21.15.40:6829/130276746","heartbeat_front_addr":"172.21.15.40:6825/130276746","state":["exists","up"]},{"osd":4,"uuid":"f8e89e0d-be96-4f19-88c0-69c408df7d98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6801","nonce":2251435758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6803","nonce":2251435758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6807","nonce":2251435758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2251435758},{"type":"v1","addr":"172.21.15.62:6805","nonce":2251435758}]},"public_addr":"172.21.15.62:6801/2251435758","cluster_addr":"172.21.15.62:6803/2251435758","heartbeat_back_addr":"172.21.15.62:6807/2251435758","heartbeat_front_addr":"172.21.15.62:6805/2251435758","state":["exists","up"]},{"osd":5,"uuid":"ba6dc1bc-272b-4f80-b55f-40bc4a0c3ff6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6809","nonce":3509322231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6811","nonce":3509322231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6815","nonce":3509322231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":3509322231},{"type":"v1","addr":"172.21.15.62:6813","nonce":3509322231}]},"public_addr":"172.21.15.62:6809/3509322231","cluster_addr":"172.21.15.62:6811/3509322231","heartbeat_back_addr":"172.21.15.62:6815/3509322231","heartbeat_front_addr":"172.21.15.62:6813/3509322231","state":["exists","up"]},{"osd":6,"uuid":"834fcd74-14bf-45ec-a10a-0374f4ce9bf6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6825","nonce":3094315954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6827","nonce":3094315954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6831","nonce":3094315954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3094315954},{"type":"v1","addr":"172.21.15.62:6829","nonce":3094315954}]},"public_addr":"172.21.15.62:6825/3094315954","cluster_addr":"172.21.15.62:6827/3094315954","heartbeat_back_addr":"172.21.15.62:6831/3094315954","heartbeat_front_addr":"172.21.15.62:6829/3094315954","state":["exists","up"]},{"osd":7,"uuid":"831c9a73-960e-4d2e-b86a-33a6916be059","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6817","nonce":147453972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6819","nonce":147453972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6823","nonce":147453972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":147453972},{"type":"v1","addr":"172.21.15.62:6821","nonce":147453972}]},"public_addr":"172.21.15.62:6817/147453972","cluster_addr":"172.21.15.62:6819/147453972","heartbeat_back_addr":"172.21.15.62:6823/147453972","heartbeat_front_addr":"172.21.15.62:6821/147453972","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.828738+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.873471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.908090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.894782+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:37.686796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.801123+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.852323+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-22T07:20:36.812139+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.34","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-22T07:25:25.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.049+0000 7ff7ff1e2640 1 -- 172.21.15.40:0/130246750 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ff7dc06c920 msgr2=0x7ff7dc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:25.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.049+0000 7ff7ff1e2640 1 --2- 172.21.15.40:0/130246750 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ff7dc06c920 0x7ff7dc06ede0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec003eb0 tx=0x7ff7ec009040 comp rx=0 tx=0).stop 2024-04-22T07:25:25.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.049+0000 7ff7ff1e2640 1 -- 172.21.15.40:0/130246750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7f81551a0 msgr2=0x7ff7f8151270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:25.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.049+0000 7ff7ff1e2640 1 --2- 172.21.15.40:0/130246750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7f81551a0 0x7ff7f8151270 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400c7f0 tx=0x7ff7e400cbf0 comp rx=0 tx=0).stop 2024-04-22T07:25:25.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.049+0000 7ff7ff1e2640 1 -- 172.21.15.40:0/130246750 shutdown_connections 2024-04-22T07:25:25.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.049+0000 7ff7ff1e2640 1 --2- 172.21.15.40:0/130246750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7f815bae0 0x7ff7f81f3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:25.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.049+0000 7ff7ff1e2640 1 --2- 172.21.15.40:0/130246750 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ff7dc06c920 0x7ff7dc06ede0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:25.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.049+0000 7ff7ff1e2640 1 --2- 172.21.15.40:0/130246750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7f81551a0 0x7ff7f8151270 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:25.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.049+0000 7ff7ff1e2640 1 --2- 172.21.15.40:0/130246750 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7f80cbc30 0x7ff7f81557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:25.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.049+0000 7ff7ff1e2640 1 -- 172.21.15.40:0/130246750 >> 172.21.15.40:0/130246750 conn(0x7ff7f80678c0 msgr2=0x7ff7f8072860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:25:25.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.049+0000 7ff7ff1e2640 1 -- 172.21.15.40:0/130246750 shutdown_connections 2024-04-22T07:25:25.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.049+0000 7ff7ff1e2640 1 -- 172.21.15.40:0/130246750 wait complete. 2024-04-22T07:25:25.059 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-22T07:25:25.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.163+0000 7ff8ee19d640 1 Processor -- start 2024-04-22T07:25:25.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.163+0000 7ff8ee19d640 1 -- start start 2024-04-22T07:25:25.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.164+0000 7ff8ee19d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8e80d08c0 0x7ff8e80caef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:25.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.164+0000 7ff8ee19d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff8e80d0ca0 0x7ff8e80cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:25.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.164+0000 7ff8ee19d640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8e80cc240 con 0x7ff8e80cd380 2024-04-22T07:25:25.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.164+0000 7ff8ee19d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7ff8e80ccef0 con 0x7ff8e80d08c0 2024-04-22T07:25:25.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.164+0000 7ff8ee19d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7ff8e815ac50 con 0x7ff8e80d0ca0 2024-04-22T07:25:25.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.164+0000 7ff8e77fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8e80d08c0 0x7ff8e80caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:25.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.164+0000 7ff8e77fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8e80d08c0 0x7ff8e80caef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40510/0 (socket says 172.21.15.40:40510) 2024-04-22T07:25:25.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.164+0000 7ff8e77fe640 1 -- 172.21.15.40:0/3412336624 learned_addr learned my addr 172.21.15.40:0/3412336624 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:25:25.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.164+0000 7ff8e6ffd640 1 --2- 172.21.15.40:0/3412336624 >> v2:172.21.15.62:3300/0 conn(0x7ff8e80d0ca0 0x7ff8e80cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:25.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.164+0000 7ff8e77fe640 1 -- 172.21.15.40:0/3412336624 >> v2:172.21.15.62:3300/0 conn(0x7ff8e80d0ca0 msgr2=0x7ff8e80cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:25:25.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.164+0000 7ff8e77fe640 1 --2- 172.21.15.40:0/3412336624 >> v2:172.21.15.62:3300/0 conn(0x7ff8e80d0ca0 0x7ff8e80cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:25.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.164+0000 7ff8e77fe640 1 -- 172.21.15.40:0/3412336624 >> v1:172.21.15.62:6789/0 conn(0x7ff8e80cd380 legacy=0x7ff8e80cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:25.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.164+0000 7ff8e77fe640 1 -- 172.21.15.40:0/3412336624 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e815af10 con 0x7ff8e80d08c0 2024-04-22T07:25:25.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.165+0000 7ff8e77fe640 1 --2- 172.21.15.40:0/3412336624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e80d08c0 0x7ff8e80caef0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8073170 tx=0x7ff8d802ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc7f8271bccbfba server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:25.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.165+0000 7ff8e67fc640 1 -- 172.21.15.40:0/3412336624 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d802f850 con 0x7ff8e80d08c0 2024-04-22T07:25:25.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.165+0000 7ff8e67fc640 1 -- 172.21.15.40:0/3412336624 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff8d802f9f0 con 0x7ff8e80d08c0 2024-04-22T07:25:25.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.165+0000 7ff8e67fc640 1 -- 172.21.15.40:0/3412336624 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d802fde0 con 0x7ff8e80d08c0 2024-04-22T07:25:25.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.166+0000 7ff8ee19d640 1 -- 172.21.15.40:0/3412336624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e80d08c0 msgr2=0x7ff8e80caef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:25.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.166+0000 7ff8ee19d640 1 --2- 172.21.15.40:0/3412336624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e80d08c0 0x7ff8e80caef0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8073170 tx=0x7ff8d802ba30 comp rx=0 tx=0).stop 2024-04-22T07:25:25.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.166+0000 7ff8ee19d640 1 -- 172.21.15.40:0/3412336624 shutdown_connections 2024-04-22T07:25:25.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.166+0000 7ff8ee19d640 1 --2- 172.21.15.40:0/3412336624 >> v2:172.21.15.62:3300/0 conn(0x7ff8e80d0ca0 0x7ff8e80cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:25.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.166+0000 7ff8ee19d640 1 --2- 172.21.15.40:0/3412336624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e80d08c0 0x7ff8e80caef0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:25.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.166+0000 7ff8ee19d640 1 -- 172.21.15.40:0/3412336624 >> 172.21.15.40:0/3412336624 conn(0x7ff8e806ce70 msgr2=0x7ff8e806d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:25:25.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.166+0000 7ff8ee19d640 1 -- 172.21.15.40:0/3412336624 shutdown_connections 2024-04-22T07:25:25.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.166+0000 7ff8ee19d640 1 -- 172.21.15.40:0/3412336624 wait complete. 2024-04-22T07:25:25.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.167+0000 7ff8ee19d640 1 Processor -- start 2024-04-22T07:25:25.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.167+0000 7ff8ee19d640 1 -- start start 2024-04-22T07:25:25.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.168+0000 7ff8ee19d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff8e80cd380 0x7ff8e8149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:25.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.168+0000 7ff8ee19d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8e80d08c0 0x7ff8e81452a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:25.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.168+0000 7ff8ee19d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e80d0ca0 0x7ff8e81457e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:25.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.168+0000 7ff8ee19d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e815b7b0 con 0x7ff8e80d0ca0 2024-04-22T07:25:25.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.168+0000 7ff8ee19d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e815b4d0 con 0x7ff8e80d08c0 2024-04-22T07:25:25.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.168+0000 7ff8ee19d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ff8e815ba90 con 0x7ff8e80cd380 2024-04-22T07:25:25.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.168+0000 7ff8e7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e80d0ca0 0x7ff8e81457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:25.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.168+0000 7ff8e7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e80d0ca0 0x7ff8e81457e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40520/0 (socket says 172.21.15.40:40520) 2024-04-22T07:25:25.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.168+0000 7ff8e7fff640 1 -- 172.21.15.40:0/4040172917 learned_addr learned my addr 172.21.15.40:0/4040172917 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:25:25.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.168+0000 7ff8e6ffd640 1 --2- 172.21.15.40:0/4040172917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8e80d08c0 0x7ff8e81452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:25.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.168+0000 7ff8e77fe640 1 --2- 172.21.15.40:0/4040172917 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff8e80cd380 0x7ff8e8149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:25.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.168+0000 7ff8e7fff640 1 -- 172.21.15.40:0/4040172917 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff8e80cd380 msgr2=0x7ff8e8149c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:25.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.168+0000 7ff8e7fff640 1 --2- 172.21.15.40:0/4040172917 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff8e80cd380 0x7ff8e8149c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:25.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.168+0000 7ff8e7fff640 1 -- 172.21.15.40:0/4040172917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8e80d08c0 msgr2=0x7ff8e81452a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:25.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.168+0000 7ff8e7fff640 1 --2- 172.21.15.40:0/4040172917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8e80d08c0 0x7ff8e81452a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:25.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.168+0000 7ff8e7fff640 1 -- 172.21.15.40:0/4040172917 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e81f0fa0 con 0x7ff8e80d0ca0 2024-04-22T07:25:25.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.168+0000 7ff8e6ffd640 1 --2- 172.21.15.40:0/4040172917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8e80d08c0 0x7ff8e81452a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:25:25.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.168+0000 7ff8e7fff640 1 --2- 172.21.15.40:0/4040172917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e80d0ca0 0x7ff8e81457e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff8e000c7d0 tx=0x7ff8e000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:25.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.169+0000 7ff8cffff640 1 -- 172.21.15.40:0/4040172917 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0003b70 con 0x7ff8e80d0ca0 2024-04-22T07:25:25.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.169+0000 7ff8cffff640 1 -- 172.21.15.40:0/4040172917 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff8e0003d30 con 0x7ff8e80d0ca0 2024-04-22T07:25:25.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.169+0000 7ff8ee19d640 1 -- 172.21.15.40:0/4040172917 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e81f1b00 con 0x7ff8e80d0ca0 2024-04-22T07:25:25.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.169+0000 7ff8cffff640 1 -- 172.21.15.40:0/4040172917 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e000aab0 con 0x7ff8e80d0ca0 2024-04-22T07:25:25.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.169+0000 7ff8ee19d640 1 -- 172.21.15.40:0/4040172917 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e81f1540 con 0x7ff8e80d0ca0 2024-04-22T07:25:25.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.170+0000 7ff8ee19d640 1 -- 172.21.15.40:0/4040172917 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8e80b58a0 con 0x7ff8e80d0ca0 2024-04-22T07:25:25.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.170+0000 7ff8cffff640 1 -- 172.21.15.40:0/4040172917 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff8e000ac50 con 0x7ff8e80d0ca0 2024-04-22T07:25:25.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.171+0000 7ff8cffff640 1 --2- 172.21.15.40:0/4040172917 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ff8d406c8f0 0x7ff8d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:25.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.171+0000 7ff8cffff640 1 -- 172.21.15.40:0/4040172917 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5738+0+0 (secure 0 0 0) 0x7ff8e008bc90 con 0x7ff8e80d0ca0 2024-04-22T07:25:25.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.171+0000 7ff8e77fe640 1 --2- 172.21.15.40:0/4040172917 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ff8d406c8f0 0x7ff8d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:25.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.171+0000 7ff8e77fe640 1 --2- 172.21.15.40:0/4040172917 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ff8d406c8f0 0x7ff8d406edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8036000 tx=0x7ff8d8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:25.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.175+0000 7ff8cffff640 1 -- 172.21.15.40:0/4040172917 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff8e80b58a0 con 0x7ff8e80d0ca0 2024-04-22T07:25:25.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.397+0000 7ff8ee19d640 1 -- 172.21.15.40:0/4040172917 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff8e8158670 con 0x7ff8e80d0ca0 2024-04-22T07:25:25.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.400+0000 7ff8cffff640 1 -- 172.21.15.40:0/4040172917 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7ff8e0059f90 con 0x7ff8e80d0ca0 2024-04-22T07:25:25.398 INFO:teuthology.orchestra.run.smithi040.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-22T07:25:25.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.402+0000 7ff8ee19d640 1 -- 172.21.15.40:0/4040172917 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ff8d406c8f0 msgr2=0x7ff8d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:25.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.402+0000 7ff8ee19d640 1 --2- 172.21.15.40:0/4040172917 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ff8d406c8f0 0x7ff8d406edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8036000 tx=0x7ff8d8008030 comp rx=0 tx=0).stop 2024-04-22T07:25:25.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.402+0000 7ff8ee19d640 1 -- 172.21.15.40:0/4040172917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e80d0ca0 msgr2=0x7ff8e81457e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:25.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.402+0000 7ff8ee19d640 1 --2- 172.21.15.40:0/4040172917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e80d0ca0 0x7ff8e81457e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff8e000c7d0 tx=0x7ff8e000cc90 comp rx=0 tx=0).stop 2024-04-22T07:25:25.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.402+0000 7ff8ee19d640 1 -- 172.21.15.40:0/4040172917 shutdown_connections 2024-04-22T07:25:25.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.402+0000 7ff8ee19d640 1 --2- 172.21.15.40:0/4040172917 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ff8d406c8f0 0x7ff8d406edb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:25.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.402+0000 7ff8ee19d640 1 --2- 172.21.15.40:0/4040172917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8e80d0ca0 0x7ff8e81457e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:25.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.402+0000 7ff8ee19d640 1 --2- 172.21.15.40:0/4040172917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8e80d08c0 0x7ff8e81452a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:25.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.402+0000 7ff8ee19d640 1 --2- 172.21.15.40:0/4040172917 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff8e80cd380 0x7ff8e8149c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:25.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.402+0000 7ff8ee19d640 1 -- 172.21.15.40:0/4040172917 >> 172.21.15.40:0/4040172917 conn(0x7ff8e806ce70 msgr2=0x7ff8e80b5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:25:25.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.402+0000 7ff8ee19d640 1 -- 172.21.15.40:0/4040172917 shutdown_connections 2024-04-22T07:25:25.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.403+0000 7ff8ee19d640 1 -- 172.21.15.40:0/4040172917 wait complete. 2024-04-22T07:25:25.413 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-22T07:25:25.443 INFO:tasks.ceph.mds.b.smithi062.stdout:starting mds.b at 2024-04-22T07:25:25.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.519+0000 7f2db0e70640 1 Processor -- start 2024-04-22T07:25:25.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.519+0000 7f2db0e70640 1 -- start start 2024-04-22T07:25:25.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.519+0000 7f2db0e70640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2dac154f50 0x7f2dac0cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:25.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.519+0000 7f2db0e70640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2dac15b3e0 0x7f2dac15b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:25.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.519+0000 7f2db0e70640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dac15e6e0 con 0x7f2dac0cc5a0 2024-04-22T07:25:25.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.519+0000 7f2db0e70640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f2dac15af50 con 0x7f2dac15b3e0 2024-04-22T07:25:25.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.519+0000 7f2db0e70640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f2dac15bdb0 con 0x7f2dac154f50 2024-04-22T07:25:25.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.520+0000 7f2daad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2dac15b3e0 0x7f2dac15b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:25.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.520+0000 7f2da3fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2dac0cc5a0 0x7f2dac0d0590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37566/0 (socket says 172.21.15.40:37566) 2024-04-22T07:25:25.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.520+0000 7f2daa59c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2dac154f50 0x7f2dac0cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:25.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.520+0000 7f2da3fff640 1 -- 172.21.15.40:0/2616565842 learned_addr learned my addr 172.21.15.40:0/2616565842 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:25:25.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.520+0000 7f2daad9d640 1 -- 172.21.15.40:0/2616565842 >> v2:172.21.15.62:3300/0 conn(0x7f2dac154f50 msgr2=0x7f2dac0cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:25:25.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.520+0000 7f2daad9d640 1 --2- 172.21.15.40:0/2616565842 >> v2:172.21.15.62:3300/0 conn(0x7f2dac154f50 0x7f2dac0cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:25.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.520+0000 7f2daad9d640 1 -- 172.21.15.40:0/2616565842 >> v1:172.21.15.40:6789/0 conn(0x7f2dac0cc5a0 legacy=0x7f2dac0d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:25.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.520+0000 7f2daad9d640 1 -- 172.21.15.40:0/2616565842 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dac15e9c0 con 0x7f2dac15b3e0 2024-04-22T07:25:25.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.520+0000 7f2da9d9b640 1 -- 172.21.15.40:0/2616565842 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 191434163 0 0) 0x7f2dac15e6e0 con 0x7f2dac0cc5a0 2024-04-22T07:25:25.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.520+0000 7f2daa59c640 1 --2- 172.21.15.40:0/2616565842 >> v2:172.21.15.62:3300/0 conn(0x7f2dac154f50 0x7f2dac0cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-22T07:25:25.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.521+0000 7f2daad9d640 1 --2- 172.21.15.40:0/2616565842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dac15b3e0 0x7f2dac15b870 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2dac0d1320 tx=0x7f2da402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9957b882370611b server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:25.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.521+0000 7f2da9d9b640 1 -- 172.21.15.40:0/2616565842 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da4039070 con 0x7f2dac15b3e0 2024-04-22T07:25:25.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.521+0000 7f2da9d9b640 1 -- 172.21.15.40:0/2616565842 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2da402cd00 con 0x7f2dac15b3e0 2024-04-22T07:25:25.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.521+0000 7f2da9d9b640 1 -- 172.21.15.40:0/2616565842 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da4034680 con 0x7f2dac15b3e0 2024-04-22T07:25:25.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.521+0000 7f2db0e70640 1 -- 172.21.15.40:0/2616565842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dac15b3e0 msgr2=0x7f2dac15b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:25.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.521+0000 7f2db0e70640 1 --2- 172.21.15.40:0/2616565842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dac15b3e0 0x7f2dac15b870 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2dac0d1320 tx=0x7f2da402bf50 comp rx=0 tx=0).stop 2024-04-22T07:25:25.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.521+0000 7f2db0e70640 1 -- 172.21.15.40:0/2616565842 shutdown_connections 2024-04-22T07:25:25.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.521+0000 7f2db0e70640 1 --2- 172.21.15.40:0/2616565842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dac15b3e0 0x7f2dac15b870 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:25.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.521+0000 7f2db0e70640 1 --2- 172.21.15.40:0/2616565842 >> v2:172.21.15.62:3300/0 conn(0x7f2dac154f50 0x7f2dac0cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:25.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.521+0000 7f2db0e70640 1 -- 172.21.15.40:0/2616565842 >> 172.21.15.40:0/2616565842 conn(0x7f2dac0676b0 msgr2=0x7f2dac067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:25:25.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.521+0000 7f2db0e70640 1 -- 172.21.15.40:0/2616565842 shutdown_connections 2024-04-22T07:25:25.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.522+0000 7f2db0e70640 1 -- 172.21.15.40:0/2616565842 wait complete. 2024-04-22T07:25:25.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.523+0000 7f2db0e70640 1 Processor -- start 2024-04-22T07:25:25.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.523+0000 7f2db0e70640 1 -- start start 2024-04-22T07:25:25.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.523+0000 7f2db0e70640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2dac0cc5a0 0x7f2dac142200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:25.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.523+0000 7f2db0e70640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dac154f50 0x7f2dac1f12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:25.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.523+0000 7f2db0e70640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2dac15b3e0 0x7f2dac1f1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:25.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.523+0000 7f2db0e70640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2dac15f260 con 0x7f2dac154f50 2024-04-22T07:25:25.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.523+0000 7f2db0e70640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2dac15ef80 con 0x7f2dac15b3e0 2024-04-22T07:25:25.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.523+0000 7f2db0e70640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f2dac15e3a0 con 0x7f2dac0cc5a0 2024-04-22T07:25:25.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.524+0000 7f2da3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dac154f50 0x7f2dac1f12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:25.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.524+0000 7f2da3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dac154f50 0x7f2dac1f12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40534/0 (socket says 172.21.15.40:40534) 2024-04-22T07:25:25.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.524+0000 7f2da3fff640 1 -- 172.21.15.40:0/3291824402 learned_addr learned my addr 172.21.15.40:0/3291824402 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:25:25.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.524+0000 7f2daa59c640 1 --2- 172.21.15.40:0/3291824402 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2dac0cc5a0 0x7f2dac142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:25.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.524+0000 7f2daad9d640 1 --2- 172.21.15.40:0/3291824402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2dac15b3e0 0x7f2dac1f1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:25.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.524+0000 7f2da3fff640 1 -- 172.21.15.40:0/3291824402 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2dac0cc5a0 msgr2=0x7f2dac142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:25.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.524+0000 7f2da3fff640 1 --2- 172.21.15.40:0/3291824402 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2dac0cc5a0 0x7f2dac142200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:25.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.524+0000 7f2da3fff640 1 -- 172.21.15.40:0/3291824402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2dac15b3e0 msgr2=0x7f2dac1f1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:25.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.524+0000 7f2da3fff640 1 --2- 172.21.15.40:0/3291824402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2dac15b3e0 0x7f2dac1f1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:25.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.524+0000 7f2da3fff640 1 -- 172.21.15.40:0/3291824402 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dac1592f0 con 0x7f2dac154f50 2024-04-22T07:25:25.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.524+0000 7f2daad9d640 1 --2- 172.21.15.40:0/3291824402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2dac15b3e0 0x7f2dac1f1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-22T07:25:25.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.524+0000 7f2da3fff640 1 --2- 172.21.15.40:0/3291824402 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dac154f50 0x7f2dac1f12f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2d9400c4b0 tx=0x7f2d9400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:25.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.524+0000 7f2da2ffd640 1 -- 172.21.15.40:0/3291824402 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d94018070 con 0x7f2dac154f50 2024-04-22T07:25:25.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.524+0000 7f2da2ffd640 1 -- 172.21.15.40:0/3291824402 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2d94007500 con 0x7f2dac154f50 2024-04-22T07:25:25.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.524+0000 7f2db0e70640 1 -- 172.21.15.40:0/3291824402 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dac15e0c0 con 0x7f2dac154f50 2024-04-22T07:25:25.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.524+0000 7f2da2ffd640 1 -- 172.21.15.40:0/3291824402 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d94004a40 con 0x7f2dac154f50 2024-04-22T07:25:25.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.524+0000 7f2db0e70640 1 -- 172.21.15.40:0/3291824402 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dac15dde0 con 0x7f2dac154f50 2024-04-22T07:25:25.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.525+0000 7f2db0e70640 1 -- 172.21.15.40:0/3291824402 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dac1587d0 con 0x7f2dac154f50 2024-04-22T07:25:25.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.526+0000 7f2da2ffd640 1 -- 172.21.15.40:0/3291824402 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2d9401b070 con 0x7f2dac154f50 2024-04-22T07:25:25.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.526+0000 7f2da2ffd640 1 --2- 172.21.15.40:0/3291824402 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2d8c06c8f0 0x7f2d8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:25.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.526+0000 7f2da2ffd640 1 -- 172.21.15.40:0/3291824402 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5824+0+0 (secure 0 0 0) 0x7f2d9408af60 con 0x7f2dac154f50 2024-04-22T07:25:25.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.526+0000 7f2daa59c640 1 --2- 172.21.15.40:0/3291824402 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2d8c06c8f0 0x7f2d8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:25.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.527+0000 7f2daa59c640 1 --2- 172.21.15.40:0/3291824402 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2d8c06c8f0 0x7f2d8c06edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c009560 tx=0x7f2d9c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:25.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.531+0000 7f2da2ffd640 1 -- 172.21.15.40:0/3291824402 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2dac15e0c0 con 0x7f2dac154f50 2024-04-22T07:25:25.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:25.755+0000 7f2db0e70640 1 -- 172.21.15.40:0/3291824402 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2dac04fdc0 con 0x7f2dac154f50 2024-04-22T07:25:26.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.405+0000 7f2da2ffd640 1 -- 172.21.15.40:0/3291824402 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f2d940593e0 con 0x7f2dac154f50 2024-04-22T07:25:26.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.407+0000 7f2db0e70640 1 -- 172.21.15.40:0/3291824402 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2d8c06c8f0 msgr2=0x7f2d8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:26.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.407+0000 7f2db0e70640 1 --2- 172.21.15.40:0/3291824402 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2d8c06c8f0 0x7f2d8c06edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c009560 tx=0x7f2d9c008040 comp rx=0 tx=0).stop 2024-04-22T07:25:26.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.407+0000 7f2db0e70640 1 -- 172.21.15.40:0/3291824402 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dac154f50 msgr2=0x7f2dac1f12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:26.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.407+0000 7f2db0e70640 1 --2- 172.21.15.40:0/3291824402 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dac154f50 0x7f2dac1f12f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2d9400c4b0 tx=0x7f2d9400c970 comp rx=0 tx=0).stop 2024-04-22T07:25:26.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.407+0000 7f2db0e70640 1 -- 172.21.15.40:0/3291824402 shutdown_connections 2024-04-22T07:25:26.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.407+0000 7f2db0e70640 1 --2- 172.21.15.40:0/3291824402 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2dac15b3e0 0x7f2dac1f1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:26.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.407+0000 7f2db0e70640 1 --2- 172.21.15.40:0/3291824402 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7f2d8c06c8f0 0x7f2d8c06edb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:26.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.407+0000 7f2db0e70640 1 --2- 172.21.15.40:0/3291824402 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dac154f50 0x7f2dac1f12f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:26.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.407+0000 7f2db0e70640 1 --2- 172.21.15.40:0/3291824402 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2dac0cc5a0 0x7f2dac142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:26.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.407+0000 7f2db0e70640 1 -- 172.21.15.40:0/3291824402 >> 172.21.15.40:0/3291824402 conn(0x7f2dac0676b0 msgr2=0x7f2dac067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:25:26.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.407+0000 7f2db0e70640 1 -- 172.21.15.40:0/3291824402 shutdown_connections 2024-04-22T07:25:26.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.407+0000 7f2db0e70640 1 -- 172.21.15.40:0/3291824402 wait complete. 2024-04-22T07:25:26.419 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-22T07:25:26.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.533+0000 7fc31cbb2640 1 Processor -- start 2024-04-22T07:25:26.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.533+0000 7fc31cbb2640 1 -- start start 2024-04-22T07:25:26.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.534+0000 7fc31cbb2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc318154f10 0x7fc3180c5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:26.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.534+0000 7fc31cbb2640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc31815e450 con 0x7fc31815eec0 2024-04-22T07:25:26.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.534+0000 7fc31cbb2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc31815f310 con 0x7fc31815adc0 2024-04-22T07:25:26.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.534+0000 7fc31cbb2640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fc31815b6f0 con 0x7fc318154f10 2024-04-22T07:25:26.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.534+0000 7fc315d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc31815eec0 0x7fc3180cb3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37568/0 (socket says 172.21.15.40:37568) 2024-04-22T07:25:26.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.534+0000 7fc315d9b640 1 -- 172.21.15.40:0/2524730173 learned_addr learned my addr 172.21.15.40:0/2524730173 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:25:26.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.534+0000 7fc31659c640 1 --2- 172.21.15.40:0/2524730173 >> v2:172.21.15.62:3300/0 conn(0x7fc318154f10 0x7fc3180c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:26.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.534+0000 7fc31559a640 1 -- 172.21.15.40:0/2524730173 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2367982614 0 0) 0x7fc31815e450 con 0x7fc31815eec0 2024-04-22T07:25:26.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.534+0000 7fc31559a640 1 -- 172.21.15.40:0/2524730173 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc304003520 con 0x7fc31815eec0 2024-04-22T07:25:26.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.535+0000 7fc31559a640 1 -- 172.21.15.40:0/2524730173 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2719845172 0 0) 0x7fc304003520 con 0x7fc31815eec0 2024-04-22T07:25:26.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.535+0000 7fc31559a640 1 -- 172.21.15.40:0/2524730173 >> v2:172.21.15.62:3300/0 conn(0x7fc318154f10 msgr2=0x7fc3180c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:25:26.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.535+0000 7fc31559a640 1 --2- 172.21.15.40:0/2524730173 >> v2:172.21.15.62:3300/0 conn(0x7fc318154f10 0x7fc3180c5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:26.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.535+0000 7fc31559a640 1 -- 172.21.15.40:0/2524730173 >> v1:172.21.15.62:6789/0 conn(0x7fc31815adc0 legacy=0x7fc3180d05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:26.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.535+0000 7fc31559a640 1 -- 172.21.15.40:0/2524730173 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc31815b9d0 con 0x7fc31815eec0 2024-04-22T07:25:26.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.535+0000 7fc31559a640 1 -- 172.21.15.40:0/2524730173 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1433152103 0 0) 0x7fc300001670 con 0x7fc31815eec0 2024-04-22T07:25:26.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.535+0000 7fc31559a640 1 -- 172.21.15.40:0/2524730173 >> v1:172.21.15.40:6789/0 conn(0x7fc31815eec0 legacy=0x7fc3180cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:26.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.535+0000 7fc31559a640 1 --2- 172.21.15.40:0/2524730173 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3040039b0 0x7fc304003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:26.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.535+0000 7fc31559a640 1 --2- 172.21.15.40:0/2524730173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc304004800 0x7fc304004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:26.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.535+0000 7fc31559a640 1 --2- 172.21.15.40:0/2524730173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3040051c0 0x7fc30400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:26.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.535+0000 7fc31559a640 1 -- 172.21.15.40:0/2524730173 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc31815b6f0 con 0x7fc3040051c0 2024-04-22T07:25:26.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.535+0000 7fc31559a640 1 -- 172.21.15.40:0/2524730173 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc30400c060 con 0x7fc304004800 2024-04-22T07:25:26.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.535+0000 7fc31559a640 1 -- 172.21.15.40:0/2524730173 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc30400c260 con 0x7fc3040039b0 2024-04-22T07:25:26.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.535+0000 7fc316d9d640 1 --2- 172.21.15.40:0/2524730173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3040051c0 0x7fc30400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:26.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.535+0000 7fc315d9b640 1 --2- 172.21.15.40:0/2524730173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc304004800 0x7fc304004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:26.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.535+0000 7fc31659c640 1 --2- 172.21.15.40:0/2524730173 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3040039b0 0x7fc304003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:26.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.535+0000 7fc316d9d640 1 -- 172.21.15.40:0/2524730173 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3040039b0 msgr2=0x7fc304003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:25:26.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.535+0000 7fc316d9d640 1 --2- 172.21.15.40:0/2524730173 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3040039b0 0x7fc304003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:26.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.535+0000 7fc316d9d640 1 -- 172.21.15.40:0/2524730173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc304004800 msgr2=0x7fc304004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:25:26.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.535+0000 7fc316d9d640 1 --2- 172.21.15.40:0/2524730173 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc304004800 0x7fc304004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:26.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.535+0000 7fc316d9d640 1 -- 172.21.15.40:0/2524730173 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc304003520 con 0x7fc3040051c0 2024-04-22T07:25:26.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.536+0000 7fc316d9d640 1 -- 172.21.15.40:0/2524730173 reap_dead start 2024-04-22T07:25:26.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.536+0000 7fc316d9d640 1 --2- 172.21.15.40:0/2524730173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3040051c0 0x7fc30400b9c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc308001e50 tx=0x7fc304005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c811fd1f09c59a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:26.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.536+0000 7fc31559a640 1 -- 172.21.15.40:0/2524730173 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc308001a70 con 0x7fc3040051c0 2024-04-22T07:25:26.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.536+0000 7fc31559a640 1 -- 172.21.15.40:0/2524730173 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc308003bb0 con 0x7fc3040051c0 2024-04-22T07:25:26.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.536+0000 7fc31559a640 1 -- 172.21.15.40:0/2524730173 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3080050d0 con 0x7fc3040051c0 2024-04-22T07:25:26.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.537+0000 7fc31cbb2640 1 -- 172.21.15.40:0/2524730173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3040051c0 msgr2=0x7fc30400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:26.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.537+0000 7fc31cbb2640 1 --2- 172.21.15.40:0/2524730173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3040051c0 0x7fc30400b9c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc308001e50 tx=0x7fc304005830 comp rx=0 tx=0).stop 2024-04-22T07:25:26.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.537+0000 7fc31cbb2640 1 -- 172.21.15.40:0/2524730173 shutdown_connections 2024-04-22T07:25:26.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.537+0000 7fc31cbb2640 1 --2- 172.21.15.40:0/2524730173 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3040051c0 0x7fc30400b9c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:26.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.537+0000 7fc31cbb2640 1 -- 172.21.15.40:0/2524730173 >> 172.21.15.40:0/2524730173 conn(0x7fc3180676b0 msgr2=0x7fc318067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:25:26.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.537+0000 7fc31cbb2640 1 -- 172.21.15.40:0/2524730173 shutdown_connections 2024-04-22T07:25:26.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.537+0000 7fc31cbb2640 1 -- 172.21.15.40:0/2524730173 wait complete. 2024-04-22T07:25:26.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.538+0000 7fc31cbb2640 1 Processor -- start 2024-04-22T07:25:26.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.538+0000 7fc31cbb2640 1 -- start start 2024-04-22T07:25:26.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.539+0000 7fc31cbb2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3040051c0 0x7fc3181f4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:26.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.539+0000 7fc31cbb2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3181f19a0 0x7fc31815bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.539+0000 7fc31cbb2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc318151ed0 0x7fc3180b5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.539+0000 7fc31cbb2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc3181552f0 con 0x7fc318151ed0 2024-04-22T07:25:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.539+0000 7fc31cbb2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc31815bcb0 con 0x7fc3040051c0 2024-04-22T07:25:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.539+0000 7fc31cbb2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc318155470 con 0x7fc3181f19a0 2024-04-22T07:25:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.539+0000 7fc316d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc318151ed0 0x7fc3180b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.539+0000 7fc316d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc318151ed0 0x7fc3180b5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40552/0 (socket says 172.21.15.40:40552) 2024-04-22T07:25:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.539+0000 7fc316d9d640 1 -- 172.21.15.40:0/2773593352 learned_addr learned my addr 172.21.15.40:0/2773593352 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:25:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.539+0000 7fc315d9b640 1 --2- 172.21.15.40:0/2773593352 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3181f19a0 0x7fc31815bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.539+0000 7fc31659c640 1 --2- 172.21.15.40:0/2773593352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3040051c0 0x7fc3181f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.539+0000 7fc316d9d640 1 -- 172.21.15.40:0/2773593352 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3181f19a0 msgr2=0x7fc31815bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.539+0000 7fc316d9d640 1 --2- 172.21.15.40:0/2773593352 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3181f19a0 0x7fc31815bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.539+0000 7fc316d9d640 1 -- 172.21.15.40:0/2773593352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3040051c0 msgr2=0x7fc3181f4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.539+0000 7fc316d9d640 1 --2- 172.21.15.40:0/2773593352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3040051c0 0x7fc3181f4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.539+0000 7fc316d9d640 1 -- 172.21.15.40:0/2773593352 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc318155830 con 0x7fc318151ed0 2024-04-22T07:25:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.539+0000 7fc316d9d640 1 --2- 172.21.15.40:0/2773593352 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc318151ed0 0x7fc3180b5440 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc308001f70 tx=0x7fc3080014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.539+0000 7fc30effd640 1 -- 172.21.15.40:0/2773593352 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc308006d60 con 0x7fc318151ed0 2024-04-22T07:25:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.540+0000 7fc30effd640 1 -- 172.21.15.40:0/2773593352 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc308039480 con 0x7fc318151ed0 2024-04-22T07:25:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.540+0000 7fc31cbb2640 1 -- 172.21.15.40:0/2773593352 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc318155ad0 con 0x7fc318151ed0 2024-04-22T07:25:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.540+0000 7fc30effd640 1 -- 172.21.15.40:0/2773593352 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc308039870 con 0x7fc318151ed0 2024-04-22T07:25:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.540+0000 7fc31cbb2640 1 -- 172.21.15.40:0/2773593352 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3181f11a0 con 0x7fc318151ed0 2024-04-22T07:25:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.541+0000 7fc31cbb2640 1 -- 172.21.15.40:0/2773593352 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc318155db0 con 0x7fc318151ed0 2024-04-22T07:25:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.541+0000 7fc30effd640 1 -- 172.21.15.40:0/2773593352 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc308039a10 con 0x7fc318151ed0 2024-04-22T07:25:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.541+0000 7fc30effd640 1 --2- 172.21.15.40:0/2773593352 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc2f806c8f0 0x7fc2f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.541+0000 7fc30effd640 1 -- 172.21.15.40:0/2773593352 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5824+0+0 (secure 0 0 0) 0x7fc3080adc80 con 0x7fc318151ed0 2024-04-22T07:25:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.541+0000 7fc31659c640 1 --2- 172.21.15.40:0/2773593352 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc2f806c8f0 0x7fc2f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.542+0000 7fc31659c640 1 --2- 172.21.15.40:0/2773593352 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc2f806c8f0 0x7fc2f806edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc310009980 tx=0x7fc310008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:26.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.546+0000 7fc30effd640 1 -- 172.21.15.40:0/2773593352 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc308033030 con 0x7fc318151ed0 2024-04-22T07:25:26.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:26.734+0000 7fc31cbb2640 1 -- 172.21.15.40:0/2773593352 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc31804fdc0 con 0x7fc318151ed0 2024-04-22T07:25:27.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.406+0000 7fc30effd640 1 -- 172.21.15.40:0/2773593352 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) ==== 181+0+0 (secure 0 0 0) 0x7fc30807b960 con 0x7fc318151ed0 2024-04-22T07:25:27.405 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' removed 2024-04-22T07:25:27.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.409+0000 7fc31cbb2640 1 -- 172.21.15.40:0/2773593352 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc2f806c8f0 msgr2=0x7fc2f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:27.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.409+0000 7fc31cbb2640 1 --2- 172.21.15.40:0/2773593352 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc2f806c8f0 0x7fc2f806edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc310009980 tx=0x7fc310008040 comp rx=0 tx=0).stop 2024-04-22T07:25:27.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.409+0000 7fc31cbb2640 1 -- 172.21.15.40:0/2773593352 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc318151ed0 msgr2=0x7fc3180b5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:27.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.409+0000 7fc31cbb2640 1 --2- 172.21.15.40:0/2773593352 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc318151ed0 0x7fc3180b5440 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc308001f70 tx=0x7fc3080014a0 comp rx=0 tx=0).stop 2024-04-22T07:25:27.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.410+0000 7fc31cbb2640 1 -- 172.21.15.40:0/2773593352 shutdown_connections 2024-04-22T07:25:27.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.410+0000 7fc31cbb2640 1 --2- 172.21.15.40:0/2773593352 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7fc2f806c8f0 0x7fc2f806edb0 secure :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc310009980 tx=0x7fc310008040 comp rx=0 tx=0).stop 2024-04-22T07:25:27.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.410+0000 7fc31cbb2640 1 --2- 172.21.15.40:0/2773593352 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc318151ed0 0x7fc3180b5440 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:27.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.410+0000 7fc31cbb2640 1 --2- 172.21.15.40:0/2773593352 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3181f19a0 0x7fc31815bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:27.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.410+0000 7fc31cbb2640 1 --2- 172.21.15.40:0/2773593352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3040051c0 0x7fc3181f4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:27.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.410+0000 7fc31cbb2640 1 -- 172.21.15.40:0/2773593352 >> 172.21.15.40:0/2773593352 conn(0x7fc3180676b0 msgr2=0x7fc3180ccae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:25:27.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.410+0000 7fc31cbb2640 1 -- 172.21.15.40:0/2773593352 shutdown_connections 2024-04-22T07:25:27.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.410+0000 7fc31cbb2640 1 -- 172.21.15.40:0/2773593352 wait complete. 2024-04-22T07:25:27.425 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-22T07:25:27.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.538+0000 7ffa410c1640 1 Processor -- start 2024-04-22T07:25:27.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.538+0000 7ffa410c1640 1 -- start start 2024-04-22T07:25:27.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.539+0000 7ffa410c1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ffa3c154f10 0x7ffa3c0c5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:27.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.539+0000 7ffa410c1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa3c15eec0 0x7ffa3c0cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:27.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.539+0000 7ffa410c1640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa3c15e450 con 0x7ffa3c15adc0 2024-04-22T07:25:27.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.539+0000 7ffa410c1640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7ffa3c15f310 con 0x7ffa3c15eec0 2024-04-22T07:25:27.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.539+0000 7ffa410c1640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7ffa3c15b6f0 con 0x7ffa3c154f10 2024-04-22T07:25:27.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.539+0000 7ffa33fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa3c15eec0 0x7ffa3c0cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:27.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.539+0000 7ffa3b59e640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ffa3c15adc0 0x7ffa3c0d05c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37578/0 (socket says 172.21.15.40:37578) 2024-04-22T07:25:27.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.539+0000 7ffa3b59e640 1 -- 172.21.15.40:0/3222024663 learned_addr learned my addr 172.21.15.40:0/3222024663 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-22T07:25:27.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.539+0000 7ffa33fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa3c15eec0 0x7ffa3c0cb3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40568/0 (socket says 172.21.15.40:40568) 2024-04-22T07:25:27.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.539+0000 7ffa3ad9d640 1 --2- 172.21.15.40:0/3222024663 >> v2:172.21.15.62:3300/0 conn(0x7ffa3c154f10 0x7ffa3c0c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:27.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.539+0000 7ffa33fff640 1 -- 172.21.15.40:0/3222024663 >> v2:172.21.15.62:3300/0 conn(0x7ffa3c154f10 msgr2=0x7ffa3c0c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-22T07:25:27.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.539+0000 7ffa33fff640 1 --2- 172.21.15.40:0/3222024663 >> v2:172.21.15.62:3300/0 conn(0x7ffa3c154f10 0x7ffa3c0c5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:27.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.539+0000 7ffa33fff640 1 -- 172.21.15.40:0/3222024663 >> v1:172.21.15.40:6789/0 conn(0x7ffa3c15adc0 legacy=0x7ffa3c0d05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:27.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.539+0000 7ffa33fff640 1 -- 172.21.15.40:0/3222024663 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa3c15b9d0 con 0x7ffa3c15eec0 2024-04-22T07:25:27.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.539+0000 7ffa3a59c640 1 -- 172.21.15.40:0/3222024663 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1025895128 0 0) 0x7ffa3c15e450 con 0x7ffa3c15adc0 2024-04-22T07:25:27.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.540+0000 7ffa33fff640 1 --2- 172.21.15.40:0/3222024663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa3c15eec0 0x7ffa3c0cb3f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c06d7f0 tx=0x7ffa2402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b5d9e71713df45 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:27.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.540+0000 7ffa3a59c640 1 -- 172.21.15.40:0/3222024663 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa24035020 con 0x7ffa3c15eec0 2024-04-22T07:25:27.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.540+0000 7ffa3a59c640 1 -- 172.21.15.40:0/3222024663 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ffa24031830 con 0x7ffa3c15eec0 2024-04-22T07:25:27.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.540+0000 7ffa3a59c640 1 -- 172.21.15.40:0/3222024663 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa24031c20 con 0x7ffa3c15eec0 2024-04-22T07:25:27.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.541+0000 7ffa410c1640 1 -- 172.21.15.40:0/3222024663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa3c15eec0 msgr2=0x7ffa3c0cb3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:27.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.541+0000 7ffa410c1640 1 --2- 172.21.15.40:0/3222024663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa3c15eec0 0x7ffa3c0cb3f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c06d7f0 tx=0x7ffa2402b8d0 comp rx=0 tx=0).stop 2024-04-22T07:25:27.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.541+0000 7ffa410c1640 1 -- 172.21.15.40:0/3222024663 shutdown_connections 2024-04-22T07:25:27.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.541+0000 7ffa410c1640 1 --2- 172.21.15.40:0/3222024663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa3c15eec0 0x7ffa3c0cb3f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:27.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.541+0000 7ffa410c1640 1 --2- 172.21.15.40:0/3222024663 >> v2:172.21.15.62:3300/0 conn(0x7ffa3c154f10 0x7ffa3c0c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:27.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.541+0000 7ffa410c1640 1 -- 172.21.15.40:0/3222024663 >> 172.21.15.40:0/3222024663 conn(0x7ffa3c0676b0 msgr2=0x7ffa3c067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:25:27.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.541+0000 7ffa410c1640 1 -- 172.21.15.40:0/3222024663 shutdown_connections 2024-04-22T07:25:27.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.541+0000 7ffa410c1640 1 -- 172.21.15.40:0/3222024663 wait complete. 2024-04-22T07:25:27.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.542+0000 7ffa410c1640 1 Processor -- start 2024-04-22T07:25:27.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.542+0000 7ffa410c1640 1 -- start start 2024-04-22T07:25:27.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.543+0000 7ffa410c1640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa3c154f10 0x7ffa3c1f4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:27.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.543+0000 7ffa410c1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa3c15adc0 0x7ffa3c0c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:27.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.543+0000 7ffa410c1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa3c15eec0 0x7ffa3c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:27.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.543+0000 7ffa410c1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c15bcb0 con 0x7ffa3c15adc0 2024-04-22T07:25:27.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.543+0000 7ffa410c1640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c0cb930 con 0x7ffa3c15eec0 2024-04-22T07:25:27.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.543+0000 7ffa410c1640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ffa3c0d0cd0 con 0x7ffa3c154f10 2024-04-22T07:25:27.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.543+0000 7ffa33fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa3c15adc0 0x7ffa3c0c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:27.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.543+0000 7ffa33fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa3c15adc0 0x7ffa3c0c5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40582/0 (socket says 172.21.15.40:40582) 2024-04-22T07:25:27.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.543+0000 7ffa33fff640 1 -- 172.21.15.40:0/1827540509 learned_addr learned my addr 172.21.15.40:0/1827540509 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-22T07:25:27.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.543+0000 7ffa3ad9d640 1 --2- 172.21.15.40:0/1827540509 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa3c154f10 0x7ffa3c1f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:27.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.543+0000 7ffa3b59e640 1 --2- 172.21.15.40:0/1827540509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa3c15eec0 0x7ffa3c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:27.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.543+0000 7ffa33fff640 1 -- 172.21.15.40:0/1827540509 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa3c154f10 msgr2=0x7ffa3c1f4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:27.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.543+0000 7ffa33fff640 1 --2- 172.21.15.40:0/1827540509 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa3c154f10 0x7ffa3c1f4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:27.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.543+0000 7ffa33fff640 1 -- 172.21.15.40:0/1827540509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa3c15eec0 msgr2=0x7ffa3c0b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:27.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.543+0000 7ffa33fff640 1 --2- 172.21.15.40:0/1827540509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa3c15eec0 0x7ffa3c0b4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:27.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.543+0000 7ffa33fff640 1 -- 172.21.15.40:0/1827540509 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa3c0cedd0 con 0x7ffa3c15adc0 2024-04-22T07:25:27.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.543+0000 7ffa3b59e640 1 --2- 172.21.15.40:0/1827540509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa3c15eec0 0x7ffa3c0b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-22T07:25:27.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.544+0000 7ffa33fff640 1 --2- 172.21.15.40:0/1827540509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa3c15adc0 0x7ffa3c0c5d20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ffa24000c00 tx=0x7ffa240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:27.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.544+0000 7ffa337fe640 1 -- 172.21.15.40:0/1827540509 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa24041070 con 0x7ffa3c15adc0 2024-04-22T07:25:27.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.544+0000 7ffa337fe640 1 -- 172.21.15.40:0/1827540509 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ffa2403aa10 con 0x7ffa3c15adc0 2024-04-22T07:25:27.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.544+0000 7ffa410c1640 1 -- 172.21.15.40:0/1827540509 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa3c0cf0b0 con 0x7ffa3c15adc0 2024-04-22T07:25:27.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.544+0000 7ffa337fe640 1 -- 172.21.15.40:0/1827540509 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa24035040 con 0x7ffa3c15adc0 2024-04-22T07:25:27.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.544+0000 7ffa410c1640 1 -- 172.21.15.40:0/1827540509 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa3c0cf670 con 0x7ffa3c15adc0 2024-04-22T07:25:27.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.545+0000 7ffa410c1640 1 -- 172.21.15.40:0/1827540509 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa3c04fdc0 con 0x7ffa3c15adc0 2024-04-22T07:25:27.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.545+0000 7ffa337fe640 1 -- 172.21.15.40:0/1827540509 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffa2404c060 con 0x7ffa3c15adc0 2024-04-22T07:25:27.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.546+0000 7ffa337fe640 1 --2- 172.21.15.40:0/1827540509 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ffa1c06c8f0 0x7ffa1c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-22T07:25:27.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.546+0000 7ffa3ad9d640 1 --2- 172.21.15.40:0/1827540509 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ffa1c06c8f0 0x7ffa1c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-22T07:25:27.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.546+0000 7ffa337fe640 1 -- 172.21.15.40:0/1827540509 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5386+0+0 (secure 0 0 0) 0x7ffa240ad640 con 0x7ffa3c15adc0 2024-04-22T07:25:27.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.546+0000 7ffa3ad9d640 1 --2- 172.21.15.40:0/1827540509 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ffa1c06c8f0 0x7ffa1c06edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c006fd0 tx=0x7ffa2c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-22T07:25:27.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.550+0000 7ffa337fe640 1 -- 172.21.15.40:0/1827540509 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffa2407bb20 con 0x7ffa3c15adc0 2024-04-22T07:25:27.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:27.735+0000 7ffa410c1640 1 -- 172.21.15.40:0/1827540509 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ffa3c0cbf10 con 0x7ffa3c15adc0 2024-04-22T07:25:28.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:28.417+0000 7ffa337fe640 1 -- 172.21.15.40:0/1827540509 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) ==== 169+0+0 (secure 0 0 0) 0x7ffa2407b420 con 0x7ffa3c15adc0 2024-04-22T07:25:28.415 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' removed 2024-04-22T07:25:28.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:28.423+0000 7ffa410c1640 1 -- 172.21.15.40:0/1827540509 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ffa1c06c8f0 msgr2=0x7ffa1c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:28.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:28.423+0000 7ffa410c1640 1 --2- 172.21.15.40:0/1827540509 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ffa1c06c8f0 0x7ffa1c06edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c006fd0 tx=0x7ffa2c008040 comp rx=0 tx=0).stop 2024-04-22T07:25:28.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:28.423+0000 7ffa410c1640 1 -- 172.21.15.40:0/1827540509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa3c15adc0 msgr2=0x7ffa3c0c5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-22T07:25:28.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:28.423+0000 7ffa410c1640 1 --2- 172.21.15.40:0/1827540509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa3c15adc0 0x7ffa3c0c5d20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ffa24000c00 tx=0x7ffa240046c0 comp rx=0 tx=0).stop 2024-04-22T07:25:28.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:28.424+0000 7ffa410c1640 1 -- 172.21.15.40:0/1827540509 shutdown_connections 2024-04-22T07:25:28.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:28.425+0000 7ffa410c1640 1 --2- 172.21.15.40:0/1827540509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa3c15eec0 0x7ffa3c0b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:28.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:28.425+0000 7ffa410c1640 1 --2- 172.21.15.40:0/1827540509 >> [v2:172.21.15.40:6832/91163869,v1:172.21.15.40:6833/91163869] conn(0x7ffa1c06c8f0 0x7ffa1c06edb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:28.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:28.425+0000 7ffa410c1640 1 --2- 172.21.15.40:0/1827540509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa3c15adc0 0x7ffa3c0c5d20 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:28.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:28.425+0000 7ffa410c1640 1 --2- 172.21.15.40:0/1827540509 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ffa3c154f10 0x7ffa3c1f4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-22T07:25:28.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:28.425+0000 7ffa410c1640 1 -- 172.21.15.40:0/1827540509 >> 172.21.15.40:0/1827540509 conn(0x7ffa3c0676b0 msgr2=0x7ffa3c0cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-22T07:25:28.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:28.426+0000 7ffa410c1640 1 -- 172.21.15.40:0/1827540509 shutdown_connections 2024-04-22T07:25:28.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-22T07:25:28.426+0000 7ffa410c1640 1 -- 172.21.15.40:0/1827540509 wait complete. 2024-04-22T07:25:28.445 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-22T07:25:28.445 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-22T07:25:28.446 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:25:28.458 INFO:tasks.ceph.mds.a:Stopped 2024-04-22T07:25:28.459 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-22T07:25:28.459 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:25:28.509 INFO:tasks.ceph.mds.c:Stopped 2024-04-22T07:25:28.509 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-22T07:25:28.509 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:25:28.561 INFO:tasks.ceph.mds.e:Stopped 2024-04-22T07:25:28.561 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-22T07:25:28.561 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:25:28.573 INFO:tasks.ceph.mds.b:Stopped 2024-04-22T07:25:28.573 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-22T07:25:28.573 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:25:28.626 INFO:tasks.ceph.mds.d:Stopped 2024-04-22T07:25:28.626 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-22T07:25:28.626 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:25:28.679 INFO:tasks.ceph.mds.f:Stopped 2024-04-22T07:25:28.679 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-22T07:25:28.679 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-22T07:25:28.679 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:25:28.716 INFO:tasks.ceph.osd.0:Stopped 2024-04-22T07:25:28.716 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-22T07:25:28.716 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:25:28.792 INFO:tasks.ceph.osd.1:Stopped 2024-04-22T07:25:28.792 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-22T07:25:28.792 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:25:28.867 INFO:tasks.ceph.osd.2:Stopped 2024-04-22T07:25:28.868 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-22T07:25:28.868 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:25:28.945 INFO:tasks.ceph.osd.3:Stopped 2024-04-22T07:25:28.946 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-22T07:25:28.946 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:25:28.979 INFO:tasks.ceph.osd.4:Stopped 2024-04-22T07:25:28.979 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-22T07:25:28.979 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:25:29.063 INFO:tasks.ceph.osd.5:Stopped 2024-04-22T07:25:29.063 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-22T07:25:29.063 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:25:29.116 INFO:tasks.ceph.osd.6:Stopped 2024-04-22T07:25:29.116 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-22T07:25:29.117 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:25:29.159 INFO:tasks.ceph.osd.7:Stopped 2024-04-22T07:25:29.160 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-22T07:25:29.160 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-22T07:25:29.160 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:25:29.193 INFO:tasks.ceph.mgr.y:Stopped 2024-04-22T07:25:29.193 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-22T07:25:29.194 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:25:29.220 INFO:tasks.ceph.mgr.x:Stopped 2024-04-22T07:25:29.220 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-22T07:25:29.220 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-22T07:25:29.221 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:25:29.244 INFO:tasks.ceph.mon.a:Stopped 2024-04-22T07:25:29.245 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-22T07:25:29.245 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:25:29.273 INFO:tasks.ceph.mon.b:Stopped 2024-04-22T07:25:29.273 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-22T07:25:29.273 INFO:teuthology.orchestra.run:waiting for 300 2024-04-22T07:25:29.325 INFO:tasks.ceph.mon.c:Stopped 2024-04-22T07:25:29.326 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-22T07:25:29.326 DEBUG:teuthology.orchestra.run.smithi040:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-04-22T07:25:29.372 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi040.front.sepia.ceph.com 2024-04-22T07:25:29.373 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-22T07:25:29.597 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi040.front.sepia.ceph.com 2024-04-22T07:25:29.598 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-22T07:25:29.688 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi040.front.sepia.ceph.com 2024-04-22T07:25:29.688 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-22T07:25:29.745 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi040.front.sepia.ceph.com 2024-04-22T07:25:29.745 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-22T07:25:29.807 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi062.front.sepia.ceph.com 2024-04-22T07:25:29.807 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-22T07:25:30.061 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi062.front.sepia.ceph.com 2024-04-22T07:25:30.061 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-22T07:25:30.118 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi062.front.sepia.ceph.com 2024-04-22T07:25:30.118 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-22T07:25:30.166 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi062.front.sepia.ceph.com 2024-04-22T07:25:30.166 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-22T07:25:30.216 INFO:tasks.ceph:Archiving mon data... 2024-04-22T07:25:30.217 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668168/data/mon.a.tgz 2024-04-22T07:25:30.217 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2024-04-22T07:25:30.236 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.Q2rvYw0UWy 2024-04-22T07:25:30.237 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Q2rvYw0UWy 2024-04-22T07:25:30.378 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.Q2rvYw0UWy 2024-04-22T07:25:30.464 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.Q2rvYw0UWy is 297KB 2024-04-22T07:25:30.559 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.Q2rvYw0UWy 2024-04-22T07:25:30.575 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668168/data/mon.b.tgz 2024-04-22T07:25:30.575 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-04-22T07:25:30.592 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.ldn9u0giLn 2024-04-22T07:25:30.593 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ldn9u0giLn 2024-04-22T07:25:30.759 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.ldn9u0giLn 2024-04-22T07:25:30.843 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.ldn9u0giLn is 401KB 2024-04-22T07:25:30.939 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.ldn9u0giLn 2024-04-22T07:25:30.954 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668168/data/mon.c.tgz 2024-04-22T07:25:30.954 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-04-22T07:25:31.008 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.rUSlH4HJS5 2024-04-22T07:25:31.008 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.rUSlH4HJS5 2024-04-22T07:25:31.148 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.rUSlH4HJS5 2024-04-22T07:25:31.230 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.rUSlH4HJS5 is 401KB 2024-04-22T07:25:31.326 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.rUSlH4HJS5 2024-04-22T07:25:31.341 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-22T07:25:31.341 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-22T07:25:31.344 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-22T07:25:31.429 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-22T07:25:31.459 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-22T07:25:31.460 INFO:tasks.ceph:Archiving crash dumps... 2024-04-22T07:25:31.461 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668168/remote/smithi040/crash 2024-04-22T07:25:31.462 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-22T07:25:31.499 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668168/remote/smithi062/crash 2024-04-22T07:25:31.499 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-22T07:25:31.523 INFO:tasks.ceph:Shutting down logrotate 2024-04-22T07:25:31.523 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:25:31.543 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-22T07:25:31.613 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-22T07:25:31.640 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-22T07:25:31.664 INFO:tasks.ceph:Compressing logs... 2024-04-22T07:25:31.664 DEBUG:teuthology.orchestra.run.smithi040:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-22T07:25:31.683 DEBUG:teuthology.orchestra.run.smithi062:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-22T07:25:31.707 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40993.log 2024-04-22T07:25:31.707 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40319.log 2024-04-22T07:25:31.722 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.40993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42167.log 2024-04-22T07:25:31.722 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.40319.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.40993.log.gz 2024-04-22T07:25:31.722 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41003.log 2024-04-22T07:25:31.722 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40319.log.gz 2024-04-22T07:25:31.722 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44036.log 2024-04-22T07:25:31.722 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42167.log: /var/log/ceph/ceph-client.admin.41003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39709.log 2024-04-22T07:25:31.722 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41003.log.gz 2024-04-22T07:25:31.722 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42922.log 2024-04-22T07:25:31.723 INFO:teuthology.orchestra.run.smithi040.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.42167.log.gz 2024-04-22T07:25:31.723 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46016.log 2024-04-22T07:25:31.723 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.39709.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44036.log.gz 2024-04-22T07:25:31.723 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39355.log 2024-04-22T07:25:31.723 INFO:teuthology.orchestra.run.smithi040.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39709.log.gz 2024-04-22T07:25:31.723 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42922.log.gz 2024-04-22T07:25:31.723 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41663.log 2024-04-22T07:25:31.723 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.39355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40109.log 2024-04-22T07:25:31.723 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46016.log.gz 2024-04-22T07:25:31.723 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39355.log.gz/var/log/ceph/ceph-client.admin.41663.log: 2024-04-22T07:25:31.723 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39541.log 2024-04-22T07:25:31.723 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41663.log.gz 2024-04-22T07:25:31.723 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.40109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46688.log 2024-04-22T07:25:31.723 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.39541.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40109.log.gz 2024-04-22T07:25:31.723 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41915.log 2024-04-22T07:25:31.724 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39541.log.gz 2024-04-22T07:25:31.724 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46688.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-22T07:25:31.724 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46688.log.gz 2024-04-22T07:25:31.724 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41328.log 2024-04-22T07:25:31.724 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41915.log.gz 2024-04-22T07:25:31.724 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46478.log 2024-04-22T07:25:31.724 INFO:teuthology.orchestra.run.smithi040.stderr:gzip/var/log/ceph/ceph-client.admin.41328.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44308.log 2024-04-22T07:25:31.724 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46478.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.41328.log.gz 2024-04-22T07:25:31.724 INFO:teuthology.orchestra.run.smithi040.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43526.log 2024-04-22T07:25:31.724 INFO:teuthology.orchestra.run.smithi040.stderr: 85.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-22T07:25:31.724 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46478.log.gz 2024-04-22T07:25:31.724 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46184.log 2024-04-22T07:25:31.724 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43526.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44308.log.gz 2024-04-22T07:25:31.724 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39857.log 2024-04-22T07:25:31.724 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43526.log.gz 2024-04-22T07:25:31.725 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46184.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-22T07:25:31.725 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46184.log.gz 2024-04-22T07:25:31.725 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.39857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41999.log 2024-04-22T07:25:31.725 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43006.log 2024-04-22T07:25:31.725 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39857.log.gz 2024-04-22T07:25:31.725 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46310.log 2024-04-22T07:25:31.725 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41999.log.gz 2024-04-22T07:25:31.725 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40663.log 2024-04-22T07:25:31.725 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46310.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43006.log.gz 2024-04-22T07:25:31.725 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42880.log 2024-04-22T07:25:31.725 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.40663.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46310.log.gz 2024-04-22T07:25:31.725 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41000.log 2024-04-22T07:25:31.725 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40663.log.gz 2024-04-22T07:25:31.725 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42083.log 2024-04-22T07:25:31.725 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42880.log.gz 2024-04-22T07:25:31.726 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40067.log 2024-04-22T07:25:31.726 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42083.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41000.log.gz 2024-04-22T07:25:31.726 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47184.log 2024-04-22T07:25:31.726 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42083.log.gz 2024-04-22T07:25:31.726 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.40067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41341.log 2024-04-22T07:25:31.726 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0%/var/log/ceph/ceph-client.admin.47184.log: -- replaced with /var/log/ceph/ceph-client.admin.40067.log.gz 2024-04-22T07:25:31.726 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43736.log 2024-04-22T07:25:31.726 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41341.log: gzip 88.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.47184.log.gz --verbose 2024-04-22T07:25:31.726 INFO:teuthology.orchestra.run.smithi040.stderr: -- /var/log/ceph/ceph.audit.log 2024-04-22T07:25:31.726 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41341.log.gz 2024-04-22T07:25:31.726 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46100.log 2024-04-22T07:25:31.726 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43608.log 2024-04-22T07:25:31.726 INFO:teuthology.orchestra.run.smithi040.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.43736.log.gz 2024-04-22T07:25:31.726 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46520.log 2024-04-22T07:25:31.726 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41705.log 2024-04-22T07:25:31.727 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46100.log.gz 2024-04-22T07:25:31.727 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43608.log: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-22T07:25:31.727 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43342.log 2024-04-22T07:25:31.727 INFO:teuthology.orchestra.run.smithi040.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.43608.log.gz 2024-04-22T07:25:31.727 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41705.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46520.log.gz 2024-04-22T07:25:31.727 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43174.log 2024-04-22T07:25:31.727 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41705.log.gz 2024-04-22T07:25:31.727 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45667.log 2024-04-22T07:25:31.727 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43342.log: /var/log/ceph/ceph-client.admin.43174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41831.log 2024-04-22T07:25:31.727 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43342.log.gz 2024-04-22T07:25:31.727 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43174.log.gz 2024-04-22T07:25:31.727 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46772.log 2024-04-22T07:25:31.727 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45667.log.gz 2024-04-22T07:25:31.727 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40669.log 2024-04-22T07:25:31.727 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46772.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41831.log.gz 2024-04-22T07:25:31.728 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40666.log 2024-04-22T07:25:31.728 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46772.log.gz 2024-04-22T07:25:31.728 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.40669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46562.log 2024-04-22T07:25:31.728 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.40666.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40669.log.gz 2024-04-22T07:25:31.728 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40662.log 2024-04-22T07:25:31.728 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40666.log.gz 2024-04-22T07:25:31.728 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43468.log 2024-04-22T07:25:31.728 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46562.log.gz 2024-04-22T07:25:31.728 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.40662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46874.log 2024-04-22T07:25:31.745 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33147.log 2024-04-22T07:25:31.745 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-22T07:25:31.745 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33147.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-04-22T07:25:31.745 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-22T07:25:31.745 INFO:teuthology.orchestra.run.smithi062.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33147.log.gz 2024-04-22T07:25:31.745 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-22T07:25:31.745 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-22T07:25:31.745 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-22T07:25:31.745 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mds.b.log: gzip 92.1% -5 --verbose -- -- replaced with /var/log/ceph/ceph.log.gz /var/log/ceph/ceph-client.admin.33358.log 2024-04-22T07:25:31.745 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-04-22T07:25:31.746 INFO:teuthology.orchestra.run.smithi062.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-04-22T07:25:31.746 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-22T07:25:31.746 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-22T07:25:31.746 INFO:teuthology.orchestra.run.smithi062.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-22T07:25:31.746 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33358.log: /var/log/ceph/ceph-osd.4.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33358.log.gz 2024-04-22T07:25:31.746 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-22T07:25:31.746 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33187.log 2024-04-22T07:25:31.746 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-22T07:25:31.746 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33227.log 2024-04-22T07:25:31.746 INFO:teuthology.orchestra.run.smithi062.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33187.log.gz 2024-04-22T07:25:31.746 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33398.log 2024-04-22T07:25:31.746 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33227.log: /var/log/ceph/ceph-osd.6.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.33227.log.gz 2024-04-22T07:25:31.746 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33318.log 2024-04-22T07:25:31.747 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33398.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33398.log.gz 2024-04-22T07:25:31.747 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-22T07:25:31.747 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33318.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33318.log.gz 2024-04-22T07:25:31.747 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-22T07:25:31.747 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mds.d.log: 93.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-22T07:25:31.747 INFO:teuthology.orchestra.run.smithi062.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-22T07:25:31.747 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33271.log 2024-04-22T07:25:31.747 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33438.log 2024-04-22T07:25:31.747 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33271.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33271.log.gz 2024-04-22T07:25:31.757 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33438.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33438.log.gz 2024-04-22T07:25:31.792 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43468.log: gzip 87.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.40662.log.gz --verbose 2024-04-22T07:25:31.792 INFO:teuthology.orchestra.run.smithi040.stderr: -- /var/log/ceph/ceph-osd.3.log 2024-04-22T07:25:31.792 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43468.log.gz 2024-04-22T07:25:31.792 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46646.log 2024-04-22T07:25:31.792 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46874.log.gz 2024-04-22T07:25:31.792 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43300.log 2024-04-22T07:25:31.792 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41221.log 2024-04-22T07:25:31.792 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43300.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46646.log.gz 2024-04-22T07:25:31.792 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41220.log 2024-04-22T07:25:31.792 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41221.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43300.log.gz 2024-04-22T07:25:31.792 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40277.log 2024-04-22T07:25:31.792 INFO:teuthology.orchestra.run.smithi040.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41221.log.gz 2024-04-22T07:25:31.793 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46436.log 2024-04-22T07:25:31.793 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41220.log.gz 2024-04-22T07:25:31.793 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.40277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43258.log 2024-04-22T07:25:31.793 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40277.log.gz 2024-04-22T07:25:31.793 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46436.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-22T07:25:31.793 INFO:teuthology.orchestra.run.smithi040.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46436.log.gz 2024-04-22T07:25:31.793 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39941.log 2024-04-22T07:25:31.793 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43258.log: /var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39497.log 2024-04-22T07:25:31.793 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43258.log.gz 2024-04-22T07:25:31.793 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.39941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46058.log 2024-04-22T07:25:31.793 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39941.log.gz 2024-04-22T07:25:31.793 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.39497.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-22T07:25:31.793 INFO:teuthology.orchestra.run.smithi040.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-22T07:25:31.793 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39497.log.gz 2024-04-22T07:25:31.793 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40361.log 2024-04-22T07:25:31.794 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46058.log: /var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-22T07:25:31.794 INFO:teuthology.orchestra.run.smithi040.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46058.log.gz 2024-04-22T07:25:31.794 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.40361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46352.log 2024-04-22T07:25:31.794 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40361.log.gz 2024-04-22T07:25:31.794 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27435.log 2024-04-22T07:25:31.794 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40665.log 2024-04-22T07:25:31.794 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46352.log: /var/log/ceph/ceph.tmp-client.admin.27435.log: gzip 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27435.log.gz 2024-04-22T07:25:31.794 INFO:teuthology.orchestra.run.smithi040.stderr: -5 --verbose -- 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46352.log.gz 2024-04-22T07:25:31.794 INFO:teuthology.orchestra.run.smithi040.stderr: /var/log/ceph/ceph-osd.0.log 2024-04-22T07:25:31.794 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.40665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39797.log 2024-04-22T07:25:31.794 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40665.log.gz 2024-04-22T07:25:31.794 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46914.log 2024-04-22T07:25:31.794 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.39797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41621.log 2024-04-22T07:25:31.794 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39797.log.gz 2024-04-22T07:25:31.794 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39455.log 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46914.log.gz 2024-04-22T07:25:31.795 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-04-22T07:25:31.795 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39625.log 2024-04-22T07:25:31.795 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41621.log.gz 2024-04-22T07:25:31.795 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.39455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39753.log 2024-04-22T07:25:31.795 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39455.log.gz 2024-04-22T07:25:31.795 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.39625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43384.log 2024-04-22T07:25:31.795 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39625.log.gz 2024-04-22T07:25:31.795 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41957.log 2024-04-22T07:25:31.795 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.39753.log: /var/log/ceph/ceph-client.admin.43384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40235.log 2024-04-22T07:25:31.795 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41957.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39753.log.gz 2024-04-22T07:25:31.795 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43384.log.gz 2024-04-22T07:25:31.795 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43864.log 2024-04-22T07:25:31.795 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41957.log.gz 2024-04-22T07:25:31.795 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46832.log 2024-04-22T07:25:31.795 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.40235.log: /var/log/ceph/ceph-client.admin.43864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43216.log 2024-04-22T07:25:31.796 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46832.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40235.log.gz 2024-04-22T07:25:31.796 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41579.log 2024-04-22T07:25:31.796 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46832.log.gz 91.0% -- replaced with /var/log/ceph/ceph-client.admin.43864.log.gz 2024-04-22T07:25:31.796 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-04-22T07:25:31.796 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33818.log 2024-04-22T07:25:31.796 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41579.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-22T07:25:31.796 INFO:teuthology.orchestra.run.smithi040.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43216.log.gz 2024-04-22T07:25:31.796 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2%/var/log/ceph/ceph-client.admin.33818.log: -- replaced with /var/log/ceph/ceph-client.admin.41579.log.gz 2024-04-22T07:25:31.796 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43090.log 2024-04-22T07:25:31.796 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33818.log.gz 2024-04-22T07:25:31.796 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41789.log 2024-04-22T07:25:31.796 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mon.a.log: gzip/var/log/ceph/ceph-client.admin.43090.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43426.log 2024-04-22T07:25:31.796 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41789.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43090.log.gz 2024-04-22T07:25:31.796 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41789.log.gz 2024-04-22T07:25:31.797 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41340.log 2024-04-22T07:25:31.797 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43426.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43426.log.gz 2024-04-22T07:25:31.797 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42618.log 2024-04-22T07:25:31.797 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43048.log 2024-04-22T07:25:31.797 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.0.42618.log: 88.6% 0.0% -- replaced with /var/log/ceph/ceph-client.0.42618.log.gz 2024-04-22T07:25:31.797 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41340.log.gz 2024-04-22T07:25:31.797 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40445.log 2024-04-22T07:25:31.797 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45974.log 2024-04-22T07:25:31.797 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43048.log.gz 2024-04-22T07:25:31.797 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.40445.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45932.log 2024-04-22T07:25:31.797 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40445.log.gz 2024-04-22T07:25:31.797 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45974.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45974.log.gz 2024-04-22T07:25:31.797 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42838.log 2024-04-22T07:25:31.797 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41873.log 2024-04-22T07:25:31.798 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42838.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45932.log.gz 2024-04-22T07:25:31.798 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42838.log.gz 2024-04-22T07:25:31.798 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41339.log 2024-04-22T07:25:31.798 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41873.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41873.log.gz 2024-04-22T07:25:31.798 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39899.log 2024-04-22T07:25:31.798 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40025.log 2024-04-22T07:25:31.798 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.39899.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41339.log.gz 2024-04-22T07:25:31.798 INFO:teuthology.orchestra.run.smithi040.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.39899.log.gz 2024-04-22T07:25:31.798 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43132.log 2024-04-22T07:25:31.798 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.40025.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40025.log.gz 2024-04-22T07:25:31.798 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42964.log 2024-04-22T07:25:31.798 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46142.log 2024-04-22T07:25:31.798 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42964.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43132.log.gz 2024-04-22T07:25:31.798 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42964.log.gz 2024-04-22T07:25:31.798 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46226.log 2024-04-22T07:25:31.799 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45484.log 2024-04-22T07:25:31.799 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46226.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46142.log.gz 2024-04-22T07:25:31.799 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46226.log.gz 2024-04-22T07:25:31.799 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39583.log 2024-04-22T07:25:31.799 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45484.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45484.log.gz 2024-04-22T07:25:31.799 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46268.log 2024-04-22T07:25:31.799 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.39583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45625.log 2024-04-22T07:25:31.799 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46268.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39583.log.gz 2024-04-22T07:25:31.799 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46268.log.gz 2024-04-22T07:25:31.799 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47016.log 2024-04-22T07:25:31.799 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45625.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45625.log.gz 2024-04-22T07:25:31.799 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39240.log 2024-04-22T07:25:31.799 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47016.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47016.log.gz 2024-04-22T07:25:31.799 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33715.log 2024-04-22T07:25:31.800 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.39240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41001.log 2024-04-22T07:25:31.800 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.33715.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39240.log.gz 2024-04-22T07:25:31.800 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33715.log.gz 2024-04-22T07:25:31.800 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45793.log 2024-04-22T07:25:31.800 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44437.log 2024-04-22T07:25:31.800 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45793.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41001.log.gz 2024-04-22T07:25:31.800 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45793.log.gz 2024-04-22T07:25:31.800 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-04-22T07:25:31.800 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40667.log 2024-04-22T07:25:31.800 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mds.e.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44437.log.gz 2024-04-22T07:25:31.800 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45527.log 2024-04-22T07:25:31.800 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.40667.log: 87.6% 93.2% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-04-22T07:25:31.800 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40667.log.gz 2024-04-22T07:25:31.800 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44239.log 2024-04-22T07:25:31.801 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45709.log 2024-04-22T07:25:31.801 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44239.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.45527.log.gz 2024-04-22T07:25:31.801 INFO:teuthology.orchestra.run.smithi040.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.44239.log.gz 2024-04-22T07:25:31.801 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40151.log 2024-04-22T07:25:31.801 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43993.log 2024-04-22T07:25:31.801 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.40151.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45709.log.gz 2024-04-22T07:25:31.801 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44196.log 2024-04-22T07:25:31.801 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40151.log.gz 2024-04-22T07:25:31.801 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47100.log 2024-04-22T07:25:31.801 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44196.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43993.log.gz 2024-04-22T07:25:31.801 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40403.log 2024-04-22T07:25:31.801 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44196.log.gz 2024-04-22T07:25:31.801 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41747.log 2024-04-22T07:25:31.801 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47100.log.gz/var/log/ceph/ceph-client.admin.40403.log: 2024-04-22T07:25:31.802 INFO:teuthology.orchestra.run.smithi040.stderr:gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40403.log.gz 2024-04-22T07:25:31.802 INFO:teuthology.orchestra.run.smithi040.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46730.log 2024-04-22T07:25:31.802 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42796.log 2024-04-22T07:25:31.802 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41747.log.gz 2024-04-22T07:25:31.802 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44352.log 2024-04-22T07:25:31.802 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42796.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46730.log.gz 2024-04-22T07:25:31.802 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42796.log.gz 2024-04-22T07:25:31.802 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46604.log 2024-04-22T07:25:31.802 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45751.log 2024-04-22T07:25:31.802 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46604.log: /var/log/ceph/ceph-client.admin.44352.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46604.log.gz 2024-04-22T07:25:31.802 INFO:teuthology.orchestra.run.smithi040.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.44352.log.gz 2024-04-22T07:25:31.802 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39667.log 2024-04-22T07:25:31.802 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42041.log 2024-04-22T07:25:31.802 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45751.log.gz 2024-04-22T07:25:31.803 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.39667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46956.log 2024-04-22T07:25:31.803 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42041.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39667.log.gz 2024-04-22T07:25:31.803 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42041.log.gz 2024-04-22T07:25:31.803 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44480.log 2024-04-22T07:25:31.803 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42754.log 2024-04-22T07:25:31.803 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46956.log: /var/log/ceph/ceph-client.admin.44480.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46956.log.gz 2024-04-22T07:25:31.803 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47142.log 2024-04-22T07:25:31.803 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.42754.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44480.log.gz 2024-04-22T07:25:31.803 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42754.log.gz 2024-04-22T07:25:31.803 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43821.log 2024-04-22T07:25:31.803 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40487.log 2024-04-22T07:25:31.803 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47142.log.gz 2024-04-22T07:25:31.803 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41005.log 2024-04-22T07:25:31.803 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.40487.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43821.log.gz 2024-04-22T07:25:31.804 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47058.log 2024-04-22T07:25:31.804 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40487.log.gz 2024-04-22T07:25:31.804 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39148.log 2024-04-22T07:25:31.804 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47058.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41005.log.gz 2024-04-22T07:25:31.804 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47058.log.gz 2024-04-22T07:25:31.804 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41338.log 2024-04-22T07:25:31.804 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42125.log 2024-04-22T07:25:31.804 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.39148.log: /var/log/ceph/ceph-client.admin.41338.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39148.log.gz 2024-04-22T07:25:31.804 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41338.log.gz 2024-04-22T07:25:31.804 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-22T07:25:31.804 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41002.log 2024-04-22T07:25:31.804 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.42125.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42125.log.gz 2024-04-22T07:25:31.804 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40999.log 2024-04-22T07:25:31.804 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41002.log: 93.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41002.log.gz 2024-04-22T07:25:31.804 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-04-22T07:25:31.805 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42269.log 2024-04-22T07:25:31.805 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41334.log 2024-04-22T07:25:31.805 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.40999.log: /var/log/ceph/ceph-client.admin.42269.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40999.log.gz 2024-04-22T07:25:31.805 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43693.log 2024-04-22T07:25:31.805 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42269.log.gz 2024-04-22T07:25:31.805 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39983.log 2024-04-22T07:25:31.805 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43693.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41334.log.gz 2024-04-22T07:25:31.805 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43693.log.gz 2024-04-22T07:25:31.805 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41537.log 2024-04-22T07:25:31.805 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41004.log 2024-04-22T07:25:31.805 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.39983.log: /var/log/ceph/ceph-client.admin.41537.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39983.log.gz 2024-04-22T07:25:31.805 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40657.log 2024-04-22T07:25:31.805 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41537.log.gz 2024-04-22T07:25:31.805 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.41004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46394.log 2024-04-22T07:25:31.805 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.40657.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41004.log.gz 2024-04-22T07:25:31.806 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40657.log.gz 2024-04-22T07:25:31.806 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40193.log 2024-04-22T07:25:31.806 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40668.log 2024-04-22T07:25:31.806 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.40193.log: /var/log/ceph/ceph-client.admin.46394.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46394.log.gz 2024-04-22T07:25:31.806 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40193.log.gz 2024-04-22T07:25:31.806 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33454.log 2024-04-22T07:25:31.806 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47226.log 2024-04-22T07:25:31.806 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.40668.log: /var/log/ceph/ceph-client.admin.33454.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40668.log.gz 2024-04-22T07:25:31.806 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33454.log.gz 2024-04-22T07:25:31.806 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47226.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47226.log.gz 2024-04-22T07:25:31.806 INFO:teuthology.orchestra.run.smithi040.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-22T07:25:31.847 INFO:teuthology.orchestra.run.smithi062.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-22T07:25:31.853 INFO:teuthology.orchestra.run.smithi062.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-22T07:25:32.059 INFO:teuthology.orchestra.run.smithi040.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-22T07:25:32.169 INFO:teuthology.orchestra.run.smithi040.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-22T07:25:32.209 INFO:teuthology.orchestra.run.smithi062.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-22T07:25:32.219 INFO:teuthology.orchestra.run.smithi062.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-22T07:25:32.303 INFO:teuthology.orchestra.run.smithi062.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-22T07:25:32.421 INFO:teuthology.orchestra.run.smithi040.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-22T07:25:32.435 INFO:teuthology.orchestra.run.smithi040.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-22T07:25:32.466 INFO:teuthology.orchestra.run.smithi062.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-22T07:25:32.696 INFO:teuthology.orchestra.run.smithi062.stderr: 95.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-22T07:25:32.697 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-04-22T07:25:32.698 INFO:teuthology.orchestra.run.smithi062.stderr:real 0m0.980s 2024-04-22T07:25:32.698 INFO:teuthology.orchestra.run.smithi062.stderr:user 0m3.384s 2024-04-22T07:25:32.698 INFO:teuthology.orchestra.run.smithi062.stderr:sys 0m0.131s 2024-04-22T07:25:32.721 INFO:teuthology.orchestra.run.smithi040.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-22T07:25:32.723 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-04-22T07:25:32.723 INFO:teuthology.orchestra.run.smithi040.stderr:real 0m1.027s 2024-04-22T07:25:32.723 INFO:teuthology.orchestra.run.smithi040.stderr:user 0m3.182s 2024-04-22T07:25:32.724 INFO:teuthology.orchestra.run.smithi040.stderr:sys 0m0.240s 2024-04-22T07:25:32.724 INFO:tasks.ceph:Archiving logs... 2024-04-22T07:25:32.724 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668168/remote/smithi040/log 2024-04-22T07:25:32.725 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-22T07:25:33.312 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668168/remote/smithi062/log 2024-04-22T07:25:33.313 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-22T07:25:33.771 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-22T07:25:33.780 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-22T07:25:33.780 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-22T07:25:33.783 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-22T07:25:33.887 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-22T07:25:33.899 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-22T07:25:33.899 DEBUG:teuthology.orchestra.run.smithi040:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-22T07:25:33.902 DEBUG:teuthology.orchestra.run.smithi062:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-22T07:25:33.916 INFO:teuthology.orchestra.run.smithi040.stderr:bash: line 1: ntpq: command not found 2024-04-22T07:25:33.917 INFO:teuthology.orchestra.run.smithi062.stderr:bash: line 1: ntpq: command not found 2024-04-22T07:25:33.920 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-22T07:25:33.920 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2024-04-22T07:25:33.921 INFO:teuthology.orchestra.run.smithi040.stdout:^- hv01.front.sepia.ceph.com 2 6 377 35 +1224us[+1224us] +/- 604ms 2024-04-22T07:25:33.921 INFO:teuthology.orchestra.run.smithi040.stdout:^* hv02.front.sepia.ceph.com 3 6 377 37 +27us[ +33us] +/- 60ms 2024-04-22T07:25:33.921 INFO:teuthology.orchestra.run.smithi040.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 -32us[ -32us] +/- 63ms 2024-04-22T07:25:33.921 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T07:25:33.922 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-22T07:25:33.922 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-04-22T07:25:33.922 INFO:teuthology.orchestra.run.smithi062.stdout:^- hv01.front.sepia.ceph.com 2 6 377 36 +1251us[+1251us] +/- 604ms 2024-04-22T07:25:33.922 INFO:teuthology.orchestra.run.smithi062.stdout:^* hv02.front.sepia.ceph.com 3 6 377 36 +33us[ +53us] +/- 60ms 2024-04-22T07:25:33.922 INFO:teuthology.orchestra.run.smithi062.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 -323ns[ +20us] +/- 63ms 2024-04-22T07:25:33.923 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-22T07:25:33.923 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-22T07:25:34.079 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-22T07:25:34.080 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-22T07:25:34.089 DEBUG:teuthology.orchestra.run.smithi040:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-22T07:25:34.160 DEBUG:teuthology.orchestra.run.smithi062:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-22T07:25:34.226 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-22T07:25:34.256 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T07:25:34.256 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-22T07:25:34.285 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T07:25:34.286 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-22T07:25:34.295 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-22T07:25:34.303 INFO:teuthology.task.internal:Duration was 728.515833 seconds 2024-04-22T07:25:34.305 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-22T07:25:34.314 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-22T07:25:34.314 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-22T07:25:34.317 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-22T07:25:34.356 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-22T07:25:34.366 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-22T07:25:34.686 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-22T07:25:34.686 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi040.front.sepia.ceph.com 2024-04-22T07:25:34.687 DEBUG:teuthology.orchestra.run.smithi040:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-22T07:25:34.709 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi062.front.sepia.ceph.com 2024-04-22T07:25:34.709 DEBUG:teuthology.orchestra.run.smithi062:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-22T07:25:34.748 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-22T07:25:34.748 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-22T07:25:34.752 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-22T07:25:34.816 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-22T07:25:34.816 DEBUG:teuthology.orchestra.run.smithi040:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-22T07:25:34.820 DEBUG:teuthology.orchestra.run.smithi062:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-22T07:25:34.954 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-22T07:25:34.964 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-22T07:25:34.964 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-22T07:25:34.989 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-22T07:25:35.013 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-22T07:25:35.022 DEBUG:teuthology.orchestra.run.smithi040:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-22T07:25:35.032 DEBUG:teuthology.orchestra.run.smithi062:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-22T07:25:35.053 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = core 2024-04-22T07:25:35.076 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = core 2024-04-22T07:25:35.098 DEBUG:teuthology.orchestra.run.smithi040:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-22T07:25:35.121 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T07:25:35.121 DEBUG:teuthology.orchestra.run.smithi062:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-22T07:25:35.153 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-22T07:25:35.153 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-22T07:25:35.164 INFO:teuthology.task.internal:Transferring archived files... 2024-04-22T07:25:35.164 DEBUG:teuthology.misc:Transferring archived files from smithi040:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668168/remote/smithi040 2024-04-22T07:25:35.165 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-22T07:25:35.198 DEBUG:teuthology.misc:Transferring archived files from smithi062:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-22_05:52:53-fs-wip-lusov-quiescer-distro-default-smithi/7668168/remote/smithi062 2024-04-22T07:25:35.198 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-22T07:25:35.231 INFO:teuthology.task.internal:Removing archive directory... 2024-04-22T07:25:35.232 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-22T07:25:35.235 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-22T07:25:35.280 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-22T07:25:35.293 INFO:teuthology.task.internal:Not uploading archives. 2024-04-22T07:25:35.293 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-22T07:25:35.303 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-22T07:25:35.303 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-22T07:25:35.306 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-22T07:25:35.318 INFO:teuthology.orchestra.run.smithi040.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 22 07:25 /home/ubuntu/cephtest 2024-04-22T07:25:35.336 INFO:teuthology.orchestra.run.smithi062.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 22 07:25 /home/ubuntu/cephtest 2024-04-22T07:25:35.336 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-22T07:25:35.348 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-22T07:25:35.372 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/suites/iozone}} duration: 728.515832901001 flavor: default owner: scheduled_leonidus@teuthology success: true 2024-04-22T07:25:35.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-22T07:25:35.460 INFO:teuthology.run:pass